00010000:00010000:0.0:1746066774.846138:0:31365:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f60f400/0xfb36a14ee6088537 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4276223) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c94d expref: 30 pid: 20532 timeout: 836 lvb_type: 0 00002000:00010000:0.0:1746066774.846151:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009284b800 00000100:00100000:0.0:1746066774.847956:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.854419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.862442:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.862487:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.866732:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.869886:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.870016:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.870428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.870440:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976434176 00000100:00100000:0.0:1746066774.870443:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976434176 00000100:00100000:0.0:1746066774.870466:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976434304 00000100:00100000:0.0:1746066774.870468:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976434304 00000100:00100000:0.0:1746066774.870492:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13358 00000100:00100000:0.0:1746066774.870497:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882976434176:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066774.870505:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066774.870516:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed6ec00/0xfb36a14ee6088599 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97c993 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066774.870535:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed6ec00/0xfb36a14ee6088599 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c993 expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066774.870543:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed6ec00/0xfb36a14ee6088599 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c993 expref: 18 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066774.870554:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed6ec00, rc 0) 00000100:00100000:0.0:1746066774.870586:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882976434176:12345-192.168.202.57@tcp:101:cat.0 Request processed in 89us (570us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066774.870590:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13358 00000100:00100000:0.0:1746066774.870602:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13359 00000100:00100000:0.0:1746066774.870606:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882976434304:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066774.870612:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066774.870620:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed6ea00/0xfb36a14ee60885a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97c99a expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066774.870632:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed6ea00/0xfb36a14ee60885a0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c99a expref: 16 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066774.870639:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed6ea00/0xfb36a14ee60885a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c99a expref: 16 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066774.870645:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed6ea00, rc 0) 00000100:00100000:0.0:1746066774.870658:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882976434304:12345-192.168.202.57@tcp:101:cat.0 Request processed in 52us (231us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066774.870662:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13359 00000100:00100000:0.0:1746066774.880739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.887659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.898417:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.900550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.905094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.917723:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976435840 00000100:00100000:0.0:1746066774.917732:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976435840 00002000:00100000:0.0:1746066774.917782:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a8691880 x1830882976435840/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:180/0 lens 488/0 e 0 to 0 dl 1746066785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066774.917799:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8691880 with x1830882976435840 ext(2097152->3145727) 00002000:00010000:0.0:1746066774.917804:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8691880 00000100:00100000:0.0:1746066774.917830:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976436352 00000100:00100000:0.0:1746066774.917834:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976436352 00002000:00100000:0.0:1746066774.917847:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135df8e00 x1830882976436352/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:180/0 lens 488/0 e 0 to 0 dl 1746066785 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066774.917853:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df8e00 with x1830882976436352 ext(3145728->4194303) 00002000:00010000:0.0:1746066774.917856:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135df8e00 00000100:00100000:0.0:1746066774.917868:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 5958 00000100:00100000:0.0:1746066774.917874:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882976435840:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066774.925587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.927248:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882976435840:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9373us (9626us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066774.927256:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 5958 00002000:00100000:0.0:1746066774.927263:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a8691880 x1830882976435840/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:180/0 lens 488/440 e 0 to 0 dl 1746066785 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066774.927272:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8691880 with x1830882976435840 ext(2097152->3145727) 00002000:00010000:0.0:1746066774.927275:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8691880 00000100:00100000:0.0:1746066774.939218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.940281:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.942599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.946481:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.946525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.955493:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.967000:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.971106:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.980322:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066774.988954:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.008606:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066775.009570:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066775.015893:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.015931:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.015969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066775.015995:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746066775.016793:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066775.033498:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.039837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.046464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.082666:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.086405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.097071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.114345:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.126196:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.127311:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066775.127428:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066775.134928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.134944:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.134968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.134992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.140754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.146414:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.149533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.156358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.156398:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066775.157359:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066775.160572:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.160601:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.160634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.165470:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.165510:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.167832:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976443136 00000100:00100000:0.0:1746066775.167836:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976443136 00010000:00010000:0.0:1746066775.167863:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099a09600/0xfb36a14ee6088481 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c8dd expref: 22 pid: 8450 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746066775.167878:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6771 00000100:00100000:0.0:1746066775.167882:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882976443136:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066775.167889:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066775.167904:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099a09600/0xfb36a14ee6088481 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c8dd expref: 22 pid: 8450 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746066775.167913:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099a09600/0xfb36a14ee6088481 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c8dd expref: 22 pid: 8450 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746066775.167927:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099a09600/0xfb36a14ee6088481 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c8dd expref: 22 pid: 8450 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746066775.167937:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066775.167938:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066775.167943:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee6088679 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->1851391) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ca03 expref: 16 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066775.168134:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee6088679 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->1851391) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ca03 expref: 16 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066775.168154:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee6088679 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ca03 expref: 16 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066775.168161:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976651648:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066775.168204:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066775.176449:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.198414:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.204205:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.206931:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.215878:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976444800 00000100:00100000:0.0:1746066775.215890:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976444800 00000100:00080000:0.0:1746066775.216768:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746066775.216771:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066775.221465:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976651904:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066775.221481:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed2d800/0xfb36a14ee60886c6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ca2d expref: 11 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066775.221489:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed2d800/0xfb36a14ee60886c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ca2d expref: 11 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066775.221500:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed2d800, rc 0) 00000100:00100000:0.0:1746066775.221517:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882976444800:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 5450us (6937us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066775.221531:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13375 00000100:00100000:0.0:1746066775.225191:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.228376:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.233463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.240750:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.241552:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976446080 00000100:00100000:0.0:1746066775.241555:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976446080 00000100:00100000:0.0:1746066775.241573:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976446208 00000100:00100000:0.0:1746066775.241575:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976446208 00000100:00100000:0.0:1746066775.241584:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976446336 00000100:00100000:0.0:1746066775.241586:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976446336 00000100:00100000:0.0:1746066775.241600:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976446464 00000100:00100000:0.0:1746066775.241602:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976446464 00000100:00100000:0.0:1746066775.241609:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976446592 00000100:00100000:0.0:1746066775.241611:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976446592 00000100:00100000:0.0:1746066775.241620:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13380 00000100:00100000:0.0:1746066775.241625:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1966:x1830882976446080:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066775.241643:0:9776:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f99e00/0xfb36a14ee6088705 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066775.241652:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed06600/0xfb36a14ee608832a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c820 expref: 20 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066775.241658:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee60883d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c87b expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066775.241664:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d8b800/0xfb36a14ee6088385 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c843 expref: 16 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066775.241703:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066775.241704:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066775.241707:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f99e00/0xfb36a14ee6088705 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066775.241722:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d8b800/0xfb36a14ee6088385 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c843 expref: 16 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066775.241730:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d8b800/0xfb36a14ee6088385 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c843 expref: 16 pid: 21973 timeout: 836 lvb_type: 1 00000100:00100000:0.0:1746066775.241738:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976652416:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066775.241793:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee60883d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c87b expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066775.241801:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee60883d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c87b expref: 12 pid: 8451 timeout: 836 lvb_type: 1 00000100:00100000:0.0:1746066775.241808:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976652544:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066775.241831:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed06600/0xfb36a14ee608832a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c820 expref: 20 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066775.241838:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed06600/0xfb36a14ee608832a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c820 expref: 20 pid: 21973 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746066775.241856:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976652672:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066775.241872:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066775.241886:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13381 00000100:00100000:0.0:1746066775.241892:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1966:x1830882976446208:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066775.241906:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092490800/0xfb36a14ee608870c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066775.241915:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee6088679 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ca03 expref: 16 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066775.241920:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066775.241921:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066775.241923:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092490800/0xfb36a14ee608870c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066775.241936:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee6088679 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->1851391) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ca03 expref: 16 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066775.241943:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee6088679 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->1851391) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ca03 expref: 16 pid: 20532 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746066775.241950:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976652800:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066775.241966:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066775.250473:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.250502:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.250536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.250562:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.255158:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.255185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.255205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.255215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.255231:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976447232 00000100:00100000:0.0:1746066775.255236:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976447232 00010000:00010000:0.0:1746066775.255258:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d8b800/0xfb36a14ee6088385 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c843 expref: 19 pid: 21973 timeout: 836 lvb_type: 1 00000100:00100000:0.0:1746066775.255276:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976447744 00000100:00100000:0.0:1746066775.255278:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976447744 00010000:00010000:0.0:1746066775.255287:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e71c00/0xfb36a14ee608857d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c977 expref: 20 pid: 21203 timeout: 836 lvb_type: 0 00000100:00100000:0.0:1746066775.255298:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976447488 00000100:00100000:0.0:1746066775.255299:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976447488 00010000:00010000:0.0:1746066775.255307:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608831c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c812 expref: 29 pid: 21203 timeout: 836 lvb_type: 1 00000100:00100000:0.0:1746066775.255314:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976447872 00000100:00100000:0.0:1746066775.255316:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976447872 00010000:00010000:0.0:1746066775.255322:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135f30400/0xfb36a14ee60886bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ca3b expref: 13 pid: 8112 timeout: 836 lvb_type: 1 00000100:00100000:0.0:1746066775.255331:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6776 00000100:00100000:0.0:1746066775.255336:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882976447232:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066775.255345:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066775.255368:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d8b800/0xfb36a14ee6088385 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c843 expref: 19 pid: 21973 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746066775.255377:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d8b800/0xfb36a14ee6088385 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c843 expref: 19 pid: 21973 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746066775.255394:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d8b800/0xfb36a14ee6088385 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c843 expref: 19 pid: 21973 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746066775.255408:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066775.255410:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066775.255414:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f99e00/0xfb36a14ee6088705 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066775.255421:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f99e00/0xfb36a14ee6088705 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066775.255437:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066775.255458:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882976447232:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 121us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066775.255464:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6776 00000100:00100000:0.0:1746066775.255477:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6777 00000100:00100000:0.0:1746066775.255481:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882976447744:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066775.255487:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066775.255496:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e71c00/0xfb36a14ee608857d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c977 expref: 20 pid: 21203 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746066775.255504:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e71c00/0xfb36a14ee608857d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c977 expref: 20 pid: 21203 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746066775.255519:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e71c00/0xfb36a14ee608857d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c977 expref: 20 pid: 21203 timeout: 836 lvb_type: 0 00010000:00010000:0.0:1746066775.255528:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066775.255539:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882976447744:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 58us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066775.255544:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6777 00000100:00100000:0.0:1746066775.255553:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6778 00000100:00100000:0.0:1746066775.255557:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882976447488:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066775.255561:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066775.255568:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608831c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c812 expref: 29 pid: 21203 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746066775.255576:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608831c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c812 expref: 29 pid: 21203 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746066775.255585:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608831c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c812 expref: 29 pid: 21203 timeout: 836 lvb_type: 1 00010000:00010000:0.0:1746066775.260033:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066775.261421:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882976447488:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5861us (6212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066775.261428:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6778 00000100:00100000:0.0:1746066775.275587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.276207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.279331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.286817:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976449280 00000100:00100000:0.0:1746066775.286823:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976449280 00010000:00010000:0.0:1746066775.286850:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f30e00/0xfb36a14ee608842d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97c8b3 expref: 271 pid: 16018 timeout: 836 lvb_type: 0 00000004:00080000:0.0:1746066775.330209:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135dfa300/2, rc 0, transno 17179873345 00000100:00100000:0.0:1746066775.330213:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976654848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066775.330218:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976655360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066775.330236:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066775.330331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000004:00080000:0.0:1746066775.330350:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135dfb480/2, rc 0, transno 17179873349 00000100:00100000:0.0:1746066775.330353:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976655360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066775.331079:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976655744 00000100:00100000:0.0:1746066775.331082:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976655744 00000100:00100000:0.0:1746066775.331095:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976656256 00000100:00100000:0.0:1746066775.331097:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976656256 00000100:00100000:0.0:1746066775.331102:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976656768 00000100:00100000:0.0:1746066775.331103:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976656768 00000100:00100000:0.0:1746066775.331110:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13395 00000100:00100000:0.0:1746066775.331114:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3294:x1830882976655744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066775.331200:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3294:x1830882976655744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (209us total) trans 17179873350 rc 0/0 00000100:00100000:0.0:1746066775.331205:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13395 00000100:00100000:0.0:1746066775.331214:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13396 00000100:00100000:0.0:1746066775.331219:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3294:x1830882976656256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066775.331287:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3294:x1830882976656256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (262us total) trans 21474840683 rc 0/0 00000100:00100000:0.0:1746066775.331296:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13396 00000100:00100000:0.0:1746066775.331306:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13397 00000100:00100000:0.0:1746066775.331309:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3294:x1830882976656768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066775.331376:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3294:x1830882976656768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (326us total) trans 21474840684 rc 0/0 00000100:00100000:0.0:1746066775.331380:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13397 00000100:00100000:0.0:1746066775.331812:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976656896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066775.331833:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066775.332039:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3293:x1830882976656128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 282us (479us total) trans 21474840687 rc 0/0 00000100:00100000:0.0:1746066775.332133:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13399 00000004:00080000:0.0:1746066775.332609:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801361f9c00/2, rc 0, transno 17179873352 00000100:00100000:0.0:1746066775.332611:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976656896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066775.334574:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.337778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.337877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.338146:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.338215:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.338452:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.339838:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066775.340406:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13407 00000100:00100000:0.0:1746066775.340413:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976450688:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066775.340419:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066775.340426:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee6088767 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ca88 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066775.340443:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38f:0x0] initial LVB size: 4194304, mtime: 0x6812dd56, atime: 0x6812dd54, ctime: 0x6812dd56, blocks: 0x102b 00010000:00010000:0.0:1746066775.340450:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066775.340452:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066775.340455:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee6088767 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ca88 expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066775.340463:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee6088767 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ca88 expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066775.340469:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d36a800, rc 0) 00000100:00100000:0.0:1746066775.340720:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976450688:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 308us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066775.340725:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13407 00000100:00100000:0.0:1746066776.359393:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.367537:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.375431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.375509:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.375536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.375569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.375590:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976451840 00000100:00100000:0.0:1746066776.375597:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976451840 00000100:00100000:0.0:1746066776.375648:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976451200 00000100:00100000:0.0:1746066776.375651:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976451200 00000100:00100000:0.0:1746066776.375665:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976451712 00000100:00100000:0.0:1746066776.375667:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976451712 00000100:00100000:0.0:1746066776.375692:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 5973 00000100:00100000:0.0:1746066776.375699:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882976451840:12345-192.168.202.57@tcp:3:mirror_io.0 00010000:00010000:0.0:1746066776.375730:0:25585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135f30200/0xfb36a14ee608877c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.375741:0:25585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066776.375743:0:25585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066776.375757:0:25585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f30200/0xfb36a14ee608877c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.375769:0:25585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135f30200/0xfb36a14ee608877c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066776.375854:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 5975 00000100:00100000:0.0:1746066776.375859:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882976451712:12345-192.168.202.57@tcp:3:mirror_io.0 00010000:00010000:0.0:1746066776.375871:0:8455:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e41400/0xfb36a14ee608878a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.375876:0:8455:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066776.375878:0:8455:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066776.375880:0:8455:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e41400/0xfb36a14ee608878a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.375886:0:8455:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e41400/0xfb36a14ee608878a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066776.381657:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.381715:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.381741:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976452736 00000100:00100000:0.0:1746066776.381755:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976452736 00000100:00100000:0.0:1746066776.386187:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 5978 00000100:00100000:0.0:1746066776.386193:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:1963:x1830882976452736:12345-192.168.202.57@tcp:3:mirror_io.0 00010000:00010000:0.0:1746066776.386218:0:31365:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94200/0xfb36a14ee608879f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.386230:0:31365:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066776.386231:0:31365:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066776.386235:0:31365:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94200/0xfb36a14ee608879f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.386245:0:31365:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94200/0xfb36a14ee608879f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.410430:0:11692:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f99e00/0xfb36a14ee6088775 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.410440:0:11692:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f99e00/0xfb36a14ee6088775 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.410447:0:11692:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f99e00/0xfb36a14ee6088775 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.410452:0:11692:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f99e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066776.410455:0:11692:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f99e00/0xfb36a14ee6088775 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.410460:0:11692:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f99e00/0xfb36a14ee6088775 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.410483:0:11692:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f99e00/0xfb36a14ee6088775 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.410488:0:11692:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f99e00/0xfb36a14ee6088775 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066776.410555:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:1964:x1830882976451328:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 42443us (43022us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066776.410564:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 5972 00010000:00010000:0.0:1746066776.428356:0:25585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135f30200/0xfb36a14ee608877c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.428366:0:25585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135f30200/0xfb36a14ee608877c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.428372:0:25585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135f30200/0xfb36a14ee608877c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.428377:0:25585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f30200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066776.428380:0:25585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135f30200/0xfb36a14ee608877c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.428386:0:25585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135f30200/0xfb36a14ee608877c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.428395:0:25585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135f30200/0xfb36a14ee608877c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.428412:0:25585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135f30200/0xfb36a14ee608877c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066776.428449:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882976451840:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 52750us (53025us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066776.428456:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 5973 00010000:00010000:0.0:1746066776.446202:0:31365:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94200/0xfb36a14ee608879f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.446218:0:31365:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94200/0xfb36a14ee608879f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.446225:0:31365:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94200/0xfb36a14ee608879f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.446231:0:31365:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4a94200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066776.446235:0:31365:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94200/0xfb36a14ee608879f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.446241:0:31365:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94200/0xfb36a14ee608879f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.446288:0:31365:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94200/0xfb36a14ee608879f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.446294:0:31365:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94200/0xfb36a14ee608879f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066776.447030:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882976452736:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 60832us (65375us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066776.447039:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 5978 00000100:00100000:0.0:1746066776.456668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.461497:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.466501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.484667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.484771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.491738:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.491784:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.491812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.491825:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.491837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.491848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.491859:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.491870:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.491881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.491890:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.491901:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.491911:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.491928:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.494184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.494201:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976455936 00000100:00100000:0.0:1746066776.494203:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976455936 00000100:00100000:0.0:1746066776.494223:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9710 00000100:00100000:0.0:1746066776.494227:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+8:31038:x1830882976455936:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066776.494242:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066776.494248:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36a400/0xfb36a14ee608884e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97caf8 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.494279:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36a600/0xfb36a14ee6088855 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066776.494285:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36a600/0xfb36a14ee6088855 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066776.494290:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36a600/0xfb36a14ee6088855 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746066776.501270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.507557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.507636:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066776.508102:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36a600/0xfb36a14ee6088855 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066776.508108:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36a600/0xfb36a14ee6088855 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746066776.508122:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066776.508228:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36a400/0xfb36a14ee608884e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97caf8 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.508256:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36a600/0xfb36a14ee6088855 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97caf8 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066776.508262:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066776.508264:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066776.508273:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d36a600, rc 0) 00000100:00100000:0.0:1746066776.508292:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:31038:x1830882976455936:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 14064us (14109us total) trans 8589943708 rc 0/0 00000100:00100000:0.0:1746066776.508297:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9710 00000100:00100000:0.0:1746066776.509972:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.509999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.511496:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.511977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.511997:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976456576 00000100:00100000:0.0:1746066776.512004:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976456576 00002000:00100000:0.0:1746066776.512040:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88008c397100 x1830882976456576/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:182/0 lens 488/0 e 0 to 0 dl 1746066787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066776.512049:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c397100 with x1830882976456576 ext(0->1048575) 00002000:00010000:0.0:1746066776.512053:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c397100 00000100:00100000:0.0:1746066776.512067:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976456832 00000100:00100000:0.0:1746066776.512070:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976456832 00002000:00100000:0.0:1746066776.512081:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88008c396680 x1830882976456832/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:182/0 lens 488/0 e 0 to 0 dl 1746066787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066776.512087:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396680 with x1830882976456832 ext(1048576->2097151) 00002000:00010000:0.0:1746066776.512090:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c396680 00000100:00100000:0.0:1746066776.512098:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976457088 00000100:00100000:0.0:1746066776.512100:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976457088 00002000:00100000:0.0:1746066776.512108:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800931d0380 x1830882976457088/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:182/0 lens 488/0 e 0 to 0 dl 1746066787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066776.512114:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0380 with x1830882976457088 ext(1048576->2097151) 00002000:00010000:0.0:1746066776.512116:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800931d0380 00000100:00100000:0.0:1746066776.512124:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 5979 00000100:00100000:0.0:1746066776.512139:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882976456576:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066776.515214:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 5982 00000100:00100000:0.0:1746066776.515224:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882976457344:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066776.558139:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882976456576:12345-192.168.202.57@tcp:3:cat.0 Request processed in 45992us (48161us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066776.558151:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 5979 00002000:00100000:0.0:1746066776.558161:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88008c397100 x1830882976456576/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:182/0 lens 488/440 e 0 to 0 dl 1746066787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066776.558170:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c397100 with x1830882976456576 ext(0->1048575) 00002000:00010000:0.0:1746066776.558175:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c397100 00000100:00100000:0.0:1746066776.558603:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882976457344:12345-192.168.202.57@tcp:3:cat.0 Request processed in 43381us (46625us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066776.558610:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 5982 00002000:00100000:0.0:1746066776.558615:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff8800931d0700 x1830882976457344/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:182/0 lens 488/440 e 0 to 0 dl 1746066787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066776.558622:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0700 with x1830882976457344 ext(1048576->2097151) 00002000:00010000:0.0:1746066776.558625:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d0700 00000100:00100000:0.0:1746066776.589859:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.616192:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976659200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066776.616212:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066776.616544:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976659712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066776.616559:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066776.617256:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e851c00/2, rc 0, transno 17179873353 00000100:00100000:0.0:1746066776.617269:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976659200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066776.617296:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746066776.617301:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976659840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066776.617317:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066776.618177:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800931d0e00/2, rc 0, transno 17179873355 00000100:00100000:0.0:1746066776.618180:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976659840:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066776.618186:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4ef480/2, rc 0, transno 17179873354 00000100:00100000:0.0:1746066776.618188:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976659712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066776.631769:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.656285:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976660480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066776.656308:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066776.657441:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976660992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066776.657460:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066776.657483:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976661504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066776.657504:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976660736 00000100:00100000:0.0:1746066776.657508:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976660736 00000100:00100000:0.0:1746066776.657527:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976660352 00000100:00100000:0.0:1746066776.657529:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976660352 00000100:00100000:0.0:1746066776.657631:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976660608 00000100:00100000:0.0:1746066776.657634:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976660608 00000100:00100000:0.0:1746066776.657645:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976660480 00000100:00100000:0.0:1746066776.657647:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976660480 00000100:00100000:0.0:1746066776.657655:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976660992 00000100:00100000:0.0:1746066776.657657:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976660992 00000100:00100000:0.0:1746066776.657662:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976660864 00000100:00100000:0.0:1746066776.657664:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976660864 00000100:00100000:0.0:1746066776.657670:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976661248 00000100:00100000:0.0:1746066776.657697:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976661248 00000100:00100000:0.0:1746066776.657708:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976661760 00000100:00100000:0.0:1746066776.657710:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976661760 00000100:00100000:0.0:1746066776.657719:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13437 00000100:00100000:0.0:1746066776.657725:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:3293:x1830882976660096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066776.657921:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066776.657932:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976662016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066776.657947:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746066776.657980:0:4614:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066776.657983:0:4614:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066774 -> 1746066774 00002000:00010000:0.0:1746066776.657985:0:4614:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066774 -> 1746066774 00002000:00010000:0.0:1746066776.657986:0:4614:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066774 -> 1746066774 00002000:00010000:0.0:1746066776.657988:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 1429 -> 1429 00000100:00100000:0.0:1746066776.658009:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3293:x1830882976660096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 285us (2454us total) trans 17179873363 rc 0/0 00000100:00100000:0.0:1746066776.658014:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13437 00000100:00100000:0.0:1746066776.658024:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13447 00000100:00100000:0.0:1746066776.658028:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3295:x1830882976662016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066776.658159:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3295:x1830882976662016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (210us total) trans 21474840698 rc 0/0 00000100:00100000:0.0:1746066776.658163:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13447 00000100:00100000:0.0:1746066776.658172:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13449 00000100:00100000:0.0:1746066776.658176:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3294:x1830882976661888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066776.658247:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3294:x1830882976661888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (120us total) trans 21474840699 rc 0/0 00000100:00100000:0.0:1746066776.658251:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13449 00000100:00100000:0.0:1746066776.659190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.659834:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.661650:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.663367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.669602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.669645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.693435:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 5990 00000100:00100000:0.0:1746066776.693441:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882976461952:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066776.693484:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882976461056:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 22288us (22443us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066776.693489:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 5988 00002000:00100000:0.0:1746066776.693494:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009a4ec000 x1830882976461056/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:182/0 lens 488/440 e 0 to 0 dl 1746066787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066776.693500:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ec000 with x1830882976461056 ext(1048576->2097151) 00002000:00010000:0.0:1746066776.693503:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4ec000 00000100:00100000:0.0:1746066776.693515:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 5991 00000100:00100000:0.0:1746066776.693518:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882976462208:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066776.702657:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.709258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.709342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.710984:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882976462208:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 17458us (17959us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066776.710993:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 5991 00002000:00100000:0.0:1746066776.711001:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009bfe2a00 x1830882976462208/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:182/0 lens 488/440 e 0 to 0 dl 1746066787 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066776.711020:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2a00 with x1830882976462208 ext(1048576->2097151) 00002000:00010000:0.0:1746066776.711024:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe2a00 00000100:00100000:0.0:1746066776.711040:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976463232 00000100:00100000:0.0:1746066776.711044:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976463232 00002000:00100000:0.0:1746066776.711059:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x390:0x0] (1048576->1105919) req@ffff8800996d8000 x1830882976463232/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:182/0 lens 488/0 e 0 to 0 dl 1746066787 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066776.711065:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8000 with x1830882976463232 ext(1048576->1105919) 00002000:00010000:0.0:1746066776.711068:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800996d8000 00000100:00100000:0.0:1746066776.724111:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.725219:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.731969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.734226:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.748837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.750874:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.756639:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.764571:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.789425:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.789458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.789488:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.796590:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6004 00000100:00100000:0.0:1746066776.796596:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882976466304:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066776.844558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.867906:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.878809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.905285:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.915904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.928268:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.932130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.935621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.937966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.946753:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.950917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.960577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.962575:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.962599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.962618:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.962637:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.962650:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.962669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982229:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982310:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982345:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982353:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.982392:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.990966:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.990992:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.991020:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.997060:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.999659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.999704:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066776.999774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.052732:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976667904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066777.052788:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066777.052825:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976668416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066777.052842:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066777.052857:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746066777.052861:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976667776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066777.052873:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066777.052882:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976668288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066777.052894:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066777.052910:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976667904 00000100:00100000:0.0:1746066777.052916:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976667904 00000100:00100000:0.0:1746066777.052938:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976668416 00000100:00100000:0.0:1746066777.052940:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976668416 00000100:00100000:0.0:1746066777.052949:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976667776 00000100:00100000:0.0:1746066777.052951:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976667776 00000100:00100000:0.0:1746066777.052960:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976668288 00000100:00100000:0.0:1746066777.052962:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976668288 00000100:00100000:0.0:1746066777.052971:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13478 00000100:00100000:0.0:1746066777.052976:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800992ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3296:x1830882976667904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066777.053141:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800992ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3296:x1830882976667904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 163us (352us total) trans 21474840708 rc 0/0 00000100:00100000:0.0:1746066777.053156:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13478 00000100:00100000:0.0:1746066777.053259:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13479 00000100:00100000:0.0:1746066777.053264:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3296:x1830882976668416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066777.053343:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3296:x1830882976668416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (499us total) trans 21474840709 rc 0/0 00000100:00100000:0.0:1746066777.053349:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13479 00000100:00100000:0.0:1746066777.053358:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13481 00000100:00100000:0.0:1746066777.053362:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3296:x1830882976668288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066777.053916:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3296:x1830882976668288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 552us (1019us total) trans 21474840711 rc 0/0 00000100:00100000:0.0:1746066777.053921:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13481 00000100:00100000:0.0:1746066777.060181:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.063147:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.064978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.095299:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.095347:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.101558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.101596:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.101700:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.105227:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.105262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.105301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.136847:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.136881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.136908:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.136955:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.136986:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976475648 00000100:00100000:0.0:1746066777.136992:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976475648 00002000:00100000:0.0:1746066777.137025:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88012c529500 x1830882976475648/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.137034:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c529500 with x1830882976475648 ext(0->1048575) 00002000:00010000:0.0:1746066777.137039:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c529500 00000100:00100000:0.0:1746066777.137052:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976475904 00000100:00100000:0.0:1746066777.137054:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976475904 00002000:00100000:0.0:1746066777.137065:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88012c52a680 x1830882976475904/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.137071:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52a680 with x1830882976475904 ext(1048576->2097151) 00002000:00010000:0.0:1746066777.137073:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c52a680 00000100:00100000:0.0:1746066777.137080:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976476160 00000100:00100000:0.0:1746066777.137082:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976476160 00002000:00100000:0.0:1746066777.137089:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009a4ee680 x1830882976476160/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.137094:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ee680 with x1830882976476160 ext(1048576->2097151) 00002000:00010000:0.0:1746066777.137097:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4ee680 00000100:00100000:0.0:1746066777.137102:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976476416 00000100:00100000:0.0:1746066777.137104:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976476416 00002000:00100000:0.0:1746066777.137110:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009a4ece00 x1830882976476416/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.137116:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ece00 with x1830882976476416 ext(1048576->2097151) 00002000:00010000:0.0:1746066777.137119:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4ece00 00000100:00100000:0.0:1746066777.137129:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6009 00000100:00100000:0.0:1746066777.137141:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882976475648:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066777.138880:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6010 00000100:00100000:0.0:1746066777.138889:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882976475904:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066777.174119:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.174153:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.174247:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976477184 00000100:00100000:0.0:1746066777.174253:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976477184 00010000:00010000:0.0:1746066777.174282:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a578de00/0xfb36a14ee6088966 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb76 expref: 254 pid: 14550 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746066777.187378:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.187459:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.187491:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976477312 00000100:00100000:0.0:1746066777.187497:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976477312 00000100:00100000:0.0:1746066777.187534:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976477440 00000100:00100000:0.0:1746066777.187536:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976477440 00000100:00100000:0.0:1746066777.187552:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9728 00000100:00100000:0.0:1746066777.187557:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31061:x1830882976477312:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066777.187574:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.187592:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48a5000/0xfb36a14ee60889eb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cbbc expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.187637:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48a5200/0xfb36a14ee60889f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066777.187644:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e892600/0xfb36a14ee60889c8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbae expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.187754:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48a5200/0xfb36a14ee60889f9 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066777.188149:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e892600/0xfb36a14ee60889c8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbae expref: 9 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.188166:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e892600/0xfb36a14ee60889c8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbae expref: 9 pid: 20127 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746066777.188176:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976669056:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066777.188225:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066777.210254:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.224976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.225014:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.225040:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.225072:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.225105:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976477824 00000100:00100000:0.0:1746066777.225111:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976477824 00002000:00100000:0.0:1746066777.225142:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009a0d0000 x1830882976477824/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.225151:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d0000 with x1830882976477824 ext(2097152->3145727) 00002000:00010000:0.0:1746066777.225155:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a0d0000 00000100:00100000:0.0:1746066777.225167:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976478080 00000100:00100000:0.0:1746066777.225169:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976478080 00002000:00100000:0.0:1746066777.225176:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009a0d1c00 x1830882976478080/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.225194:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d1c00 with x1830882976478080 ext(3145728->4194303) 00002000:00010000:0.0:1746066777.225196:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a0d1c00 00000100:00100000:0.0:1746066777.225203:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976478336 00000100:00100000:0.0:1746066777.225205:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976478336 00002000:00100000:0.0:1746066777.225214:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88008c396300 x1830882976478336/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.225219:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396300 with x1830882976478336 ext(2097152->3145727) 00002000:00010000:0.0:1746066777.225221:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c396300 00000100:00100000:0.0:1746066777.225227:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976478592 00000100:00100000:0.0:1746066777.225228:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976478592 00002000:00100000:0.0:1746066777.225235:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88008c395f80 x1830882976478592/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.225240:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395f80 with x1830882976478592 ext(3145728->4194303) 00002000:00010000:0.0:1746066777.225242:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c395f80 00000100:00100000:0.0:1746066777.225250:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6013 00000100:00100000:0.0:1746066777.225255:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882976477824:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066777.235750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.235788:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976478848 00000100:00100000:0.0:1746066777.235795:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976478848 00000100:00100000:0.0:1746066777.235829:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9730 00000100:00100000:0.0:1746066777.235836:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:31055:x1830882976478848:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066777.235852:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.235855:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746066777.235874:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c7600/0xfb36a14ee60889d6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbb5 expref: 254 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.235899:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066777.235903:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066777.235931:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72000/0xfb36a14ee6088a00 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cbca expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.235969:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72400/0xfb36a14ee6088a07 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066777.235977:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a578d400/0xfb36a14ee608894a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb6f expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.235982:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e892400/0xfb36a14ee60889f2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbc3 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.235987:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48a5200/0xfb36a14ee60889f9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbbc expref: 254 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.235991:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72400/0xfb36a14ee6088a07 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066777.236013:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48a5200/0xfb36a14ee60889f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbbc expref: 254 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.236021:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48a5200/0xfb36a14ee60889f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbbc expref: 254 pid: 14548 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746066777.236031:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c395c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976669184:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066777.236088:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e892400/0xfb36a14ee60889f2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbc3 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.236100:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e892400/0xfb36a14ee60889f2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbc3 expref: 8 pid: 14549 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746066777.236106:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c394380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976669312:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066777.236129:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a578d400/0xfb36a14ee608894a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb6f expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.236135:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a578d400/0xfb36a14ee608894a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb6f expref: 8 pid: 14550 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746066777.236141:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c395500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976669440:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066777.236153:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066777.243718:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.243736:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.243757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.244196:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.244240:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.244267:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13492 00000100:00100000:0.0:1746066777.244272:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882976479488:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066777.244276:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.244281:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef73600/0xfb36a14ee6088a2a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cbed expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.244288:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.244289:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.244297:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef73600/0xfb36a14ee6088a2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbed expref: 34 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.244305:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef73600/0xfb36a14ee6088a2a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbed expref: 34 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.244311:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef73600, rc 0) 00000100:00100000:0.0:1746066777.244322:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882976479488:12345-192.168.202.57@tcp:101:cat.0 Request processed in 50us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.245449:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13492 00000100:00100000:0.0:1746066777.253313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.265774:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.265799:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.265812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.266144:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1965:x1830882976478336:12345-192.168.202.57@tcp:3:cat.0 Request processed in 38009us (41101us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066777.266153:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6015 00002000:00100000:0.0:1746066777.266162:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88008c396300 x1830882976478336/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/440 e 0 to 0 dl 1746066788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.266171:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396300 with x1830882976478336 ext(2097152->3145727) 00002000:00010000:0.0:1746066777.266176:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c396300 00000100:00100000:0.0:1746066777.266263:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976479872 00000100:00100000:0.0:1746066777.266269:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976479872 00010000:00010000:0.0:1746066777.266289:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48a5200/0xfb36a14ee60889f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbbc expref: 255 pid: 14548 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746066777.266307:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976480128 00000100:00100000:0.0:1746066777.266316:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976480128 00010000:00010000:0.0:1746066777.266326:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a578d400/0xfb36a14ee608894a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb6f expref: 11 pid: 14550 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746066777.266337:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976480000 00000100:00100000:0.0:1746066777.266339:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976480000 00010000:00010000:0.0:1746066777.266345:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e892400/0xfb36a14ee60889f2 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbc3 expref: 9 pid: 14549 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746066777.266357:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6831 00000100:00100000:0.0:1746066777.266362:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:1964:x1830882976479872:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066777.266370:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066777.266375:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48a5200/0xfb36a14ee60889f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbbc expref: 255 pid: 14548 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746066777.266384:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48a5200/0xfb36a14ee60889f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbbc expref: 255 pid: 14548 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746066777.266401:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48a5200/0xfb36a14ee60889f9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbbc expref: 255 pid: 14548 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746066777.266414:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066777.266418:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a94200/0xfb36a14ee6088a4d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066777.266424:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72400/0xfb36a14ee6088a07 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066777.266429:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72400/0xfb36a14ee6088a07 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066777.266441:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a94200/0xfb36a14ee6088a4d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066777.266445:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066777.266464:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:1964:x1830882976479872:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 101us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.266469:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6831 00000100:00100000:0.0:1746066777.266479:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6832 00000100:00100000:0.0:1746066777.266483:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976480128:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066777.266489:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066777.266493:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a578d400/0xfb36a14ee608894a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb6f expref: 11 pid: 14550 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746066777.266498:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a578d400/0xfb36a14ee608894a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb6f expref: 11 pid: 14550 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746066777.266508:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066777.266511:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a94200/0xfb36a14ee6088a4d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066777.266515:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72400/0xfb36a14ee6088a07 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066777.266518:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72400/0xfb36a14ee6088a07 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066777.266522:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a94200/0xfb36a14ee6088a4d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066777.266534:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066777.266548:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976480128:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 65us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.266553:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6832 00000100:00100000:0.0:1746066777.266562:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6833 00000100:00100000:0.0:1746066777.266566:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:1964:x1830882976480000:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066777.266572:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066777.266575:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e892400/0xfb36a14ee60889f2 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbc3 expref: 9 pid: 14549 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746066777.266582:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e892400/0xfb36a14ee60889f2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbc3 expref: 9 pid: 14549 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746066777.266590:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066777.266593:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a94200/0xfb36a14ee6088a4d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066777.266598:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72400/0xfb36a14ee6088a07 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066777.266603:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72400/0xfb36a14ee6088a07 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066777.266608:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72400/0xfb36a14ee6088a07 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066777.266613:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a94200/0xfb36a14ee6088a4d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066777.266617:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a94200/0xfb36a14ee6088a4d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066777.266634:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066777.266648:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:1964:x1830882976480000:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 81us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.266653:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6833 00000100:00100000:0.0:1746066777.271232:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.271526:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882976478592:12345-192.168.202.57@tcp:3:cat.0 Request processed in 42430us (46452us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066777.271535:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6016 00002000:00100000:0.0:1746066777.271545:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88008c395f80 x1830882976478592/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/440 e 0 to 0 dl 1746066788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.271553:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395f80 with x1830882976478592 ext(3145728->4194303) 00002000:00010000:0.0:1746066777.271558:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c395f80 00000100:00100000:0.0:1746066777.277982:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.318125:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980aefe6-2860-4e29-9b4a-3d9c65563e6f:3296:1830882976669696:0@lo:400:kworker.0 00000100:00100000:0.0:1746066777.318152:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066777.318177:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746066777.318181:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830882976670080:0@lo:400:kworker.0 00000100:00100000:0.0:1746066777.318201:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066777.318225:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976669696 00000100:00100000:0.0:1746066777.318228:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976669696 00000100:00100000:0.0:1746066777.318247:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1746066777.318252:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a852a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980aefe6-2860-4e29-9b4a-3d9c65563e6f+18:3296:x1830882976669696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066777.318279:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a852a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980aefe6-2860-4e29-9b4a-3d9c65563e6f+18:3296:x1830882976669696:12345-0@lo:400:kworker.0 Request processed in 27us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.318295:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1746066777.318332:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980aefe6-2860-4e29-9b4a-3d9c65563e6f:3296:1830882976669696:0@lo:400:kworker.0 00000100:00100000:0.0:1746066777.318885:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830882976670080:0@lo:400:kworker.0 00000100:00100000:0.0:1746066777.318946:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976670208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746066777.318963:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066777.318981:0:30571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976670208 00000100:00100000:0.0:1746066777.318984:0:30571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976670208 00000100:00100000:0.0:1746066777.318999:0:30571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1746066777.319004:0:30571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+59:3296:x1830882976670208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746066777.319014:0:30571:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 418971648 pending 20447232 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746066777.319035:0:30571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+59:3296:x1830882976670208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.319039:0:30571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1746066777.319173:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976670208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746066777.319625:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976670976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066777.319708:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066777.319722:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976671488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066777.319735:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066777.319756:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746066777.319760:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976670848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066777.319773:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066777.319783:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976671360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066777.319794:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066777.319815:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976671488 00000100:00100000:0.0:1746066777.319818:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976671488 00000100:00100000:0.0:1746066777.319827:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976671360 00000100:00100000:0.0:1746066777.319829:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976671360 00000100:00100000:0.0:1746066777.319847:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13497 00000100:00100000:0.0:1746066777.319851:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+66:3296:x1830882976670976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066777.319862:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13498 00000100:00100000:0.0:1746066777.319865:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:3296:x1830882976671488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066777.319935:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3296:x1830882976671488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (199us total) trans 17179873384 rc 0/0 00000100:00100000:0.0:1746066777.319940:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13498 00000100:00100000:0.0:1746066777.319949:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13500 00000100:00100000:0.0:1746066777.319953:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3296:x1830882976671360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066777.320002:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746066777.320005:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746066777.320006:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066777.320008:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746066777.320009:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746066777.320022:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3296:x1830882976671360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (227us total) trans 17179873386 rc 0/0 00000100:00100000:0.0:1746066777.320026:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13500 00000100:00100000:0.0:1746066777.320039:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066777.320053:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976671104 00000100:00100000:0.0:1746066777.320055:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976671104 00000100:00100000:0.0:1746066777.320066:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13501 00000100:00100000:0.0:1746066777.320069:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3294:x1830882976671104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066777.320138:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3294:x1830882976671104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (98us total) trans 17179873388 rc 0/0 00000100:00100000:0.0:1746066777.320147:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13501 00000100:00100000:0.0:1746066777.320233:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+71:3296:x1830882976670976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 382us (524us total) trans 17179873389 rc 0/0 00000100:00100000:0.0:1746066777.320237:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13497 00000004:00080000:0.0:1746066777.320252:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009244ed80/2, rc 0, transno 17179873385 00000100:00100000:0.0:1746066777.320255:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976670848:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066777.320260:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16fb80/2, rc 0, transno 17179873386 00000100:00100000:0.0:1746066777.320262:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976671360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066777.320267:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009244c700/2, rc 0, transno 17179873389 00000100:00100000:0.0:1746066777.320270:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976670976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066777.320274:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16e300/2, rc 0, transno 17179873384 00000100:00100000:0.0:1746066777.320276:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976671488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066777.324819:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.324848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.325422:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13506 00000100:00100000:0.0:1746066777.325428:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3295:x1830882976672512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066777.325502:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3295:x1830882976672512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (1118us total) trans 21474840715 rc 0/0 00000100:00100000:0.0:1746066777.325506:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13506 00000100:00100000:0.0:1746066777.325514:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13508 00000100:00100000:0.0:1746066777.325518:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3293:x1830882976672640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066777.325638:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+63:3293:x1830882976672640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 119us (1174us total) trans 21474840717 rc 0/0 00000100:00100000:0.0:1746066777.325653:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13508 00000100:00100000:0.0:1746066777.325663:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13509 00000100:00100000:0.0:1746066777.325667:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3293:x1830882976671744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066777.325870:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066777.325872:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066773 -> 1746066773 00002000:00010000:0.0:1746066777.325874:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066772 -> 1746066772 00002000:00010000:0.0:1746066777.325876:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066773 -> 1746066773 00002000:00010000:0.0:1746066777.325877:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746066777.325893:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+63:3293:x1830882976671744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (1383us total) trans 21474840719 rc 0/0 00000100:00100000:0.0:1746066777.325897:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13509 00000100:00100000:0.0:1746066777.326120:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 3997 00000100:00100000:0.0:1746066777.326125:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d6b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31061:x1830882976480640:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:0.0:1746066777.326161:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d6b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31061:x1830882976480640:12345-192.168.202.57@tcp:49:cat.0 Request processed in 36us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.326166:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 3997 00000100:00100000:0.0:1746066777.349418:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.349480:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.349544:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.359270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.359306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.359352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.359366:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.359393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.359427:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976482048 00000100:00100000:0.0:1746066777.359435:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976482048 00000100:00100000:0.0:1746066777.359458:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13512 00000100:00100000:0.0:1746066777.359464:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976482048:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066777.359475:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.359487:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a578c600/0xfb36a14ee6088a70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cc1e expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.359500:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.359502:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.359510:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a578c600/0xfb36a14ee6088a70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc1e expref: 9 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.359521:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a578c600/0xfb36a14ee6088a70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc1e expref: 9 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.359530:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a578c600, rc 0) 00000100:00100000:0.0:1746066777.359560:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976482048:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 96us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.359565:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13512 00000100:00080000:0.0:1746066777.360191:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066777.360419:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1966:x1830882976481280:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 10454us (10877us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066777.360425:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6017 00002000:00100000:0.0:1746066777.360430:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009f16ea00 x1830882976481280/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:183/0 lens 488/440 e 0 to 0 dl 1746066788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.360436:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16ea00 with x1830882976481280 ext(0->1048575) 00002000:00010000:0.0:1746066777.360439:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16ea00 00000100:00100000:0.0:1746066777.361924:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.363049:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.363079:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.363673:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.363731:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.364281:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976482304 00000100:00100000:0.0:1746066777.364288:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976482304 00000100:00100000:0.0:1746066777.364324:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976482560 00000100:00100000:0.0:1746066777.364326:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976482560 00000100:00100000:0.0:1746066777.364335:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976482816 00000100:00100000:0.0:1746066777.364337:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976482816 00000100:00100000:0.0:1746066777.364345:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976482432 00000100:00100000:0.0:1746066777.364347:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976482432 00000100:00100000:0.0:1746066777.364355:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976482688 00000100:00100000:0.0:1746066777.364357:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976482688 00000100:00100000:0.0:1746066777.364370:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13513 00000100:00100000:0.0:1746066777.364375:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976482304:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066777.364390:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.364407:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e41400/0xfb36a14ee6088a77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cc25 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.364424:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.364426:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.364433:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e41400/0xfb36a14ee6088a77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc25 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.364445:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e41400/0xfb36a14ee6088a77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc25 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.364454:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e41400, rc 0) 00000100:00100000:0.0:1746066777.364486:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976482304:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 110us (2564us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.364492:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13513 00000100:00100000:0.0:1746066777.364506:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13514 00000100:00100000:0.0:1746066777.364510:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976482560:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066777.364516:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.364525:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e892800/0xfb36a14ee6088a7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cc33 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.364536:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.364537:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.364541:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e892800/0xfb36a14ee6088a7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc33 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.364550:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e892800/0xfb36a14ee6088a7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc33 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.364556:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e892800, rc 0) 00000100:00100000:0.0:1746066777.364569:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976482560:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 59us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.364574:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13514 00000100:00100000:0.0:1746066777.364583:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13515 00000100:00100000:0.0:1746066777.364587:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976482816:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066777.364592:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.364598:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e893600/0xfb36a14ee6088a85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cc41 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.364615:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.364622:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e893600/0xfb36a14ee6088a85 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc41 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.364630:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e893600/0xfb36a14ee6088a85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc41 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.364642:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e893600, rc 0) 00000100:00100000:0.0:1746066777.364658:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976482816:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 70us (1578us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066777.364662:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13515 00000100:00100000:0.0:1746066777.364672:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13516 00000100:00100000:0.0:1746066777.364696:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976482432:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066777.364702:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.364708:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e892600/0xfb36a14ee6088a8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cc2c expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.364716:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.364718:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.364722:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e892600/0xfb36a14ee6088a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc2c expref: 10 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.364730:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e892600/0xfb36a14ee6088a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc2c expref: 10 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.364737:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e892600, rc 0) 00000100:00100000:0.0:1746066777.364769:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976482432:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 92us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.364773:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13516 00000100:00100000:0.0:1746066777.364783:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13517 00000100:00100000:0.0:1746066777.364787:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976482688:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066777.364792:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.364797:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099014200/0xfb36a14ee6088a93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cc3a expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.364805:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.364806:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.364809:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099014200/0xfb36a14ee6088a93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc3a expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.364817:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099014200/0xfb36a14ee6088a93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc3a expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.364822:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099014200, rc 0) 00000100:00100000:0.0:1746066777.364833:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976482688:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 46us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.364837:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13517 00000100:00080000:0.0:1746066777.364851:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066777.384572:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.404152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.413202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.426902:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1965:x1830882976484224:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13511us (13706us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066777.426920:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6022 00002000:00100000:0.0:1746066777.426931:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880093211500 x1830882976484224/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:183/0 lens 488/440 e 0 to 0 dl 1746066788 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.426940:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093211500 with x1830882976484224 ext(2097152->3145727) 00002000:00010000:0.0:1746066777.426944:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093211500 00000100:00100000:0.0:1746066777.430771:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.430795:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.430857:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.430877:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976485120 00000100:00100000:0.0:1746066777.430883:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976485120 00002000:00100000:0.0:1746066777.430912:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3018752->3022847) req@ffff880093210700 x1830882976485120/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.430922:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093210700 with x1830882976485120 ext(3018752->3022847) 00010000:00010000:0.0:1746066777.430929:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092590e00/0xfb36a14ee6088a62 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc17 expref: 22 pid: 9776 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746066777.430938:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092590e00/0xfb36a14ee6088a62 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc17 expref: 22 pid: 9776 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746066777.430944:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093210700 00000100:00100000:0.0:1746066777.430957:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976485376 00000100:00100000:0.0:1746066777.430959:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976485376 00002000:00100000:0.0:1746066777.430970:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880093211f80 x1830882976485376/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.430976:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093211f80 with x1830882976485376 ext(3145728->4194303) 00002000:00010000:0.0:1746066777.430985:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093211f80 00000100:00100000:0.0:1746066777.430996:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1979 00000100:00100000:0.0:1746066777.431002:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882976485120:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066777.431120:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882976485120:12345-192.168.202.57@tcp:3:cat.0 Request processed in 118us (322us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066777.431125:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1979 00002000:00100000:0.0:1746066777.431130:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3018752->3022847) req@ffff880093210700 x1830882976485120/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:183/0 lens 488/4536 e 0 to 0 dl 1746066788 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.431136:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093210700 with x1830882976485120 ext(3018752->3022847) 00010000:00010000:0.0:1746066777.431141:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092590e00/0xfb36a14ee6088a62 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc17 expref: 22 pid: 9776 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746066777.431148:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092590e00/0xfb36a14ee6088a62 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3018752->3145727] (req 3018752->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc17 expref: 22 pid: 9776 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746066777.431153:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093210700 00000100:00100000:0.0:1746066777.431165:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6023 00000100:00100000:0.0:1746066777.431169:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882976485376:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066777.435225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.438319:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.438352:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.438375:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.445671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.450329:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.450412:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.450439:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.450458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.451816:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976487168 00000100:00100000:0.0:1746066777.451820:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976487168 00000100:00100000:0.0:1746066777.452133:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 3998 00000100:00100000:0.0:1746066777.452138:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31062:x1830882976487168:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:0.0:1746066777.452254:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31062:x1830882976487168:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 115us (592us total) trans 8589943727 rc 0/0 00000100:00100000:0.0:1746066777.452259:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 3998 00000100:00100000:0.0:1746066777.453144:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.457757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.457789:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.471393:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.472225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.493727:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.497506:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.501342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.501955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.505410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.507998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.525463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.525504:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.526352:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.528051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.528110:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.534540:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882976490624:12345-192.168.202.57@tcp:4:cat.0 Request processed in 6068us (6421us total) trans 17179873392 rc 0/0 00000100:00100000:0.0:1746066777.534559:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1985 00002000:00100000:0.0:1746066777.534568:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->3416063) req@ffff880135e5f100 x1830882976490624/t17179873392(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/448 e 0 to 0 dl 1746066788 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.534576:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5f100 with x1830882976490624 ext(3145728->3416063) 00010000:00010000:0.0:1746066777.534584:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800997c6c00/0xfb36a14ee6088b03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->3416063] (req 3145728->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc95 expref: 24 pid: 8452 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746066777.534598:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800997c6c00/0xfb36a14ee6088b03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->3416063] (req 3145728->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc95 expref: 24 pid: 8452 timeout: 838 lvb_type: 0 00002000:00010000:0.0:1746066777.534604:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135e5f100 00000100:00100000:0.0:1746066777.535640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.536906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.548232:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.548278:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.575347:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.592509:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.638875:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.639121:0:14544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976492288 00000100:00100000:0.0:1746066777.639124:0:14544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976492288 00000100:00100000:0.0:1746066777.639143:0:14544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 213 00000100:00100000:0.0:1746066777.639148:0:14544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69ee3f12-76db-44fe-a8c9-a42ead582d61+15:1963:x1830882976492288:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1746066777.647050:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.673305:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.681874:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.690773:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.691762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.691787:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.691814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.691827:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976493952 00000100:00100000:0.0:1746066777.691830:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976493952 00002000:00100000:0.0:1746066777.691847:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880135e5ed80 x1830882976493952/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.691854:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ed80 with x1830882976493952 ext(1048576->2097151) 00002000:00010000:0.0:1746066777.691857:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5ed80 00000100:00100000:0.0:1746066777.691866:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976494080 00000100:00100000:0.0:1746066777.691868:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976494080 00002000:00100000:0.0:1746066777.691876:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880135e5e300 x1830882976494080/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.691882:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5e300 with x1830882976494080 ext(1048576->2097151) 00002000:00010000:0.0:1746066777.691885:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5e300 00000100:00100000:0.0:1746066777.691890:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976494336 00000100:00100000:0.0:1746066777.691892:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976494336 00002000:00100000:0.0:1746066777.691900:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff880135e5c700 x1830882976494336/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.691905:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5c700 with x1830882976494336 ext(1048576->2097151) 00002000:00010000:0.0:1746066777.691907:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5c700 00000100:00100000:0.0:1746066777.691916:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6031 00000100:00100000:0.0:1746066777.691920:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882976493952:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066777.714108:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976494720 00000100:00100000:0.0:1746066777.714115:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976494720 00000100:00100000:0.0:1746066777.714170:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13532 00000100:00100000:0.0:1746066777.714177:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:31075:x1830882976494720:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066777.714191:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.714206:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e892400/0xfb36a14ee6088b88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ccd4 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.714229:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e893800/0xfb36a14ee6088997 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb84 expref: 23 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.714238:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a578c600/0xfb36a14ee6088a70 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc1e expref: 9 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.714244:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099539200/0xfb36a14ee6088a0e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbd1 expref: 35 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.714249:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.714250:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.714254:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e892400/0xfb36a14ee6088b88 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1036288->1048575] (req 1036288->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccd4 expref: 35 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.714279:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099539200/0xfb36a14ee6088a0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbd1 expref: 35 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.714289:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099539200/0xfb36a14ee6088a0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbd1 expref: 35 pid: 8451 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746066777.714298:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976675200:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066777.714514:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a578c600/0xfb36a14ee6088a70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc1e expref: 9 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.714523:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a578c600/0xfb36a14ee6088a70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc1e expref: 9 pid: 21973 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746066777.714531:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976675328:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066777.714555:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e893800/0xfb36a14ee6088997 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb84 expref: 23 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.714562:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e893800/0xfb36a14ee6088997 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb84 expref: 23 pid: 8452 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746066777.714571:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976675456:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066777.714585:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929eacc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746066777.720417:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099539200/0xfb36a14ee6088a0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cbd1 expref: 35 pid: 8451 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746066777.720441:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976675200:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066777.720452:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976675328:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066777.720460:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e893800/0xfb36a14ee6088997 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb84 expref: 23 pid: 8452 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746066777.720467:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976675456:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066777.720488:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e892400/0xfb36a14ee6088b88 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1036288->1048575] (req 1036288->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccd4 expref: 34 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.720505:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e892400, rc 0) 00000100:00100000:0.0:1746066777.720535:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:31075:x1830882976494720:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6359us (6480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.720541:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13532 00000100:00100000:0.0:1746066777.725929:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.730054:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976495488 00000100:00100000:0.0:1746066777.730059:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976495488 00000100:00100000:0.0:1746066777.730273:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13533 00000100:00100000:0.0:1746066777.730281:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+21:31070:x1830882976495488:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066777.730293:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.730306:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e893200/0xfb36a14ee6088b8f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ccdb expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.730329:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e893400/0xfb36a14ee6088ad9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc72 expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.730336:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095ff3000/0xfb36a14ee6088b11 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cca3 expref: 22 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.730342:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.730343:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.730346:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e893200/0xfb36a14ee6088b8f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2433024->3071999] (req 2433024->3071999) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccdb expref: 22 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.730371:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095ff3000/0xfb36a14ee6088b11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cca3 expref: 22 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.730391:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095ff3000/0xfb36a14ee6088b11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cca3 expref: 22 pid: 9776 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746066777.730402:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976675712:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066777.730467:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e893400/0xfb36a14ee6088ad9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc72 expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.730475:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e893400/0xfb36a14ee6088ad9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc72 expref: 23 pid: 21203 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746066777.730482:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976675840:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066777.730499:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066777.730521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.730556:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.735797:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976675712:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066777.736572:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976675840:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066777.736594:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e893200/0xfb36a14ee6088b8f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2433024->3071999] (req 2433024->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccdb expref: 24 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.736607:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e893200, rc 0) 00000100:00100000:0.0:1746066777.736645:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+24:31070:x1830882976495488:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6364us (7057us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.736652:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13533 00000100:00100000:0.0:1746066777.741618:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.749402:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.750501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.751203:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.751236:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976496896 00000100:00100000:0.0:1746066777.751240:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976496896 00010000:00010000:0.0:1746066777.751254:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e893c00/0xfb36a14ee608899e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb8b expref: 22 pid: 8452 timeout: 838 lvb_type: 1 00000100:00100000:0.0:1746066777.751271:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6851 00000100:00100000:0.0:1746066777.751276:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976496896:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066777.751282:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066777.751291:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e893c00/0xfb36a14ee608899e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb8b expref: 22 pid: 8452 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746066777.751299:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e893c00/0xfb36a14ee608899e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb8b expref: 22 pid: 8452 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746066777.751310:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e893c00/0xfb36a14ee608899e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cb8b expref: 22 pid: 8452 timeout: 838 lvb_type: 1 00010000:00010000:0.0:1746066777.751318:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.751320:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.751325:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b190800/0xfb36a14ee6088b96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cce2 expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.751332:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b190800/0xfb36a14ee6088b96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cce2 expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.751365:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b190800/0xfb36a14ee6088b96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cce2 expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066777.751376:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976676352:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066777.751417:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066777.753898:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.759199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.759507:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976676352:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066777.759523:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066777.759554:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882976496896:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8276us (8351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.759563:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6851 00000100:00100000:0.0:1746066777.759609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.762200:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.762222:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976497280 00000100:00100000:0.0:1746066777.762619:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976497280 00002000:00100000:0.0:1746066777.762654:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1200128->1204223) req@ffff880135e5a300 x1830882976497280/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.762663:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5a300 with x1830882976497280 ext(1200128->1204223) 00002000:00010000:0.0:1746066777.762667:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5a300 00000100:00100000:0.0:1746066777.762695:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976497664 00000100:00100000:0.0:1746066777.762698:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976497664 00002000:00100000:0.0:1746066777.762708:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2433024->2437119) req@ffff880135e5ad80 x1830882976497664/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.762723:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ad80 with x1830882976497664 ext(2433024->2437119) 00002000:00010000:0.0:1746066777.762726:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5ad80 00000100:00100000:0.0:1746066777.762748:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6037 00000100:00100000:0.0:1746066777.762754:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882976497280:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066777.763700:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882976497280:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 944us (4505us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066777.763707:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6037 00002000:00100000:0.0:1746066777.763713:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1200128->1204223) req@ffff880135e5a300 x1830882976497280/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:183/0 lens 488/4536 e 0 to 0 dl 1746066788 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.763721:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5a300 with x1830882976497280 ext(1200128->1204223) 00002000:00010000:0.0:1746066777.763724:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5a300 00000100:00100000:0.0:1746066777.763749:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6038 00000100:00100000:0.0:1746066777.763755:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882976497664:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066777.763809:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882976497664:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 54us (1614us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066777.763814:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6038 00002000:00100000:0.0:1746066777.763818:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2433024->2437119) req@ffff880135e5ad80 x1830882976497664/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:183/0 lens 488/4536 e 0 to 0 dl 1746066788 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.763824:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ad80 with x1830882976497664 ext(2433024->2437119) 00002000:00010000:0.0:1746066777.763827:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5ad80 00000100:00100000:0.0:1746066777.769281:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.771829:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.777107:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13535 00000100:00100000:0.0:1746066777.777115:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:31073:x1830882976497408:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066777.777129:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.777143:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94a00/0xfb36a14ee6088b9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cce9 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.777165:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e893200/0xfb36a14ee6088b8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2433024->3145727] (req 2433024->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccdb expref: 21 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.777172:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066777.777174:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066777.777177:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94a00/0xfb36a14ee6088b9d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cce9 expref: 21 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.777200:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e893200/0xfb36a14ee6088b8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2433024->3145727] (req 2433024->3071999) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccdb expref: 21 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.777209:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e893200/0xfb36a14ee6088b8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2433024->3145727] (req 2433024->3071999) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccdb expref: 21 pid: 9776 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746066777.777219:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976676608:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066777.777280:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066777.790789:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976676608:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066777.790813:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94a00/0xfb36a14ee6088b9d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cce9 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.790828:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a94a00, rc 0) 00000100:00100000:0.0:1746066777.790864:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:31073:x1830882976497408:12345-192.168.202.57@tcp:101:cat.0 Request processed in 13750us (31254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.790872:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13535 00000100:00100000:0.0:1746066777.797643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.797716:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976498688 00000100:00100000:0.0:1746066777.797723:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976498688 00010000:00010000:0.0:1746066777.797765:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e893200/0xfb36a14ee6088b8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2433024->3145727] (req 2433024->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccdb expref: 23 pid: 9776 timeout: 838 lvb_type: 0 00000100:00100000:0.0:1746066777.797789:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6853 00000100:00100000:0.0:1746066777.797795:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882976498688:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066777.797805:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066777.797822:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e893200/0xfb36a14ee6088b8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2433024->3145727] (req 2433024->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccdb expref: 23 pid: 9776 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746066777.797832:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e893200/0xfb36a14ee6088b8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2433024->3145727] (req 2433024->3071999) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccdb expref: 23 pid: 9776 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746066777.797848:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e893200/0xfb36a14ee6088b8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2433024->3145727] (req 2433024->3071999) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccdb expref: 23 pid: 9776 timeout: 838 lvb_type: 0 00010000:00010000:0.0:1746066777.797859:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.797861:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.797866:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94a00/0xfb36a14ee6088b9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cce9 expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.797873:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94a00/0xfb36a14ee6088b9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cce9 expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.797906:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94a00/0xfb36a14ee6088b9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cce9 expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066777.797916:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976676736:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066777.797961:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066777.824886:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976676736:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066777.824902:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066777.824931:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+11:1965:x1830882976498688:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 27137us (27295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.824938:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6853 00000100:00100000:0.0:1746066777.825027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.825062:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976499328 00000100:00100000:0.0:1746066777.825065:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976499328 00000100:00100000:0.0:1746066777.825085:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13536 00000100:00100000:0.0:1746066777.825089:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+13:1964:x1830882976499328:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066777.825098:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.825110:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94e00/0xfb36a14ee6088bb9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ccf7 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.825126:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.825128:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.825135:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94e00/0xfb36a14ee6088bb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccf7 expref: 14 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.825149:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94e00/0xfb36a14ee6088bb9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccf7 expref: 14 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.825167:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a94e00, rc 0) 00000100:00100000:0.0:1746066777.825187:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1964:x1830882976499328:12345-192.168.202.57@tcp:101:cat.0 Request processed in 97us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.825192:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13536 00000100:00100000:0.0:1746066777.838184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.838218:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.838495:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976499712 00000100:00100000:0.0:1746066777.838502:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976499712 00002000:00100000:0.0:1746066777.838536:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x38e:0x0] (0->1036287) req@ffff880135e58700 x1830882976499712/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.838546:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e58700 with x1830882976499712 ext(0->1036287) 00002000:00010000:0.0:1746066777.838551:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e58700 00000100:00100000:0.0:1746066777.838563:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976499840 00000100:00100000:0.0:1746066777.838565:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976499840 00002000:00100000:0.0:1746066777.838575:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38d:0x0] (1204224->2097151) req@ffff88009ef5d180 x1830882976499840/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.838581:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5d180 with x1830882976499840 ext(1204224->2097151) 00002000:00010000:0.0:1746066777.838584:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef5d180 00000100:00100000:0.0:1746066777.838594:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6041 00000100:00100000:0.0:1746066777.838600:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882976499712:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066777.839325:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6042 00000100:00100000:0.0:1746066777.839332:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1966:x1830882976499840:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066777.848148:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.848183:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.848201:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976500096 00000100:00100000:0.0:1746066777.848207:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976500096 00000100:00100000:0.0:1746066777.848235:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976499968 00000100:00100000:0.0:1746066777.848236:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976499968 00000100:00100000:0.0:1746066777.849698:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13538 00000100:00100000:0.0:1746066777.849704:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882976499968:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066777.849711:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.849719:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a94200/0xfb36a14ee6088bc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ccfe expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066777.849750:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976676992:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066777.849782:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066777.851580:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1966:x1830882976499840:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12243us (13355us total) trans 0 rc 892928/892928 00000100:00100000:0.0:1746066777.851590:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6042 00002000:00100000:0.0:1746066777.851599:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1204224->2097151) req@ffff88009ef5d180 x1830882976499840/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:183/0 lens 488/440 e 0 to 0 dl 1746066788 ref 1 fl Complete:/200/0 rc 892928/892928 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.851607:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5d180 with x1830882976499840 ext(1204224->2097151) 00002000:00010000:0.0:1746066777.851612:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef5d180 00000100:00100000:0.0:1746066777.855071:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882976499712:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16471us (16892us total) trans 0 rc 1036288/1036288 00000100:00100000:0.0:1746066777.855079:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6041 00002000:00100000:0.0:1746066777.855086:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x38e:0x0] (0->1036287) req@ffff880135e58700 x1830882976499712/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:183/0 lens 488/440 e 0 to 0 dl 1746066788 ref 1 fl Complete:/200/0 rc 1036288/1036288 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.855093:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e58700 with x1830882976499712 ext(0->1036287) 00002000:00010000:0.0:1746066777.855104:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e58700 00000100:00100000:0.0:1746066777.860813:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.862082:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976500224 00000100:00100000:0.0:1746066777.862086:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976500224 00000100:00100000:0.0:1746066777.862125:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13540 00000100:00100000:0.0:1746066777.862130:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882976500224:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066777.862137:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.862146:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a94400/0xfb36a14ee6088bd5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cd0c expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066777.862168:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976677248:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066777.862215:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b180 going to sleep for 11 seconds 00000001:00080000:0.0:1746066777.862560:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873392 is committed 00000001:00080000:0.0:1746066777.862577:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873389 is committed 00000001:00080000:0.0:1746066777.862594:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873340 is committed 00000001:00080000:0.0:1746066777.862654:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873336 is committed 00000001:00080000:0.0:1746066777.862693:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873391 is committed 00000001:00080000:0.0:1746066777.862723:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873390 is committed 00000100:00100000:0.0:1746066777.873546:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.873586:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.873660:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.873702:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976500864 00000100:00100000:0.0:1746066777.873706:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976500864 00002000:00100000:0.0:1746066777.873730:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009ef5ea00 x1830882976500864/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:183/0 lens 488/0 e 0 to 0 dl 1746066788 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066777.873750:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5ea00 with x1830882976500864 ext(2097152->3145727) 00002000:00010000:0.0:1746066777.873755:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef5ea00 00000100:00100000:0.0:1746066777.873777:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6043 00000100:00100000:0.0:1746066777.873782:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882976500864:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066777.903639:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.909019:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.909052:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.909091:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.909125:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976501760 00000100:00100000:0.0:1746066777.909132:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976501760 00010000:00010000:0.0:1746066777.909160:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135969600/0xfb36a14ee6088b3b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccb8 expref: 14 pid: 14548 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746066777.909180:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976501888 00000100:00100000:0.0:1746066777.909182:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976501888 00010000:00010000:0.0:1746066777.909189:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a48a4a00/0xfb36a14ee6088ac4 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc4f expref: 10 pid: 14550 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746066777.909241:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976502016 00000100:00100000:0.0:1746066777.909243:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976502016 00010000:00010000:0.0:1746066777.909251:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef42800/0xfb36a14ee6088b7a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cccd expref: 261 pid: 14548 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746066777.909271:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6856 00000100:00100000:0.0:1746066777.909277:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:1965:x1830882976502016:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066777.909283:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066777.909286:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef42800/0xfb36a14ee6088b7a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cccd expref: 261 pid: 14548 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746066777.909302:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef42800/0xfb36a14ee6088b7a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cccd expref: 261 pid: 14548 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746066777.909376:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066777.909380:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066777.909408:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:1965:x1830882976502016:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 131us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.909414:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6856 00000100:00100000:0.0:1746066777.967504:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.970834:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.981920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.981963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066777.983988:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976502656 00000100:00100000:0.0:1746066777.983991:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976502656 00000100:00100000:0.0:1746066777.984016:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13545 00000100:00100000:0.0:1746066777.984021:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1966:x1830882976502656:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066777.984027:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.984033:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b190200/0xfb36a14ee6088c29 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cd44 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.984044:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.984045:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.984052:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b190200/0xfb36a14ee6088c29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cd44 expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.984066:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b190200/0xfb36a14ee6088c29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cd44 expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.984075:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b190200, rc 0) 00000100:00100000:0.0:1746066777.984113:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882976502656:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 92us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.984118:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13545 00000100:00100000:0.0:1746066777.984366:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976502784 00000100:00100000:0.0:1746066777.984370:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976502784 00000100:00100000:0.0:1746066777.984393:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13546 00000100:00100000:0.0:1746066777.984397:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1966:x1830882976502784:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066777.984404:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066777.984410:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b191400/0xfb36a14ee6088c30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cd4b expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066777.984439:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.984441:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066777.984445:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b191400/0xfb36a14ee6088c30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cd4b expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.984455:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b191400/0xfb36a14ee6088c30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cd4b expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066777.984462:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b191400, rc 0) 00000100:00100000:0.0:1746066777.984488:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882976502784:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 90us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066777.984493:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13546 00000100:00100000:0.0:1746066778.007006:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.008463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.014496:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.014857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.017029:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.026377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.026403:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.026434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.026448:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976504064 00000100:00100000:0.0:1746066778.026451:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976504064 00010000:00010000:0.0:1746066778.026467:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a94e00/0xfb36a14ee6088bb9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccf7 expref: 16 pid: 8452 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746066778.026844:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6863 00000100:00100000:0.0:1746066778.026850:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882976504576:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066778.026858:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066778.026862:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a02e600/0xfb36a14ee6088c4c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cd52 expref: 16 pid: 14550 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746066778.026871:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a02e600/0xfb36a14ee6088c4c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cd52 expref: 16 pid: 14550 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746066778.026884:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a02e600/0xfb36a14ee6088c4c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cd52 expref: 16 pid: 14550 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746066778.026900:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066778.026905:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee6088c61 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.026911:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee6088c61 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.026915:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee6088c61 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.026935:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066778.026952:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882976504576:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 103us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066778.026958:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6863 00000100:00100000:0.0:1746066778.029362:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.032468:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976505344 00000100:00100000:0.0:1746066778.032473:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976505344 00000100:00100000:0.0:1746066778.032501:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9747 00000100:00100000:0.0:1746066778.032506:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:31090:x1830882976505344:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066778.032519:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066778.032531:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b191200/0xfb36a14ee6088c84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cd75 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066778.032607:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190e00/0xfb36a14ee6088c8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032616:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190e00/0xfb36a14ee6088c8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032624:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190e00/0xfb36a14ee6088c8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032634:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190600/0xfb36a14ee6088c92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032639:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190600/0xfb36a14ee6088c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032644:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190600/0xfb36a14ee6088c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032761:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b191e00/0xfb36a14ee6088c99 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032768:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b191e00/0xfb36a14ee6088c99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032773:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b191e00/0xfb36a14ee6088c99 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746066778.032779:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066778.032839:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190e00/0xfb36a14ee6088c8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032844:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190e00/0xfb36a14ee6088c8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032849:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190e00/0xfb36a14ee6088c8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032853:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b190e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066778.032856:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190e00/0xfb36a14ee6088c8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032861:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190e00/0xfb36a14ee6088c8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032869:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066778.032871:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066778.032874:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190e00/0xfb36a14ee6088c8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032878:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190e00/0xfb36a14ee6088c8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032893:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190600/0xfb36a14ee6088c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032898:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190600/0xfb36a14ee6088c92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032902:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190600/0xfb36a14ee6088c92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032905:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b190600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066778.032907:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190600/0xfb36a14ee6088c92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032911:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190600/0xfb36a14ee6088c92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032917:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b74800) 00010000:00010000:0.0:1746066778.032919:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066778.032921:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190600/0xfb36a14ee6088c92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.032925:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b190600/0xfb36a14ee6088c92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066778.034964:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b191200/0xfb36a14ee6088c84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cd75 expref: 19 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066778.034974:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b191e00/0xfb36a14ee6088c99 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cd75 expref: 18 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066778.034979:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066778.034989:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066778.034991:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b191e00, rc 0) 00000100:00100000:0.0:1746066778.035020:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:31090:x1830882976505344:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2514us (2626us total) trans 8589943742 rc 0/0 00000100:00100000:0.0:1746066778.035025:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9747 00000100:00100000:0.0:1746066778.035773:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976505472 00000100:00100000:0.0:1746066778.035777:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976505472 00000100:00100000:0.0:1746066778.035800:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13548 00000100:00100000:0.0:1746066778.035805:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:31083:x1830882976505472:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066778.035816:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066778.035826:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b191600/0xfb36a14ee6088cb5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cd7c expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066778.035844:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b818800/0xfb36a14ee6088b18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccaa expref: 21 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066778.035851:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b190200/0xfb36a14ee6088c29 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cd44 expref: 6 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066778.035856:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135969000/0xfb36a14ee6088b5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccc6 expref: 8 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066778.035861:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee6088afc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3416064->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc8e expref: 8 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066778.035867:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066778.035868:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066778.035875:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b191600/0xfb36a14ee6088cb5 lrc: 7/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->5005311] (req 4194304->5005311) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cd7c expref: 21 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066778.035898:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee6088afc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3416064->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc8e expref: 8 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066778.035907:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee6088afc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3416064->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc8e expref: 8 pid: 8452 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746066778.035916:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976679424:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066778.035969:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135969000/0xfb36a14ee6088b5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccc6 expref: 8 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066778.035976:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135969000/0xfb36a14ee6088b5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccc6 expref: 8 pid: 9776 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746066778.035983:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976679552:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066778.036002:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b190200/0xfb36a14ee6088c29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cd44 expref: 6 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066778.036009:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b190200/0xfb36a14ee6088c29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cd44 expref: 6 pid: 10402 timeout: 839 lvb_type: 1 00000100:00100000:0.0:1746066778.036015:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976679680:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066778.036031:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b818800/0xfb36a14ee6088b18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccaa expref: 21 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066778.036047:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b818800/0xfb36a14ee6088b18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccaa expref: 21 pid: 10402 timeout: 839 lvb_type: 0 00000100:00100000:0.0:1746066778.036107:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976679808:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066778.036126:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066778.039188:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976679424:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066778.039196:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976679552:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066778.039203:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976679680:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066778.041423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.041516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.041547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.044319:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.044353:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.051831:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.056563:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976507136 00000100:00100000:0.0:1746066778.056570:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976507136 00002000:00100000:0.0:1746066778.056601:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x38e:0x0] (1036288->1048575) req@ffff88008c395500 x1830882976507136/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:184/0 lens 12776/0 e 0 to 0 dl 1746066789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066778.056610:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395500 with x1830882976507136 ext(1036288->1048575) 00010000:00010000:0.0:1746066778.056617:0:31365:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e892400/0xfb36a14ee6088b88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccd4 expref: 20 pid: 9776 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746066778.056628:0:31365:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e892400/0xfb36a14ee6088b88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccd4 expref: 20 pid: 9776 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746066778.056640:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c395500 00000100:00100000:0.0:1746066778.056664:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1988 00000100:00100000:0.0:1746066778.056670:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1966:x1830882976507136:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066778.057086:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882976507136:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 415us (576us total) trans 17179873393 rc 0/0 00000100:00100000:0.0:1746066778.057092:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1988 00002000:00100000:0.0:1746066778.057097:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x38e:0x0] (1036288->1048575) req@ffff88008c395500 x1830882976507136/t17179873393(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:184/0 lens 12776/448 e 0 to 0 dl 1746066789 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066778.057104:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395500 with x1830882976507136 ext(1036288->1048575) 00010000:00010000:0.0:1746066778.057108:0:31365:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e892400/0xfb36a14ee6088b88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccd4 expref: 22 pid: 9776 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746066778.057116:0:31365:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e892400/0xfb36a14ee6088b88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1036288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ccd4 expref: 22 pid: 9776 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746066778.057121:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c395500 00000100:00100000:0.0:1746066778.058296:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.062202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.069197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.102289:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.106935:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.108764:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.112116:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.112927:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.115415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.119254:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.123659:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.128128:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976510080 00000100:00100000:0.0:1746066778.128135:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976510080 00002000:00100000:0.0:1746066778.128166:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88008c394380 x1830882976510080/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:184/0 lens 488/0 e 0 to 0 dl 1746066789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066778.128178:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394380 with x1830882976510080 ext(1048576->2097151) 00002000:00010000:0.0:1746066778.128182:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c394380 00000100:00100000:0.0:1746066778.128195:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6050 00000100:00100000:0.0:1746066778.128200:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+9:1963:x1830882976510080:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066778.135875:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.135903:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.151922:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.152669:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.153240:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.170117:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.172843:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.173983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.174882:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.175667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.179186:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.183188:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.188063:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.190268:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.197915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.197956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.201652:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.216884:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.216936:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.221267:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.251229:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.289303:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.295062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.295540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.308542:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.312630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.315319:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.319407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.324416:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.349844:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.449176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.460569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.471779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.477222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.486425:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976517760 00000100:00100000:0.0:1746066778.486432:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976517760 00000100:00100000:0.0:1746066778.488434:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4011 00000100:00100000:0.0:1746066778.488442:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:31108:x1830882976517760:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:0.0:1746066778.488598:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:31108:x1830882976517760:12345-192.168.202.57@tcp:35:cat.0 Request processed in 157us (2549us total) trans 8589943753 rc 0/0 00000100:00100000:0.0:1746066778.488604:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4011 00000100:00100000:0.0:1746066778.497131:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.500024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.502727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.502782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.507612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.507713:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.511810:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.522603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.522642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.523475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.540486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.544434:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882976519680:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18229us (21787us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066778.544442:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6067 00002000:00100000:0.0:1746066778.544450:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3583999) req@ffff88009b470000 x1830882976519680/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:184/0 lens 504/440 e 0 to 0 dl 1746066789 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066778.544458:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470000 with x1830882976519680 ext(2097152->3583999) 00010000:00010000:0.0:1746066778.544466:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092bccc00/0xfb36a14ee6088d9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ce01 expref: 14 pid: 21203 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746066778.544476:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092bccc00/0xfb36a14ee6088d9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ce01 expref: 14 pid: 21203 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746066778.544482:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b470000 00000100:00100000:0.0:1746066778.550022:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.550093:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.557229:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.567257:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.567883:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.570137:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.570178:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.580419:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.585857:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.588146:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.589378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.589423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.589454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.589518:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976522368 00000100:00100000:0.0:1746066778.589521:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976522368 00002000:00100000:0.0:1746066778.589536:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e86a300 x1830882976522368/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:184/0 lens 488/0 e 0 to 0 dl 1746066789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066778.589543:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e86a300 with x1830882976522368 ext(3145728->4194303) 00002000:00010000:0.0:1746066778.589546:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e86a300 00000100:00100000:0.0:1746066778.589557:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 1997 00000100:00100000:0.0:1746066778.589562:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882976522112:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066778.596998:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.597014:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.597030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.600898:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882976522112:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11326us (11511us total) trans 0 rc 552960/552960 00000100:00100000:0.0:1746066778.600908:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 1997 00002000:00100000:0.0:1746066778.600918:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3641344->4194303) req@ffff88009e868a80 x1830882976522112/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:184/0 lens 488/440 e 0 to 0 dl 1746066789 ref 1 fl Complete:H/200/0 rc 552960/552960 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066778.600928:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e868a80 with x1830882976522112 ext(3641344->4194303) 00010000:00010000:0.0:1746066778.600936:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931e6400/0xfb36a14ee6088dfe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3641343) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ce2b expref: 13 pid: 9776 timeout: 839 lvb_type: 0 00010000:00010000:0.0:1746066778.600957:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931e6400/0xfb36a14ee6088dfe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3641343) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ce2b expref: 13 pid: 9776 timeout: 839 lvb_type: 0 00002000:00010000:0.0:1746066778.600963:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e868a80 00000100:00100000:0.0:1746066778.604782:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.607517:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.611160:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976684416:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066778.611171:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976684544:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066778.611188:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066778.611228:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882976523776:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3521us (3714us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066778.611237:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6884 00000100:00100000:0.0:1746066778.613160:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.614797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.614828:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.634164:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.635000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.635989:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.640820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.644136:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.646870:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.646912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.647756:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.651502:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.658499:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.659413:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882976526080:12345-192.168.202.57@tcp:3:cat.0 Request processed in 7779us (7918us total) trans 0 rc 892928/892928 00000100:00100000:0.0:1746066778.659418:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6077 00002000:00100000:0.0:1746066778.659422:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4198400->5091327) req@ffff88009ed0ad80 x1830882976526080/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:184/0 lens 488/440 e 0 to 0 dl 1746066789 ref 1 fl Complete:/200/0 rc 892928/892928 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066778.659428:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed0ad80 with x1830882976526080 ext(4198400->5091327) 00002000:00010000:0.0:1746066778.659430:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed0ad80 00000100:00100000:0.0:1746066778.664899:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.664926:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.664959:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.670272:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.672994:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976526976 00000100:00100000:0.0:1746066778.672999:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976526976 00000100:00100000:0.0:1746066778.673024:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13580 00000100:00100000:0.0:1746066778.673030:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+13:1966:x1830882976526976:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066778.673041:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066778.673053:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b47a00/0xfb36a14ee6088e59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ce86 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066778.673092:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976685312:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066778.673148:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066778.759942:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.765161:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.769176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.774547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.776582:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.776644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.776688:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.785817:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.799532:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.803281:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.803329:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.807910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.812006:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.832661:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.833736:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.833775:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.838293:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.846170:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.849577:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.854927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.862742:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.869881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.874043:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976532096 00000100:00100000:0.0:1746066778.874050:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976532096 00002000:00100000:0.0:1746066778.874081:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009f16ca80 x1830882976532096/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:184/0 lens 488/0 e 0 to 0 dl 1746066789 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066778.874089:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16ca80 with x1830882976532096 ext(1048576->2097151) 00002000:00010000:0.0:1746066778.874094:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16ca80 00000100:00100000:0.0:1746066778.874122:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6081 00000100:00100000:0.0:1746066778.874128:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882976532096:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066778.891511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.896166:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.896852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.902714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.905000:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.908191:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 673 00000100:00100000:0.0:1746066778.908199:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+273:1963:x1830882976533248:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066778.908211:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066778.908234:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3c00/0xfb36a14ee6088f5c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cf04 expref: 273 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066778.908255:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066778.908259:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066778.908298:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+272:1963:x1830882976533248:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 100us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066778.908304:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 673 00000100:00100000:0.0:1746066778.920766:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.921475:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.936672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.942083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.943457:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.946826:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.946877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.951837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.957614:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.957662:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.960425:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.960441:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976535936 00000100:00100000:0.0:1746066778.960444:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976535936 00000100:00100000:0.0:1746066778.960472:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13598 00000100:00100000:0.0:1746066778.960477:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882976535936:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066778.960488:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066778.960499:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009025c800/0xfb36a14ee6088f94 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cf35 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066778.960519:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009025c800/0xfb36a14ee6088f94 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cf35 expref: 16 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066778.960527:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009025c800/0xfb36a14ee6088f94 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cf35 expref: 16 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066778.960537:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025c800, rc 0) 00000100:00100000:0.0:1746066778.960562:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882976535936:12345-192.168.202.57@tcp:101:cat.0 Request processed in 85us (140us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066778.960567:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13598 00000100:00100000:0.0:1746066778.961818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.962450:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.962464:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976536192 00000100:00100000:0.0:1746066778.962467:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976536192 00010000:00010000:0.0:1746066778.962477:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb9e800/0xfb36a14ee6088df7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ce24 expref: 21 pid: 21203 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746066778.964714:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.969939:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.975789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.982301:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.983370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.987279:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066778.989471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.011103:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066779.012547:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066779.113489:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066779.113656:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066779.124257:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976539392 00000100:00100000:0.0:1746066779.124261:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976539392 00010000:00010000:0.0:1746066779.124374:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800925a3400/0xfb36a14ee6088f86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cf27 expref: 31 pid: 4614 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746066779.124389:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6901 00000100:00100000:0.0:1746066779.124395:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882976539392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066779.124401:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066779.124409:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800925a3400/0xfb36a14ee6088f86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cf27 expref: 31 pid: 4614 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746066779.124416:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800925a3400/0xfb36a14ee6088f86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cf27 expref: 31 pid: 4614 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746066779.124426:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800925a3400/0xfb36a14ee6088f86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cf27 expref: 31 pid: 4614 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746066779.124438:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066779.124440:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066779.124445:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800925a2200/0xfb36a14ee6088fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3796992->4198399] (req 3796992->4173823) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cf51 expref: 17 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.124464:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925a2200/0xfb36a14ee6088fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3796992->4198399] (req 3796992->4173823) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cf51 expref: 17 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.124784:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800925a2200/0xfb36a14ee6088fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3796992->4198399] (req 3796992->4173823) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cf51 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066779.124794:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976688640:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066779.125118:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066779.134179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.143290:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.143339:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.143372:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976540160 00000100:00100000:0.0:1746066779.143380:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976540160 00002000:00100000:0.0:1746066779.143414:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4169728->4173823) req@ffff88009f618a80 x1830882976540160/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:185/0 lens 488/0 e 0 to 0 dl 1746066790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066779.143422:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f618a80 with x1830882976540160 ext(4169728->4173823) 00002000:00010000:0.0:1746066779.143427:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f618a80 00000100:00100000:0.0:1746066779.143455:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6094 00000100:00100000:0.0:1746066779.143461:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882976540160:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066779.143583:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882976540160:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 122us (244us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066779.143589:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6094 00002000:00100000:0.0:1746066779.143593:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4169728->4173823) req@ffff88009f618a80 x1830882976540160/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:185/0 lens 488/4536 e 0 to 0 dl 1746066790 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066779.143611:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f618a80 with x1830882976540160 ext(4169728->4173823) 00002000:00010000:0.0:1746066779.143613:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f618a80 00000100:00080000:0.0:1746066779.148012:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066779.148069:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.148465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.150659:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.150720:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.153443:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.164280:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.170574:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.172780:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.186385:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.205861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.209039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.213810:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.216866:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.226283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.238765:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.240505:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.256084:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.261008:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.265814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.265886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.265908:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976543488 00000100:00100000:0.0:1746066779.265914:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976543488 00000100:00100000:0.0:1746066779.265946:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976543616 00000100:00100000:0.0:1746066779.265947:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976543616 00000100:00100000:0.0:1746066779.265986:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13611 00000100:00100000:0.0:1746066779.265993:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:31139:x1830882976543488:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066779.266007:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066779.266020:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f319200/0xfb36a14ee6089035 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cf9e expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.266040:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066779.266045:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800925a3c00/0xfb36a14ee608902e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3698688->4120575] (req 3698688->4120575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cf97 expref: 33 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.266050:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066779.266053:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f319200/0xfb36a14ee6089035 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cf9e expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.266085:0:4614:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800925a3c00/0xfb36a14ee608902e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3698688->4120575] (req 3698688->4120575) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cf97 expref: 33 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.266095:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f319200/0xfb36a14ee6089035 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cf9e expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.266103:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f319200, rc 0) 00000100:00100000:0.0:1746066779.266133:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:31139:x1830882976543488:12345-192.168.202.57@tcp:101:cat.0 Request processed in 141us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066779.266139:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13611 00000100:00100000:0.0:1746066779.266152:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13612 00000100:00100000:0.0:1746066779.266157:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800992ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:31140:x1830882976543616:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066779.266163:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066779.266172:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f318600/0xfb36a14ee608903c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cfa5 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.266183:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066779.266186:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f318600/0xfb36a14ee608903c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfa5 expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.266192:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f318600/0xfb36a14ee608903c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfa5 expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.266198:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f318600, rc 0) 00000100:00100000:0.0:1746066779.266211:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800992ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:31140:x1830882976543616:12345-192.168.202.57@tcp:101:cat.0 Request processed in 54us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066779.266216:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13612 00000100:00100000:0.0:1746066779.279105:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.284616:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.291501:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.296956:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.297034:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.314042:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.321101:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.321130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.330522:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.330562:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.344762:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.349356:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.426276:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.428463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066779.428878:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066779.434627:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.440672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066779.442059:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066779.447950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.447986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.448022:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066779.448370:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746066779.448373:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066779.449794:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.464444:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.472845:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.478666:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.490823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.492139:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976548608 00000100:00100000:0.0:1746066779.492145:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976548608 00000100:00100000:0.0:1746066779.493967:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9769 00000100:00100000:0.0:1746066779.493990:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+278:31154:x1830882976548608:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066779.494020:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066779.494051:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009025d200/0xfb36a14ee60890c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cfe4 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.494202:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ca00/0xfb36a14ee60890cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.494214:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ca00/0xfb36a14ee60890cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.494247:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ca00/0xfb36a14ee60890cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.494288:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ce00/0xfb36a14ee60890d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.494321:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ce00/0xfb36a14ee60890d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.494328:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ce00/0xfb36a14ee60890d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.494576:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee60890dd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.494600:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee60890dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.494621:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee60890dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:0.0:1746066779.494650:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066779.494786:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ca00/0xfb36a14ee60890cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.494793:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ca00/0xfb36a14ee60890cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.494798:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ca00/0xfb36a14ee60890cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.494802:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009025ca00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066779.494805:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ca00/0xfb36a14ee60890cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.494810:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ca00/0xfb36a14ee60890cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.494826:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066779.494828:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066779.494832:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ca00/0xfb36a14ee60890cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.494836:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ca00/0xfb36a14ee60890cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.496742:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ce00/0xfb36a14ee60890d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.496772:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ce00/0xfb36a14ee60890d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.496778:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ce00/0xfb36a14ee60890d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.496782:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009025ce00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066779.496784:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ce00/0xfb36a14ee60890d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.496805:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ce00/0xfb36a14ee60890d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.496818:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800921a4700) 00010000:00010000:0.0:1746066779.496820:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066779.496839:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ce00/0xfb36a14ee60890d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.496845:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009025ce00/0xfb36a14ee60890d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.496952:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009025d200/0xfb36a14ee60890c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfe4 expref: 281 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.497067:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee60890dd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfe4 expref: 280 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.497096:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066779.497099:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066779.497124:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025c600, rc 0) 00000100:00100000:0.0:1746066779.497336:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+280:31154:x1830882976548608:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3348us (6345us total) trans 8589943774 rc 0/0 00000100:00100000:0.0:1746066779.497343:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9769 00000100:00100000:0.0:1746066779.499784:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.500313:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.509068:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.509374:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.509404:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.509885:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6910 00000100:00100000:0.0:1746066779.509890:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a530fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882976549632:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066779.509895:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066779.510689:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f318600/0xfb36a14ee608903c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfa5 expref: 18 pid: 4614 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746066779.510698:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f318600/0xfb36a14ee608903c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfa5 expref: 18 pid: 4614 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746066779.510709:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f318600/0xfb36a14ee608903c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfa5 expref: 18 pid: 4614 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746066779.510748:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066779.510749:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066779.510755:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba5600/0xfb36a14ee60890eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3878912->4198399] (req 3878912->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfeb expref: 33 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.510762:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba5600/0xfb36a14ee60890eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3878912->4198399] (req 3878912->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfeb expref: 33 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066779.521971:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976549760 00000100:00100000:0.0:1746066779.521979:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976549760 00000100:00100000:0.0:1746066779.522027:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13617 00000100:00100000:0.0:1746066779.522034:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:31154:x1830882976549888:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066779.522049:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066779.522063:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee60890f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97cff9 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.522085:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba5600/0xfb36a14ee60890eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3878912->4198399] (req 3878912->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfeb expref: 35 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.522092:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066779.522094:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066779.522097:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee60890f2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cff9 expref: 35 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.522120:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba5600/0xfb36a14ee60890eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3878912->4198399] (req 3878912->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfeb expref: 35 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066779.522139:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba5600/0xfb36a14ee60890eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3878912->4198399] (req 3878912->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfeb expref: 35 pid: 10402 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746066779.522145:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f618380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976690816:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066779.522207:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066779.522623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.528186:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.528207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.528671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.528728:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.532743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.535047:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.536661:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.538192:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.543933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.545326:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.545490:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.563514:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.563564:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.567338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.570692:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976552448 00000100:00100000:0.0:1746066779.570699:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976552448 00002000:00100000:0.0:1746066779.570743:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3387391) req@ffff88009e86b100 x1830882976552448/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:185/0 lens 488/0 e 0 to 0 dl 1746066790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066779.570752:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e86b100 with x1830882976552448 ext(3145728->3387391) 00010000:00010000:0.0:1746066779.570767:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009391e800/0xfb36a14ee60890f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->3805183] (req 3145728->3387391) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cff2 expref: 23 pid: 10402 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746066779.570777:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009391e800/0xfb36a14ee60890f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->3805183] (req 3145728->3387391) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cff2 expref: 23 pid: 10402 timeout: 840 lvb_type: 0 00002000:00010000:0.0:1746066779.570784:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e86b100 00000100:00100000:0.0:1746066779.570812:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2013 00000100:00100000:0.0:1746066779.570819:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882976552448:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066779.581857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.581895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.581940:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.586165:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066779.586284:0:10402:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.57@tcp) returned -22 from glimpse AST (req@ffff88009e841f80 x1830882976692480) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009e893800/0xfb36a14ee6089100 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3805184->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d000 expref: 15 pid: 9776 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746066779.586311:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e893800/0xfb36a14ee6089100 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3805184->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d000 expref: 15 pid: 9776 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746066779.586328:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976692480:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066779.586355:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ed35600/0xfb36a14ee608911c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d01c expref: 14 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066779.586364:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ed35600/0xfb36a14ee608911c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d01c expref: 14 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066779.586381:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed35600, rc 0) 00000100:00100000:0.0:1746066779.586539:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882976553088:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4440us (4690us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066779.586546:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13622 00000100:00100000:0.0:1746066779.596055:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.604307:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.609667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.612001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.627429:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.631414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.632642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.638831:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.638856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.638889:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976555008 00000100:00100000:0.0:1746066779.638895:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976555008 00002000:00100000:0.0:1746066779.638931:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009e93c380 x1830882976555008/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:185/0 lens 488/0 e 0 to 0 dl 1746066790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066779.638940:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93c380 with x1830882976555008 ext(3145728->4194303) 00002000:00010000:0.0:1746066779.638945:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93c380 00000100:00100000:0.0:1746066779.638967:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976555136 00000100:00100000:0.0:1746066779.638970:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976555136 00002000:00100000:0.0:1746066779.638983:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e93fb80 x1830882976555136/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:185/0 lens 488/0 e 0 to 0 dl 1746066790 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066779.638989:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93fb80 with x1830882976555136 ext(3145728->4194303) 00002000:00010000:0.0:1746066779.638992:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93fb80 00000100:00100000:0.0:1746066779.639007:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6111 00000100:00100000:0.0:1746066779.639011:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882976555136:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066779.651881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.660958:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.661774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.667466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.671206:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.673809:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.674472:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976556416 00000100:00100000:0.0:1746066779.674475:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976556416 00010000:00010000:0.0:1746066779.674488:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a94800/0xfb36a14ee60890b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfd6 expref: 16 pid: 14548 timeout: 840 lvb_type: 0 00000100:00100000:0.0:1746066779.674511:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6921 00000100:00100000:0.0:1746066779.674516:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1966:x1830882976556416:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066779.674522:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066779.674526:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a94800/0xfb36a14ee60890b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfd6 expref: 16 pid: 14548 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746066779.674533:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a94800/0xfb36a14ee60890b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfd6 expref: 16 pid: 14548 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746066779.674545:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a94800/0xfb36a14ee60890b3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cfd6 expref: 16 pid: 14548 timeout: 840 lvb_type: 0 00010000:00010000:0.0:1746066779.674564:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066779.674567:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a536b400/0xfb36a14ee608914d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.674582:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a536b400/0xfb36a14ee608914d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.674589:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a536b400/0xfb36a14ee608914d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066779.674602:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066779.674621:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1966:x1830882976556416:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 105us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066779.674626:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6921 00000100:00100000:0.0:1746066779.727515:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.729072:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976556928 00000100:00100000:0.0:1746066779.729075:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976556928 00010000:00010000:0.0:1746066779.729088:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e892600/0xfb36a14ee6088a8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc2c expref: 7 pid: 8450 timeout: 840 lvb_type: 1 00000100:00100000:0.0:1746066779.729102:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6923 00000100:00100000:0.0:1746066779.729106:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976556928:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066779.729112:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066779.729120:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e892600/0xfb36a14ee6088a8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc2c expref: 7 pid: 8450 timeout: 840 lvb_type: 1 00010000:00010000:0.0:1746066779.729127:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e892600/0xfb36a14ee6088a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc2c expref: 7 pid: 8450 timeout: 840 lvb_type: 1 00010000:00010000:0.0:1746066779.729138:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e892600/0xfb36a14ee6088a8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97cc2c expref: 7 pid: 8450 timeout: 840 lvb_type: 1 00010000:00010000:0.0:1746066779.730007:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066779.730022:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882976556928:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 915us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066779.730027:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6923 00000100:00100000:0.0:1746066779.731329:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.737180:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.737482:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6115 00000100:00100000:0.0:1746066779.737491:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882976557696:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066779.737667:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882976557696:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 177us (493us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066779.737700:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6115 00002000:00100000:0.0:1746066779.737705:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1728512->1732607) req@ffff88009e93dc00 x1830882976557696/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:185/0 lens 488/4536 e 0 to 0 dl 1746066790 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066779.737712:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93dc00 with x1830882976557696 ext(1728512->1732607) 00002000:00010000:0.0:1746066779.737750:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93dc00 00000100:00100000:0.0:1746066779.769549:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.781389:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.781436:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.789515:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.796525:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.796556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.796583:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.798400:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.802783:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.802844:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.808932:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.819116:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.838603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.845857:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.846852:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.847226:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6118 00000100:00100000:0.0:1746066779.847234:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882976560384:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066779.874567:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.894274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.898612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.904889:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.908866:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.908913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.912912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.924779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.924818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.931743:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1966:x1830882976562048:12345-192.168.202.57@tcp:3:cat.0 Request processed in 6656us (6935us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066779.931753:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6122 00002000:00100000:0.0:1746066779.931763:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800a45e4700 x1830882976562048/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:185/0 lens 488/440 e 0 to 0 dl 1746066790 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066779.931771:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e4700 with x1830882976562048 ext(1048576->2097151) 00002000:00010000:0.0:1746066779.931776:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a45e4700 00000100:00100000:0.0:1746066779.935780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.938986:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.947191:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.954455:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.978673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.982754:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066779.991610:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.001239:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.001275:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.001313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.001477:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6126 00000100:00100000:0.0:1746066780.001486:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882976563968:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066780.005816:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.015639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.016084:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6935 00000100:00100000:0.0:1746066780.016092:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+14:1966:x1830882976564224:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066780.016105:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066780.016124:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13800/0xfb36a14ee6089123 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d023 expref: 14 pid: 10402 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746066780.016134:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13800/0xfb36a14ee6089123 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d023 expref: 14 pid: 10402 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746066780.016152:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13800/0xfb36a14ee6089123 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d023 expref: 14 pid: 10402 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746066780.016170:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066780.016200:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+13:1966:x1830882976564224:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 110us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.016212:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6935 00000100:00100000:0.0:1746066780.016474:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882976563968:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14992us (15160us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066780.016482:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6126 00002000:00100000:0.0:1746066780.016489:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ed72a00 x1830882976563968/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:186/0 lens 488/440 e 0 to 0 dl 1746066791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066780.016497:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed72a00 with x1830882976563968 ext(2097152->3145727) 00010000:00010000:0.0:1746066780.016502:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ba4200/0xfb36a14ee608910e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d00e expref: 27 pid: 10402 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746066780.016511:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ba4200/0xfb36a14ee608910e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d00e expref: 27 pid: 10402 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746066780.016517:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed72a00 00000100:00100000:0.0:1746066780.021079:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.023759:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.028912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.033615:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.057630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.059994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.060025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.060052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.060088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.063379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.063826:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.064032:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.070579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.074484:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976566656 00000100:00100000:0.0:1746066780.074491:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976566656 00002000:00100000:0.0:1746066780.074525:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8801361f9180 x1830882976566656/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:186/0 lens 488/0 e 0 to 0 dl 1746066791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066780.074534:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f9180 with x1830882976566656 ext(3145728->4194303) 00002000:00010000:0.0:1746066780.074539:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361f9180 00000100:00100000:0.0:1746066780.074552:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976566528 00000100:00100000:0.0:1746066780.074555:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976566528 00002000:00100000:0.0:1746066780.074565:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8801361fad80 x1830882976566528/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:186/0 lens 488/0 e 0 to 0 dl 1746066791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066780.074571:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fad80 with x1830882976566528 ext(2097152->3145727) 00002000:00010000:0.0:1746066780.074573:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361fad80 00000100:00100000:0.0:1746066780.074895:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6128 00000100:00100000:0.0:1746066780.074903:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882976566656:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066780.076058:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.083067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.099661:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.099753:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.102817:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976567936 00000100:00100000:0.0:1746066780.102821:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976567936 00000100:00100000:0.0:1746066780.102859:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13650 00000100:00100000:0.0:1746066780.102865:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882976567936:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066780.102875:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066780.102888:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009290d400/0xfb36a14ee6089203 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d0e7 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066780.102930:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8690380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976697344:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066780.102982:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066780.120299:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.139823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.147474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.153456:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.153839:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.219167:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.228560:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.229020:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.234490:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976569984 00000100:00100000:0.0:1746066780.234496:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976569984 00002000:00100000:0.0:1746066780.234527:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2838528->2842623) req@ffff88009f618700 x1830882976569984/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:186/0 lens 488/0 e 0 to 0 dl 1746066791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066780.234536:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f618700 with x1830882976569984 ext(2838528->2842623) 00002000:00010000:0.0:1746066780.234539:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f618700 00000100:00100000:0.0:1746066780.234566:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6138 00000100:00100000:0.0:1746066780.234572:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+14:1965:x1830882976569984:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066780.234710:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+14:1965:x1830882976569984:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 138us (392us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066780.234731:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6138 00002000:00100000:0.0:1746066780.234736:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2838528->2842623) req@ffff88009f618700 x1830882976569984/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:186/0 lens 488/4536 e 0 to 0 dl 1746066791 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066780.234754:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f618700 with x1830882976569984 ext(2838528->2842623) 00002000:00010000:0.0:1746066780.234757:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f618700 00000100:00100000:0.0:1746066780.245366:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.269648:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.275896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.281956:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.281987:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.282022:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.287641:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.295845:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.300619:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.309557:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.319273:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.346584:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.346622:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.415410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.417122:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.442102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.459392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.462821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.474242:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.476138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.484721:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976573824 00000100:00100000:0.0:1746066780.484729:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976573824 00002000:00100000:0.0:1746066780.484760:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009270b800 x1830882976573824/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:186/0 lens 488/0 e 0 to 0 dl 1746066791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066780.484780:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009270b800 with x1830882976573824 ext(2097152->3145727) 00010000:00010000:0.0:1746066780.484784:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13400/0xfb36a14ee6089250 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d134 expref: 19 pid: 21203 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746066780.484792:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13400/0xfb36a14ee6089250 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d134 expref: 19 pid: 21203 timeout: 841 lvb_type: 0 00002000:00010000:0.0:1746066780.484797:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009270b800 00000100:00100000:0.0:1746066780.484812:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2023 00000100:00100000:0.0:1746066780.484827:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882976573824:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066780.496997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.506545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.506607:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.506632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.506648:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976574848 00000100:00100000:0.0:1746066780.506651:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976574848 00010000:00010000:0.0:1746066780.506667:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb9e400/0xfb36a14ee6089138 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d038 expref: 27 pid: 8112 timeout: 841 lvb_type: 0 00000100:00100000:0.0:1746066780.506707:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6947 00000100:00100000:0.0:1746066780.506725:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882976574848:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066780.506733:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066780.506749:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb9e400/0xfb36a14ee6089138 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d038 expref: 27 pid: 8112 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746066780.506768:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb9e400/0xfb36a14ee6089138 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d038 expref: 27 pid: 8112 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746066780.506783:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb9e400/0xfb36a14ee6089138 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d038 expref: 27 pid: 8112 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746066780.506801:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066780.506818:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+26:1965:x1830882976574848:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 106us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.506822:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6947 00000100:00100000:0.0:1746066780.508899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.510559:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.512982:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976700032:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066780.513002:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d99bc00/0xfb36a14ee608927a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->4599807] (req 4194304->4599807) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d15e expref: 34 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.513010:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d99bc00, rc 0) 00000100:00100000:0.0:1746066780.513039:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:31205:x1830882976575616:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2769us (3118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.513045:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13667 00000100:00100000:0.0:1746066780.514725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.515858:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.515993:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.521725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.521758:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.523180:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.523898:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976577024 00000100:00100000:0.0:1746066780.523904:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976577024 00002000:00100000:0.0:1746066780.523928:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880093211880 x1830882976577024/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:186/0 lens 488/0 e 0 to 0 dl 1746066791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066780.523935:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093211880 with x1830882976577024 ext(2097152->3145727) 00002000:00010000:0.0:1746066780.523939:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093211880 00000100:00100000:0.0:1746066780.523959:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6149 00000100:00100000:0.0:1746066780.523964:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882976577024:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066780.537204:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.541413:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.541839:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.544941:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.544982:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.547721:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.549656:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.553826:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.555955:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.565878:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.566444:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.573670:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.579985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.584767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.586919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.599374:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976579712 00000100:00100000:0.0:1746066780.599378:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976579712 00010000:00010000:0.0:1746066780.599393:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d99aa00/0xfb36a14ee6089281 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d165 expref: 22 pid: 21203 timeout: 841 lvb_type: 0 00000100:00100000:0.0:1746066780.599427:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6956 00000100:00100000:0.0:1746066780.599432:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976579712:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066780.599439:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066780.599454:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d99aa00/0xfb36a14ee6089281 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d165 expref: 22 pid: 21203 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746066780.599464:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d99aa00/0xfb36a14ee6089281 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4009983) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d165 expref: 22 pid: 21203 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746066780.599480:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.599481:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.599487:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f54c800/0xfb36a14ee608929d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d181 expref: 31 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.599493:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f54c800/0xfb36a14ee608929d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d181 expref: 31 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.599509:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f54c800/0xfb36a14ee608929d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d181 expref: 31 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066780.599515:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976702080:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066780.599536:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066780.611220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.622546:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.626578:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.731124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.732141:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.736179:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.736213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.736241:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976580736 00000100:00100000:0.0:1746066780.736245:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976580736 00010000:00010000:0.0:1746066780.736271:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5487c00/0xfb36a14ee608923b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d11f expref: 34 pid: 20532 timeout: 841 lvb_type: 0 00000100:00100000:0.0:1746066780.736288:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976580864 00000100:00100000:0.0:1746066780.736289:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976580864 00010000:00010000:0.0:1746066780.736296:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d99a400/0xfb36a14ee6089242 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d126 expref: 20 pid: 20532 timeout: 841 lvb_type: 1 00000100:00100000:0.0:1746066780.736318:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6957 00000100:00100000:0.0:1746066780.736323:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882976580736:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066780.736333:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066780.736350:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5487c00/0xfb36a14ee608923b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d11f expref: 34 pid: 20532 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746066780.736357:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5487c00/0xfb36a14ee608923b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d11f expref: 34 pid: 20532 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746066780.736375:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5487c00/0xfb36a14ee608923b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d11f expref: 34 pid: 20532 timeout: 841 lvb_type: 0 00010000:00010000:0.0:1746066780.736389:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066780.736416:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882976580736:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.736429:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6957 00000100:00100000:0.0:1746066780.736441:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6958 00000100:00100000:0.0:1746066780.736445:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882976580864:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066780.736450:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066780.736456:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d99a400/0xfb36a14ee6089242 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d126 expref: 20 pid: 20532 timeout: 841 lvb_type: 1 00010000:00010000:0.0:1746066780.736463:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d99a400/0xfb36a14ee6089242 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d126 expref: 20 pid: 20532 timeout: 841 lvb_type: 1 00010000:00010000:0.0:1746066780.736472:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.736474:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.736478:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5d1a00/0xfb36a14ee60892b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1110016->1851391) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d19d expref: 32 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.736484:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5d1a00/0xfb36a14ee60892b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1110016->1851391) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d19d expref: 32 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.736506:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5d1a00/0xfb36a14ee60892b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1110016->1851391) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d19d expref: 32 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066780.736514:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976702464:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066780.736562:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066780.744599:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.745511:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.751524:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.751905:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.757916:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.757953:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.757978:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.758000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.763123:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976703104:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066780.763139:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066780.763170:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1966:x1830882976582272:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4379us (5169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.763178:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6961 00000100:00100000:0.0:1746066780.783866:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.791417:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.810914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.810951:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.810981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.811020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.811035:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976583680 00000100:00100000:0.0:1746066780.811038:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976583680 00002000:00100000:0.0:1746066780.811056:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009ec2c000 x1830882976583680/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:186/0 lens 488/0 e 0 to 0 dl 1746066791 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066780.811063:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2c000 with x1830882976583680 ext(3145728->4194303) 00002000:00010000:0.0:1746066780.811068:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2c000 00000100:00100000:0.0:1746066780.847625:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.851288:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.851390:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.855420:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.855503:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066780.857128:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7600/0xfb36a14ee60892ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857135:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7600/0xfb36a14ee60892ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746066780.857167:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:0.0:1746066780.857170:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746066780.857656:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7600/0xfb36a14ee60892ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857665:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7600/0xfb36a14ee60892ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857693:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7200/0xfb36a14ee60892dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857699:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7200/0xfb36a14ee60892dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857705:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7200/0xfb36a14ee60892dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857722:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e6e7200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066780.857725:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7200/0xfb36a14ee60892dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857732:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7200/0xfb36a14ee60892dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857741:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066780.857743:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066780.857746:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7200/0xfb36a14ee60892dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857761:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7200/0xfb36a14ee60892dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857787:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7400/0xfb36a14ee60892e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857791:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7400/0xfb36a14ee60892e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857795:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7400/0xfb36a14ee60892e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857799:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e6e7400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066780.857802:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7400/0xfb36a14ee60892e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857807:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7400/0xfb36a14ee60892e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857813:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ffed800) 00010000:00010000:0.0:1746066780.857815:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066780.857817:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7400/0xfb36a14ee60892e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857821:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7400/0xfb36a14ee60892e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066780.857850:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7000/0xfb36a14ee60892d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1b9 expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.857861:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e6e7600/0xfb36a14ee60892ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1b9 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.857874:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066780.857876:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066780.857878:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e6e7600, rc 0) 00000100:00100000:0.0:1746066780.860123:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.860157:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.860183:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.860202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.860214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.860238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.860271:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976585728 00000100:00100000:0.0:1746066780.860274:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976585728 00000100:00100000:0.0:1746066780.860289:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976585600 00000100:00100000:0.0:1746066780.860290:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976585600 00000100:00100000:0.0:1746066780.860299:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13680 00000100:00100000:0.0:1746066780.860305:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976585216:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066780.860319:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066780.860331:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f73ba00/0xfb36a14ee60892f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d1c0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066780.860369:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976703616:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066780.860423:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066780.860438:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13683 00000100:00100000:0.0:1746066780.860443:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976585344:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066780.860449:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066780.860455:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73b400/0xfb36a14ee6089306 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d1c7 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.860472:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.860474:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.860478:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73b400/0xfb36a14ee6089306 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1c7 expref: 8 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066780.860488:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73b400/0xfb36a14ee6089306 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1c7 expref: 8 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066780.860495:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73b400, rc 0) 00000100:00100000:0.0:1746066780.860509:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976585344:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 65us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.860514:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13683 00000100:00100000:0.0:1746066780.860524:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13685 00000100:00100000:0.0:1746066780.860528:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976585856:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066780.860533:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066780.860538:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73b200/0xfb36a14ee6089314 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d1e3 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.860546:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.860547:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.860551:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73b200/0xfb36a14ee6089314 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1e3 expref: 8 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066780.860558:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f73b200/0xfb36a14ee6089314 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1e3 expref: 8 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066780.860573:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f73b200, rc 0) 00000100:00100000:0.0:1746066780.860585:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976585856:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 57us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.860590:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13685 00000100:00100000:0.0:1746066780.864282:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.865826:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.868222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.870301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.871027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.871056:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.871069:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.871082:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.871106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.871247:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976587008 00000100:00100000:0.0:1746066780.871250:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976587008 00000100:00100000:0.0:1746066780.871266:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13687 00000100:00100000:0.0:1746066780.871271:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976586880:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066780.872064:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f73b000/0xfb36a14ee608934c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.872073:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edf6a00/0xfb36a14ee6089193 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d077 expref: 19 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.872080:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a445f800/0xfb36a14ee60892f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1ce expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066780.872096:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee60891af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d08c expref: 32 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066780.872102:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.872103:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.872105:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73b000/0xfb36a14ee608934c lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.872118:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee60891af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d08c expref: 32 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066780.872125:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee60891af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d08c expref: 32 pid: 21203 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746066780.872132:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976705536:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066780.872150:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a445f800/0xfb36a14ee60892f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1ce expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066780.872156:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a445f800/0xfb36a14ee60892f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1ce expref: 10 pid: 10402 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746066780.872162:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976705664:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066780.872175:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edf6a00/0xfb36a14ee6089193 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d077 expref: 19 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.872190:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edf6a00/0xfb36a14ee6089193 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d077 expref: 19 pid: 10402 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746066780.872196:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976705792:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066780.872206:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066780.879792:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976705792:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066780.880168:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976705536:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066780.880197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880523:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880605:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880614:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880662:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.880702:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976588288 00000100:00100000:0.0:1746066780.880723:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976588288 00010000:00010000:0.0:1746066780.880735:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73b200/0xfb36a14ee6089314 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1e3 expref: 12 pid: 21973 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746066780.880746:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976588928 00000100:00100000:0.0:1746066780.880748:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976588928 00010000:00010000:0.0:1746066780.880754:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a445f800/0xfb36a14ee60892f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1ce expref: 13 pid: 10402 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746066780.880762:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976589312 00000100:00100000:0.0:1746066780.880763:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976589312 00010000:00010000:0.0:1746066780.880770:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed34a00/0xfb36a14ee6089296 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d17a expref: 25 pid: 20532 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746066780.880779:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6968 00000100:00100000:0.0:1746066780.880783:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882976587904:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066780.880789:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066780.880799:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5d1800/0xfb36a14ee60892c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1ab expref: 22 pid: 20532 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066780.880806:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5d1800/0xfb36a14ee60892c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1ab expref: 22 pid: 20532 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066780.880817:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5d1800/0xfb36a14ee60892c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1ab expref: 22 pid: 20532 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066780.880827:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066780.880841:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882976587904:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 58us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.880850:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6968 00000100:00100000:0.0:1746066780.880860:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6970 00000100:00100000:0.0:1746066780.880863:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882976588416:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066780.880868:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066780.880875:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edf6a00/0xfb36a14ee6089193 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d077 expref: 19 pid: 10402 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066780.880882:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edf6a00/0xfb36a14ee6089193 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d077 expref: 18 pid: 10402 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066780.880890:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edf6a00/0xfb36a14ee6089193 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d077 expref: 18 pid: 10402 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066780.880896:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066780.880908:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882976588416:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 44us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.880913:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6970 00000100:00100000:0.0:1746066780.880922:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6972 00000100:00100000:0.0:1746066780.880927:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882976587776:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066780.880933:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066780.880941:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f73b400/0xfb36a14ee6089306 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1c7 expref: 13 pid: 21973 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746066780.880949:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f73b400/0xfb36a14ee6089306 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1c7 expref: 13 pid: 21973 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746066780.880968:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f73b400/0xfb36a14ee6089306 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1c7 expref: 13 pid: 21973 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746066780.880975:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.880977:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.880980:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a445fe00/0xfb36a14ee608935a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.880987:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a445fe00/0xfb36a14ee608935a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.881002:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066780.881020:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882976587776:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 92us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.881025:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6972 00000100:00100000:0.0:1746066780.881045:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6975 00000100:00100000:0.0:1746066780.881050:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976588544:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066780.881055:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066780.881064:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a445fa00/0xfb36a14ee608930d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1d5 expref: 9 pid: 10402 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746066780.881071:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a445fa00/0xfb36a14ee608930d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1d5 expref: 9 pid: 10402 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746066780.881081:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a445fa00/0xfb36a14ee608930d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1d5 expref: 9 pid: 10402 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746066780.881097:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066780.881112:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976588544:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 62us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.881117:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6975 00000100:00100000:0.0:1746066780.881128:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6977 00000100:00100000:0.0:1746066780.881132:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976588928:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066780.882409:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066780.882420:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a445f800/0xfb36a14ee60892f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1ce expref: 7 pid: 10402 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746066780.882428:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a445f800/0xfb36a14ee60892f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1ce expref: 7 pid: 10402 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746066780.882440:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a445f800/0xfb36a14ee60892f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1ce expref: 7 pid: 10402 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746066780.882447:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.882448:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.882451:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f73b000/0xfb36a14ee608934c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.882456:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73b000/0xfb36a14ee608934c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.882481:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066780.882500:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882976588928:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1367us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.882505:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6977 00000100:00100000:0.0:1746066780.896970:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.903331:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.908596:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976590208 00000100:00100000:0.0:1746066780.908602:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976590208 00000100:00100000:0.0:1746066780.908635:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4027 00000100:00100000:0.0:1746066780.908641:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+283:7642:x1830882976590208:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746066780.908819:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+285:7642:x1830882976590208:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 179us (251us total) trans 8589943784 rc 0/0 00000100:00100000:0.0:1746066780.908825:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4027 00000100:00100000:0.0:1746066780.910283:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976590464 00000100:00100000:0.0:1746066780.910286:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976590464 00000100:00100000:0.0:1746066780.910304:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4028 00000100:00100000:0.0:1746066780.910308:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:27099:x1830882976590464:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746066780.910399:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:27099:x1830882976590464:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 89us (159us total) trans 8589943785 rc 0/0 00000100:00100000:0.0:1746066780.910404:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4028 00000100:00100000:0.0:1746066780.912652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.913277:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000001:00080000:0.0:1746066780.945807:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943785 is committed 00000001:00080000:0.0:1746066780.945819:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943784 is committed 00000001:00080000:0.0:1746066780.945828:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943727 is committed 00000001:00080000:0.0:1746066780.945867:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943760 is committed 00000004:00080000:0.0:1746066780.945893:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2234 committed 00000001:00080000:0.0:1746066780.945909:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943786 is committed 00000004:00080000:0.0:1746066780.945912:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2274 committed 00000004:00080000:0.0:1746066780.945917:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2243 committed 00000004:00080000:0.0:1746066780.945918:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2242 committed 00000004:00080000:0.0:1746066780.945920:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2241 committed 00000004:00080000:0.0:1746066780.945921:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2240 committed 00000004:00080000:0.0:1746066780.945923:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2273 committed 00000004:00080000:0.0:1746066780.945924:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2239 committed 00000004:00080000:0.0:1746066780.945926:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2272 committed 00000004:00080000:0.0:1746066780.945928:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2238 committed 00000004:00080000:0.0:1746066780.945929:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2271 committed 00000004:00080000:0.0:1746066780.945930:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2270 committed 00000004:00080000:0.0:1746066780.945931:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2269 committed 00000004:00080000:0.0:1746066780.945933:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2237 committed 00000004:00080000:0.0:1746066780.945934:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2236 committed 00000004:00080000:0.0:1746066780.945935:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2268 committed 00000004:00080000:0.0:1746066780.945937:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2267 committed 00000004:00080000:0.0:1746066780.945938:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2235 committed 00000004:00080000:0.0:1746066780.945978:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2266 committed 00000100:00100000:0.0:1746066780.949280:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.958024:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976591360 00000100:00100000:0.0:1746066780.958032:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976591360 00000100:00100000:0.0:1746066780.958079:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 677 00000100:00100000:0.0:1746066780.958087:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31222:x1830882976591360:12345-192.168.202.57@tcp:103:mirror_io.0 00010000:00010000:0.0:1746066780.958098:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066780.958176:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135074e00/0xfb36a14ee6089337 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1f1 expref: 8 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066780.958189:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066780.958192:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066780.958246:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31222:x1830882976591360:12345-192.168.202.57@tcp:103:mirror_io.0 Request processed in 159us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.958252:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 677 00000100:00100000:0.0:1746066780.961430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.964082:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976591872 00000100:00100000:0.0:1746066780.964090:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976591872 00000100:00100000:0.0:1746066780.964134:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4030 00000100:00100000:0.0:1746066780.964141:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31222:x1830882976591872:12345-192.168.202.57@tcp:35:mirror_io.0 00000100:00100000:0.0:1746066780.964299:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31222:x1830882976591872:12345-192.168.202.57@tcp:35:mirror_io.0 Request processed in 159us (287us total) trans 8589943788 rc 0/0 00000100:00100000:0.0:1746066780.964306:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4030 00000100:00100000:0.0:1746066780.975912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.981757:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.981779:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.981811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.981954:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13710 00000100:00100000:0.0:1746066780.981962:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882976592640:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066780.981970:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066780.981988:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009361b200/0xfb36a14ee60893ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d214 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066780.982004:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13711 00000100:00100000:0.0:1746066780.982010:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882976593280:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066780.982016:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066780.982024:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009361b000/0xfb36a14ee60893d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d230 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066780.982048:0:20532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38d:0x0] initial LVB size: 2097152, mtime: 0x6812dd5c, atime: 0x6812dd5b, ctime: 0x6812dd5c, blocks: 0x821 00010000:00010000:0.0:1746066780.982058:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.982059:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.982063:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009361b000/0xfb36a14ee60893d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d230 expref: 32 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066780.982072:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009361b000/0xfb36a14ee60893d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d230 expref: 32 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066780.982079:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009361b000, rc 0) 00000100:00100000:0.0:1746066780.982097:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882976593280:12345-192.168.202.57@tcp:101:cat.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.982101:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13711 00010000:00010000:0.0:1746066780.982120:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.982121:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066780.982126:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009361b200/0xfb36a14ee60893ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d214 expref: 25 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066780.982134:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009361b200/0xfb36a14ee60893ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d214 expref: 25 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066780.982140:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009361b200, rc 0) 00000100:00100000:0.0:1746066780.982152:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882976592640:12345-192.168.202.57@tcp:101:cat.0 Request processed in 192us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.982157:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13710 00000100:00100000:0.0:1746066780.982555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.982588:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.982613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.982625:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.982636:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.982649:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.982662:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.982672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.982723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066780.985579:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976594304 00000100:00100000:0.0:1746066780.985584:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976594304 00010000:00010000:0.0:1746066780.985609:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9a0000/0xfb36a14ee60893b5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1ff expref: 254 pid: 14548 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746066780.985629:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976594432 00000100:00100000:0.0:1746066780.985631:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976594432 00010000:00010000:0.0:1746066780.985640:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf45a00/0xfb36a14ee6089392 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d206 expref: 8 pid: 20127 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746066780.985652:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6989 00000100:00100000:0.0:1746066780.985658:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:1965:x1830882976594304:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066780.985668:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066780.985672:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9a0000/0xfb36a14ee60893b5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1ff expref: 254 pid: 14548 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066780.985698:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9a0000/0xfb36a14ee60893b5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d1ff expref: 254 pid: 14548 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066780.985723:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066780.985727:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9a1000/0xfb36a14ee60893df lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066780.985740:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9a1000/0xfb36a14ee60893df lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066780.985744:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066780.985769:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:1965:x1830882976594304:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 111us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.985774:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6989 00000100:00100000:0.0:1746066780.985786:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6990 00000100:00100000:0.0:1746066780.985790:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:1965:x1830882976594432:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066780.985795:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066780.985799:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf45a00/0xfb36a14ee6089392 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d206 expref: 8 pid: 20127 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066780.985805:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf45a00/0xfb36a14ee6089392 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d206 expref: 8 pid: 20127 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066780.985813:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066780.985815:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9a1000/0xfb36a14ee60893df lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066780.985821:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9a1000/0xfb36a14ee60893df lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066780.985826:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9a1000/0xfb36a14ee60893df lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066780.985838:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066780.985849:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:1965:x1830882976594432:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 59us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066780.985861:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6990 00000100:00100000:0.0:1746066780.999180:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.003102:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976595328 00000100:00100000:0.0:1746066781.003110:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976595328 00002000:00100000:0.0:1746066781.003151:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88012c0fdc00 x1830882976595328/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:187/0 lens 488/0 e 0 to 0 dl 1746066792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066781.003161:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fdc00 with x1830882976595328 ext(1048576->2097151) 00002000:00010000:0.0:1746066781.003166:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fdc00 00000100:00100000:0.0:1746066781.003181:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976595584 00000100:00100000:0.0:1746066781.003184:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976595584 00002000:00100000:0.0:1746066781.003195:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88012c0fdf80 x1830882976595584/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:187/0 lens 488/0 e 0 to 0 dl 1746066792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066781.003201:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fdf80 with x1830882976595584 ext(1048576->2097151) 00002000:00010000:0.0:1746066781.003204:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fdf80 00000100:00100000:0.0:1746066781.003213:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976596224 00000100:00100000:0.0:1746066781.003215:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976596224 00002000:00100000:0.0:1746066781.003225:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88008c395880 x1830882976596224/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:187/0 lens 488/0 e 0 to 0 dl 1746066792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066781.003232:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395880 with x1830882976596224 ext(1048576->2097151) 00002000:00010000:0.0:1746066781.003234:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c395880 00000100:00100000:0.0:1746066781.003297:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6165 00000100:00100000:0.0:1746066781.003302:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882976595456:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066781.003744:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6166 00000100:00100000:0.0:1746066781.003750:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882976595584:12345-192.168.202.57@tcp:3:cat.0 00000100:00080000:0.0:1746066781.023338:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066781.023665:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882976594944:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24108us (24491us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066781.023672:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6163 00002000:00100000:0.0:1746066781.023698:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e86aa00 x1830882976594944/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:186/0 lens 488/440 e 0 to 0 dl 1746066791 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066781.023716:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e86aa00 with x1830882976594944 ext(0->1048575) 00002000:00010000:0.0:1746066781.023719:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e86aa00 00000100:00100000:0.0:1746066781.023732:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976596736 00000100:00100000:0.0:1746066781.023735:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976596736 00002000:00100000:0.0:1746066781.023749:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88008c394000 x1830882976596736/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:187/0 lens 488/0 e 0 to 0 dl 1746066792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066781.023792:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394000 with x1830882976596736 ext(1048576->2097151) 00002000:00010000:0.0:1746066781.023795:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c394000 00000100:00100000:0.0:1746066781.053619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066781.054219:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066781.066986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.069280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.069419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066781.070192:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746066781.070576:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135f30200/0xfb36a14ee6089464 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066781.070582:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f30200/0xfb36a14ee6089464 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746066781.075464:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000001:00080000:0.0:1746066781.102577:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943788 is committed 00000001:00080000:0.0:1746066781.102587:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943793 is committed 00000004:00080000:0.0:1746066781.102590:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2282 committed 00000004:00080000:0.0:1746066781.102599:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2252 committed 00000004:00080000:0.0:1746066781.102605:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2251 committed 00000004:00080000:0.0:1746066781.102606:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2250 committed 00000004:00080000:0.0:1746066781.102607:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2249 committed 00000004:00080000:0.0:1746066781.102609:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2281 committed 00000004:00080000:0.0:1746066781.102610:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2248 committed 00000004:00080000:0.0:1746066781.102611:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2280 committed 00000004:00080000:0.0:1746066781.102612:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2247 committed 00000004:00080000:0.0:1746066781.102613:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2279 committed 00000004:00080000:0.0:1746066781.102615:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2278 committed 00000004:00080000:0.0:1746066781.102616:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2277 committed 00000004:00080000:0.0:1746066781.102617:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2246 committed 00000004:00080000:0.0:1746066781.102619:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2245 committed 00000004:00080000:0.0:1746066781.102621:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2276 committed 00000004:00080000:0.0:1746066781.102622:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2275 committed 00000004:00080000:0.0:1746066781.102624:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2244 committed 00000001:00080000:0.0:1746066781.102634:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943792 is committed 00000004:00080000:0.0:1746066781.104925:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a0d1880/2, rc 0, transno 17179873419 00000100:00100000:0.0:1746066781.104935:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976709760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066781.104941:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976710272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066781.104966:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066781.105367:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e58000/2, rc 0, transno 17179873423 00000100:00100000:0.0:1746066781.105372:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976710272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066781.107139:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e5b480/2, rc 0, transno 17179873421 00000100:00100000:0.0:1746066781.107144:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976710144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066781.107165:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976710656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066781.107397:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976710528 00000100:00100000:0.0:1746066781.107402:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976710528 00000100:00100000:0.0:1746066781.107427:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976710912 00000100:00100000:0.0:1746066781.107430:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976710912 00000100:00100000:0.0:1746066781.107445:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13726 00000100:00100000:0.0:1746066781.107451:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3293:x1830882976710528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066781.107583:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746066781.107587:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746066781.107589:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066781.107590:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746066781.107591:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746066781.107623:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882976710528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (1957us total) trans 17179873424 rc 0/0 00000100:00100000:0.0:1746066781.107629:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13726 00000100:00100000:0.0:1746066781.107641:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13727 00000100:00100000:0.0:1746066781.107646:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3295:x1830882976710912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066781.107763:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3295:x1830882976710912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (805us total) trans 17179873425 rc 0/0 00000100:00100000:0.0:1746066781.107768:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13727 00000100:00100000:0.0:1746066781.107780:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066781.107795:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976710656 00000100:00100000:0.0:1746066781.107798:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976710656 00000100:00100000:0.0:1746066781.107810:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13728 00000100:00100000:0.0:1746066781.107813:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3294:x1830882976710656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066781.107882:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3294:x1830882976710656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (100us total) trans 17179873426 rc 0/0 00000100:00100000:0.0:1746066781.107902:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13728 00000004:00080000:0.0:1746066781.107924:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e58380/2, rc 0, transno 17179873426 00000100:00100000:0.0:1746066781.107928:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976710656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066781.108511:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976710400 00000100:00100000:0.0:1746066781.108515:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976710400 00000100:00100000:0.0:1746066781.108530:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13729 00000100:00100000:0.0:1746066781.108534:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3296:x1830882976710400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066781.108611:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3296:x1830882976710400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (439us total) trans 17179873427 rc 0/0 00000100:00100000:0.0:1746066781.108616:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13729 00000100:00100000:0.0:1746066781.108847:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976711296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066781.108866:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066781.108877:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976711808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066781.108889:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066781.108899:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746066781.108903:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976711168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066781.108915:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066781.108924:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976711680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066781.108936:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066781.108951:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976711296 00000100:00100000:0.0:1746066781.108954:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976711296 00000100:00100000:0.0:1746066781.108967:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976711808 00000100:00100000:0.0:1746066781.108969:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976711808 00000100:00100000:0.0:1746066781.108976:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976711168 00000100:00100000:0.0:1746066781.108978:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976711168 00000100:00100000:0.0:1746066781.108986:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976711680 00000100:00100000:0.0:1746066781.108993:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976711680 00000100:00100000:0.0:1746066781.109005:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13730 00000100:00100000:0.0:1746066781.109009:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3294:x1830882976711296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066781.109096:0:8452:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066781.109099:0:8452:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066780 -> 1746066780 00002000:00010000:0.0:1746066781.109100:0:8452:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066780 -> 1746066780 00002000:00010000:0.0:1746066781.109102:0:8452:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066780 -> 1746066780 00002000:00010000:0.0:1746066781.109104:0:8452:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746066781.109125:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3294:x1830882976711296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (257us total) trans 21474840746 rc 0/0 00000100:00100000:0.0:1746066781.109129:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13730 00000100:00100000:0.0:1746066781.109138:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13731 00000100:00100000:0.0:1746066781.109142:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3294:x1830882976711808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066781.109209:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3294:x1830882976711808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (318us total) trans 21474840747 rc 0/0 00000100:00100000:0.0:1746066781.109213:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13731 00000100:00100000:0.0:1746066781.109221:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13732 00000100:00100000:0.0:1746066781.109225:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3294:x1830882976711168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066781.109283:0:8452:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066781.109286:0:8452:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066779 -> 1746066779 00002000:00010000:0.0:1746066781.109288:0:8452:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066774 -> 1746066774 00002000:00010000:0.0:1746066781.109289:0:8452:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066779 -> 1746066779 00002000:00010000:0.0:1746066781.109291:0:8452:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746066781.109307:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3294:x1830882976711168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (391us total) trans 21474840748 rc 0/0 00000100:00100000:0.0:1746066781.109318:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13732 00000100:00100000:0.0:1746066781.109326:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13733 00000100:00100000:0.0:1746066781.109331:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3294:x1830882976711680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066781.109400:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3294:x1830882976711680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (462us total) trans 21474840749 rc 0/0 00000100:00100000:0.0:1746066781.109405:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13733 00000004:00080000:0.0:1746066781.109424:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5c0e00/2, rc 0, transno 21474840748 00000100:00100000:0.0:1746066781.109428:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976711168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066781.109434:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5c0700/2, rc 0, transno 21474840749 00000100:00100000:0.0:1746066781.109436:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976711680:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066781.109441:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5c3800/2, rc 0, transno 21474840746 00000100:00100000:0.0:1746066781.109443:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976711296:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066781.109448:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5c3480/2, rc 0, transno 21474840747 00000100:00100000:0.0:1746066781.109450:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976711808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066781.115781:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976598016 00000100:00100000:0.0:1746066781.115791:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976598016 00000100:00100000:0.0:1746066781.115894:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4031 00000100:00100000:0.0:1746066781.115901:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+7:31232:x1830882976598016:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:0.0:1746066781.115997:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+7:31232:x1830882976598016:12345-192.168.202.57@tcp:49:cat.0 Request processed in 96us (4996us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066781.116002:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4031 00000100:00100000:0.0:1746066781.116151:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.116164:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976598144 00000100:00100000:0.0:1746066781.116175:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976598144 00000100:00100000:0.0:1746066781.116207:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4032 00000100:00100000:0.0:1746066781.116211:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31233:x1830882976598144:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:0.0:1746066781.116249:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31233:x1830882976598144:12345-192.168.202.57@tcp:49:cat.0 Request processed in 37us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066781.116254:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4032 00000100:00100000:0.0:1746066781.131906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.134368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.141537:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.143991:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.144282:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.144538:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.156346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.156370:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976599552 00000100:00100000:0.0:1746066781.156376:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976599552 00010000:00010000:0.0:1746066781.156402:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e6e7600/0xfb36a14ee6089402 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d25a expref: 34 pid: 21973 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746066781.156426:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6996 00000100:00100000:0.0:1746066781.156432:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882976599552:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066781.156442:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066781.156461:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e6e7600/0xfb36a14ee6089402 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d25a expref: 34 pid: 21973 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746066781.156470:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e6e7600/0xfb36a14ee6089402 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d25a expref: 34 pid: 21973 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746066781.156501:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066781.156532:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882976599552:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 101us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066781.156538:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6996 00000100:00100000:0.0:1746066781.156566:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.156578:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976599424 00000100:00100000:0.0:1746066781.156580:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976599424 00010000:00010000:0.0:1746066781.156589:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e6e6c00/0xfb36a14ee6089417 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d261 expref: 24 pid: 21973 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746066781.156601:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6997 00000100:00100000:0.0:1746066781.156605:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:1966:x1830882976599424:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066781.156611:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066781.156617:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e6e6c00/0xfb36a14ee6089417 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d261 expref: 24 pid: 21973 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746066781.156624:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e6e6c00/0xfb36a14ee6089417 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d261 expref: 24 pid: 21973 timeout: 842 lvb_type: 1 00010000:00010000:0.0:1746066781.156634:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066781.156636:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066781.156642:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351cf400/0xfb36a14ee6089480 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3706880->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d299 expref: 24 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.156649:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351cf400/0xfb36a14ee6089480 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3706880->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d299 expref: 24 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.156722:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801351cf400/0xfb36a14ee6089480 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3706880->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d299 expref: 24 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066781.156734:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094129500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976712704:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066781.156789:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066781.156836:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.161202:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6174 00000100:00100000:0.0:1746066781.161209:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882976600064:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066781.179830:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.188287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.188323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.195579:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976601472 00000100:00100000:0.0:1746066781.195588:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976601472 00000100:00100000:0.0:1746066781.197128:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976601600 00000100:00100000:0.0:1746066781.197133:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976601600 00000100:00100000:0.0:1746066781.197345:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13742 00000100:00100000:0.0:1746066781.197352:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:31233:x1830882976601472:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066781.197365:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066781.197377:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef72200/0xfb36a14ee6089495 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d2ae expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.197395:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066781.197399:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef72200/0xfb36a14ee6089495 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d2ae expref: 41 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.197420:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef72200/0xfb36a14ee6089495 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d2ae expref: 41 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.197429:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef72200, rc 0) 00000100:00100000:0.0:1746066781.197446:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:31233:x1830882976601472:12345-192.168.202.57@tcp:101:cat.0 Request processed in 95us (3193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066781.197451:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13742 00000100:00100000:0.0:1746066781.197462:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13743 00000100:00100000:0.0:1746066781.197466:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+27:31235:x1830882976601600:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066781.197471:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066781.197477:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef72e00/0xfb36a14ee608949c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d2b5 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.197488:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066781.197490:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066781.197493:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef72e00/0xfb36a14ee608949c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->4358143] (req 4194304->4358143) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d2b5 expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.197500:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef72e00/0xfb36a14ee608949c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->4358143] (req 4194304->4358143) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d2b5 expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.197506:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef72e00, rc 0) 00000100:00100000:0.0:1746066781.197518:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+28:31235:x1830882976601600:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 52us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066781.197522:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13743 00000100:00100000:0.0:1746066781.204882:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.204925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.207826:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.211394:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.211461:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.214778:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6180 00000100:00100000:0.0:1746066781.214793:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882976602752:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066781.217150:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976603008 00000100:00100000:0.0:1746066781.217157:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976603008 00000100:00100000:0.0:1746066781.217204:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4034 00000100:00100000:0.0:1746066781.217211:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+7:31235:x1830882976603008:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:0.0:1746066781.217412:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+8:31235:x1830882976603008:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 201us (295us total) trans 8589943794 rc 0/0 00000100:00100000:0.0:1746066781.217418:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4034 00000100:00100000:0.0:1746066781.232187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.236559:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.236590:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.238012:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.243040:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976603648 00000100:00100000:0.0:1746066781.243047:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976603648 00000100:00100000:0.0:1746066781.243089:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13747 00000100:00100000:0.0:1746066781.243097:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:31233:x1830882976603648:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066781.243110:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066781.243122:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef73a00/0xfb36a14ee60894b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d2d1 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.243148:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066781.243152:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef73a00/0xfb36a14ee60894b8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2244608->3145727] (req 2244608->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d2d1 expref: 41 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.243161:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef73a00/0xfb36a14ee60894b8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2244608->3145727] (req 2244608->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d2d1 expref: 41 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.243169:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef73a00, rc 0) 00000100:00100000:0.0:1746066781.243198:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:31233:x1830882976603648:12345-192.168.202.57@tcp:101:cat.0 Request processed in 102us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066781.243203:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13747 00000100:00100000:0.0:1746066781.247137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.252053:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.259927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.259962:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.259988:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.260013:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.260414:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6182 00000100:00100000:0.0:1746066781.260421:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882976604544:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066781.270076:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.271583:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+30:1963:x1830882976604544:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11157us (11658us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066781.271593:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6182 00002000:00100000:0.0:1746066781.271603:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a8692a00 x1830882976604544/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:187/0 lens 488/440 e 0 to 0 dl 1746066792 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066781.271618:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8692a00 with x1830882976604544 ext(3145728->4194303) 00002000:00010000:0.0:1746066781.271623:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8692a00 00000100:00100000:0.0:1746066781.291000:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.298126:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.298317:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.299463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.299538:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.299563:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6187 00000100:00100000:0.0:1746066781.299569:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882976606336:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066781.329642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.330573:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.333827:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.334288:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.337281:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.339507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.340815:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.350287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.350338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.356918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.360826:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.364346:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.367233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.368941:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.401634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.405818:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976609792 00000100:00100000:0.0:1746066781.405824:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976609792 00010000:00010000:0.0:1746066781.405847:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf45000/0xfb36a14ee60894bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d2d8 expref: 35 pid: 20532 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746066781.405879:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7004 00000100:00100000:0.0:1746066781.405885:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1963:x1830882976609792:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066781.405895:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066781.405912:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf45000/0xfb36a14ee60894bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d2d8 expref: 35 pid: 20532 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066781.405920:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf45000/0xfb36a14ee60894bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d2d8 expref: 35 pid: 20532 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066781.405939:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf45000/0xfb36a14ee60894bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d2d8 expref: 35 pid: 20532 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066781.405952:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066781.405969:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882976609792:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 84us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066781.405974:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7004 00000100:00100000:0.0:1746066781.408974:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.412193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.419146:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.419453:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.419478:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.419496:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976610432 00000100:00100000:0.0:1746066781.419501:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976610432 00010000:00010000:0.0:1746066781.419524:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef73a00/0xfb36a14ee60894b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2244608->4194303] (req 2244608->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d2d1 expref: 43 pid: 21203 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746066781.419549:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976610688 00000100:00100000:0.0:1746066781.419552:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976610688 00010000:00010000:0.0:1746066781.419630:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092590c00/0xfb36a14ee608950c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d309 expref: 31 pid: 9776 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746066781.419732:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7008 00000100:00100000:0.0:1746066781.419738:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+30:1963:x1830882976610688:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066781.419745:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066781.419753:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092590c00/0xfb36a14ee608950c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d309 expref: 29 pid: 9776 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066781.419761:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092590c00/0xfb36a14ee608950c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d309 expref: 29 pid: 9776 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066781.419772:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092590c00/0xfb36a14ee608950c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d309 expref: 29 pid: 9776 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066781.419783:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066781.419797:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882976610688:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 60us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066781.419802:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7008 00000100:00100000:0.0:1746066781.419832:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.427448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.443520:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.448665:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.451095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.458567:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.462857:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.465249:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976612096 00000100:00100000:0.0:1746066781.465253:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976612096 00000100:00100000:0.0:1746066781.465286:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13758 00000100:00100000:0.0:1746066781.465292:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+28:31245:x1830882976612096:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066781.465305:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066781.465341:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351cf200/0xfb36a14ee608954b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d32c expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.465362:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092590400/0xfb36a14ee608951a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d317 expref: 39 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.465368:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066781.465369:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066781.465372:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801351cf200/0xfb36a14ee608954b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [4194304->4308991] (req 4194304->4308991) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d32c expref: 29 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.465395:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092590400/0xfb36a14ee608951a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d317 expref: 39 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.465405:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092590400/0xfb36a14ee608951a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3518463) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d317 expref: 39 pid: 9776 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746066781.465415:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976716672:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066781.465559:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0aba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066781.467727:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.473842:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.479330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.481635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.551828:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.554958:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.555043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.555076:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976613504 00000100:00100000:0.0:1746066781.555079:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976613504 00000100:00100000:0.0:1746066781.555112:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 678 00000100:00100000:0.0:1746066781.555118:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:1964:x1830882976613504:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066781.555126:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066781.555141:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef73a00/0xfb36a14ee6089567 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d333 expref: 260 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.555156:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066781.555159:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066781.555186:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:1964:x1830882976613504:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 69us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066781.555191:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 678 00000100:00100000:0.0:1746066781.585194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.594794:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.594818:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.594837:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976613760 00000100:00100000:0.0:1746066781.594843:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976613760 00010000:00010000:0.0:1746066781.594872:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9a1000/0xfb36a14ee60893df lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d229 expref: 259 pid: 809 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746066781.594899:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7012 00000100:00100000:0.0:1746066781.594905:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:1964:x1830882976613760:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066781.594916:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066781.594920:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9a1000/0xfb36a14ee60893df lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d229 expref: 259 pid: 809 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066781.594930:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9a1000/0xfb36a14ee60893df lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d229 expref: 259 pid: 809 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066781.594948:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066781.594951:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c6200/0xfb36a14ee608958a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066781.594959:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c6200/0xfb36a14ee608958a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066781.594964:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c6200/0xfb36a14ee608958a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066781.594978:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066781.595010:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:1964:x1830882976613760:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 105us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066781.595015:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7012 00000100:00100000:0.0:1746066781.601914:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.602510:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.605467:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.607230:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.607242:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.607254:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976614656 00000100:00100000:0.0:1746066781.607257:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976614656 00000100:00100000:0.0:1746066781.607271:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976614272 00000100:00100000:0.0:1746066781.607272:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976614272 00000100:00100000:0.0:1746066781.607282:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976614528 00000100:00100000:0.0:1746066781.607283:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976614528 00000100:00100000:0.0:1746066781.607293:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13761 00000100:00100000:0.0:1746066781.607298:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976614656:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066781.607306:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066781.607313:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351cec00/0xfb36a14ee60895d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d364 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066781.607343:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976717056:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066781.607383:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0aba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066781.607398:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13762 00000100:00100000:0.0:1746066781.607403:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882976614272:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066781.607408:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066781.607414:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351ce800/0xfb36a14ee60895de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d34f expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.607423:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066781.607424:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066781.607429:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351ce800/0xfb36a14ee60895de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d34f expref: 7 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.607438:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801351ce800/0xfb36a14ee60895de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d34f expref: 7 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.607449:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351ce800, rc 0) 00000100:00100000:0.0:1746066781.607462:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976614272:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 60us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066781.607466:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13762 00000100:00100000:0.0:1746066781.607476:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13763 00000100:00100000:0.0:1746066781.607481:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976614528:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066781.607485:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066781.607489:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351ce000/0xfb36a14ee60895e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d35d expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.607496:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066781.607498:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066781.607501:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801351ce000/0xfb36a14ee60895e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d35d expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.607509:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801351ce000/0xfb36a14ee60895e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d35d expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.607515:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351ce000, rc 0) 00000100:00100000:0.0:1746066781.607526:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976614528:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 45us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066781.607530:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13763 00000100:00100000:0.0:1746066781.607551:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.607560:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976614784 00000100:00100000:0.0:1746066781.607562:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976614784 00000100:00100000:0.0:1746066781.607574:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13764 00000100:00100000:0.0:1746066781.607577:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976614784:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066781.607582:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066781.607588:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801351cfa00/0xfb36a14ee60895ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d36b expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066781.607605:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976717184:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066781.607621:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066781.607653:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.607698:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.607724:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976615168 00000100:00100000:0.0:1746066781.607726:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976615168 00000100:00100000:0.0:1746066781.607737:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976615296 00000100:00100000:0.0:1746066781.607739:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976615296 00000100:00100000:0.0:1746066781.607748:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13765 00000100:00100000:0.0:1746066781.607752:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1963:x1830882976615168:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066781.607757:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066781.607762:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092590a00/0xfb36a14ee60895f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d379 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066781.607780:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976717312:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066781.607799:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab240 going to sleep for 11 seconds 00002000:00010000:0.0:1746066781.609233:0:8451:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime: 1746066780 -> 1746066781 00000100:00100000:0.0:1746066781.609246:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976717184:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066781.609263:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801351cfa00/0xfb36a14ee60895ec lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d36b expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.609276:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351cfa00/0xfb36a14ee60895ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d36b expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.609296:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351cfa00, rc 0) 00000100:00100000:0.0:1746066781.609315:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976614784:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 1736us (1763us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066781.609321:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13764 00000100:00100000:0.0:1746066781.611217:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.614231:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.623738:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.624061:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976616704 00000100:00100000:0.0:1746066781.624070:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976616704 00002000:00100000:0.0:1746066781.624109:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009f16f800 x1830882976616704/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:187/0 lens 488/0 e 0 to 0 dl 1746066792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066781.624118:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16f800 with x1830882976616704 ext(1048576->2097151) 00002000:00010000:0.0:1746066781.624122:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16f800 00000100:00100000:0.0:1746066781.624137:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6199 00000100:00100000:0.0:1746066781.624144:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882976616704:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066781.643302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.659323:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.664786:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.665488:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.665520:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.667290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.667320:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.667563:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976618240 00000100:00100000:0.0:1746066781.667567:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976618240 00002000:00100000:0.0:1746066781.667694:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880136b41f80 x1830882976618240/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:187/0 lens 488/0 e 0 to 0 dl 1746066792 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066781.667710:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b41f80 with x1830882976618240 ext(3145728->4194303) 00002000:00010000:0.0:1746066781.667713:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b41f80 00000100:00100000:0.0:1746066781.667804:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6201 00000100:00100000:0.0:1746066781.667810:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+30:1965:x1830882976618240:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066781.670173:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.673368:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976718208:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066781.673397:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608964e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d3a3 expref: 36 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.673408:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608964e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d3a3 expref: 36 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.673422:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed2d400, rc 0) 00000100:00100000:0.0:1746066781.673454:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882976617856:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6814us (7965us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066781.673462:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13768 00000100:00100000:0.0:1746066781.673601:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976718080:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066781.673617:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801351cf000/0xfb36a14ee6089647 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d39c expref: 42 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.673631:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351cf000/0xfb36a14ee6089647 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d39c expref: 42 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.673638:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351cf000, rc 0) 00000100:00100000:0.0:1746066781.673656:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1964:x1830882976617728:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7806us (8878us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066781.673661:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13767 00000100:00100000:0.0:1746066781.679834:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.692636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.701360:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.701425:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.704423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.710099:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.712739:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.724425:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976620544 00000100:00100000:0.0:1746066781.724432:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976620544 00000100:00100000:0.0:1746066781.724470:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4041 00000100:00100000:0.0:1746066781.724476:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+14:31256:x1830882976620544:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:0.0:1746066781.725156:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:31256:x1830882976620544:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 678us (850us total) trans 8589943808 rc 0/0 00000100:00100000:0.0:1746066781.725162:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4041 00000100:00100000:0.0:1746066781.732134:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.736417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.738171:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.740632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.747114:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976621312 00000100:00100000:0.0:1746066781.747121:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976621312 00000100:00100000:0.0:1746066781.747162:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13773 00000100:00100000:0.0:1746066781.747168:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:31248:x1830882976621312:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066781.747181:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066781.747192:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f73ac00/0xfb36a14ee6089671 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d3c6 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.747213:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ed34a00/0xfb36a14ee60893e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d245 expref: 37 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.747221:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136820000/0xfb36a14ee60895bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d356 expref: 6 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.747228:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e6e7000/0xfb36a14ee60893f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d222 expref: 23 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.747233:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066781.747235:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066781.747238:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f73ac00/0xfb36a14ee6089671 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1638400->2097151] (req 1638400->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d3c6 expref: 37 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.747261:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e6e7000/0xfb36a14ee60893f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d222 expref: 23 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.747270:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e6e7000/0xfb36a14ee60893f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d222 expref: 23 pid: 21973 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746066781.747284:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976719104:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066781.747353:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136820000/0xfb36a14ee60895bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d356 expref: 6 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.747362:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136820000/0xfb36a14ee60895bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d356 expref: 6 pid: 20532 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746066781.747369:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c22ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976719232:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066781.747389:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ed34a00/0xfb36a14ee60893e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d245 expref: 37 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066781.747397:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ed34a00/0xfb36a14ee60893e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d245 expref: 37 pid: 21973 timeout: 842 lvb_type: 1 00000100:00100000:0.0:1746066781.747403:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c22f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976719360:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066781.747417:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066781.754292:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.754791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.754815:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.756862:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976621824 00000100:00100000:0.0:1746066781.756866:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976621824 00010000:00010000:0.0:1746066781.756883:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f208800/0xfb36a14ee6089544 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d325 expref: 23 pid: 9776 timeout: 842 lvb_type: 0 00000100:00100000:0.0:1746066781.756971:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7022 00000100:00100000:0.0:1746066781.756977:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882976621824:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066781.756985:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066781.757000:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f208800/0xfb36a14ee6089544 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d325 expref: 23 pid: 9776 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066781.757007:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f208800/0xfb36a14ee6089544 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d325 expref: 23 pid: 9776 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066781.757020:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f208800/0xfb36a14ee6089544 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d325 expref: 23 pid: 9776 timeout: 842 lvb_type: 0 00010000:00010000:0.0:1746066781.757151:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066781.757153:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066781.757158:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091bbba00/0xfb36a14ee608966a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d3bf expref: 36 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.757166:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091bbba00/0xfb36a14ee608966a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d3bf expref: 36 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066781.757186:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091bbba00/0xfb36a14ee608966a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d3bf expref: 36 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066781.757196:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c22df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976719616:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066781.757471:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0aba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066781.757532:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976719488:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066781.757543:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066781.757567:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882976621696:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2681us (2751us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066781.757573:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7021 00000100:00100000:0.0:1746066781.757884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.759431:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.761586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.764636:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.772976:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.773027:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.774293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.780401:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.780661:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.780764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.782455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.783249:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.783268:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976624128 00000100:00100000:0.0:1746066781.783272:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976624128 00000100:00100000:0.0:1746066781.783307:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4042 00000100:00100000:0.0:1746066781.783313:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:31248:x1830882976624128:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:0.0:1746066781.783654:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:31248:x1830882976624128:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 340us (405us total) trans 8589943809 rc 0/0 00000100:00100000:0.0:1746066781.783659:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4042 00000100:00100000:0.0:1746066781.786709:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.786984:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.791759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.805243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.805283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.805320:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.813823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.814456:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.823332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.823383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.841027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.916817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066781.967914:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.022081:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.027104:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.045841:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.053914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.074955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.085849:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.085887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.085929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.086431:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13789 00000100:00100000:0.0:1746066782.086438:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+24:31264:x1830882976628608:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066782.086450:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.086459:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091bba600/0xfb36a14ee6089751 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d452 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.086473:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091bbba00/0xfb36a14ee608966a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d3bf expref: 37 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.086484:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351cfa00/0xfb36a14ee6089678 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d3cd expref: 25 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.086489:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.086490:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.086492:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091bba600/0xfb36a14ee6089751 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3198976->4194303] (req 3198976->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d452 expref: 25 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.086505:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801351cfa00/0xfb36a14ee6089678 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d3cd expref: 25 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.086511:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801351cfa00/0xfb36a14ee6089678 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d3cd expref: 25 pid: 20532 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746066782.086519:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976721792:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066782.086800:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091bbba00/0xfb36a14ee608966a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d3bf expref: 37 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.086808:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091bbba00/0xfb36a14ee608966a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d3bf expref: 37 pid: 20532 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746066782.086816:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976721920:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066782.086833:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0aba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066782.089542:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976721792:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066782.091872:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.091930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.092734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.092775:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.102729:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976630016 00000100:00100000:0.0:1746066782.102733:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976630016 00002000:00100000:0.0:1746066782.102749:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1515520->2097151) req@ffff88009f16f480 x1830882976630016/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.102756:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16f480 with x1830882976630016 ext(1515520->2097151) 00010000:00010000:0.0:1746066782.102761:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092591000/0xfb36a14ee6089727 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d436 expref: 38 pid: 4614 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.102768:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092591000/0xfb36a14ee6089727 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d436 expref: 38 pid: 4614 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746066782.102773:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f16f480 00000100:00100000:0.0:1746066782.102791:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2047 00000100:00100000:0.0:1746066782.102800:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882976630016:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066782.105007:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.125985:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.131409:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.134017:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.134073:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c395180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976723072:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066782.134090:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066782.134120:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+33:1964:x1830882976631040:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2569us (2716us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.134132:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7033 00000100:00100000:0.0:1746066782.136118:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.142537:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.144152:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.144191:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.159156:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.159185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.159210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.159223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.159252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.159275:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976632320 00000100:00100000:0.0:1746066782.159281:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976632320 00002000:00100000:0.0:1746066782.159318:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (1261568->1265663) req@ffff8800931d0a80 x1830882976632320/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.159327:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0a80 with x1830882976632320 ext(1261568->1265663) 00002000:00010000:0.0:1746066782.159331:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d0a80 00000100:00100000:0.0:1746066782.159344:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976632704 00000100:00100000:0.0:1746066782.159346:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976632704 00002000:00100000:0.0:1746066782.159356:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800931d1180 x1830882976632704/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.159362:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d1180 with x1830882976632704 ext(2097152->3145727) 00002000:00010000:0.0:1746066782.159365:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d1180 00000100:00100000:0.0:1746066782.159371:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976632832 00000100:00100000:0.0:1746066782.159373:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976632832 00002000:00100000:0.0:1746066782.159381:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800931d1f80 x1830882976632832/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.159392:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d1f80 with x1830882976632832 ext(3145728->4194303) 00002000:00010000:0.0:1746066782.159394:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d1f80 00000100:00100000:0.0:1746066782.159400:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976633216 00000100:00100000:0.0:1746066782.159402:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976633216 00002000:00100000:0.0:1746066782.159411:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3198975) req@ffff8800931d0000 x1830882976633216/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.159417:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0000 with x1830882976633216 ext(3145728->3198975) 00002000:00010000:0.0:1746066782.159419:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800931d0000 00000100:00100000:0.0:1746066782.159427:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976633088 00000100:00100000:0.0:1746066782.159429:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976633088 00002000:00100000:0.0:1746066782.159438:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800931d3480 x1830882976633088/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.159443:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d3480 with x1830882976633088 ext(2097152->3145727) 00002000:00010000:0.0:1746066782.159446:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800931d3480 00000100:00100000:0.0:1746066782.159455:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6218 00000100:00100000:0.0:1746066782.159461:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+44:1964:x1830882976632320:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066782.159590:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+44:1964:x1830882976632320:12345-192.168.202.57@tcp:3:cat.0 Request processed in 128us (440us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066782.159596:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6218 00002000:00100000:0.0:1746066782.159601:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (1261568->1265663) req@ffff8800931d0a80 x1830882976632320/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:188/0 lens 488/4536 e 0 to 0 dl 1746066793 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.159607:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0a80 with x1830882976632320 ext(1261568->1265663) 00002000:00010000:0.0:1746066782.159610:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d0a80 00000100:00100000:0.0:1746066782.159623:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6219 00000100:00100000:0.0:1746066782.159627:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+34:1964:x1830882976632704:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066782.160577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.160597:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976633600 00000100:00100000:0.0:1746066782.160600:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976633600 00002000:00100000:0.0:1746066782.160618:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x390:0x0] (1265664->2097151) req@ffff88009ef59c00 x1830882976633600/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.160624:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef59c00 with x1830882976633600 ext(1265664->2097151) 00002000:00010000:0.0:1746066782.160627:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef59c00 00000100:00100000:0.0:1746066782.160638:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6223 00000100:00100000:0.0:1746066782.160642:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+44:1964:x1830882976633600:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066782.165210:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882976633216:12345-192.168.202.57@tcp:3:cat.0 Request processed in 5113us (5985us total) trans 0 rc 53248/53248 00000100:00100000:0.0:1746066782.165218:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6221 00002000:00100000:0.0:1746066782.165224:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3198975) req@ffff8800931d0000 x1830882976633216/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/440 e 0 to 0 dl 1746066793 ref 1 fl Complete:/200/0 rc 53248/53248 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.165231:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0000 with x1830882976633216 ext(3145728->3198975) 00002000:00010000:0.0:1746066782.165235:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800931d0000 00000100:00100000:0.0:1746066782.199633:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976634624 00000100:00100000:0.0:1746066782.199637:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976634624 00000100:00100000:0.0:1746066782.199660:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9799 00000100:00100000:0.0:1746066782.199666:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31275:x1830882976634624:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066782.199691:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.199711:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dce00/0xfb36a14ee608977b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d498 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.199751:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dcc00/0xfb36a14ee6089782 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199762:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dcc00/0xfb36a14ee6089782 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199770:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dcc00/0xfb36a14ee6089782 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199779:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dca00/0xfb36a14ee6089790 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199783:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dca00/0xfb36a14ee6089790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199787:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dca00/0xfb36a14ee6089790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199869:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dc800/0xfb36a14ee608979e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199876:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dc800/0xfb36a14ee608979e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199881:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dc800/0xfb36a14ee608979e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:0.0:1746066782.199903:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:0.0:1746066782.199907:0:14550:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746066782.199918:0:14550:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dc800/0xfb36a14ee608979e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199924:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dc800/0xfb36a14ee608979e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199930:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dcc00/0xfb36a14ee6089782 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199934:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dcc00/0xfb36a14ee6089782 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199939:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dcc00/0xfb36a14ee6089782 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199943:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7dcc00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066782.199946:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dcc00/0xfb36a14ee6089782 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199952:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dcc00/0xfb36a14ee6089782 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199959:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066782.199961:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066782.199964:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dcc00/0xfb36a14ee6089782 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199968:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dcc00/0xfb36a14ee6089782 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199981:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dca00/0xfb36a14ee6089790 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199985:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dca00/0xfb36a14ee6089790 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199989:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dca00/0xfb36a14ee6089790 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199993:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7dca00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066782.199995:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dca00/0xfb36a14ee6089790 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.199999:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dca00/0xfb36a14ee6089790 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.200004:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012dc13500) 00010000:00010000:0.0:1746066782.200005:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066782.200007:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dca00/0xfb36a14ee6089790 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.200011:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dca00/0xfb36a14ee6089790 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.200030:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dce00/0xfb36a14ee608977b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d498 expref: 10 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.200038:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dc800/0xfb36a14ee608979e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d498 expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.200043:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066782.200045:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066782.200047:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7dc800, rc 0) 00000100:00100000:0.0:1746066782.200066:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31275:x1830882976634624:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 400us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.200071:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9799 00000100:00100000:0.0:1746066782.203287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.203309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.203318:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.203353:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.203383:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13799 00000100:00100000:0.0:1746066782.203390:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1966:x1830882976634752:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066782.203399:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.203408:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7dc400/0xfb36a14ee60897b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d49f expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.203422:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.203423:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.203429:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7dc400/0xfb36a14ee60897b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d49f expref: 8 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066782.203440:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7dc400/0xfb36a14ee60897b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d49f expref: 8 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066782.203447:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7dc400, rc 0) 00000100:00100000:0.0:1746066782.203472:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1966:x1830882976634752:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 84us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.203607:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13799 00000100:00100000:0.0:1746066782.203619:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13801 00000100:00100000:0.0:1746066782.203624:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1966:x1830882976635008:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066782.203629:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.203635:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7dc200/0xfb36a14ee60897c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d4ad expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066782.203653:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976723968:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066782.203715:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066782.206461:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.207443:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976723968:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066782.207460:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7dc200/0xfb36a14ee60897c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d4ad expref: 7 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066782.207468:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7dc200/0xfb36a14ee60897c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d4ad expref: 7 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066782.207478:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7dc200, rc 0) 00000100:00100000:0.0:1746066782.207492:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1966:x1830882976635008:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 3868us (4173us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066782.207497:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13801 00000100:00100000:0.0:1746066782.208853:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.210652:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.210722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.216670:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.224595:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.224634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.224664:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.224693:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976636416 00000100:00100000:0.0:1746066782.224723:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976636416 00000100:00100000:0.0:1746066782.224752:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976636544 00000100:00100000:0.0:1746066782.224754:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976636544 00000100:00100000:0.0:1746066782.224764:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976636672 00000100:00100000:0.0:1746066782.224766:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976636672 00000100:00100000:0.0:1746066782.224777:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13804 00000100:00100000:0.0:1746066782.224784:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+34:1966:x1830882976636416:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066782.224799:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.224813:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7dce00/0xfb36a14ee60897eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d4c9 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066782.224859:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976724736:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066782.224905:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066782.229333:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.233391:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.233585:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.235235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.236658:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.236711:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.240326:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.241064:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.241755:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.245479:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.255719:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.255778:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.255997:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.256266:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.257039:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.257067:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.264867:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c22ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976726144:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066782.265032:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c22ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976725888:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066782.265040:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c22fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976726016:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066782.265063:0:21973:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ee2ac00/0xfb36a14ee608984d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066782.266886:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976639360 00000100:00100000:0.0:1746066782.266891:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976639360 00010000:00010000:0.0:1746066782.266911:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801351ce800/0xfb36a14ee60895de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d34f expref: 12 pid: 8451 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746066782.266939:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7040 00000100:00100000:0.0:1746066782.266944:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882976639616:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066782.266952:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066782.266968:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eea3600/0xfb36a14ee608982a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d508 expref: 12 pid: 20532 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.266976:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eea3600/0xfb36a14ee608982a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d508 expref: 12 pid: 20532 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.266994:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eea3600/0xfb36a14ee608982a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d508 expref: 12 pid: 20532 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.267007:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066782.267025:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976639616:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 81us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.267031:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7040 00000100:00100000:0.0:1746066782.267781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.267791:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976639744 00000100:00100000:0.0:1746066782.267794:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976639744 00010000:00010000:0.0:1746066782.267804:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f20ea00/0xfb36a14ee6089789 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d475 expref: 24 pid: 9776 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746066782.267820:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7046 00000100:00100000:0.0:1746066782.267825:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882976639744:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066782.267831:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066782.267839:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f20ea00/0xfb36a14ee6089789 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d475 expref: 24 pid: 9776 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.267846:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f20ea00/0xfb36a14ee6089789 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d475 expref: 24 pid: 9776 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.267855:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f20ea00/0xfb36a14ee6089789 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d475 expref: 24 pid: 9776 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.267863:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066782.267876:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882976639744:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 51us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.267881:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7046 00000100:00100000:0.0:1746066782.267909:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.267938:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.267957:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.267974:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.267994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.268003:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976640000 00000100:00100000:0.0:1746066782.268005:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976640000 00010000:00010000:0.0:1746066782.268015:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009361b200/0xfb36a14ee60893ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d214 expref: 33 pid: 21973 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746066782.268037:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7050 00000100:00100000:0.0:1746066782.268041:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+33:1964:x1830882976640000:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066782.268046:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066782.268052:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009361b200/0xfb36a14ee60893ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d214 expref: 33 pid: 21973 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.268059:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009361b200/0xfb36a14ee60893ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d214 expref: 33 pid: 21973 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.268068:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009361b200/0xfb36a14ee60893ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d214 expref: 33 pid: 21973 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.268075:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.268076:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.268078:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eea2800/0xfb36a14ee6089862 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.268083:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eea2800/0xfb36a14ee6089862 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.268094:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066782.268103:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+32:1964:x1830882976640000:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 62us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.268107:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7050 00000100:00100000:0.0:1746066782.268116:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976640640 00000100:00100000:0.0:1746066782.268119:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976640640 00010000:00010000:0.0:1746066782.268126:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7dc400/0xfb36a14ee60897b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d49f expref: 8 pid: 8112 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746066782.268143:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976641024 00000100:00100000:0.0:1746066782.268145:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976641024 00010000:00010000:0.0:1746066782.268152:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edcae00/0xfb36a14ee6089758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d459 expref: 38 pid: 4614 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746066782.268161:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7052 00000100:00100000:0.0:1746066782.268165:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882976641024:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066782.268169:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066782.268187:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edcae00/0xfb36a14ee6089758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d459 expref: 38 pid: 4614 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.268194:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edcae00/0xfb36a14ee6089758 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d459 expref: 38 pid: 4614 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.268205:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edcae00/0xfb36a14ee6089758 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d459 expref: 38 pid: 4614 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.268212:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.268213:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.268215:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801351cf000/0xfb36a14ee6089869 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.268221:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801351cf000/0xfb36a14ee6089869 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.268236:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066782.268250:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1964:x1830882976641024:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 85us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.268255:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7052 00010000:00010000:0.0:1746066782.268272:0:21973:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ee2ac00/0xfb36a14ee608984d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.268279:0:21973:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee2ac00/0xfb36a14ee608984d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.268307:0:21973:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ee2ac00/0xfb36a14ee608984d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.268313:0:21973:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee2ac00/0xfb36a14ee608984d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.268672:0:21973:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ee2ac00/0xfb36a14ee608984d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.268693:0:21973:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee2ac00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066782.268705:0:21973:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ee2ac00/0xfb36a14ee608984d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.268711:0:21973:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ee2ac00/0xfb36a14ee608984d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.268723:0:21973:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ee2ac00/0xfb36a14ee608984d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.268728:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee2ac00/0xfb36a14ee608984d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066782.268760:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882976638592:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 12414us (13045us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.268765:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13813 00000100:00100000:0.0:1746066782.270561:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.272778:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.276525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066782.277087:0:21203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ee7f800/0xfb36a14ee6089870 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.277095:0:21203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee7f800/0xfb36a14ee6089870 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.277111:0:21203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee7f800/0xfb36a14ee6089870 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.277117:0:21203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee7f800/0xfb36a14ee6089870 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.277124:0:21203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ee7f800/0xfb36a14ee6089870 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.277133:0:21203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee7f800 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066782.277137:0:21203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee7f800/0xfb36a14ee6089870 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.277144:0:21203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee7f800/0xfb36a14ee6089870 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.277152:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.277153:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.277158:0:21203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135458a00/0xfb36a14ee6089877 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d516 expref: 43 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.277163:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135458a00/0xfb36a14ee6089877 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d516 expref: 43 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.277187:0:21203:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135458a00/0xfb36a14ee6089877 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d516 expref: 43 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066782.277196:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c22e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976727936:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066782.277588:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066782.280811:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.280849:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.284473:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.284503:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.284524:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.284534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.284546:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.284562:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976642304 00000100:00100000:0.0:1746066782.284567:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976642304 00010000:00010000:0.0:1746066782.284590:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d800/0xfb36a14ee60894e2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d2e6 expref: 265 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746066782.284606:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976642816 00000100:00100000:0.0:1746066782.284608:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976642816 00010000:00010000:0.0:1746066782.284614:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa21e00/0xfb36a14ee608946b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d284 expref: 266 pid: 20127 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746066782.284622:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976642176 00000100:00100000:0.0:1746066782.284624:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976642176 00010000:00010000:0.0:1746066782.284630:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2c800/0xfb36a14ee6089536 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d31e expref: 20 pid: 14548 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746066782.284642:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976642432 00000100:00100000:0.0:1746066782.284644:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976642432 00010000:00010000:0.0:1746066782.284649:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee7fc00/0xfb36a14ee6089735 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d43d expref: 267 pid: 14550 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746066782.284658:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7056 00000100:00100000:0.0:1746066782.284663:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:1964:x1830882976642304:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066782.284672:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066782.284704:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d800/0xfb36a14ee60894e2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d2e6 expref: 267 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.284713:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d800/0xfb36a14ee60894e2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d2e6 expref: 267 pid: 14548 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.286177:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066782.286183:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2e00/0xfb36a14ee608987e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066782.286189:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066782.286210:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:1964:x1830882976642304:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1546us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.286216:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7056 00000100:00100000:0.0:1746066782.286256:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.286442:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.286507:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.289295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.300133:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976643712 00000100:00100000:0.0:1746066782.300139:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976643712 00000100:00100000:0.0:1746066782.300175:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9805 00000100:00100000:0.0:1746066782.300180:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:31272:x1830882976643712:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066782.300197:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.300209:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dd400/0xfb36a14ee60898a1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d52b expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.300248:0:20127:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2e00/0xfb36a14ee608987e lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066782.300255:0:20127:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dd400/0xfb36a14ee60898a1 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d52b expref: 262 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.300268:0:20127:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2e00/0xfb36a14ee608987e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066782.300277:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dd400/0xfb36a14ee60898a1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d52b expref: 262 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.300286:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066782.300289:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066782.300292:0:20127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dd400/0xfb36a14ee60898a1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d52b expref: 262 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.300297:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7dd400, rc 0) 00000100:00100000:0.0:1746066782.300325:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:31272:x1830882976643712:12345-192.168.202.57@tcp:101:cat.0 Request processed in 145us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.300330:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9805 00000100:00100000:0.0:1746066782.304361:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000001:00080000:0.0:1746066782.314733:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943809 is committed 00000001:00080000:0.0:1746066782.314748:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943808 is committed 00000001:00080000:0.0:1746066782.314756:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943820 is committed 00000001:00080000:0.0:1746066782.314760:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943818 is committed 00000001:00080000:0.0:1746066782.314763:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943817 is committed 00000001:00080000:0.0:1746066782.314778:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943819 is committed 00000001:00080000:0.0:1746066782.316143:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943821 is committed 00000004:00080000:0.0:1746066782.316148:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2290 committed 00000004:00080000:0.0:1746066782.316154:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2261 committed 00000004:00080000:0.0:1746066782.316158:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2260 committed 00000004:00080000:0.0:1746066782.316159:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2259 committed 00000004:00080000:0.0:1746066782.316161:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2258 committed 00000004:00080000:0.0:1746066782.316163:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2289 committed 00000004:00080000:0.0:1746066782.316164:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2257 committed 00000004:00080000:0.0:1746066782.316166:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2288 committed 00000004:00080000:0.0:1746066782.316167:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2256 committed 00000004:00080000:0.0:1746066782.316169:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2287 committed 00000004:00080000:0.0:1746066782.316170:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2286 committed 00000004:00080000:0.0:1746066782.316171:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2285 committed 00000004:00080000:0.0:1746066782.316172:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2255 committed 00000004:00080000:0.0:1746066782.316174:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2254 committed 00000004:00080000:0.0:1746066782.316175:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2284 committed 00000004:00080000:0.0:1746066782.316177:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2283 committed 00000004:00080000:0.0:1746066782.316178:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2253 committed 00000100:00100000:0.0:1746066782.316322:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976729216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066782.316356:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066782.316373:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976729728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066782.316387:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066782.316401:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746066782.316405:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976729344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066782.316418:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066782.316427:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976729856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066782.316437:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066782.316454:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976729344 00000100:00100000:0.0:1746066782.316456:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976729344 00000100:00100000:0.0:1746066782.316469:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13821 00000100:00100000:0.0:1746066782.316474:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3293:x1830882976729216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066782.316488:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13823 00000100:00100000:0.0:1746066782.316492:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3293:x1830882976729344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066782.318222:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3293:x1830882976729728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1745us (1833us total) trans 21474840766 rc 0/0 00000100:00100000:0.0:1746066782.318228:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13822 00000100:00100000:0.0:1746066782.318238:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976731264 00000100:00100000:0.0:1746066782.318240:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976731264 00000100:00100000:0.0:1746066782.318250:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13833 00000100:00100000:0.0:1746066782.318253:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3295:x1830882976731264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066782.318325:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3295:x1830882976731264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (458us total) trans 17179873441 rc 0/0 00000100:00100000:0.0:1746066782.318329:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13833 00000100:00100000:0.0:1746066782.318376:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.318425:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.318441:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976730496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066782.318457:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066782.318468:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976731008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066782.318479:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066782.318487:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746066782.318491:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976730368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066782.318504:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066782.318510:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976730880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066782.318521:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066782.318620:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3293:x1830882976729216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2146us (2264us total) trans 21474840767 rc 0/0 00000100:00100000:0.0:1746066782.318625:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13821 00000100:00100000:0.0:1746066782.318633:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976730880 00000100:00100000:0.0:1746066782.318634:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976730880 00000100:00100000:0.0:1746066782.318642:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13835 00000100:00100000:0.0:1746066782.318645:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3294:x1830882976731008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066782.318732:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746066782.318735:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746066782.318736:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066782.318738:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746066782.318740:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746066782.318764:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3294:x1830882976731008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (283us total) trans 17179873442 rc 0/0 00000100:00100000:0.0:1746066782.318768:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13835 00000100:00100000:0.0:1746066782.318777:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13837 00000100:00100000:0.0:1746066782.318781:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3294:x1830882976730880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066782.318841:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3294:x1830882976730880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (319us total) trans 17179873444 rc 0/0 00000100:00100000:0.0:1746066782.318845:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13837 00000004:00080000:0.0:1746066782.318862:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009244ea00/2, rc 0, transno 17179873443 00000100:00100000:0.0:1746066782.318864:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976730368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066782.318869:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c22f100/2, rc 0, transno 17179873444 00000100:00100000:0.0:1746066782.318872:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976730880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066782.318876:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c22ed80/2, rc 0, transno 17179873442 00000100:00100000:0.0:1746066782.318878:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c22ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976731008:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066782.318904:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066782.318906:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066781 -> 1746066781 00002000:00010000:0.0:1746066782.318907:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066781 -> 1746066781 00002000:00010000:0.0:1746066782.318909:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066781 -> 1746066781 00002000:00010000:0.0:1746066782.318911:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746066782.318927:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3293:x1830882976729344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2435us (2508us total) trans 21474840761 rc 0/0 00000100:00100000:0.0:1746066782.318934:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13823 00000004:00080000:0.0:1746066782.319729:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136b42a00/2, rc 0, transno 21474840761 00000100:00100000:0.0:1746066782.319733:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976729344:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066782.319740:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e5d180/2, rc 0, transno 21474840760 00000100:00100000:0.0:1746066782.319742:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976729856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066782.319748:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136b41180/2, rc 0, transno 21474840767 00000100:00100000:0.0:1746066782.319750:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976729216:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066782.319756:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e5f800/2, rc 0, transno 21474840766 00000100:00100000:0.0:1746066782.319758:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976729728:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066782.319831:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:0.0:1746066782.319834:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066781 -> 1746066781 00002000:00010000:0.0:1746066782.319836:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066781 -> 1746066781 00002000:00010000:0.0:1746066782.319837:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066781 -> 1746066781 00002000:00010000:0.0:1746066782.319839:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5921 -> 5921 00000100:00100000:0.0:1746066782.319861:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3294:x1830882976730496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1222us (1403us total) trans 17179873445 rc 0/0 00000100:00100000:0.0:1746066782.319867:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13834 00000100:00100000:0.0:1746066782.320878:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.324338:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.331335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.331375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.331415:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.342865:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.350114:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e636300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976732160:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066782.350124:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e634000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976732288:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066782.350150:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135459400/0xfb36a14ee60898ee lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:0.0:1746066782.351022:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976645888 00000100:00100000:0.0:1746066782.351026:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976645888 00000100:00100000:0.0:1746066782.351048:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9810 00000100:00100000:0.0:1746066782.351052:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31272:x1830882976645888:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066782.351068:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.351078:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013082f800/0xfb36a14ee60898f5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d54e expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.351386:0:16018:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135459400/0xfb36a14ee60898ee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066782.351393:0:16018:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013082f800/0xfb36a14ee60898f5 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d54e expref: 252 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.351406:0:16018:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880135459400/0xfb36a14ee60898ee lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066782.351415:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013082f800/0xfb36a14ee60898f5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d54e expref: 252 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.351424:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066782.351426:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066782.351428:0:16018:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013082f800/0xfb36a14ee60898f5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d54e expref: 252 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.351437:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013082f800, rc 0) 00000100:00100000:0.0:1746066782.351453:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31272:x1830882976645888:12345-192.168.202.57@tcp:101:cat.0 Request processed in 401us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.351458:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9810 00010000:00010000:0.0:1746066782.351473:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135459400/0xfb36a14ee60898ee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066782.351478:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135459400/0xfb36a14ee60898ee lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 809 initiator: MDT0 00000040:00080000:0.0:1746066782.352131:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2988, 88 off252184 00000004:00080000:0.0:1746066782.352136:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743529459600ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066782.352180:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3017, 88 off254656 00000004:00080000:0.0:1746066782.352184:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743529508163ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066782.352205:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3018, 88 off254744 00000004:00080000:0.0:1746066782.352208:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743529531853ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066782.353138:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2989, 88 off252272 00000004:00080000:0.0:1746066782.353144:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743530468324ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066782.353169:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2990, 88 off252360 00000004:00080000:0.0:1746066782.353171:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743530495492ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066782.353180:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3019, 88 off254832 00000004:00080000:0.0:1746066782.353182:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743530506434ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066782.354121:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3020, 88 off254920 00000004:00080000:0.0:1746066782.354127:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743531450727ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066782.354133:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3021, 88 off255008 00000004:00080000:0.0:1746066782.354135:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743531459016ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066782.354143:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2991, 88 off252448 00000004:00080000:0.0:1746066782.354145:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743531469529ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066782.354151:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3022, 88 off255096 00000004:00080000:0.0:1746066782.354155:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743531479019ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066782.354160:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2992, 88 off252536 00000004:00080000:0.0:1746066782.354162:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743531486242ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066782.354167:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3023, 88 off255184 00000004:00080000:0.0:1746066782.354169:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743531493447ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066782.354174:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2993, 88 off252624 00000004:00080000:0.0:1746066782.354176:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743531500161ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066782.354181:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2994, 88 off252712 00000004:00080000:0.0:1746066782.354183:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743531507319ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066782.354189:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2995, 88 off252800 00000004:00080000:0.0:1746066782.354191:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743531514877ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066782.354196:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2996, 88 off252888 00000004:00080000:0.0:1746066782.354197:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 743531521606ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066782.354202:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3024, 88 off255272 00000004:00080000:0.0:1746066782.354204:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 743531528242ns, next at 739495247010ns, rc = 0 00000100:00100000:0.0:1746066782.372733:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976646144 00000100:00100000:0.0:1746066782.372742:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976646144 00000100:00100000:0.0:1746066782.372776:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9811 00000100:00100000:0.0:1746066782.372782:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+10:31285:x1830882976646144:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066782.372798:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.372813:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009edf6c00/0xfb36a14ee60898fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d555 expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.372893:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1000/0xfb36a14ee6089903 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.372907:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1000/0xfb36a14ee6089903 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.372915:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1000/0xfb36a14ee6089903 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.372925:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1600/0xfb36a14ee608990a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.372929:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1600/0xfb36a14ee608990a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.372934:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1600/0xfb36a14ee608990a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373011:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f31000/0xfb36a14ee6089911 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373017:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f31000/0xfb36a14ee6089911 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373023:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f31000/0xfb36a14ee6089911 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:0.0:1746066782.373029:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066782.373120:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f31000/0xfb36a14ee6089911 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373126:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f31000/0xfb36a14ee6089911 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373131:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135f31000/0xfb36a14ee6089911 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373139:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f31000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066782.373142:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135f31000/0xfb36a14ee6089911 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373147:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135f31000/0xfb36a14ee6089911 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373156:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066782.373158:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746066782.373162:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135f31000/0xfb36a14ee6089911 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373167:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f31000/0xfb36a14ee6089911 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373176:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1000/0xfb36a14ee6089903 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373180:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1000/0xfb36a14ee6089903 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373184:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1000/0xfb36a14ee6089903 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373188:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5d1000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066782.373189:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1000/0xfb36a14ee6089903 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373193:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1000/0xfb36a14ee6089903 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373198:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066782.373199:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066782.373202:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1000/0xfb36a14ee6089903 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373205:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1000/0xfb36a14ee6089903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373211:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1600/0xfb36a14ee608990a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373215:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1600/0xfb36a14ee608990a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373219:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1600/0xfb36a14ee608990a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373222:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f5d1600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066782.373224:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1600/0xfb36a14ee608990a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373228:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1600/0xfb36a14ee608990a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373232:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800921a4d00) 00010000:00010000:0.0:1746066782.373234:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066782.373236:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1600/0xfb36a14ee608990a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373240:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f5d1600/0xfb36a14ee608990a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.373266:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009edf6c00/0xfb36a14ee60898fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d555 expref: 12 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.373272:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009edf6c00/0xfb36a14ee60898fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d555 expref: 12 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.373279:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edf6c00, rc 0) 00000100:00100000:0.0:1746066782.375518:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:31285:x1830882976646144:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2726us (4677us total) trans 8589943827 rc 301/301 00000100:00100000:0.0:1746066782.375528:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9811 00000100:00100000:0.0:1746066782.380376:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976646272 00000100:00100000:0.0:1746066782.380383:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976646272 00000100:00100000:0.0:1746066782.380416:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9812 00000100:00100000:0.0:1746066782.380423:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:31285:x1830882976646272:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066782.380440:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.380454:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092590400/0xfb36a14ee608991f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d55c expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.380515:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee6089926 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.380525:0:16018:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee6089926 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.380533:0:16018:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee6089926 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.389930:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135459400/0xfb36a14ee60898ee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d547 expref: 13 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.389941:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066782.389944:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746066782.389947:0:809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee6089926 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.389957:0:809:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee6089926 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.389962:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee6089926 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.389968:0:809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013082f800/0xfb36a14ee60898f5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d54e expref: 251 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.389974:0:809:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013082f800/0xfb36a14ee60898f5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d54e expref: 251 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.389980:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013082f800/0xfb36a14ee60898f5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d54e expref: 251 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.390010:0:809:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013082f800/0xfb36a14ee60898f5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d54e expref: 251 pid: 16018 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066782.390020:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092848000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976732416:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066782.390104:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7278780 going to sleep for 11 seconds 00000001:00080000:0.0:1746066782.390119:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943826 is committed 00000004:00080000:0.0:1746066782.390125:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2298 committed 00000004:00080000:0.0:1746066782.390130:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2270 committed 00000004:00080000:0.0:1746066782.390134:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2269 committed 00000004:00080000:0.0:1746066782.390135:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2268 committed 00000004:00080000:0.0:1746066782.390137:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2267 committed 00000004:00080000:0.0:1746066782.390139:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2297 committed 00000004:00080000:0.0:1746066782.390140:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2266 committed 00000004:00080000:0.0:1746066782.390141:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2296 committed 00000004:00080000:0.0:1746066782.390143:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2265 committed 00000004:00080000:0.0:1746066782.390145:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2295 committed 00000004:00080000:0.0:1746066782.390146:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2294 committed 00000004:00080000:0.0:1746066782.390147:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2293 committed 00000004:00080000:0.0:1746066782.390149:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2264 committed 00000004:00080000:0.0:1746066782.390150:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2263 committed 00000004:00080000:0.0:1746066782.390151:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2292 committed 00000004:00080000:0.0:1746066782.390152:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2291 committed 00000004:00080000:0.0:1746066782.390154:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2262 committed 00000001:00080000:0.0:1746066782.390162:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943824 is committed 00000001:00080000:0.0:1746066782.390166:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943822 is committed 00000001:00080000:0.0:1746066782.390169:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943825 is committed 00000100:00100000:0.0:1746066782.394071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.396673:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976646656 00000100:00100000:0.0:1746066782.396704:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976646656 00000100:00100000:0.0:1746066782.396725:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9814 00000100:00100000:0.0:1746066782.396729:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+9:31285:x1830882976646656:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066782.396736:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.396741:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9a1200/0xfb36a14ee6089934 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d56a expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.397042:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9a1200/0xfb36a14ee6089934 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d56a expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.397051:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f9a1200/0xfb36a14ee6089934 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d56a expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.397063:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066782.397066:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066782.397069:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9a1200, rc 0) 00000100:00100000:0.0:1746066782.397089:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+10:31285:x1830882976646656:12345-192.168.202.57@tcp:101:cat.0 Request processed in 359us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.397094:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9814 00000100:00100000:0.0:1746066782.401856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.401894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.403964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.403992:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.404010:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.404031:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.404043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.404058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.404117:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.404132:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976647296 00000100:00100000:0.0:1746066782.404140:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976647296 00000100:00100000:0.0:1746066782.404157:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976647424 00000100:00100000:0.0:1746066782.404159:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976647424 00000100:00100000:0.0:1746066782.404167:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976647680 00000100:00100000:0.0:1746066782.404168:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976647680 00000100:00100000:0.0:1746066782.404176:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976647808 00000100:00100000:0.0:1746066782.404178:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976647808 00000100:00100000:0.0:1746066782.404186:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13857 00000100:00100000:0.0:1746066782.404191:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882976647296:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066782.404199:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.404209:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9a0c00/0xfb36a14ee6089949 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d57f expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066782.404242:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976734720:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066782.404292:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a72783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066782.404307:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13859 00000100:00100000:0.0:1746066782.404312:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+34:1965:x1830882976647680:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066782.404319:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.404327:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1400/0xfb36a14ee6089957 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d594 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.404339:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.404340:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.404345:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1400/0xfb36a14ee6089957 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d594 expref: 35 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066782.404356:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1400/0xfb36a14ee6089957 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d594 expref: 36 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066782.404363:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9a1400, rc 0) 00000100:00100000:0.0:1746066782.404378:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+36:1965:x1830882976647680:12345-192.168.202.57@tcp:101:cat.0 Request processed in 66us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.404383:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13859 00000100:00100000:0.0:1746066782.404394:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13861 00000100:00100000:0.0:1746066782.404399:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882976647808:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066782.406323:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.406337:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9a0a00/0xfb36a14ee608996c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d59b expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.406355:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.406357:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.406364:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f9a0a00/0xfb36a14ee608996c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d59b expref: 28 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066782.406376:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f9a0a00/0xfb36a14ee608996c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d59b expref: 28 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066782.406384:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9a0a00, rc 0) 00000100:00100000:0.0:1746066782.406407:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882976647808:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2008us (2363us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.406413:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13861 00000100:00100000:0.0:1746066782.406427:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976648576 00000100:00100000:0.0:1746066782.406430:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976648576 00000100:00100000:0.0:1746066782.407598:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976648448 00000100:00100000:0.0:1746066782.407602:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976648448 00000100:00100000:0.0:1746066782.407622:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13866 00000100:00100000:0.0:1746066782.407626:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1964:x1830882976648448:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066782.407632:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.407638:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f9a1e00/0xfb36a14ee6089988 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d5b0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066782.407672:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976734976:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066782.408129:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a72789c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066782.411826:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.417050:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.417098:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.419812:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.433198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.433237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.433266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.433346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.434108:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6232 00000100:00100000:0.0:1746066782.434115:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+29:1965:x1830882976650624:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066782.452210:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.453768:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.454013:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+29:1965:x1830882976650624:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19898us (20667us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066782.454019:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6232 00002000:00100000:0.0:1746066782.454027:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800a8694380 x1830882976650624/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/440 e 0 to 0 dl 1746066793 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.454036:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8694380 with x1830882976650624 ext(1048576->2097151) 00002000:00010000:0.0:1746066782.454039:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8694380 00000100:00100000:0.0:1746066782.458245:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.461425:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.462015:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.468077:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.472106:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.473994:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.488198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.494816:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.528020:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.571399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.585241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.588638:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.604655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.609859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.609943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.611393:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.613770:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.613800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.613829:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.613926:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976656128 00000100:00100000:0.0:1746066782.613928:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976656128 00002000:00100000:0.0:1746066782.613938:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009ed09500 x1830882976656128/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.613944:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed09500 with x1830882976656128 ext(1048576->2097151) 00002000:00010000:0.0:1746066782.613947:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed09500 00000100:00100000:0.0:1746066782.613957:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6241 00000100:00100000:0.0:1746066782.613962:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+43:1964:x1830882976656256:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066782.651592:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.656368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.656402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.656420:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976657152 00000100:00100000:0.0:1746066782.656425:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976657152 00000100:00100000:0.0:1746066782.656465:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 350 00000100:00100000:0.0:1746066782.656470:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1963:x1830882976657152:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1746066782.656504:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1963:x1830882976657152:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.656508:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 350 00000100:00100000:0.0:1746066782.656533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.656589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.656600:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976657280 00000100:00100000:0.0:1746066782.656603:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976657280 00000100:00100000:0.0:1746066782.656617:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 351 00000100:00100000:0.0:1746066782.656621:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1963:x1830882976657280:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1746066782.656644:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1963:x1830882976657280:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 23us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.656648:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 351 00000100:00100000:0.0:1746066782.659336:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.669782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.669820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.669850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.670889:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6246 00000100:00100000:0.0:1746066782.670897:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+43:1963:x1830882976658176:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066782.718292:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976658560 00000100:00100000:0.0:1746066782.718299:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976658560 00000100:00100000:0.0:1746066782.718344:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4056 00000100:00100000:0.0:1746066782.718350:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:31291:x1830882976658560:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:0.0:1746066782.719408:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.722444:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.726890:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.727861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.728325:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.735968:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976659584 00000100:00100000:0.0:1746066782.735974:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976659584 00000100:00100000:0.0:1746066782.736003:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13873 00000100:00100000:0.0:1746066782.736009:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+29:31299:x1830882976659584:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066782.736022:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.736034:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013082e200/0xfb36a14ee6089a37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d60b expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.736051:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 30 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.736057:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066782.736058:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066782.736061:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013082e200/0xfb36a14ee6089a37 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d60b expref: 30 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.736079:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 30 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.736088:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 30 pid: 4614 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746066782.736097:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976736384:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066782.736130:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7278cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066782.738824:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976736256:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066782.738840:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066782.738869:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+30:1966:x1830882976659456:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4093us (4472us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.738878:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7071 00000100:00100000:0.0:1746066782.738927:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976736384:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066782.738945:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013082e200/0xfb36a14ee6089a37 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d60b expref: 29 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.738956:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013082e200, rc 0) 00000100:00100000:0.0:1746066782.738971:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+29:31299:x1830882976659584:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2963us (4320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.738976:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13873 00000100:00100000:0.0:1746066782.739314:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.739332:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976659840 00000100:00100000:0.0:1746066782.739337:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976659840 00002000:00100000:0.0:1746066782.739363:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1806336->1810431) req@ffff88009bfe3b80 x1830882976659840/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.739371:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3b80 with x1830882976659840 ext(1806336->1810431) 00010000:00010000:0.0:1746066782.739377:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 29 pid: 4614 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.739387:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 29 pid: 4614 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746066782.739392:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe3b80 00000100:00100000:0.0:1746066782.739405:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2057 00000100:00100000:0.0:1746066782.739410:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882976659840:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066782.739517:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882976659840:12345-192.168.202.57@tcp:3:cat.0 Request processed in 106us (203us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066782.739522:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2057 00002000:00100000:0.0:1746066782.739527:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1806336->1810431) req@ffff88009bfe3b80 x1830882976659840/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/4536 e 0 to 0 dl 1746066793 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.739534:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3b80 with x1830882976659840 ext(1806336->1810431) 00010000:00010000:0.0:1746066782.739539:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 29 pid: 4614 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.739547:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 29 pid: 4614 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746066782.739552:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe3b80 00000100:00100000:0.0:1746066782.747572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.747598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.747614:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976660096 00000100:00100000:0.0:1746066782.747621:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976660096 00002000:00100000:0.0:1746066782.747656:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38e:0x0] (1806336->2097151) req@ffff88009bfe1500 x1830882976660096/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.747665:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1500 with x1830882976660096 ext(1806336->2097151) 00010000:00010000:0.0:1746066782.747672:0:1992:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 29 pid: 4614 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.747724:0:1992:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 29 pid: 4614 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746066782.747730:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe1500 00000100:00100000:0.0:1746066782.747745:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2058 00000100:00100000:0.0:1746066782.747751:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882976660096:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066782.748066:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.748079:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976660352 00000100:00100000:0.0:1746066782.748082:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976660352 00000100:00100000:0.0:1746066782.748098:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13875 00000100:00100000:0.0:1746066782.748102:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+46:31293:x1830882976660352:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066782.748108:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.748114:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d619 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.748124:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.748125:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.748128:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1986560->2097151] (req 1986560->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d619 expref: 47 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.748136:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1986560->2097151] (req 1986560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d619 expref: 47 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.748143:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092591c00, rc 0) 00000100:00100000:0.0:1746066782.748163:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+47:31293:x1830882976660352:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 60us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.748168:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13875 00000100:00100000:0.0:1746066782.754309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.754327:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976660608 00000100:00100000:0.0:1746066782.754333:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976660608 00010000:00010000:0.0:1746066782.754358:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136148600/0xfb36a14ee608995e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d58d expref: 37 pid: 8450 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746066782.754387:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7072 00000100:00100000:0.0:1746066782.754394:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+37:1965:x1830882976660608:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066782.754405:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066782.754421:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136148600/0xfb36a14ee608995e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d58d expref: 37 pid: 8450 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.754430:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136148600/0xfb36a14ee608995e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d58d expref: 37 pid: 8450 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.754449:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066782.754479:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+37:1965:x1830882976660608:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 85us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.754485:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7072 00000100:00100000:0.0:1746066782.754535:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.754547:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976660480 00000100:00100000:0.0:1746066782.754550:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976660480 00010000:00010000:0.0:1746066782.754561:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136149a00/0xfb36a14ee6089981 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5be expref: 47 pid: 9776 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746066782.754574:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7073 00000100:00100000:0.0:1746066782.754577:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5219c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+47:1965:x1830882976660480:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066782.754583:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066782.754589:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136149a00/0xfb36a14ee6089981 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5be expref: 47 pid: 9776 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.754600:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136149a00/0xfb36a14ee6089981 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5be expref: 47 pid: 9776 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.754611:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136149a00/0xfb36a14ee6089981 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5be expref: 47 pid: 9776 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.754620:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.754621:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.754627:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee2a800/0xfb36a14ee6089a3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->1986559] (req 1048576->1421311) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d612 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.754633:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee2a800/0xfb36a14ee6089a3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->1986559] (req 1048576->1421311) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d612 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.754639:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.754641:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.754644:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1986560->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d619 expref: 46 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.754649:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1986560->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d619 expref: 46 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.754670:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1986560->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d619 expref: 46 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066782.754704:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976736768:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066782.754746:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee2a800/0xfb36a14ee6089a3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->1986559] (req 1048576->1421311) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d612 expref: 34 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066782.754753:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976736896:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066782.754768:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a72783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066782.759581:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976736768:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066782.759598:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976736896:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066782.759616:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066782.759648:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5219c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+46:1965:x1830882976660480:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5068us (5111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.759658:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7073 00000100:00100000:0.0:1746066782.759800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.759847:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976660864 00000100:00100000:0.0:1746066782.759852:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976660864 00002000:00100000:0.0:1746066782.759881:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x390:0x0] (1986560->1990655) req@ffff88009bfe3480 x1830882976660864/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.759891:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3480 with x1830882976660864 ext(1986560->1990655) 00002000:00010000:0.0:1746066782.759894:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3480 00000100:00100000:0.0:1746066782.759909:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6248 00000100:00100000:0.0:1746066782.759915:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+46:1963:x1830882976660864:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066782.760144:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+46:1963:x1830882976660864:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 229us (345us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066782.760150:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6248 00002000:00100000:0.0:1746066782.760155:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x390:0x0] (1986560->1990655) req@ffff88009bfe3480 x1830882976660864/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:188/0 lens 488/4536 e 0 to 0 dl 1746066793 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.760162:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3480 with x1830882976660864 ext(1986560->1990655) 00002000:00010000:0.0:1746066782.760165:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3480 00000100:00100000:0.0:1746066782.763303:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.763328:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976661120 00000100:00100000:0.0:1746066782.763335:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976661120 00002000:00100000:0.0:1746066782.763369:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1417216->1421311) req@ffff88009bfe2680 x1830882976661120/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.763379:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2680 with x1830882976661120 ext(1417216->1421311) 00002000:00010000:0.0:1746066782.763384:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2680 00000100:00100000:0.0:1746066782.763400:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6249 00000100:00100000:0.0:1746066782.763406:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+35:1963:x1830882976661120:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066782.763514:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+35:1963:x1830882976661120:12345-192.168.202.57@tcp:3:cat.0 Request processed in 108us (216us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066782.763520:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6249 00002000:00100000:0.0:1746066782.763534:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1417216->1421311) req@ffff88009bfe2680 x1830882976661120/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/4536 e 0 to 0 dl 1746066793 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.763540:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2680 with x1830882976661120 ext(1417216->1421311) 00002000:00010000:0.0:1746066782.763543:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2680 00000100:00100000:0.0:1746066782.765493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.767072:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.783866:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.783905:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092046a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976737152:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066782.783934:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee2bc00/0xfb36a14ee6089a4c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->2723839] (req 2097152->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d620 expref: 47 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.784965:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee2bc00, rc 0) 00000100:00100000:0.0:1746066782.784993:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976661632 00000100:00100000:0.0:1746066782.784998:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976661632 00010000:00010000:0.0:1746066782.785023:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1400/0xfb36a14ee6089957 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d594 expref: 35 pid: 10402 timeout: 843 lvb_type: 1 00000100:00100000:0.0:1746066782.785045:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7074 00000100:00100000:0.0:1746066782.785052:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+35:1963:x1830882976661632:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066782.785062:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066782.785076:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1400/0xfb36a14ee6089957 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d594 expref: 35 pid: 10402 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.785085:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1400/0xfb36a14ee6089957 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d594 expref: 35 pid: 10402 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.785103:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1400/0xfb36a14ee6089957 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d594 expref: 35 pid: 10402 timeout: 843 lvb_type: 1 00010000:00010000:0.0:1746066782.785111:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066782.785143:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+34:1963:x1830882976661632:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 91us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.785149:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7074 00000100:00100000:0.0:1746066782.786763:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+47:31293:x1830882976661248:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 19476us (21268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.786772:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13876 00000100:00100000:0.0:1746066782.787157:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+31:1964:x1830882976660096:12345-192.168.202.57@tcp:4:cat.0 Request processed in 39404us (39556us total) trans 21474840778 rc 0/0 00000100:00100000:0.0:1746066782.787253:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2058 00002000:00100000:0.0:1746066782.787279:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38e:0x0] (1806336->2097151) req@ffff88009bfe1500 x1830882976660096/t21474840778(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/448 e 0 to 0 dl 1746066793 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.787288:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1500 with x1830882976660096 ext(1806336->2097151) 00010000:00010000:0.0:1746066782.787296:0:1992:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 31 pid: 4614 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.787306:0:1992:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 31 pid: 4614 timeout: 843 lvb_type: 0 00002000:00010000:0.0:1746066782.787312:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe1500 00000100:00100000:0.0:1746066782.787358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.787407:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976661760 00000100:00100000:0.0:1746066782.787412:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976661760 00010000:00010000:0.0:1746066782.787430:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135458a00/0xfb36a14ee6089877 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d516 expref: 47 pid: 10402 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746066782.787449:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7075 00000100:00100000:0.0:1746066782.787454:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+47:1964:x1830882976661760:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066782.787463:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066782.787477:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135458a00/0xfb36a14ee6089877 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d516 expref: 47 pid: 10402 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.787485:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135458a00/0xfb36a14ee6089877 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d516 expref: 47 pid: 10402 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.787500:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135458a00/0xfb36a14ee6089877 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d516 expref: 47 pid: 10402 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.787510:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.787511:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.787517:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee2bc00/0xfb36a14ee6089a4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2723839) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d620 expref: 46 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.787524:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee2bc00/0xfb36a14ee6089a4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2723839) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d620 expref: 46 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.787550:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee2bc00/0xfb36a14ee6089a4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2723839) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d620 expref: 46 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066782.787559:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976737280:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066782.787797:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7278780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066782.790578:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.790603:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976661888 00000100:00100000:0.0:1746066782.790609:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976661888 00010000:00010000:0.0:1746066782.790635:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 31 pid: 4614 timeout: 843 lvb_type: 0 00000100:00100000:0.0:1746066782.790656:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7076 00000100:00100000:0.0:1746066782.790663:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+31:1965:x1830882976661888:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066782.790673:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746066782.790716:0:7108:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066781 -> 1746066782 00002000:00010000:0.0:1746066782.790719:0:7108:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066781 -> 1746066782 00010000:00010000:0.0:1746066782.790724:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 31 pid: 4614 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.790733:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 31 pid: 4614 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.790751:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed2de00/0xfb36a14ee6089a06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1806336->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5fd expref: 31 pid: 4614 timeout: 843 lvb_type: 0 00010000:00010000:0.0:1746066782.790763:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.790765:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.790770:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013082e200/0xfb36a14ee6089a37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d60b expref: 30 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.790776:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013082e200/0xfb36a14ee6089a37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d60b expref: 30 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.790801:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013082e200/0xfb36a14ee6089a37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d60b expref: 30 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066782.790811:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996dad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976737408:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066782.791261:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a72789c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066782.812163:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.812188:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.812211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.812247:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976737280:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066782.812264:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066782.812301:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+46:1964:x1830882976661760:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 24846us (24943us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.812311:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7075 00000100:00100000:0.0:1746066782.812342:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976662144 00000100:00100000:0.0:1746066782.812347:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976662144 00002000:00100000:0.0:1746066782.812374:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (2719744->2723839) req@ffff880135433480 x1830882976662144/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.812383:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135433480 with x1830882976662144 ext(2719744->2723839) 00002000:00010000:0.0:1746066782.812387:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135433480 00000100:00100000:0.0:1746066782.812398:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976662400 00000100:00100000:0.0:1746066782.812400:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976662400 00002000:00100000:0.0:1746066782.812411:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880135430380 x1830882976662400/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.812417:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135430380 with x1830882976662400 ext(1048576->2097151) 00002000:00010000:0.0:1746066782.812420:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135430380 00000100:00100000:0.0:1746066782.812427:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976662656 00000100:00100000:0.0:1746066782.812429:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976662656 00002000:00100000:0.0:1746066782.812437:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x390:0x0] (1421312->1986559) req@ffff880135430e00 x1830882976662656/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/0 e 0 to 0 dl 1746066793 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.812442:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135430e00 with x1830882976662656 ext(1421312->1986559) 00002000:00010000:0.0:1746066782.812444:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135430e00 00000100:00100000:0.0:1746066782.812454:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6250 00000100:00100000:0.0:1746066782.812459:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+46:1965:x1830882976662144:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066782.812566:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+46:1965:x1830882976662144:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 106us (409us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066782.812571:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6250 00002000:00100000:0.0:1746066782.812575:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (2719744->2723839) req@ffff880135433480 x1830882976662144/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:188/0 lens 488/4536 e 0 to 0 dl 1746066793 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.812580:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135433480 with x1830882976662144 ext(2719744->2723839) 00002000:00010000:0.0:1746066782.812582:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135433480 00000100:00100000:0.0:1746066782.812591:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6251 00000100:00100000:0.0:1746066782.812595:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+31:1965:x1830882976662400:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066782.812651:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996dad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976737408:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066782.812660:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066782.812698:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+31:1965:x1830882976661888:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 22012us (22103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.812705:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7076 00000100:00100000:0.0:1746066782.812723:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6252 00000100:00100000:0.0:1746066782.812728:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+34:1965:x1830882976662656:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066782.826036:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+34:1965:x1830882976662656:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13300us (13816us total) trans 0 rc 565248/565248 00000100:00100000:0.0:1746066782.826047:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6252 00002000:00100000:0.0:1746066782.826057:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x390:0x0] (1421312->1986559) req@ffff880135430e00 x1830882976662656/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/440 e 0 to 0 dl 1746066793 ref 1 fl Complete:/200/0 rc 565248/565248 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.826065:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135430e00 with x1830882976662656 ext(1421312->1986559) 00002000:00010000:0.0:1746066782.826070:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135430e00 00000100:00100000:0.0:1746066782.836815:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+30:1965:x1830882976662400:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24213us (24620us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066782.836826:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6251 00002000:00100000:0.0:1746066782.836837:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880135430380 x1830882976662400/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:188/0 lens 488/440 e 0 to 0 dl 1746066793 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.836845:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135430380 with x1830882976662400 ext(1048576->2097151) 00002000:00010000:0.0:1746066782.836851:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135430380 00000100:00100000:0.0:1746066782.850760:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.850788:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976662784 00000100:00100000:0.0:1746066782.850795:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976662784 00000100:00100000:0.0:1746066782.850828:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13877 00000100:00100000:0.0:1746066782.850835:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+34:31299:x1830882976662784:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066782.850848:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.850861:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed06c00/0xfb36a14ee6089a53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d627 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.850883:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee2a800/0xfb36a14ee6089a3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->1986559] (req 1048576->1421311) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d612 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.850891:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1986560->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d619 expref: 45 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.850897:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066782.850899:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066782.850902:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed06c00/0xfb36a14ee6089a53 lrc: 5/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d627 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.850925:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1986560->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d619 expref: 45 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.850936:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1986560->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d619 expref: 45 pid: 10402 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746066782.850947:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976737536:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066782.851025:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee2a800/0xfb36a14ee6089a3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->1986559] (req 1048576->1421311) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d612 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.851033:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee2a800/0xfb36a14ee6089a3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->1986559] (req 1048576->1421311) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d612 expref: 35 pid: 4614 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746066782.851040:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976737664:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066782.851056:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099616a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066782.853888:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976737536:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066782.853897:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976737664:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066782.853920:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed06c00/0xfb36a14ee6089a53 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d627 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.853932:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed06c00, rc 0) 00000100:00100000:0.0:1746066782.853959:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+35:31299:x1830882976662784:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3125us (3205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.853966:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13877 00000100:00100000:0.0:1746066782.858192:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.858820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.867223:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+48:1966:x1830882976662912:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 7941us (8398us total) trans 17179873455 rc 0/0 00000100:00100000:0.0:1746066782.867236:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2060 00002000:00100000:0.0:1746066782.867243:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x390:0x0] (1986560->2097151) req@ffff880135431c00 x1830882976662912/t17179873455(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:188/0 lens 488/448 e 0 to 0 dl 1746066793 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066782.867252:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135431c00 with x1830882976662912 ext(1986560->2097151) 00010000:00010000:0.0:1746066782.867260:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1986560->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d619 expref: 48 pid: 10402 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066782.867272:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1986560->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d619 expref: 48 pid: 10402 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746066782.867278:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135431c00 00000100:00100000:0.0:1746066782.871191:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.872325:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976663168 00000100:00100000:0.0:1746066782.872332:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976663168 00010000:00010000:0.0:1746066782.872360:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1986560->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d619 expref: 48 pid: 10402 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746066782.872383:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7077 00000100:00100000:0.0:1746066782.872390:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+48:1965:x1830882976663168:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066782.872400:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746066782.872414:0:7108:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066781 -> 1746066782 00002000:00010000:0.0:1746066782.872417:0:7108:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066781 -> 1746066782 00010000:00010000:0.0:1746066782.872422:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1986560->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d619 expref: 48 pid: 10402 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066782.872436:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1986560->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d619 expref: 48 pid: 10402 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066782.872456:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092591c00/0xfb36a14ee6089a45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1986560->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d619 expref: 48 pid: 10402 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066782.872801:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066782.872840:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+47:1965:x1830882976663168:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 450us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.872846:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7077 00000100:00100000:0.0:1746066782.873884:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.873900:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976663296 00000100:00100000:0.0:1746066782.873903:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976663296 00010000:00010000:0.0:1746066782.873917:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee2a800/0xfb36a14ee6089a3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->1986559] (req 1048576->1421311) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d612 expref: 37 pid: 4614 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746066782.873932:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7078 00000100:00100000:0.0:1746066782.873937:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135432300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+37:1964:x1830882976663296:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066782.873945:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066782.873956:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee2a800/0xfb36a14ee6089a3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->1986559] (req 1048576->1421311) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d612 expref: 37 pid: 4614 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066782.873964:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee2a800/0xfb36a14ee6089a3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->1986559] (req 1048576->1421311) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d612 expref: 37 pid: 4614 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066782.874336:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee2a800/0xfb36a14ee6089a3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->1986559] (req 1048576->1421311) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d612 expref: 37 pid: 4614 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066782.874345:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.874347:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.874352:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed06c00/0xfb36a14ee6089a53 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d627 expref: 36 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.874358:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed06c00/0xfb36a14ee6089a53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d627 expref: 36 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.874383:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed06c00/0xfb36a14ee6089a53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d627 expref: 36 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066782.874393:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976737792:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066782.874517:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab9c0 going to sleep for 11 seconds 00000001:00080000:0.0:1746066782.887581:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873445 is committed 00000001:00080000:0.0:1746066782.887602:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873409 is committed 00000001:00080000:0.0:1746066782.887609:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873393 is committed 00000001:00080000:0.0:1746066782.887616:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873453 is committed 00000001:00080000:0.0:1746066782.887630:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873431 is committed 00000001:00080000:0.0:1746066782.887635:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873430 is committed 00000001:00080000:0.0:1746066782.887664:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873454 is committed 00000001:00080000:0.0:1746066782.887709:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873436 is committed 00000001:00080000:0.0:1746066782.887716:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873434 is committed 00000001:00080000:0.0:1746066782.887979:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873435 is committed 00000100:00100000:0.0:1746066782.891303:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.894348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.915158:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.926325:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.927980:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.932759:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.948667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.958116:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.965672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.969065:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.969129:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.969162:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.969182:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.969202:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976665344 00000100:00100000:0.0:1746066782.969207:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976665344 00000100:00100000:0.0:1746066782.969238:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976665472 00000100:00100000:0.0:1746066782.969240:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976665472 00000100:00100000:0.0:1746066782.969251:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976665600 00000100:00100000:0.0:1746066782.969252:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976665600 00000100:00100000:0.0:1746066782.969265:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13879 00000100:00100000:0.0:1746066782.969276:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+13:1963:x1830882976665344:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066782.969290:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.969302:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dee0a00/0xfb36a14ee6089ac3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d64a expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.969317:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.969319:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066782.969325:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dee0a00/0xfb36a14ee6089ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d64a expref: 14 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066782.969339:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dee0a00/0xfb36a14ee6089ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d64a expref: 14 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066782.969345:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee0a00, rc 0) 00000100:00100000:0.0:1746066782.969504:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1963:x1830882976665344:12345-192.168.202.57@tcp:101:cat.0 Request processed in 232us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066782.969509:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13879 00000100:00100000:0.0:1746066782.969527:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976665856 00000100:00100000:0.0:1746066782.969530:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976665856 00000100:00100000:0.0:1746066782.969557:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9822 00000100:00100000:0.0:1746066782.969563:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:31309:x1830882976665856:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066782.969573:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066782.969582:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1400/0xfb36a14ee6089ad8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d65f expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.969654:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee6089adf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.969663:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee6089adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.969670:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee6089adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.969722:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee6089ae6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.969729:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee6089ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.969736:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee6089ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.969846:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0e00/0xfb36a14ee6089aed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.969856:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0e00/0xfb36a14ee6089aed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.969862:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0e00/0xfb36a14ee6089aed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:0.0:1746066782.969871:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066782.969955:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee6089adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.969963:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee6089adf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.969968:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee6089adf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.969973:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dee1200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066782.969976:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee6089adf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.969982:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee6089adf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.969992:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066782.969995:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066782.969999:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee6089adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.970006:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee6089adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.970033:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee6089ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.970040:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee6089ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.970044:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee6089ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.970048:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dee0000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066782.970050:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee6089ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.970054:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee6089ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.970061:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d3b8100) 00010000:00010000:0.0:1746066782.970063:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066782.970065:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee6089ae6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.970069:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee6089ae6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066782.970104:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1400/0xfb36a14ee6089ad8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d65f expref: 262 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.970115:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0e00/0xfb36a14ee6089aed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d65f expref: 261 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066782.970124:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066782.970126:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066782.970129:0:16018:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093d01400/0xfb36a14ee6089abc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.970135:0:16018:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093d01400/0xfb36a14ee6089abc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066782.970139:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee0e00, rc 0) 00000100:00100000:0.0:1746066782.970188:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:31309:x1830882976665856:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 625us (1128us total) trans 8589943840 rc 0/0 00000100:00100000:0.0:1746066782.970193:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9822 00000100:00100000:0.0:1746066782.985828:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066782.998202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.002873:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066783.003195:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066783.004192:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.004218:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.004243:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.004255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.004278:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.004290:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976667136 00000100:00100000:0.0:1746066783.004293:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976667136 00000100:00100000:0.0:1746066783.004311:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976667264 00000100:00100000:0.0:1746066783.004313:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976667264 00000100:00100000:0.0:1746066783.004325:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13883 00000100:00100000:0.0:1746066783.004330:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1966:x1830882976667392:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066783.004339:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066783.004348:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dee1800/0xfb36a14ee6089b02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d67b expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.004359:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.004360:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.004365:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dee1800/0xfb36a14ee6089b02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d67b expref: 8 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066783.004374:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008dee1800/0xfb36a14ee6089b02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d67b expref: 8 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066783.004381:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee1800, rc 0) 00000100:00100000:0.0:1746066783.004399:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1966:x1830882976667392:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 70us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066783.004404:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13883 00000100:00100000:0.0:1746066783.004414:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13885 00000100:00100000:0.0:1746066783.004419:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1966:x1830882976667648:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066783.004424:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066783.004430:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dee0600/0xfb36a14ee6089b17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d689 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.004437:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.004439:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.004442:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dee0600/0xfb36a14ee6089b17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d689 expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066783.004451:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dee0600/0xfb36a14ee6089b17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d689 expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066783.004457:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee0600, rc 0) 00000100:00100000:0.0:1746066783.004469:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882976667648:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 50us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066783.004519:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13885 00000100:00080000:0.0:1746066783.004529:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066783.004555:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.004624:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976666880 00000100:00100000:0.0:1746066783.004627:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976666880 00002000:00100000:0.0:1746066783.004655:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800a5bb3480 x1830882976666880/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:189/0 lens 488/0 e 0 to 0 dl 1746066794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066783.004663:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb3480 with x1830882976666880 ext(1048576->2097151) 00002000:00010000:0.0:1746066783.004666:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb3480 00000100:00100000:0.0:1746066783.004709:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6257 00000100:00100000:0.0:1746066783.004716:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1964:x1830882976666880:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066783.019271:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066783.021025:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066783.021836:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.021910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066783.022645:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746066783.025428:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066783.031136:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976668544 00000100:00100000:0.0:1746066783.031143:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976668544 00010000:00010000:0.0:1746066783.031177:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093d01400/0xfb36a14ee6089abc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d643 expref: 9 pid: 14550 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746066783.031209:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7081 00000100:00100000:0.0:1746066783.031215:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976668544:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066783.031226:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066783.031230:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093d01400/0xfb36a14ee6089abc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d643 expref: 9 pid: 14550 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066783.031240:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093d01400/0xfb36a14ee6089abc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d643 expref: 9 pid: 14550 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066783.031256:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093d01400/0xfb36a14ee6089abc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d643 expref: 9 pid: 14550 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066783.033285:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066783.033295:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72200/0xfb36a14ee6089b2c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066783.033306:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72200/0xfb36a14ee6089b2c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066783.033312:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72200/0xfb36a14ee6089b2c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066783.033344:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066783.033409:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976668544:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2187us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066783.033418:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7081 00000100:00100000:0.0:1746066783.044027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.048081:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.059250:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.071525:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.072145:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.072958:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.096669:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882976669824:12345-192.168.202.57@tcp:3:cat.0 Request processed in 21259us (23704us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066783.096702:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6260 00002000:00100000:0.0:1746066783.096713:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a5bb2a00 x1830882976669824/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:189/0 lens 488/440 e 0 to 0 dl 1746066794 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066783.096722:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb2a00 with x1830882976669824 ext(3145728->4194303) 00002000:00010000:0.0:1746066783.096726:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb2a00 00000100:00100000:0.0:1746066783.103318:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066783.104731:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066783.115039:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.115080:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.115111:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.115140:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.115157:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976670336 00000100:00100000:0.0:1746066783.115159:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976670336 00010000:00010000:0.0:1746066783.115175:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f20ee00/0xfb36a14ee6089942 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d578 expref: 13 pid: 4614 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746066783.115189:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7083 00000100:00100000:0.0:1746066783.115194:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976670080:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066783.115212:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066783.115230:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e7e5e00/0xfb36a14ee6089afb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d666 expref: 8 pid: 4614 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746066783.115419:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e7e5e00/0xfb36a14ee6089afb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d666 expref: 8 pid: 4614 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746066783.119268:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e7e5e00/0xfb36a14ee6089afb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d666 expref: 8 pid: 4614 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746066783.119288:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.119290:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.119295:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e7e5400/0xfb36a14ee6089b56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d6a5 expref: 10 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.119302:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7e5400/0xfb36a14ee6089b56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d6a5 expref: 10 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.119342:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e7e5400/0xfb36a14ee6089b56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1040384->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d6a5 expref: 10 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066783.119352:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135f83800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976738944:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066783.119396:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066783.130033:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.138856:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066783.139636:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066783.140905:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.162915:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.162954:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.162994:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.163049:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976671232 00000100:00100000:0.0:1746066783.163058:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976671232 00010000:00010000:0.0:1746066783.163100:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edcae00/0xfb36a14ee60899c7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5e1 expref: 14 pid: 10402 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746066783.163128:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7086 00000100:00100000:0.0:1746066783.163138:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1966:x1830882976671232:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066783.163154:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066783.163176:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edcae00/0xfb36a14ee60899c7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5e1 expref: 14 pid: 10402 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746066783.163187:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edcae00/0xfb36a14ee60899c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5e1 expref: 14 pid: 10402 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746066783.163211:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066783.163257:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1966:x1830882976671232:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 120us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066783.163264:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7086 00000100:00100000:0.0:1746066783.163283:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976671488 00000100:00100000:0.0:1746066783.163286:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976671488 00010000:00010000:0.0:1746066783.163297:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef72600/0xfb36a14ee608999d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5d3 expref: 12 pid: 10402 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746066783.163313:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976671360 00000100:00100000:0.0:1746066783.163316:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976671360 00010000:00010000:0.0:1746066783.163329:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093631200/0xfb36a14ee6089b09 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d66d expref: 8 pid: 21203 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746066783.163347:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7087 00000100:00100000:0.0:1746066783.163354:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:1966:x1830882976671488:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066783.163364:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066783.163374:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ef72600/0xfb36a14ee608999d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5d3 expref: 12 pid: 10402 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066783.163382:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ef72600/0xfb36a14ee608999d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d5d3 expref: 12 pid: 10402 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066783.163395:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066783.163418:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:1966:x1830882976671488:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 64us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066783.163424:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7087 00000100:00100000:0.0:1746066783.163439:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7088 00000100:00100000:0.0:1746066783.163446:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1966:x1830882976671360:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066783.163453:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066783.163462:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093631200/0xfb36a14ee6089b09 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d66d expref: 8 pid: 21203 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746066783.163471:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093631200/0xfb36a14ee6089b09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d66d expref: 8 pid: 21203 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746066783.163483:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.163485:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.163492:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e7e4800/0xfb36a14ee6089b5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1785855) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d6ac expref: 11 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.163500:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7e4800/0xfb36a14ee6089b5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1785855) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d6ac expref: 11 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.163532:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e7e4800/0xfb36a14ee6089b5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1785855) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d6ac expref: 11 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066783.163544:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135f81880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976739584:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066783.164512:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066783.185447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.187549:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.214589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.217093:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.219220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.221797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.224881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.230531:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.255539:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.260891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.267863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.267933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.276864:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.280100:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.280219:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.284483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.293780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.300797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.330193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.334891:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.353029:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.359850:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.395864:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.410825:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.424091:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.424193:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.424218:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.426386:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.431501:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.432488:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.432513:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.432532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.432545:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976678016 00000100:00100000:0.0:1746066783.432547:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976678016 00010000:00010000:0.0:1746066783.432560:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e7e4400/0xfb36a14ee6089b41 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d697 expref: 9 pid: 14550 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746066783.432573:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7094 00000100:00100000:0.0:1746066783.432578:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:1964:x1830882976677760:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066783.432585:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066783.432589:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57c3600/0xfb36a14ee6089bdb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d6f9 expref: 266 pid: 14550 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066783.432597:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57c3600/0xfb36a14ee6089bdb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d6f9 expref: 266 pid: 14550 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066783.433061:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57c3600/0xfb36a14ee6089bdb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d6f9 expref: 266 pid: 14550 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066783.433080:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880093705100) 00010000:00010000:0.0:1746066783.433084:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aa8a00/0xfb36a14ee6089c1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066783.433090:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aa8a00/0xfb36a14ee6089c1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066783.433095:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066783.433115:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:1964:x1830882976677760:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 536us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066783.433120:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7094 00000100:00100000:0.0:1746066783.442208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.446292:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.466722:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.485388:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.502033:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.502064:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.502153:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.502305:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7098 00000100:00100000:0.0:1746066783.502316:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1965:x1830882976679296:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066783.502324:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066783.502954:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008dee0a00/0xfb36a14ee6089ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d64a expref: 16 pid: 10402 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746066783.502965:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008dee0a00/0xfb36a14ee6089ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d64a expref: 16 pid: 10402 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746066783.503142:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dee0a00/0xfb36a14ee6089ac3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d64a expref: 16 pid: 10402 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746066783.503160:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.503161:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.503167:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee6089c28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d723 expref: 11 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.503174:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee6089c28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d723 expref: 11 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.503198:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee6089c28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d723 expref: 11 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066783.503208:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0ff480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976742272:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066783.503731:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066783.505428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.508430:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.512731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.514349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.515407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.521853:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.534003:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.538105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.541155:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.545584:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.545621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.545645:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.545669:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.546318:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13905 00000100:00100000:0.0:1746066783.546330:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976681088:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066783.546337:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066783.546345:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f318e00/0xfb36a14ee6089c59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d73f expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066783.546380:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976743040:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066783.546434:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab300 going to sleep for 11 seconds 00002000:00010000:0.0:1746066783.547870:0:8451:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime: 1746066782 -> 1746066783 00000100:00100000:0.0:1746066783.547889:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976743040:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066783.547913:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f318e00/0xfb36a14ee6089c59 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d73f expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066783.547922:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f318e00/0xfb36a14ee6089c59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d73f expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066783.547936:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f318e00, rc 0) 00000100:00100000:0.0:1746066783.547962:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976681088:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1637us (2340us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066783.547968:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13905 00000100:00100000:0.0:1746066783.553741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.556648:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.559359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.561313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.563445:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.564082:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.570833:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.574913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.574969:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.574983:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.575332:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.575422:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976682880 00000100:00100000:0.0:1746066783.575424:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976682880 00000100:00100000:0.0:1746066783.575445:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13913 00000100:00100000:0.0:1746066783.575449:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800992a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976683264:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:0.0:1746066783.575464:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f318600/0xfb36a14ee6089cc2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.575473:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aaab400/0xfb36a14ee6089a5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d62e expref: 12 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.575480:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093630c00/0xfb36a14ee6089b1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d682 expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066783.575486:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ef73e00/0xfb36a14ee6089ad1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d658 expref: 24 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066783.575490:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.575491:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.575493:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f318600/0xfb36a14ee6089cc2 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.575509:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ef73e00/0xfb36a14ee6089ad1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d658 expref: 24 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066783.575515:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ef73e00/0xfb36a14ee6089ad1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d658 expref: 24 pid: 8452 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746066783.575522:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976744576:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066783.575540:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093630c00/0xfb36a14ee6089b1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d682 expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066783.575546:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093630c00/0xfb36a14ee6089b1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d682 expref: 9 pid: 21203 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746066783.575553:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976744704:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066783.575570:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009aaab400/0xfb36a14ee6089a5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d62e expref: 12 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.575577:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009aaab400/0xfb36a14ee6089a5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d62e expref: 12 pid: 4614 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746066783.575583:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976744832:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066783.575594:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066783.575606:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13915 00000100:00100000:0.0:1746066783.575611:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976682880:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:0.0:1746066783.575625:0:8112:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f319800/0xfb36a14ee6089cd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.575634:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009917be00/0xfb36a14ee6089bfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d700 expref: 14 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.575639:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066783.575640:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066783.575642:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f319800/0xfb36a14ee6089cd7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.575656:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009917be00/0xfb36a14ee6089bfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1646591) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d700 expref: 14 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.575662:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009917be00/0xfb36a14ee6089bfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->1646591) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d700 expref: 14 pid: 4614 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746066783.575669:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976745088:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066783.575713:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0aba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066783.577786:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976744064:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066783.586591:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.586650:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976744832:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066783.587385:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976745088:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066783.587405:0:8112:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f319800/0xfb36a14ee6089cd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066783.587950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.587965:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.587977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.587988:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.588000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.588011:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.588021:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.588032:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976684160 00000100:00100000:0.0:1746066783.588034:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976684160 00010000:00010000:0.0:1746066783.588046:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7e4800/0xfb36a14ee6089bb8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d6eb expref: 13 pid: 4614 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746066783.588062:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976684672 00000100:00100000:0.0:1746066783.588064:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976684672 00010000:00010000:0.0:1746066783.588071:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef73e00/0xfb36a14ee6089ad1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d658 expref: 26 pid: 8452 timeout: 844 lvb_type: 1 00000100:00100000:0.0:1746066783.588083:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7108 00000100:00100000:0.0:1746066783.588088:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882976684160:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066783.588094:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066783.588102:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e7e4800/0xfb36a14ee6089bb8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d6eb expref: 14 pid: 4614 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066783.588114:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e7e4800/0xfb36a14ee6089bb8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d6eb expref: 14 pid: 4614 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066783.588134:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.588136:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.588139:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008de12c00/0xfb36a14ee6089cbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.588146:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008de12c00/0xfb36a14ee6089cbb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.588158:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066783.588178:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882976684160:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 89us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066783.588184:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7108 00000100:00100000:0.0:1746066783.588195:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7110 00000100:00100000:0.0:1746066783.588201:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976684032:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066783.588207:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066783.588215:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008dee0600/0xfb36a14ee6089b17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d689 expref: 9 pid: 10402 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746066783.588222:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008dee0600/0xfb36a14ee6089b17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d689 expref: 9 pid: 10402 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746066783.588237:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dee0600/0xfb36a14ee6089b17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d689 expref: 9 pid: 10402 timeout: 844 lvb_type: 1 00010000:00010000:0.0:1746066783.588249:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066783.588269:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976684032:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 68us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066783.588274:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7110 00000100:00100000:0.0:1746066783.588301:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.588315:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976684288 00000100:00100000:0.0:1746066783.588317:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976684288 00002000:00100000:0.0:1746066783.588331:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38e:0x0] (1982464->2097151) req@ffff88009ec2e300 x1830882976684288/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:189/0 lens 488/0 e 0 to 0 dl 1746066794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066783.588337:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2e300 with x1830882976684288 ext(1982464->2097151) 00010000:00010000:0.0:1746066783.588341:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee6089c28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d723 expref: 10 pid: 9776 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066783.588348:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee6089c28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d723 expref: 10 pid: 9776 timeout: 844 lvb_type: 0 00002000:00010000:0.0:1746066783.588352:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ec2e300 00000100:00100000:0.0:1746066783.588364:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2068 00000100:00100000:0.0:1746066783.588369:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882976684288:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066783.594224:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.595200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066783.600575:0:8452:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e200/0xfb36a14ee6089cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.600583:0:8452:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e200/0xfb36a14ee6089cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.600600:0:8452:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e200/0xfb36a14ee6089cd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.600607:0:8452:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e200/0xfb36a14ee6089cd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.600613:0:8452:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e200/0xfb36a14ee6089cd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.600617:0:8452:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4a1e200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066783.600620:0:8452:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e200/0xfb36a14ee6089cd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.600626:0:8452:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e200/0xfb36a14ee6089cd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.600635:0:8452:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e200/0xfb36a14ee6089cd0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.600640:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e200/0xfb36a14ee6089cd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066783.600707:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1964:x1830882976683136:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 25156us (25373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066783.600713:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13914 00000100:00100000:0.0:1746066783.602884:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.606408:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.606595:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.606623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.606643:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.606806:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.609162:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000001:00080000:0.0:1746066783.632247:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943840 is committed 00000001:00080000:0.0:1746066783.632259:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943827 is committed 00000001:00080000:0.0:1746066783.632264:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943857 is committed 00000001:00080000:0.0:1746066783.632268:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943854 is committed 00000001:00080000:0.0:1746066783.632285:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943844 is committed 00000001:00080000:0.0:1746066783.632302:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943858 is committed 00000004:00080000:0.0:1746066783.632305:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2306 committed 00000004:00080000:0.0:1746066783.632311:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2279 committed 00000004:00080000:0.0:1746066783.632315:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2278 committed 00000004:00080000:0.0:1746066783.632317:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2277 committed 00000004:00080000:0.0:1746066783.632319:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2276 committed 00000004:00080000:0.0:1746066783.632320:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2305 committed 00000004:00080000:0.0:1746066783.632321:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2275 committed 00000004:00080000:0.0:1746066783.632323:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2304 committed 00000004:00080000:0.0:1746066783.632324:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2274 committed 00000004:00080000:0.0:1746066783.632325:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2303 committed 00000004:00080000:0.0:1746066783.632326:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2302 committed 00000004:00080000:0.0:1746066783.632327:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2301 committed 00000004:00080000:0.0:1746066783.632329:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2273 committed 00000004:00080000:0.0:1746066783.632330:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2272 committed 00000004:00080000:0.0:1746066783.632331:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2300 committed 00000004:00080000:0.0:1746066783.632333:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2299 committed 00000004:00080000:0.0:1746066783.632334:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2271 committed 00000100:00100000:0.0:1746066783.634147:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976747264 00000100:00100000:0.0:1746066783.634150:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976747264 00000100:00100000:0.0:1746066783.634161:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976747136 00000100:00100000:0.0:1746066783.634163:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976747136 00000100:00100000:0.0:1746066783.634168:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976748160 00000100:00100000:0.0:1746066783.634170:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976748160 00000100:00100000:0.0:1746066783.634313:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13926 00000100:00100000:0.0:1746066783.634319:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3296:x1830882976747776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066783.634828:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840775 gen 2 00000004:00080000:0.0:1746066783.634834:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e841180, transno 21474840738 00000004:00080000:0.0:1746066783.634839:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e841500, transno 21474840739 00000004:00080000:0.0:1746066783.634841:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e842d80, transno 21474840740 00000004:00080000:0.0:1746066783.634843:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e843b80, transno 21474840741 00000004:00080000:0.0:1746066783.634844:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e840700, transno 21474840742 00000004:00080000:0.0:1746066783.634846:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e841f80, transno 21474840743 00000004:00080000:0.0:1746066783.634848:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e843800, transno 21474840744 00000004:00080000:0.0:1746066783.634850:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e841880, transno 21474840745 00000004:00080000:0.0:1746066783.634852:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c3800, transno 21474840746 00000004:00080000:0.0:1746066783.634854:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c3480, transno 21474840747 00000004:00080000:0.0:1746066783.634856:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c0e00, transno 21474840748 00000004:00080000:0.0:1746066783.634858:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c0700, transno 21474840749 00000004:00080000:0.0:1746066783.634860:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c0380, transno 21474840750 00000004:00080000:0.0:1746066783.634861:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c0000, transno 21474840751 00000004:00080000:0.0:1746066783.634863:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c1180, transno 21474840752 00000004:00080000:0.0:1746066783.634865:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c1880, transno 21474840753 00000004:00080000:0.0:1746066783.634867:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e5d180, transno 21474840760 00000004:00080000:0.0:1746066783.634869:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136b42a00, transno 21474840761 00000004:00080000:0.0:1746066783.634871:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136b41500, transno 21474840762 00000004:00080000:0.0:1746066783.634872:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e5ce00, transno 21474840763 00000004:00080000:0.0:1746066783.634874:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136b42680, transno 21474840764 00000004:00080000:0.0:1746066783.634876:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e5fb80, transno 21474840765 00000004:00080000:0.0:1746066783.634878:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e5f800, transno 21474840766 00000004:00080000:0.0:1746066783.634880:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136b41180, transno 21474840767 00000004:00080000:0.0:1746066783.634882:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef58000, transno 21474840768 00000004:00080000:0.0:1746066783.634884:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5bb80, transno 21474840769 00000004:00080000:0.0:1746066783.634886:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5b100, transno 21474840770 00000004:00080000:0.0:1746066783.634887:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2c380, transno 21474840771 00000004:00080000:0.0:1746066783.634889:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef59880, transno 21474840772 00000004:00080000:0.0:1746066783.634891:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef58e00, transno 21474840773 00000004:00080000:0.0:1746066783.634893:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5b480, transno 21474840774 00000004:00080000:0.0:1746066783.634895:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2fb80, transno 21474840775 00000100:00100000:0.0:1746066783.634900:0:3294:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880092046d80 x1830882976746368/t21474840783(21474840783) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066799 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746066783.634908:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092046d80/2, rc 0, transno 21474840783 00000100:00100000:0.0:1746066783.634911:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976746368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066783.635178:0:3294:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873454 gen 2 00000004:00080000:0.0:1746066783.635182:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135dfb800, transno 17179873410 00000004:00080000:0.0:1746066783.635188:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135df9880, transno 17179873411 00000004:00080000:0.0:1746066783.635191:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e58a80, transno 17179873412 00000004:00080000:0.0:1746066783.635193:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4ef100, transno 17179873413 00000004:00080000:0.0:1746066783.635195:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e5bb80, transno 17179873414 00000004:00080000:0.0:1746066783.635197:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4ef480, transno 17179873415 00000004:00080000:0.0:1746066783.635199:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4ec700, transno 17179873416 00000004:00080000:0.0:1746066783.635201:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e59500, transno 17179873417 00000004:00080000:0.0:1746066783.635203:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4ec380, transno 17179873418 00000004:00080000:0.0:1746066783.635205:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a0d1880, transno 17179873419 00000004:00080000:0.0:1746066783.635207:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a0d1500, transno 17179873420 00000004:00080000:0.0:1746066783.635209:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e5b480, transno 17179873421 00000004:00080000:0.0:1746066783.635211:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a0d2680, transno 17179873422 00000004:00080000:0.0:1746066783.635213:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e58000, transno 17179873423 00000004:00080000:0.0:1746066783.635215:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e5aa00, transno 17179873424 00000004:00080000:0.0:1746066783.635217:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009244ca80, transno 17179873425 00000004:00080000:0.0:1746066783.635219:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e58380, transno 17179873426 00000004:00080000:0.0:1746066783.635221:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e59c00, transno 17179873427 00000004:00080000:0.0:1746066783.635223:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c22e300, transno 17179873437 00000004:00080000:0.0:1746066783.635225:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009244f480, transno 17179873438 00000004:00080000:0.0:1746066783.635227:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8696a00, transno 17179873439 00000004:00080000:0.0:1746066783.635229:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c22df80, transno 17179873440 00000004:00080000:0.0:1746066783.635231:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590f100, transno 17179873441 00000004:00080000:0.0:1746066783.635233:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c22ed80, transno 17179873442 00000004:00080000:0.0:1746066783.635235:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009244ea00, transno 17179873443 00000004:00080000:0.0:1746066783.635237:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c22f100, transno 17179873444 00000004:00080000:0.0:1746066783.635239:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009244e680, transno 17179873445 00000004:00080000:0.0:1746066783.635241:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094128a80, transno 17179873446 00000004:00080000:0.0:1746066783.635243:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009412ad80, transno 17179873447 00000004:00080000:0.0:1746066783.635245:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590c380, transno 17179873448 00000004:00080000:0.0:1746066783.635247:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590ca80, transno 17179873449 00000004:00080000:0.0:1746066783.635249:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009412b480, transno 17179873450 00000004:00080000:0.0:1746066783.635251:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094129500, transno 17179873451 00000004:00080000:0.0:1746066783.635253:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e86bb80, transno 17179873452 00000004:00080000:0.0:1746066783.635255:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590d500, transno 17179873453 00000004:00080000:0.0:1746066783.635256:0:3294:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094128e00, transno 17179873454 00000100:00100000:0.0:1746066783.635260:0:3294:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800a5bb0700 x1830882976747904/t17179873463(17179873463) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066799 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746066783.635267:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5bb0700/2, rc 0, transno 17179873463 00000100:00100000:0.0:1746066783.635270:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976747904:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066783.635280:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8695500/2, rc 0, transno 17179873461 00000100:00100000:0.0:1746066783.635282:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976747008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066783.635287:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5bb2680/2, rc 0, transno 17179873465 00000100:00100000:0.0:1746066783.635289:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976747520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066783.635294:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5bb1500/2, rc 0, transno 17179873462 00000100:00100000:0.0:1746066783.635297:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976748032:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066783.635305:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092044380/2, rc 0, transno 21474840784 00000100:00100000:0.0:1746066783.635307:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976746880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066783.635499:0:14590:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 36 done 00000004:00080000:0.0:1746066783.635536:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8695c00/2, rc 0, transno 17179873468 00000100:00100000:0.0:1746066783.635539:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976746496:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066783.635547:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092045500/2, rc 0, transno 21474840785 00000100:00100000:0.0:1746066783.635549:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976747392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066783.636549:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3296:x1830882976747776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2231us (3120us total) trans 21474840787 rc 0/0 00000100:00100000:0.0:1746066783.636554:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13926 00000100:00100000:0.0:1746066783.636632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.641651:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.645548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.648714:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13938 00000100:00100000:0.0:1746066783.648724:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976687232:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066783.648728:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066783.648739:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f319800/0xfb36a14ee6089d16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d7a1 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066783.648755:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 2097152, mtime: 0x6812dd5f, atime: 0x6812dd5d, ctime: 0x6812dd5f, blocks: 0x81d 00010000:00010000:0.0:1746066783.648766:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.648768:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.648773:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f319800/0xfb36a14ee6089d16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7a1 expref: 9 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066783.648785:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f319800/0xfb36a14ee6089d16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7a1 expref: 9 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066783.648791:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f319800, rc 0) 00000100:00100000:0.0:1746066783.649654:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976687232:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 933us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066783.649660:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13938 00000100:00100000:0.0:1746066783.664082:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.664120:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.664813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.666550:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.668552:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.668576:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.668594:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976688512 00000100:00100000:0.0:1746066783.668599:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976688512 00000100:00100000:0.0:1746066783.668650:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976688384 00000100:00100000:0.0:1746066783.668652:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976688384 00000100:00100000:0.0:1746066783.668667:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976688640 00000100:00100000:0.0:1746066783.668668:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976688640 00000100:00100000:0.0:1746066783.668706:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6276 00000100:00100000:0.0:1746066783.668713:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976688512:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:0.0:1746066783.668736:0:25585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f319c00/0xfb36a14ee6089d40 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.668747:0:25585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.668748:0:25585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.668752:0:25585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f319c00/0xfb36a14ee6089d40 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.668763:0:25585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f319c00/0xfb36a14ee6089d40 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066783.684483:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976689024 00000100:00100000:0.0:1746066783.684496:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976689024 00000100:00100000:0.0:1746066783.684543:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976689280 00000100:00100000:0.0:1746066783.684546:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976689280 00000100:00100000:0.0:1746066783.684568:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6279 00000100:00100000:0.0:1746066783.684575:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882976689024:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:0.0:1746066783.684603:0:1993:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f318a00/0xfb36a14ee6089d55 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.684615:0:1993:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.684616:0:1993:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.684747:0:1993:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f318a00/0xfb36a14ee6089d55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.684761:0:1993:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f318a00/0xfb36a14ee6089d55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.718396:0:1993:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f318a00/0xfb36a14ee6089d55 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.718404:0:1993:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f318a00/0xfb36a14ee6089d55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.718409:0:1993:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f318a00/0xfb36a14ee6089d55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.718414:0:1993:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f318a00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066783.718417:0:1993:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f318a00/0xfb36a14ee6089d55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.718422:0:1993:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f318a00/0xfb36a14ee6089d55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.718431:0:1993:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f318a00/0xfb36a14ee6089d55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.718436:0:1993:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f318a00/0xfb36a14ee6089d55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.724056:0:31366:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880131882e00/0xfb36a14ee6089d5c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.724067:0:31366:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131882e00/0xfb36a14ee6089d5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.724074:0:31366:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131882e00/0xfb36a14ee6089d5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.724079:0:31366:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131882e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066783.724082:0:31366:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131882e00/0xfb36a14ee6089d5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.724089:0:31366:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131882e00/0xfb36a14ee6089d5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.724104:0:31366:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131882e00/0xfb36a14ee6089d5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.724109:0:31366:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131882e00/0xfb36a14ee6089d5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066783.724151:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976689280:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 38790us (44074us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066783.724158:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6280 00000100:00100000:0.0:1746066783.732926:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.740070:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.740085:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.740101:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.740156:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.742465:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13945 00000100:00100000:0.0:1746066783.742476:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976690304:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:0.0:1746066783.742622:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066783.742624:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066781 -> 1746066783 00002000:00010000:0.0:1746066783.742626:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066781 -> 1746066783 00002000:00010000:0.0:1746066783.742628:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066781 -> 1746066783 00002000:00010000:0.0:1746066783.742629:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746066783.742744:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976690304:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 271us (1008us total) trans 21474840793 rc 0/0 00000100:00100000:0.0:1746066783.742748:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13945 00000100:00100000:0.0:1746066783.744011:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.745624:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000001:00080000:0.0:1746066783.761970:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943859 is committed 00000001:00080000:0.0:1746066783.761980:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943860 is committed 00000004:00080000:0.0:1746066783.761983:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2314 committed 00000004:00080000:0.0:1746066783.761988:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2288 committed 00000004:00080000:0.0:1746066783.761993:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2287 committed 00000004:00080000:0.0:1746066783.761994:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2286 committed 00000004:00080000:0.0:1746066783.761995:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2285 committed 00000004:00080000:0.0:1746066783.761996:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2313 committed 00000004:00080000:0.0:1746066783.761998:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2284 committed 00000004:00080000:0.0:1746066783.761999:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2312 committed 00000004:00080000:0.0:1746066783.762000:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2283 committed 00000004:00080000:0.0:1746066783.762002:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2311 committed 00000004:00080000:0.0:1746066783.762003:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2310 committed 00000004:00080000:0.0:1746066783.762004:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2309 committed 00000004:00080000:0.0:1746066783.762005:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2282 committed 00000004:00080000:0.0:1746066783.762007:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2281 committed 00000004:00080000:0.0:1746066783.762008:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2308 committed 00000004:00080000:0.0:1746066783.762010:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2307 committed 00000004:00080000:0.0:1746066783.762011:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2280 committed 00000100:00100000:0.0:1746066783.762121:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976748544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066783.762712:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066783.762738:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976749056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066783.762754:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066783.762764:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976749568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066783.762776:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066783.762783:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976750080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066783.762793:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066783.762802:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746066783.762806:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976748672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066783.762820:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066783.762828:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976749184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066783.762838:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066783.762846:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976749696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066783.762855:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066783.762863:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976750208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066783.762874:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066783.762895:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976748544 00000100:00100000:0.0:1746066783.762900:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976748544 00000100:00100000:0.0:1746066783.762926:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976749056 00000100:00100000:0.0:1746066783.762928:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976749056 00000100:00100000:0.0:1746066783.762936:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976749568 00000100:00100000:0.0:1746066783.762938:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976749568 00000100:00100000:0.0:1746066783.762944:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976750080 00000100:00100000:0.0:1746066783.762945:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976750080 00000100:00100000:0.0:1746066783.762950:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976748672 00000100:00100000:0.0:1746066783.762952:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976748672 00000100:00100000:0.0:1746066783.762957:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976749184 00000100:00100000:0.0:1746066783.762959:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976749184 00000100:00100000:0.0:1746066783.762964:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976749696 00000100:00100000:0.0:1746066783.762965:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976749696 00000100:00100000:0.0:1746066783.762970:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976750208 00000100:00100000:0.0:1746066783.762971:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976750208 00000100:00100000:0.0:1746066783.762979:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13946 00000100:00100000:0.0:1746066783.762985:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3293:x1830882976748544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066783.763123:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066783.763126:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763128:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763130:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763132:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2017 -> 2017 00000100:00100000:0.0:1746066783.763153:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3293:x1830882976748544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (442us total) trans 17179873473 rc 0/0 00000100:00100000:0.0:1746066783.763159:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13946 00000100:00100000:0.0:1746066783.763172:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13947 00000100:00100000:0.0:1746066783.763177:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3293:x1830882976749056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066783.763245:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3293:x1830882976749056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (490us total) trans 17179873474 rc 0/0 00000100:00100000:0.0:1746066783.763250:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13947 00000100:00100000:0.0:1746066783.763258:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13948 00000100:00100000:0.0:1746066783.763264:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3293:x1830882976749568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066783.763344:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066783.763347:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763349:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763351:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763352:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746066783.763371:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3293:x1830882976749568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (595us total) trans 21474840794 rc 0/0 00000100:00100000:0.0:1746066783.763377:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13948 00000100:00100000:0.0:1746066783.763386:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13949 00000100:00100000:0.0:1746066783.763391:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3293:x1830882976750080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066783.763462:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3293:x1830882976750080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (667us total) trans 21474840795 rc 0/0 00000100:00100000:0.0:1746066783.763467:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13949 00000100:00100000:0.0:1746066783.763476:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13950 00000100:00100000:0.0:1746066783.763481:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800992a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3293:x1830882976748672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066783.763544:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066783.763547:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763548:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763550:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763551:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746066783.763566:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800992a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3293:x1830882976748672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (745us total) trans 17179873475 rc 0/0 00000100:00100000:0.0:1746066783.763571:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13950 00000100:00100000:0.0:1746066783.763661:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13952 00000100:00100000:0.0:1746066783.763666:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3293:x1830882976749696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066783.763751:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066783.763753:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763755:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763756:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763758:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746066783.763772:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3293:x1830882976749696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (916us total) trans 21474840796 rc 0/0 00000100:00100000:0.0:1746066783.763777:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13952 00000100:00100000:0.0:1746066783.763783:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13954 00000100:00100000:0.0:1746066783.763787:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3295:x1830882976748800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066783.763839:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:0.0:1746066783.763841:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763843:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763845:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763847:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5921 -> 5921 00000100:00100000:0.0:1746066783.763864:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3295:x1830882976748800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (322us total) trans 17179873477 rc 0/0 00000100:00100000:0.0:1746066783.763868:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13954 00000100:00100000:0.0:1746066783.763876:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13956 00000100:00100000:0.0:1746066783.763880:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3295:x1830882976749824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066783.763933:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066783.763935:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763936:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763938:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066783.763939:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746066783.763952:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3295:x1830882976749824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (365us total) trans 21474840798 rc 0/0 00000100:00100000:0.0:1746066783.763956:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13956 00000004:00080000:0.0:1746066783.763985:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efb5f80/2, rc 0, transno 17179873475 00000100:00100000:0.0:1746066783.763992:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976748672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066783.763999:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009244ea00/2, rc 0, transno 17179873476 00000100:00100000:0.0:1746066783.764002:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976749184:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066783.764008:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136b42a00/2, rc 0, transno 21474840796 00000100:00100000:0.0:1746066783.764010:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976749696:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066783.764016:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e841180/2, rc 0, transno 21474840797 00000100:00100000:0.0:1746066783.764018:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976750208:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066783.764023:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009244f480/2, rc 0, transno 17179873474 00000100:00100000:0.0:1746066783.764026:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976749056:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066783.764032:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e5f800/2, rc 0, transno 21474840794 00000100:00100000:0.0:1746066783.764034:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976749568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066783.764038:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136b41180/2, rc 0, transno 21474840795 00000100:00100000:0.0:1746066783.764040:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976750080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066783.764046:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efb6a00/2, rc 0, transno 17179873473 00000100:00100000:0.0:1746066783.764048:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976748544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066783.764170:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746066783.764176:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976750592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066783.764193:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066783.766361:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.769241:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.784905:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.787942:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.788579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.793100:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.798072:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976692096 00000100:00100000:0.0:1746066783.798078:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976692096 00010000:00010000:0.0:1746066783.798101:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e892400/0xfb36a14ee6089d8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7bd expref: 254 pid: 809 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746066783.798117:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7124 00000100:00100000:0.0:1746066783.798122:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:1964:x1830882976692096:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066783.798130:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066783.798135:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e892400/0xfb36a14ee6089d8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7bd expref: 254 pid: 809 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066783.798149:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e892400/0xfb36a14ee6089d8d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7bd expref: 254 pid: 809 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066783.798165:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e892400/0xfb36a14ee6089d8d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7bd expref: 254 pid: 809 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746066783.798179:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8900) 00010000:00010000:0.0:1746066783.798183:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135717600/0xfb36a14ee6089da9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066783.798190:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135717600/0xfb36a14ee6089da9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066783.798195:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135717600/0xfb36a14ee6089da9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066783.798213:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066783.798233:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:1964:x1830882976692096:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 111us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066783.798238:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7124 00000100:00100000:0.0:1746066783.798285:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.803935:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.816852:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.816901:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.821167:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.822696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.836456:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.836479:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.836515:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.840993:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976693888 00000100:00100000:0.0:1746066783.841002:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976693888 00000100:00100000:0.0:1746066783.841050:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13966 00000100:00100000:0.0:1746066783.841057:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+11:31344:x1830882976693888:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066783.841070:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066783.841084:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5893400/0xfb36a14ee6089e27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d803 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.841103:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.841104:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.841111:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5893400/0xfb36a14ee6089e27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d803 expref: 12 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.841132:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5893400/0xfb36a14ee6089e27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d803 expref: 12 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.841144:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5893400, rc 0) 00000100:00100000:0.0:1746066783.841194:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+12:31344:x1830882976693888:12345-192.168.202.57@tcp:101:cat.0 Request processed in 138us (4678us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066783.841200:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 13966 00000100:00100000:0.0:1746066783.847216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.849208:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976694144 00000100:00100000:0.0:1746066783.849213:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976694144 00000100:00100000:0.0:1746066783.849239:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9846 00000100:00100000:0.0:1746066783.849244:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+8:31344:x1830882976694144:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066783.849259:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066783.849268:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5892400/0xfb36a14ee6089e2e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d80a expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.849951:0:20127:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5892400/0xfb36a14ee6089e2e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d80a expref: 9 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.849962:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5892400/0xfb36a14ee6089e2e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d80a expref: 9 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.849972:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8900) 00010000:00010000:0.0:1746066783.849974:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066783.849977:0:20127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba4200/0xfb36a14ee6089e19 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066783.849982:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5892400, rc 0) 00000100:00100000:0.0:1746066783.850021:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+9:31344:x1830882976694144:12345-192.168.202.57@tcp:101:cat.0 Request processed in 776us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066783.850027:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9846 00000100:00100000:0.0:1746066783.850047:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976694272 00000100:00100000:0.0:1746066783.850050:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976694272 00010000:00010000:0.0:1746066783.850062:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131883400/0xfb36a14ee6089d71 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7b6 expref: 8 pid: 809 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746066783.850086:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7126 00000100:00100000:0.0:1746066783.850091:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976694272:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066783.850098:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066783.850101:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131883400/0xfb36a14ee6089d71 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7b6 expref: 8 pid: 809 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066783.850119:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131883400/0xfb36a14ee6089d71 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7b6 expref: 8 pid: 809 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066783.850132:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131883400/0xfb36a14ee6089d71 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7b6 expref: 8 pid: 809 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066783.850145:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8900) 00010000:00010000:0.0:1746066783.850147:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba4200/0xfb36a14ee6089e19 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066783.850153:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba4200/0xfb36a14ee6089e19 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066783.850158:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba4200/0xfb36a14ee6089e19 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066783.850164:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136764e00/0xfb36a14ee6089e20 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7fc expref: 255 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.850187:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066783.852111:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976694272:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 116us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066783.852122:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7126 00000100:00100000:0.0:1746066783.889106:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976752896 00000100:00100000:0.0:1746066783.889109:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976752896 00000100:00100000:0.0:1746066783.905847:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.905902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.910105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.914958:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.916778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.930793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.930822:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.950644:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.950819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.962377:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976696192 00000100:00100000:0.0:1746066783.962385:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976696192 00000100:00100000:0.0:1746066783.963272:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13986 00000100:00100000:0.0:1746066783.963284:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:31341:x1830882976696192:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066783.963300:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066783.963316:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5892200/0xfb36a14ee6089e43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d81f expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.963339:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee6089d1d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7a8 expref: 10 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066783.963346:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.963347:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066783.963350:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5892200/0xfb36a14ee6089e43 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3977216->4194303] (req 3977216->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d81f expref: 14 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066783.963376:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee6089d1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7a8 expref: 10 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066783.963385:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee6089d1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7a8 expref: 10 pid: 21973 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746066783.963395:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976753920:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066783.963474:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b9b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066783.968822:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.972862:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.973235:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.973857:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.973872:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976696576 00000100:00100000:0.0:1746066783.973876:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976696576 00002000:00100000:0.0:1746066783.973906:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38e:0x0] (1368064->1556479) req@ffff88009ed70000 x1830882976696576/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:189/0 lens 488/0 e 0 to 0 dl 1746066794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066783.973914:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed70000 with x1830882976696576 ext(1368064->1556479) 00010000:00010000:0.0:1746066783.973922:0:11692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e400/0xfb36a14ee6089e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d811 expref: 17 pid: 21203 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066783.973932:0:11692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e400/0xfb36a14ee6089e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d811 expref: 17 pid: 21203 timeout: 845 lvb_type: 0 00002000:00010000:0.0:1746066783.973938:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed70000 00000100:00100000:0.0:1746066783.973949:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976696960 00000100:00100000:0.0:1746066783.973951:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976696960 00002000:00100000:0.0:1746066783.973961:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (3977216->3981311) req@ffff88009ed73800 x1830882976696960/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:189/0 lens 488/0 e 0 to 0 dl 1746066794 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066783.973967:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73800 with x1830882976696960 ext(3977216->3981311) 00002000:00010000:0.0:1746066783.973969:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed73800 00000100:00100000:0.0:1746066783.973987:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2069 00000100:00100000:0.0:1746066783.973993:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1964:x1830882976696576:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066783.980399:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066783.980442:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.000329:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.004178:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.004208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.004220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.007004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.014383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.020385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.021599:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976699008 00000100:00100000:0.0:1746066784.021603:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976699008 00000100:00100000:0.0:1746066784.021643:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4073 00000100:00100000:0.0:1746066784.021649:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c60c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+7:31341:x1830882976699008:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:0.0:1746066784.021939:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c60c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+8:31341:x1830882976699008:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 290us (384us total) trans 8589943867 rc 0/0 00000100:00100000:0.0:1746066784.021946:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4073 00000100:00100000:0.0:1746066784.026331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.026375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.038782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.059075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.059127:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.060235:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.060966:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6293 00000100:00100000:0.0:1746066784.060976:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882976700288:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066784.061398:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.061419:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.064636:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.087947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.094027:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.100475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.100526:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.102308:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6296 00000100:00100000:0.0:1746066784.102322:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882976701952:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066784.119355:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882976701952:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17040us (18828us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066784.119361:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6296 00002000:00100000:0.0:1746066784.119366:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880094128e00 x1830882976701952/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:190/0 lens 488/440 e 0 to 0 dl 1746066795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066784.119373:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094128e00 with x1830882976701952 ext(3145728->4194303) 00002000:00010000:0.0:1746066784.119376:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094128e00 00000100:00100000:0.0:1746066784.138772:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.148821:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.159725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.160619:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.160738:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976704128 00000100:00100000:0.0:1746066784.160742:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976704128 00000100:00100000:0.0:1746066784.160770:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 13997 00000100:00100000:0.0:1746066784.160775:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:31349:x1830882976704128:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066784.160785:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066784.160799:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee6089eb3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d873 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.160821:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1f000/0xfb36a14ee6089e3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d818 expref: 15 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.160829:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5d1e00/0xfb36a14ee6089e58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d834 expref: 21 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066784.160835:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066784.160837:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066784.160840:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee6089eb3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1232896->1605631] (req 1232896->1605631) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d873 expref: 21 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.160863:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5d1e00/0xfb36a14ee6089e58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d834 expref: 21 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066784.160873:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5d1e00/0xfb36a14ee6089e58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d834 expref: 21 pid: 8452 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746066784.160884:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976755456:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066784.160958:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee1f000/0xfb36a14ee6089e3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d818 expref: 15 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.160966:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1f000/0xfb36a14ee6089e3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d818 expref: 15 pid: 21203 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746066784.160973:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976755584:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066784.160992:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b9b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066784.163110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.164809:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976704384 00000100:00100000:0.0:1746066784.164813:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976704384 00010000:00010000:0.0:1746066784.164828:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee1f000/0xfb36a14ee6089e3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d818 expref: 16 pid: 21203 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746066784.164860:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7134 00000100:00100000:0.0:1746066784.164866:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882976704384:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066784.164873:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066784.164883:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee1f000/0xfb36a14ee6089e3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d818 expref: 16 pid: 21203 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066784.164891:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee1f000/0xfb36a14ee6089e3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d818 expref: 16 pid: 21203 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066784.164902:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1f000/0xfb36a14ee6089e3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d818 expref: 16 pid: 21203 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066784.166046:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066784.166048:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066784.166055:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee6089eb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->1605631) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d873 expref: 19 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.166063:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee6089eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->1605631) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d873 expref: 19 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.166091:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee6089eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1232896->1605631) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d873 expref: 19 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066784.166102:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976755712:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066784.166162:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b9b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066784.170208:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.172938:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.176447:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976705152 00000100:00100000:0.0:1746066784.176455:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976705152 00002000:00100000:0.0:1746066784.176487:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1601536->1605631) req@ffff880099713b80 x1830882976705152/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:190/0 lens 488/0 e 0 to 0 dl 1746066795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066784.176496:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099713b80 with x1830882976705152 ext(1601536->1605631) 00002000:00010000:0.0:1746066784.176501:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099713b80 00000100:00100000:0.0:1746066784.176517:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6303 00000100:00100000:0.0:1746066784.176523:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882976705152:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066784.176659:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882976705152:12345-192.168.202.57@tcp:3:cat.0 Request processed in 136us (433us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066784.176668:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6303 00002000:00100000:0.0:1746066784.176698:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1601536->1605631) req@ffff880099713b80 x1830882976705152/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:190/0 lens 488/4536 e 0 to 0 dl 1746066795 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066784.177202:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099713b80 with x1830882976705152 ext(1601536->1605631) 00002000:00010000:0.0:1746066784.177204:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099713b80 00000100:00100000:0.0:1746066784.193415:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.200820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.204150:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066784.204870:0:16018:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013510b000/0xfb36a14ee6089ecf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.204878:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013510b000/0xfb36a14ee6089ecf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:0.0:1746066784.204910:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:0.0:1746066784.204914:0:16018:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746066784.204926:0:16018:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013510b000/0xfb36a14ee6089ecf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.204934:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013510b000/0xfb36a14ee6089ecf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.204941:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013510a200/0xfb36a14ee6089ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.204947:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013510a200/0xfb36a14ee6089ec1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.204952:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013510a200/0xfb36a14ee6089ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.204956:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013510a200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066784.204960:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013510a200/0xfb36a14ee6089ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.204965:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013510a200/0xfb36a14ee6089ec1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.204973:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066784.204975:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066784.204978:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013510a200/0xfb36a14ee6089ec1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.204982:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013510a200/0xfb36a14ee6089ec1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.205003:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013510aa00/0xfb36a14ee6089ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.205007:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013510aa00/0xfb36a14ee6089ec8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.205012:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013510aa00/0xfb36a14ee6089ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.205015:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013510aa00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066784.205018:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013510aa00/0xfb36a14ee6089ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.205022:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013510aa00/0xfb36a14ee6089ec8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.205027:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012dc13600) 00010000:00010000:0.0:1746066784.205029:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066784.205031:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013510aa00/0xfb36a14ee6089ec8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.205035:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013510aa00/0xfb36a14ee6089ec8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.205060:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013510a800/0xfb36a14ee6089eba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d87a expref: 8 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.205069:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013510b000/0xfb36a14ee6089ecf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d87a expref: 7 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.205075:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8900) 00010000:00010000:0.0:1746066784.205076:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066784.205078:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013510b000, rc 0) 00000100:00100000:0.0:1746066784.205100:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31353:x1830882976705280:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 11530us (11963us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066784.205106:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9848 00000100:00100000:0.0:1746066784.207198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.207231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.207274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.207594:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14000 00000100:00100000:0.0:1746066784.207604:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976705920:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066784.207609:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066784.207617:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9200/0xfb36a14ee6089ee4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d888 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.207626:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066784.207628:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066784.207632:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9200/0xfb36a14ee6089ee4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d888 expref: 11 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066784.207640:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9200/0xfb36a14ee6089ee4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d888 expref: 11 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066784.207646:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5e9200, rc 0) 00000100:00100000:0.0:1746066784.207663:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976705920:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 60us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066784.207668:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14000 00000100:00100000:0.0:1746066784.211949:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.214097:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.216760:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.218552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.220798:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.228257:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.232441:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.232474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.232499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.232517:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976707328 00000100:00100000:0.0:1746066784.232524:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976707328 00000100:00100000:0.0:1746066784.232557:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976707584 00000100:00100000:0.0:1746066784.232559:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976707584 00000100:00100000:0.0:1746066784.232582:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976707840 00000100:00100000:0.0:1746066784.232584:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976707840 00000100:00100000:0.0:1746066784.232598:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14002 00000100:00100000:0.0:1746066784.232604:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882976707328:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:0.0:1746066784.232637:0:8452:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8800/0xfb36a14ee6089f2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.232650:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131883200/0xfb36a14ee6089d08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d793 expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066784.232658:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5893400/0xfb36a14ee6089e27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d803 expref: 14 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.232664:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57c3600/0xfb36a14ee6089e04 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7e7 expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.232669:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066784.232671:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066784.232673:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8800/0xfb36a14ee6089f2a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.232722:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57c3600/0xfb36a14ee6089e04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7e7 expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.232731:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57c3600/0xfb36a14ee6089e04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7e7 expref: 19 pid: 8112 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746066784.232742:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976756608:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066784.233361:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5893400/0xfb36a14ee6089e27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d803 expref: 14 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.233369:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5893400/0xfb36a14ee6089e27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d803 expref: 14 pid: 21973 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746066784.233376:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976756992:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066784.233395:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131883200/0xfb36a14ee6089d08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d793 expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066784.233401:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131883200/0xfb36a14ee6089d08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d793 expref: 11 pid: 21203 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746066784.233408:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976757248:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066784.233421:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b9b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066784.242368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.242394:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.242413:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976708096 00000100:00100000:0.0:1746066784.242418:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976708096 00010000:00010000:0.0:1746066784.242444:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131883200/0xfb36a14ee6089d08 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d793 expref: 13 pid: 21203 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746066784.242476:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7138 00000100:00100000:0.0:1746066784.242483:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882976708096:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066784.242495:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066784.242513:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131883200/0xfb36a14ee6089d08 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d793 expref: 13 pid: 21203 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746066784.242522:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131883200/0xfb36a14ee6089d08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d793 expref: 13 pid: 21203 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746066784.242543:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131883200/0xfb36a14ee6089d08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d793 expref: 13 pid: 21203 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746066784.242561:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066784.242604:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882976708096:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 122us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066784.242609:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7138 00000100:00100000:0.0:1746066784.242655:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976708224 00000100:00100000:0.0:1746066784.242658:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976708224 00010000:00010000:0.0:1746066784.242669:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57c3600/0xfb36a14ee6089e04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7e7 expref: 20 pid: 8112 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746066784.242713:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7139 00000100:00100000:0.0:1746066784.242719:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882976708224:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066784.242725:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066784.242733:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57c3600/0xfb36a14ee6089e04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7e7 expref: 20 pid: 8112 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066784.242740:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57c3600/0xfb36a14ee6089e04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7e7 expref: 20 pid: 8112 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066784.242749:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57c3600/0xfb36a14ee6089e04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d7e7 expref: 20 pid: 8112 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066784.242757:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066784.242770:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1963:x1830882976708224:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 52us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066784.242774:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7139 00000100:00100000:0.0:1746066784.246143:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.246187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066784.247650:0:10402:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013510a600/0xfb36a14ee6089f31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.247658:0:10402:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013510a600/0xfb36a14ee6089f31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.247708:0:10402:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013510a600/0xfb36a14ee6089f31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.247715:0:10402:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013510a600/0xfb36a14ee6089f31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.247721:0:10402:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013510a600/0xfb36a14ee6089f31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.247727:0:10402:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013510a600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066784.247730:0:10402:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013510a600/0xfb36a14ee6089f31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.247736:0:10402:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013510a600/0xfb36a14ee6089f31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.247745:0:10402:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013510a600/0xfb36a14ee6089f31 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.247750:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013510a600/0xfb36a14ee6089f31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066784.247787:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882976707584:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 15162us (15312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066784.247794:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14003 00010000:00010000:0.0:1746066784.255497:0:8112:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a85bc200/0xfb36a14ee6089f4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.255505:0:8112:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a85bc200/0xfb36a14ee6089f4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.255519:0:8112:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a85bc200/0xfb36a14ee6089f4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.255525:0:8112:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85bc200/0xfb36a14ee6089f4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.255531:0:8112:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a85bc200/0xfb36a14ee6089f4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.255536:0:8112:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a85bc200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066784.255539:0:8112:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a85bc200/0xfb36a14ee6089f4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.255544:0:8112:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a85bc200/0xfb36a14ee6089f4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.255553:0:8112:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a85bc200/0xfb36a14ee6089f4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.255557:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a85bc200/0xfb36a14ee6089f4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066784.255595:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976707712:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 20741us (21188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066784.255605:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14007 00000100:00100000:0.0:1746066784.265247:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.268414:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.268440:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.268463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.306236:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976760320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.306260:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066784.306282:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976760832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.306295:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066784.306306:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746066784.306310:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976760448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.306322:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066784.306331:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976760960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.306343:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066784.306360:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976760320 00000100:00100000:0.0:1746066784.306363:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976760320 00000100:00100000:0.0:1746066784.306380:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976760832 00000100:00100000:0.0:1746066784.306382:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976760832 00000100:00100000:0.0:1746066784.306394:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976760448 00000100:00100000:0.0:1746066784.306395:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976760448 00000100:00100000:0.0:1746066784.306402:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976760960 00000100:00100000:0.0:1746066784.306403:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976760960 00000100:00100000:0.0:1746066784.306412:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14017 00000100:00100000:0.0:1746066784.306418:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3293:x1830882976760320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.306522:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3293:x1830882976760320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (260us total) trans 21474840813 rc 0/0 00000100:00100000:0.0:1746066784.306527:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14017 00000100:00100000:0.0:1746066784.306536:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14018 00000100:00100000:0.0:1746066784.306540:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3293:x1830882976760832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.306605:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3293:x1830882976760832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (309us total) trans 21474840814 rc 0/0 00000100:00100000:0.0:1746066784.306610:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14018 00000100:00100000:0.0:1746066784.306619:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14019 00000100:00100000:0.0:1746066784.306623:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3293:x1830882976760448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.306731:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3293:x1830882976760448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (407us total) trans 21474840815 rc 0/0 00000100:00100000:0.0:1746066784.306737:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14019 00000100:00100000:0.0:1746066784.306746:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14020 00000100:00100000:0.0:1746066784.306751:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3293:x1830882976760960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.306817:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3293:x1830882976760960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (473us total) trans 21474840816 rc 0/0 00000100:00100000:0.0:1746066784.306822:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14020 00000100:00080000:0.0:1746066784.306840:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746066784.306855:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e86bb80/2, rc 0, transno 21474840815 00000100:00100000:0.0:1746066784.306858:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976760448:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066784.306864:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135dfaa00/2, rc 0, transno 21474840816 00000100:00100000:0.0:1746066784.306867:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976760960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066784.306872:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c6300/2, rc 0, transno 21474840813 00000100:00100000:0.0:1746066784.306874:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976760320:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066784.306880:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135df9180/2, rc 0, transno 21474840814 00000100:00100000:0.0:1746066784.306882:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976760832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.310295:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976760192 00000100:00100000:0.0:1746066784.310301:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976760192 00000100:00100000:0.0:1746066784.310333:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976760576 00000100:00100000:0.0:1746066784.310335:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976760576 00000100:00100000:0.0:1746066784.310348:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14021 00000100:00100000:0.0:1746066784.310355:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3296:x1830882976760192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.310523:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3296:x1830882976760192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (2767us total) trans 21474840817 rc 0/0 00000100:00100000:0.0:1746066784.310531:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14021 00000100:00100000:0.0:1746066784.310543:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14022 00000100:00100000:0.0:1746066784.310548:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3295:x1830882976760576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.310628:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3295:x1830882976760576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (453us total) trans 21474840818 rc 0/0 00000100:00100000:0.0:1746066784.310633:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14022 00000100:00100000:0.0:1746066784.316058:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976711424 00000100:00100000:0.0:1746066784.316062:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976711424 00000100:00100000:0.0:1746066784.316317:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976711808 00000100:00100000:0.0:1746066784.316320:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976711808 00000100:00100000:0.0:1746066784.316340:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14028 00000100:00100000:0.0:1746066784.316346:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976711424:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066784.316352:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066784.316360:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb64c00/0xfb36a14ee6089f85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d8ce expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066784.316372:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd5f, atime: 0x6812dd5f, ctime: 0x6812dd5f, blocks: 0x821 00010000:00010000:0.0:1746066784.316380:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066784.316382:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066784.316385:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb64c00/0xfb36a14ee6089f85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d8ce expref: 11 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066784.316394:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eb64c00/0xfb36a14ee6089f85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d8ce expref: 11 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066784.316400:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb64c00, rc 0) 00000100:00100000:0.0:1746066784.316418:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976711424:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 72us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066784.316424:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14028 00000100:00100000:0.0:1746066784.322865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.323342:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.325883:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.326633:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.330430:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.330462:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.330485:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.330504:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.371130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.376182:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.379459:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.383149:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.385579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.389050:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.393574:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.396864:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.399749:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.403423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.408251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.410902:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.416730:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.419888:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.419914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.419926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.420357:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.420536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.423304:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976716160 00000100:00100000:0.0:1746066784.423313:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976716160 00000100:00100000:0.0:1746066784.423348:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14041 00000100:00100000:0.0:1746066784.423355:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882976716160:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:0.0:1746066784.423463:0:4614:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066784.423465:0:4614:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066784.423467:0:4614:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066784.423469:0:4614:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066783 -> 1746066784 00002000:00010000:0.0:1746066784.423470:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746066784.423498:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882976716160:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 144us (2962us total) trans 17179873503 rc 0/0 00000100:00100000:0.0:1746066784.423503:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14041 00000100:00100000:0.0:1746066784.423557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.423568:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976716416 00000100:00100000:0.0:1746066784.423570:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976716416 00000100:00100000:0.0:1746066784.423583:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14042 00000100:00100000:0.0:1746066784.423587:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882976716416:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:0.0:1746066784.423650:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066784.423652:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066784.423653:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066784.423655:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066783 -> 1746066784 00002000:00010000:0.0:1746066784.423656:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746066784.423668:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882976716416:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 81us (112us total) trans 21474840823 rc 0/0 00000100:00100000:0.0:1746066784.423672:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14042 00000100:00100000:0.0:1746066784.425574:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.432448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066784.469503:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093630800/0xfb36a14ee608a003 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14551 initiator: MDT0 00010000:00010000:0.0:1746066784.469512:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093630800/0xfb36a14ee608a003 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14551 initiator: MDT0 00010000:00010000:0.0:1746066784.469518:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093630800/0xfb36a14ee608a003 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14551 initiator: MDT0 00010000:00010000:0.0:1746066784.469523:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093630800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066784.469527:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093630800/0xfb36a14ee608a003 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14551 initiator: MDT0 00010000:00010000:0.0:1746066784.469533:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093630800/0xfb36a14ee608a003 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14551 initiator: MDT0 00010000:00010000:0.0:1746066784.469545:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8900) 00010000:00010000:0.0:1746066784.469548:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066784.469551:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093630800/0xfb36a14ee608a003 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14551 initiator: MDT0 00010000:00010000:0.0:1746066784.469555:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093630800/0xfb36a14ee608a003 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14551 initiator: MDT0 00000100:00100000:0.0:1746066784.469579:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976764032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066784.469598:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066784.469609:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976764544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066784.469619:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066784.469626:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746066784.469629:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976764160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066784.469642:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066784.469648:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976764672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066784.469658:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066784.469671:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976764032 00000100:00100000:0.0:1746066784.469673:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976764032 00000100:00100000:0.0:1746066784.469716:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976764544 00000100:00100000:0.0:1746066784.469718:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976764544 00000100:00100000:0.0:1746066784.469724:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976764160 00000100:00100000:0.0:1746066784.469725:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976764160 00000100:00100000:0.0:1746066784.469730:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976764672 00000100:00100000:0.0:1746066784.469732:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976764672 00000100:00100000:0.0:1746066784.469738:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14045 00000100:00100000:0.0:1746066784.469743:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3296:x1830882976763264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.469894:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3296:x1830882976763264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (1401us total) trans 21474840824 rc 0/0 00000100:00100000:0.0:1746066784.469899:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14045 00000100:00100000:0.0:1746066784.469913:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14046 00000100:00100000:0.0:1746066784.469918:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3296:x1830882976763776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.471297:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3296:x1830882976763776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1378us (2784us total) trans 21474840830 rc 0/0 00000100:00100000:0.0:1746066784.471303:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14046 00000100:00100000:0.0:1746066784.471314:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14051 00000100:00100000:0.0:1746066784.471320:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3295:x1830882976764288:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066784.472093:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e851880/2, rc 0, transno 17179873507 00000100:00100000:0.0:1746066784.472096:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976764032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066784.472435:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000004:00080000:0.0:1746066784.472457:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e852d80/2, rc 0, transno 17179873509 00000100:00100000:0.0:1746066784.472460:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976764160:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066784.472466:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e58a80/2, rc 0, transno 17179873508 00000100:00100000:0.0:1746066784.472469:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976764544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066784.472548:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3295:x1830882976764288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1228us (3533us total) trans 17179873510 rc 0/0 00000100:00100000:0.0:1746066784.472552:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14051 00000004:00080000:0.0:1746066784.472813:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efb7480/2, rc 0, transno 17179873511 00000100:00100000:0.0:1746066784.472816:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976764672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066784.475277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.497785:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.499928:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.502727:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.502758:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.503360:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.506028:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.506056:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.506916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.506940:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976719104 00000100:00100000:0.0:1746066784.506942:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976719104 00010000:00010000:0.0:1746066784.506962:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013510b000/0xfb36a14ee608a026 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d91b expref: 254 pid: 16018 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746066784.507175:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7167 00000100:00100000:0.0:1746066784.507183:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:1963:x1830882976719104:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066784.507189:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066784.507194:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013510b000/0xfb36a14ee608a026 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d91b expref: 254 pid: 16018 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066784.507203:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013510b000/0xfb36a14ee608a026 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d91b expref: 254 pid: 16018 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066784.507214:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013510b000/0xfb36a14ee608a026 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d91b expref: 254 pid: 16018 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066784.507231:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066784.507235:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093630c00/0xfb36a14ee608a065 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066784.507242:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093630c00/0xfb36a14ee608a065 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066784.507248:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093630c00/0xfb36a14ee608a065 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066784.507254:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013510ae00/0xfb36a14ee608a073 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.507258:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013510ae00/0xfb36a14ee608a073 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.507262:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013510ae00/0xfb36a14ee608a073 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.507282:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066784.507296:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:1963:x1830882976719104:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 115us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066784.507301:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7167 00010000:00010000:0.0:1746066784.507316:0:16018:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013510ae00/0xfb36a14ee608a073 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066784.507322:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013510ae00/0xfb36a14ee608a073 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:0.0:1746066784.507329:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066784.507411:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013510bc00/0xfb36a14ee608a06c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d93e expref: 254 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.507421:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013510ae00/0xfb36a14ee608a073 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d93e expref: 253 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.507434:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066784.507436:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066784.507438:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013510ae00, rc 0) 00000100:00100000:0.0:1746066784.507453:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31362:x1830882976718592:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3891us (4093us total) trans 8589943882 rc 0/0 00000100:00100000:0.0:1746066784.507459:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9860 00000100:00100000:0.0:1746066784.507816:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.507854:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976719232 00000100:00100000:0.0:1746066784.507857:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976719232 00000100:00100000:0.0:1746066784.508624:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9861 00000100:00100000:0.0:1746066784.508631:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+9:31365:x1830882976719232:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066784.508643:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066784.508653:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b093200/0xfb36a14ee608a08f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d945 expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.508725:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b093200/0xfb36a14ee608a08f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d945 expref: 10 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.508739:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b093200/0xfb36a14ee608a08f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d945 expref: 10 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.508752:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066784.508755:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066784.508757:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b093200, rc 0) 00000100:00100000:0.0:1746066784.508831:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+10:31365:x1830882976719232:12345-192.168.202.57@tcp:101:cat.0 Request processed in 200us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066784.508837:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9861 00000100:00100000:0.0:1746066784.515253:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.526654:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066784.528559:0:20127:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1000/0xfb36a14ee608a09d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066784.528567:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1000/0xfb36a14ee608a09d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000040:00080000:0.0:1746066784.529125:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3043, 88 off257032 00000004:00080000:0.0:1746066784.529130:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745706454210ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066784.529166:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3065, 88 off258880 00000004:00080000:0.0:1746066784.529170:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745706493975ns, next at 739495247010ns, rc = 0 00000100:00100000:0.0:1746066784.537740:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.537835:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.537858:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976720128 00000100:00100000:0.0:1746066784.537864:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976720128 00000100:00100000:0.0:1746066784.537907:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14062 00000100:00100000:0.0:1746066784.537914:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:31363:x1830882976720128:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066784.537929:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066784.537945:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a3ec400/0xfb36a14ee608a0a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d95a expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.537968:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092491400/0xfb36a14ee6089fe0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d8f1 expref: 13 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.537975:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066784.537976:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066784.537979:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a3ec400/0xfb36a14ee608a0a4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d95a expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.538005:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092491400/0xfb36a14ee6089fe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d8f1 expref: 13 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.538015:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092491400/0xfb36a14ee6089fe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d8f1 expref: 13 pid: 8451 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746066784.538025:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976765696:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066784.538079:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b9b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066784.542058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.542160:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.542193:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976765696:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066784.542219:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a3ec400/0xfb36a14ee608a0a4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d95a expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.542233:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a3ec400, rc 0) 00000100:00100000:0.0:1746066784.542263:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:31363:x1830882976720128:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4349us (4427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066784.542270:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14062 00000100:00100000:0.0:1746066784.546704:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.569042:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976766080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066784.569066:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066784.569084:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976766592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066784.569098:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066784.569512:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976766080 00000100:00100000:0.0:1746066784.569515:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976766080 00000100:00100000:0.0:1746066784.569877:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976766848 00000100:00100000:0.0:1746066784.569880:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976766848 00000100:00100000:0.0:1746066784.569891:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976768128 00000100:00100000:0.0:1746066784.569893:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976768128 00000100:00100000:0.0:1746066784.569900:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976768256 00000100:00100000:0.0:1746066784.569901:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976768256 00000100:00100000:0.0:1746066784.569914:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14065 00000100:00100000:0.0:1746066784.569919:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800992a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+56:3294:x1830882976766720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066784.569974:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14066 00000100:00100000:0.0:1746066784.569980:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+56:3293:x1830882976766080:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066784.570053:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066784.570056:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066784.570057:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066784.570059:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066784 -> 1746066784 00002000:00010000:0.0:1746066784.570061:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2017 -> 2017 00000100:00100000:0.0:1746066784.570081:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3293:x1830882976766080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (1015us total) trans 17179873514 rc 0/0 00000100:00100000:0.0:1746066784.570089:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14066 00000100:00100000:0.0:1746066784.570099:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14068 00000100:00100000:0.0:1746066784.570104:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+56:3295:x1830882976766848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066784.570168:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746066784.570171:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746066784.570172:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066784.570173:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746066784.570175:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746066784.570195:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3295:x1830882976766848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (762us total) trans 17179873515 rc 0/0 00000100:00100000:0.0:1746066784.570200:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14068 00000100:00100000:0.0:1746066784.570210:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14070 00000100:00100000:0.0:1746066784.570215:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3295:x1830882976768128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.570271:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976767360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.570290:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066784.570300:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976767872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.570312:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066784.570330:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a590d880/2, rc 0, transno 17179873514 00000100:00100000:0.0:1746066784.570339:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976766080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066784.570345:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746066784.570349:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976767488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.570364:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066784.570371:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976768000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.570383:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066784.570443:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3295:x1830882976768128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 229us (966us total) trans 21474840833 rc 0/0 00000100:00100000:0.0:1746066784.570448:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14070 00000100:00100000:0.0:1746066784.570456:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976768384 00000100:00100000:0.0:1746066784.570458:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976768384 00000100:00100000:0.0:1746066784.570469:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14073 00000100:00100000:0.0:1746066784.570473:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3293:x1830882976767360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066784.570537:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066784.570540:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066784.570542:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066784.570543:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066784 -> 1746066784 00002000:00010000:0.0:1746066784.570545:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746066784.570565:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3293:x1830882976767360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (274us total) trans 21474840835 rc 0/0 00000100:00100000:0.0:1746066784.570570:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14073 00000100:00100000:0.0:1746066784.570579:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14075 00000100:00100000:0.0:1746066784.570584:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3293:x1830882976767488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066784.570654:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800992a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3294:x1830882976766720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 734us (1612us total) trans 17179873517 rc 0/0 00000100:00100000:0.0:1746066784.570659:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14065 00002000:00010000:0.0:1746066784.570834:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066784.570836:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066784.570838:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066784.570840:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066784 -> 1746066784 00002000:00010000:0.0:1746066784.570841:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746066784.571236:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3293:x1830882976767488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 652us (870us total) trans 21474840838 rc 0/0 00000100:00100000:0.0:1746066784.571243:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14075 00000004:00080000:0.0:1746066784.571999:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bb2ea00/2, rc 0, transno 17179873520 00000100:00100000:0.0:1746066784.572003:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976766592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066784.577600:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.578706:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.578730:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.596337:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.596390:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.611343:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.616405:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882976721664:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 19635us (20013us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066784.616413:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6314 00002000:00100000:0.0:1746066784.616418:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880093210a80 x1830882976721664/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:190/0 lens 488/440 e 0 to 0 dl 1746066795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066784.616426:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093210a80 with x1830882976721664 ext(1048576->2097151) 00002000:00010000:0.0:1746066784.616430:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093210a80 00000100:00100000:0.0:1746066784.622014:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976722432 00000100:00100000:0.0:1746066784.622021:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976722432 00002000:00100000:0.0:1746066784.622057:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2813952->2818047) req@ffff88009ef5f800 x1830882976722432/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:190/0 lens 488/0 e 0 to 0 dl 1746066795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066784.622066:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5f800 with x1830882976722432 ext(2813952->2818047) 00010000:00010000:0.0:1746066784.622074:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008de12a00/0xfb36a14ee608a0c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d976 expref: 25 pid: 8112 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066784.622086:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008de12a00/0xfb36a14ee608a0c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d976 expref: 25 pid: 8112 timeout: 845 lvb_type: 0 00002000:00010000:0.0:1746066784.622093:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef5f800 00000100:00100000:0.0:1746066784.622117:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2075 00000100:00100000:0.0:1746066784.622124:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882976722432:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066784.622262:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882976722432:12345-192.168.202.57@tcp:3:cat.0 Request processed in 139us (587us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066784.622268:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2075 00002000:00100000:0.0:1746066784.622273:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2813952->2818047) req@ffff88009ef5f800 x1830882976722432/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:190/0 lens 488/4536 e 0 to 0 dl 1746066795 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066784.622280:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5f800 with x1830882976722432 ext(2813952->2818047) 00010000:00010000:0.0:1746066784.622285:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008de12a00/0xfb36a14ee608a0c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d976 expref: 25 pid: 8112 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066784.622294:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008de12a00/0xfb36a14ee608a0c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d976 expref: 25 pid: 8112 timeout: 845 lvb_type: 0 00002000:00010000:0.0:1746066784.622299:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef5f800 00000100:00100000:0.0:1746066784.628073:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.640608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.640714:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.640925:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976723072 00000100:00100000:0.0:1746066784.640928:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976723072 00010000:00010000:0.0:1746066784.640946:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092490600/0xfb36a14ee6089fe7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d8f8 expref: 13 pid: 8451 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746066784.640964:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7171 00000100:00100000:0.0:1746066784.640969:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882976723072:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066784.640976:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066784.640992:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092490600/0xfb36a14ee6089fe7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d8f8 expref: 13 pid: 8451 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066784.640999:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092490600/0xfb36a14ee6089fe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d8f8 expref: 13 pid: 8451 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746066784.641014:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066784.641015:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066784.641020:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008de13e00/0xfb36a14ee608a0d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d984 expref: 15 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.641027:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008de13e00/0xfb36a14ee608a0d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d984 expref: 15 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.641050:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008de13e00/0xfb36a14ee608a0d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d984 expref: 15 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066784.641058:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976769152:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066784.641076:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066784.643484:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976769152:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066784.643504:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066784.643530:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882976723072:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2560us (2670us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066784.643539:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7171 00000100:00100000:0.0:1746066784.644158:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.646205:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.646590:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.646727:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976723584 00000100:00100000:0.0:1746066784.646731:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976723584 00002000:00100000:0.0:1746066784.646754:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800a590d500 x1830882976723584/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:190/0 lens 488/0 e 0 to 0 dl 1746066795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066784.646763:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590d500 with x1830882976723584 ext(1048576->2097151) 00002000:00010000:0.0:1746066784.646766:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590d500 00000100:00100000:0.0:1746066784.646787:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6316 00000100:00100000:0.0:1746066784.646793:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882976723584:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066784.653198:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.653242:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.660082:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.664180:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882976723840:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10208us (10932us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066784.664188:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6318 00002000:00100000:0.0:1746066784.664196:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800921c2d80 x1830882976723840/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:190/0 lens 488/440 e 0 to 0 dl 1746066795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066784.664203:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c2d80 with x1830882976723840 ext(1048576->2097151) 00002000:00010000:0.0:1746066784.664207:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921c2d80 00000100:00100000:0.0:1746066784.666019:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.668363:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.675718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.676702:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.685412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.686537:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.712107:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.718945:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.730366:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.753942:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.754019:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.761399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.761430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.776350:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.783940:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.783991:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.792785:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.792814:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.792833:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.793941:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882976727296:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9766us (9945us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066784.793949:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6324 00002000:00100000:0.0:1746066784.793955:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009e93c700 x1830882976727296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:190/0 lens 488/440 e 0 to 0 dl 1746066795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066784.793962:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93c700 with x1830882976727296 ext(2097152->3145727) 00002000:00010000:0.0:1746066784.793966:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93c700 00000100:00100000:0.0:1746066784.796550:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976728320 00000100:00100000:0.0:1746066784.796559:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976728320 00000100:00100000:0.0:1746066784.796880:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9866 00000100:00100000:0.0:1746066784.796891:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31369:x1830882976728320:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066784.796910:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066784.796929:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093678600/0xfb36a14ee608a10d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d9bc expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.797033:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093678c00/0xfb36a14ee608a114 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.797046:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093678c00/0xfb36a14ee608a114 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.797055:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093678c00/0xfb36a14ee608a114 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.797065:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093678e00/0xfb36a14ee608a11b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.797070:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093678e00/0xfb36a14ee608a11b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.797075:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093678e00/0xfb36a14ee608a11b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:0.0:1746066784.799422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.811327:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.811395:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976728704 00000100:00100000:0.0:1746066784.811401:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976728704 00000100:00100000:0.0:1746066784.811437:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9867 00000100:00100000:0.0:1746066784.811444:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+9:31371:x1830882976728704:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066784.811459:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066784.811474:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5894600/0xfb36a14ee608a137 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97d9ca expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066784.811552:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895400/0xfb36a14ee608a13e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.811562:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895400/0xfb36a14ee608a13e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.811571:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895400/0xfb36a14ee608a13e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.811582:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5894e00/0xfb36a14ee608a145 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.811587:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5894e00/0xfb36a14ee608a145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.811592:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5894e00/0xfb36a14ee608a145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.811706:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895c00/0xfb36a14ee608a14c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.811714:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895c00/0xfb36a14ee608a14c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.811720:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895c00/0xfb36a14ee608a14c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:0.0:1746066784.811727:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066784.811794:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895400/0xfb36a14ee608a13e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.811800:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895400/0xfb36a14ee608a13e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.811805:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895400/0xfb36a14ee608a13e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.811810:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5895400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066784.811813:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895400/0xfb36a14ee608a13e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.811818:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895400/0xfb36a14ee608a13e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.811827:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066784.811829:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066784.811833:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895400/0xfb36a14ee608a13e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.811838:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895400/0xfb36a14ee608a13e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.812781:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5894e00/0xfb36a14ee608a145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.812788:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5894e00/0xfb36a14ee608a145 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.812792:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5894e00/0xfb36a14ee608a145 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.812797:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5894e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066784.812799:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5894e00/0xfb36a14ee608a145 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.812804:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5894e00/0xfb36a14ee608a145 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.812815:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800901e3b00) 00010000:00010000:0.0:1746066784.812818:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066784.812820:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5894e00/0xfb36a14ee608a145 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066784.812825:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5894e00/0xfb36a14ee608a145 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00000100:00100000:0.0:1746066784.812955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.812994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.813013:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976729088 00000100:00100000:0.0:1746066784.813017:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976729088 00002000:00100000:0.0:1746066784.815319:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880094128a80 x1830882976729088/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:190/0 lens 488/0 e 0 to 0 dl 1746066795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066784.815328:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094128a80 with x1830882976729088 ext(3145728->4194303) 00002000:00010000:0.0:1746066784.815332:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094128a80 00000100:00100000:0.0:1746066784.815347:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6329 00000100:00100000:0.0:1746066784.815358:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882976729088:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066784.829042:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976729728 00000100:00100000:0.0:1746066784.829053:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976729728 00000100:00100000:0.0:1746066784.829115:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4085 00000100:00100000:0.0:1746066784.829122:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+11:31371:x1830882976729728:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:0.0:1746066784.829297:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:31371:x1830882976729728:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 175us (3068us total) trans 8589943887 rc 0/0 00000100:00100000:0.0:1746066784.829302:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4085 00000100:00100000:0.0:1746066784.837796:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.848653:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882976729088:12345-192.168.202.57@tcp:3:cat.0 Request processed in 33289us (35687us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066784.848665:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6329 00002000:00100000:0.0:1746066784.848697:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880094128a80 x1830882976729088/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:190/0 lens 488/440 e 0 to 0 dl 1746066795 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066784.848705:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094128a80 with x1830882976729088 ext(3145728->4194303) 00002000:00010000:0.0:1746066784.848710:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094128a80 00000100:00100000:0.0:1746066784.849932:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.870730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.875459:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.875482:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976731008 00000100:00100000:0.0:1746066784.875487:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976731008 00002000:00100000:0.0:1746066784.875522:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1257472->1261567) req@ffff8800924d3100 x1830882976731008/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:190/0 lens 488/0 e 0 to 0 dl 1746066795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066784.875531:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d3100 with x1830882976731008 ext(1257472->1261567) 00002000:00010000:0.0:1746066784.875535:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d3100 00000100:00100000:0.0:1746066784.875565:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6332 00000100:00100000:0.0:1746066784.875572:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882976731008:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066784.876161:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882976731008:12345-192.168.202.57@tcp:3:cat.0 Request processed in 589us (702us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066784.876168:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6332 00002000:00100000:0.0:1746066784.876174:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1257472->1261567) req@ffff8800924d3100 x1830882976731008/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:190/0 lens 488/4536 e 0 to 0 dl 1746066795 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066784.876181:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d3100 with x1830882976731008 ext(1257472->1261567) 00002000:00010000:0.0:1746066784.876185:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d3100 00000100:00100000:0.0:1746066784.879037:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.883911:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.900755:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.911229:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066784.919522:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.015421:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066785.017599:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066785.021983:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066785.022555:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066785.032110:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066785.033595:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066785.039774:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.039806:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.039895:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.039942:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976733056 00000100:00100000:0.0:1746066785.039949:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976733056 00010000:00010000:0.0:1746066785.039980:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c33c600/0xfb36a14ee608a130 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9c3 expref: 20 pid: 8112 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746066785.040006:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976733184 00000100:00100000:0.0:1746066785.040008:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976733184 00010000:00010000:0.0:1746066785.040018:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131883400/0xfb36a14ee608a0f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9a7 expref: 30 pid: 8112 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746066785.040033:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7179 00000100:00100000:0.0:1746066785.040040:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882976733056:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066785.040052:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066785.040070:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c33c600/0xfb36a14ee608a130 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9c3 expref: 20 pid: 8112 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.040080:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c33c600/0xfb36a14ee608a130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9c3 expref: 20 pid: 8112 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.040100:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c33c600/0xfb36a14ee608a130 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9c3 expref: 20 pid: 8112 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.040115:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066785.040146:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882976733056:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 107us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066785.040152:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7179 00000100:00100000:0.0:1746066785.040165:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7180 00000100:00100000:0.0:1746066785.040171:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882976733184:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066785.040177:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066785.040183:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131883400/0xfb36a14ee608a0f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9a7 expref: 30 pid: 8112 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.040191:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131883400/0xfb36a14ee608a0f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9a7 expref: 30 pid: 8112 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.040202:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131883400/0xfb36a14ee608a0f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9a7 expref: 30 pid: 8112 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.040212:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066785.040213:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066785.040219:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa29000/0xfb36a14ee608a199 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9f4 expref: 18 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066785.040226:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa29000/0xfb36a14ee608a199 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9f4 expref: 18 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066785.040252:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa29000/0xfb36a14ee608a199 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9f4 expref: 18 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066785.040262:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976771328:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066785.040315:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41910c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746066785.042251:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746066785.042930:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066785.044734:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.060630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.060730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066785.061150:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066785.062663:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.070374:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.070420:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.073198:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.076726:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.081503:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976735232 00000100:00100000:0.0:1746066785.081510:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976735232 00002000:00100000:0.0:1746066785.081545:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2723840->2727935) req@ffff88009bae8e00 x1830882976735232/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:191/0 lens 488/0 e 0 to 0 dl 1746066796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066785.081554:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae8e00 with x1830882976735232 ext(2723840->2727935) 00002000:00010000:0.0:1746066785.081558:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae8e00 00000100:00100000:0.0:1746066785.081583:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6338 00000100:00100000:0.0:1746066785.081590:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882976735232:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066785.081724:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882976735232:12345-192.168.202.57@tcp:3:cat.0 Request processed in 134us (471us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066785.081730:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6338 00002000:00100000:0.0:1746066785.081736:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2723840->2727935) req@ffff88009bae8e00 x1830882976735232/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:191/0 lens 488/4536 e 0 to 0 dl 1746066796 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066785.081742:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae8e00 with x1830882976735232 ext(2723840->2727935) 00002000:00010000:0.0:1746066785.081744:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae8e00 00000100:00100000:0.0:1746066785.088828:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.093773:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:1966:x1830882976734976:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16609us (17043us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066785.093784:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6337 00002000:00100000:0.0:1746066785.093794:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff8800942da300 x1830882976734976/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:191/0 lens 488/440 e 0 to 0 dl 1746066796 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066785.093803:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942da300 with x1830882976734976 ext(0->1048575) 00002000:00010000:0.0:1746066785.093807:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942da300 00000100:00100000:0.0:1746066785.104075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066785.104334:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066785.108976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.113918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.113953:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.113968:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.114008:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.116793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.118553:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882976736512:12345-192.168.202.57@tcp:4:cat.0 Request processed in 4063us (4541us total) trans 21474840841 rc 0/0 00000100:00100000:0.0:1746066785.118561:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2081 00002000:00100000:0.0:1746066785.118568:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (1167360->1261567) req@ffff8800942db800 x1830882976736512/t21474840841(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:191/0 lens 488/448 e 0 to 0 dl 1746066796 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066785.118576:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942db800 with x1830882976736512 ext(1167360->1261567) 00010000:00010000:0.0:1746066785.118581:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608a15a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9d1 expref: 25 pid: 20532 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.118590:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608a15a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9d1 expref: 25 pid: 20532 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746066785.118595:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942db800 00000100:00100000:0.0:1746066785.123961:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.124961:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976737024 00000100:00100000:0.0:1746066785.124964:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976737024 00010000:00010000:0.0:1746066785.124979:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013510ae00/0xfb36a14ee608a073 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d93e expref: 260 pid: 16018 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746066785.124998:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7185 00000100:00100000:0.0:1746066785.125003:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:1964:x1830882976737024:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066785.125008:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066785.125011:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013510ae00/0xfb36a14ee608a073 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d93e expref: 260 pid: 16018 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.125018:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013510ae00/0xfb36a14ee608a073 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d93e expref: 260 pid: 16018 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.125032:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013510ae00/0xfb36a14ee608a073 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d93e expref: 260 pid: 16018 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.125044:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066785.125047:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e41400/0xfb36a14ee608a1ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066785.125052:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e41400/0xfb36a14ee608a1ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066785.125058:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e41400/0xfb36a14ee608a1ed lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066785.125073:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066785.125089:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:1964:x1830882976737024:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 86us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066785.125093:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7185 00000100:00100000:0.0:1746066785.152368:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.152404:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.152429:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.152439:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.152466:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066785.152480:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066785.152493:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066785.152527:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066785.152543:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976737792 00000100:00100000:0.0:1746066785.152546:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976737792 00000100:00100000:0.0:1746066785.152565:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14101 00000100:00100000:0.0:1746066785.152572:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1966:x1830882976737408:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066785.152587:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066785.152601:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092490800/0xfb36a14ee608a21e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97da2c expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066785.152618:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066785.152620:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066785.152626:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092490800/0xfb36a14ee608a21e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da2c expref: 14 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066785.152638:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092490800/0xfb36a14ee608a21e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da2c expref: 14 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066785.152647:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092490800, rc 0) 00000100:00100000:0.0:1746066785.152712:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1966:x1830882976737408:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 140us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066785.152724:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14101 00000100:00100000:0.0:1746066785.152739:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14106 00000100:00100000:0.0:1746066785.152744:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1965:x1830882976738048:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066785.152750:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066785.152756:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092490600/0xfb36a14ee608a241 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97da4f expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066785.152786:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976772736:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066785.152826:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066785.159397:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.159435:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.163587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.170293:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.173568:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.182346:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976739072 00000100:00100000:0.0:1746066785.182353:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976739072 00000100:00100000:0.0:1746066785.183763:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9873 00000100:00100000:0.0:1746066785.183778:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31383:x1830882976739072:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066785.183799:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066785.183818:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28e00/0xfb36a14ee608a264 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97da64 expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066785.183899:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28800/0xfb36a14ee608a26b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066785.183914:0:16018:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5894e00/0xfb36a14ee608a256 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da5d expref: 9 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066785.183921:0:16018:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28800/0xfb36a14ee608a26b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066785.183953:0:16018:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5894e00/0xfb36a14ee608a256 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da5d expref: 9 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066785.183963:0:16018:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5894e00/0xfb36a14ee608a256 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da5d expref: 9 pid: 16018 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746066785.183975:0:16018:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882976773120:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066785.184088:0:16018:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066785.191262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.192411:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.192441:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.198936:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.199050:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.206859:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.206900:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.211519:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.226589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066785.230026:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0800/0xfb36a14ee608a287 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230033:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0800/0xfb36a14ee608a287 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230073:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608a280 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da79 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.230079:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608a280 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da79 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.230086:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af1000, rc 0) 00000100:00100000:1.0:1746066785.230105:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31383:x1830882976740864:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 252us (3523us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066785.230109:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9874 00000100:00100000:1.0:1746066785.230119:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9875 00000100:00100000:1.0:1746066785.230123:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+14:31387:x1830882976741120:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066785.230132:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066785.230138:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0400/0xfb36a14ee608a28e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97da80 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.230187:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608a295 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230195:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608a295 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230200:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608a295 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230209:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a29c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230214:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a29c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230218:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a29c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230283:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608a2a3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230288:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608a2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230293:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608a2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:1.0:1746066785.230299:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066785.230354:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608a295 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230358:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608a295 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230362:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608a295 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230366:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4af1e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066785.230368:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608a295 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230372:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608a295 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230377:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066785.230379:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066785.230381:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608a295 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230385:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608a295 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230392:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a29c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230396:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a29c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230400:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a29c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230403:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4af1a00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066785.230404:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a29c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230408:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a29c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230412:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec74500) 00010000:00010000:1.0:1746066785.230414:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066785.230415:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a29c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230418:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a29c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066785.230441:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0400/0xfb36a14ee608a28e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da80 expref: 17 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.230449:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608a2a3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da80 expref: 16 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.230454:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066785.230456:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066785.230457:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af0600, rc 0) 00000100:00100000:1.0:1746066785.230475:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:31387:x1830882976741120:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 352us (1555us total) trans 8589943896 rc 0/0 00000100:00100000:1.0:1746066785.230479:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9875 00000100:00100000:0.0:1746066785.233091:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.237242:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976741248 00000100:00100000:1.0:1746066785.237248:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976741248 00000100:00100000:1.0:1746066785.237277:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14110 00000100:00100000:1.0:1746066785.237284:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:31381:x1830882976741248:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066785.237295:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066785.237311:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1200/0xfb36a14ee608a2b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97da87 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.237333:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.237335:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.237339:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1200/0xfb36a14ee608a2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da87 expref: 18 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.237350:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1200/0xfb36a14ee608a2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da87 expref: 18 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.237359:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af1200, rc 0) 00000100:00100000:1.0:1746066785.237374:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:31381:x1830882976741248:12345-192.168.202.57@tcp:101:cat.0 Request processed in 91us (4294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.237378:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14110 00000100:00100000:0.0:1746066785.237606:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.250818:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.250926:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976741632 00000100:00100000:1.0:1746066785.250934:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976741632 00000100:00100000:1.0:1746066785.251429:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14111 00000100:00100000:1.0:1746066785.251437:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882976741632:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066785.251457:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066785.251472:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a2b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97da8e expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.251492:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.251494:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.251500:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a2b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da8e expref: 26 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.251512:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a2b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da8e expref: 26 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.251521:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af1a00, rc 0) 00000100:00100000:1.0:1746066785.251569:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882976741632:12345-192.168.202.57@tcp:101:cat.0 Request processed in 132us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.251574:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14111 00000100:00100000:0.0:1746066785.251936:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.251981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.256135:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976742400 00000100:00100000:0.0:1746066785.256144:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976742400 00002000:00100000:0.0:1746066785.256182:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009bae9f80 x1830882976742400/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:191/0 lens 488/0 e 0 to 0 dl 1746066796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066785.256191:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae9f80 with x1830882976742400 ext(3145728->4194303) 00002000:00010000:0.0:1746066785.256196:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bae9f80 00000100:00100000:0.0:1746066785.256216:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6347 00000100:00100000:0.0:1746066785.256223:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+21:1965:x1830882976742400:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066785.259081:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.278544:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.281084:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976742784 00000100:00100000:1.0:1746066785.281095:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976742784 00000100:00100000:1.0:1746066785.281153:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14112 00000100:00100000:1.0:1746066785.281160:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+22:31387:x1830882976742784:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066785.281176:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066785.281191:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608a2bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97da95 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.281221:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008de13e00/0xfb36a14ee608a0d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d984 expref: 23 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.281229:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350bca00/0xfb36a14ee608a22c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da3a expref: 13 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.281235:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008de12000/0xfb36a14ee608a0e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d992 expref: 25 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.281240:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.281242:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.281245:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608a2bf lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1409024->1810431] (req 1409024->1810431) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da95 expref: 23 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.281273:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008de12000/0xfb36a14ee608a0e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d992 expref: 25 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.281284:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008de12000/0xfb36a14ee608a0e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d992 expref: 25 pid: 9776 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746066785.282285:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976773376:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.282382:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350bca00/0xfb36a14ee608a22c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da3a expref: 13 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.282392:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350bca00/0xfb36a14ee608a22c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da3a expref: 13 pid: 8112 timeout: 846 lvb_type: 1 00000100:00100000:1.0:1746066785.282401:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099711500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976773504:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.282426:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008de13e00/0xfb36a14ee608a0d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d984 expref: 21 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.282434:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008de13e00/0xfb36a14ee608a0d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d984 expref: 21 pid: 9776 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746066785.282441:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976773632:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.282460:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066785.291008:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976773632:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066785.293082:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.294931:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.294954:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976773376:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066785.294964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.294965:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099711500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976773504:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066785.294976:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976743040 00000100:00100000:0.0:1746066785.294979:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976743040 00010000:00010000:1.0:1746066785.294994:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608a2bf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1409024->1810431] (req 1409024->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da95 expref: 18 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066785.294996:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350bca00/0xfb36a14ee608a22c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da3a expref: 14 pid: 8112 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746066785.295004:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e83a00, rc 0) 00000100:00100000:0.0:1746066785.295022:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976743168 00000100:00100000:0.0:1746066785.295024:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976743168 00010000:00010000:0.0:1746066785.295034:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008de12000/0xfb36a14ee608a0e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d992 expref: 26 pid: 9776 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746066785.295056:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7192 00000100:00100000:0.0:1746066785.295061:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882976743168:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066785.295068:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066785.295078:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008de12000/0xfb36a14ee608a0e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d992 expref: 26 pid: 9776 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.295086:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008de12000/0xfb36a14ee608a0e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d992 expref: 26 pid: 9776 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.295099:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008de12000/0xfb36a14ee608a0e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d992 expref: 26 pid: 9776 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.295110:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066785.295111:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+18:31387:x1830882976742784:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 13951us (16575us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.295117:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14112 00000100:00100000:0.0:1746066785.295121:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882976743168:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 61us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066785.295126:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7192 00000100:00100000:0.0:1746066785.297518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.297538:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.297557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.297721:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976743552 00000100:00100000:1.0:1746066785.297725:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976743552 00000100:00100000:1.0:1746066785.297743:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14113 00000100:00100000:1.0:1746066785.297747:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882976743552:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066785.297755:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066785.297765:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d498e00/0xfb36a14ee608a2c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97da9c expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066785.298394:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099711500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976773888:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066785.298436:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066785.304159:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00010000:1.0:1746066785.304329:0:21973:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime: 1746066783 -> 1746066784 00002000:00010000:1.0:1746066785.304333:0:21973:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime: 1746066783 -> 1746066785 00000100:00100000:1.0:1746066785.304354:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099711500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976773888:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066785.304383:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d498e00/0xfb36a14ee608a2c6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da9c expref: 26 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.304396:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d498e00/0xfb36a14ee608a2c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da9c expref: 26 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.304416:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d498e00, rc 0) 00000100:00100000:1.0:1746066785.304456:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882976743552:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6707us (6915us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066785.304467:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14113 00000100:00100000:0.0:1746066785.307543:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.308220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.308242:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976744192 00000100:00100000:1.0:1746066785.308248:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976744192 00000100:00100000:1.0:1746066785.308293:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14114 00000100:00100000:1.0:1746066785.308299:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882976744192:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066785.308313:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066785.308327:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d498600/0xfb36a14ee608a2cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97daa3 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066785.308369:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099711500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976774016:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066785.308438:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3480 going to sleep for 11 seconds 00002000:00010000:1.0:1746066785.309458:0:21973:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime: 1746066784 -> 1746066785 00002000:00010000:1.0:1746066785.309462:0:21973:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime: 1746066784 -> 1746066785 00000100:00100000:1.0:1746066785.309476:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099711500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976774016:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066785.309496:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d498600/0xfb36a14ee608a2cd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97daa3 expref: 26 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.309506:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d498600/0xfb36a14ee608a2cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97daa3 expref: 26 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.309514:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d498600, rc 0) 00000100:00100000:1.0:1746066785.309534:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882976744192:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1234us (1995us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066785.309539:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14114 00000100:00100000:0.0:1746066785.311643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.317106:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.328253:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.328547:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976745088 00000100:00100000:1.0:1746066785.328554:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976745088 00000100:00100000:1.0:1746066785.329383:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14115 00000100:00100000:1.0:1746066785.329391:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31385:x1830882976745088:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066785.329405:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066785.329419:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d498c00/0xfb36a14ee608a2d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97daaa expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.329446:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608a2bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da95 expref: 17 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.329453:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066785.329454:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066785.329457:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d498c00/0xfb36a14ee608a2d4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1523712->2097151] (req 1523712->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97daaa expref: 26 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.329479:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608a2bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1810431) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da95 expref: 17 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.329488:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608a2bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1810431) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da95 expref: 17 pid: 21973 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746066785.329497:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976774144:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.331427:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066785.336482:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.336823:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976774144:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.336847:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d498c00/0xfb36a14ee608a2d4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1523712->2097151] (req 1523712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97daaa expref: 26 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.336858:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d498c00, rc 0) 00000100:00100000:1.0:1746066785.336892:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31385:x1830882976745088:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 7502us (8645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.336898:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14115 00000100:00100000:0.0:1746066785.347232:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.352127:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.358568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.358747:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976745728 00000100:00100000:1.0:1746066785.358756:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976745728 00000100:00100000:1.0:1746066785.358959:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14116 00000100:00100000:1.0:1746066785.358967:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31385:x1830882976745728:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066785.358980:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066785.358994:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d498e00/0xfb36a14ee608a2db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dab1 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.359016:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b093800/0xfb36a14ee608a0ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d999 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.359023:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1400/0xfb36a14ee608a23a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da41 expref: 13 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.359029:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131882e00/0xfb36a14ee608a0f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9a0 expref: 29 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.359034:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.359036:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.359039:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d498e00/0xfb36a14ee608a2db lrc: 6/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1048576->1363967] (req 1048576->1363967) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dab1 expref: 29 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.359065:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131882e00/0xfb36a14ee608a0f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9a0 expref: 29 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.359074:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131882e00/0xfb36a14ee608a0f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9a0 expref: 29 pid: 8112 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746066785.359084:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976774400:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.359628:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1400/0xfb36a14ee608a23a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da41 expref: 13 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.359636:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1400/0xfb36a14ee608a23a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da41 expref: 13 pid: 9776 timeout: 846 lvb_type: 1 00000100:00100000:1.0:1746066785.359645:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976774528:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.359713:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b093800/0xfb36a14ee608a0ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d999 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.359721:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b093800/0xfb36a14ee608a0ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d999 expref: 20 pid: 8112 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746066785.359727:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099712300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976774656:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.361422:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066785.364564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.364797:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976774400:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.364807:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976774528:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.364813:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099712300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976774656:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.364841:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d498e00/0xfb36a14ee608a2db lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 7 type: EXT [1048576->1363967] (req 1048576->1363967) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dab1 expref: 29 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.364858:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d498e00, rc 0) 00000100:00100000:1.0:1746066785.364893:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:31385:x1830882976745728:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 5927us (6331us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.364902:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14116 00000100:00100000:0.0:1746066785.365607:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.366372:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.370159:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.372309:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.449899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.453985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.454818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.500650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.511841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.511980:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976747520 00000100:00100000:1.0:1746066785.511987:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976747520 00000100:00100000:1.0:1746066785.512044:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 689 00000100:00100000:1.0:1746066785.512051:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:1965:x1830882976747520:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066785.512063:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066785.512083:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881200/0xfb36a14ee608a30c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dabf expref: 262 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.512302:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066785.512306:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066785.512354:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:1965:x1830882976747520:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 302us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.512360:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 689 00000100:00100000:0.0:1746066785.517079:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.519642:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976747648 00000100:00100000:1.0:1746066785.519653:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976747648 00000100:00100000:1.0:1746066785.519753:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14117 00000100:00100000:1.0:1746066785.519760:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+19:31394:x1830882976747648:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066785.519775:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066785.519792:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a3ec400/0xfb36a14ee608a31a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dacd expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.519814:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5895600/0xfb36a14ee608a248 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da56 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.519826:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1200/0xfb36a14ee608a2b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da87 expref: 20 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.519832:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608a279 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da72 expref: 12 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.519838:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.519839:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.519841:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a3ec400/0xfb36a14ee608a31a lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3493888->4034559] (req 3493888->4034559) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dacd expref: 20 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.519867:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608a279 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da72 expref: 12 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.519877:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608a279 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da72 expref: 12 pid: 21973 timeout: 846 lvb_type: 1 00000100:00100000:1.0:1746066785.519886:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976775168:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.519970:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1200/0xfb36a14ee608a2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da87 expref: 20 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.519977:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1200/0xfb36a14ee608a2b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da87 expref: 20 pid: 21203 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746066785.519984:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976775296:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.520005:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5895600/0xfb36a14ee608a248 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da56 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.520011:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5895600/0xfb36a14ee608a248 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da56 expref: 25 pid: 21203 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746066785.520017:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099712680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976775424:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.520030:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066785.520348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.534206:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099710000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976775168:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.534217:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976775296:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.534224:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099712680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976775424:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.534258:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a3ec400/0xfb36a14ee608a31a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3493888->4034559] (req 3493888->4034559) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dacd expref: 20 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.534273:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a3ec400, rc 0) 00000100:00100000:1.0:1746066785.534320:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+20:31394:x1830882976747648:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 14560us (17247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.534328:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14117 00000100:00100000:0.0:1746066785.541057:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.549259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.553574:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.553653:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.553704:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976747904 00000100:00100000:0.0:1746066785.553709:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.553712:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976747904 00000100:00100000:1.0:1746066785.553736:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976748032 00000100:00100000:0.0:1746066785.553737:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.553738:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976748032 00000100:00100000:0.0:1746066785.553765:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.553780:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.553792:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976748160 00000100:00100000:0.0:1746066785.553795:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976748160 00010000:00010000:0.0:1746066785.553812:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801350bc200/0xfb36a14ee608a233 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da48 expref: 13 pid: 8112 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746066785.553826:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976748928 00000100:00100000:0.0:1746066785.553828:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976748928 00000100:00100000:0.0:1746066785.553841:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7200 00000100:00100000:0.0:1746066785.553848:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882976748288:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066785.553858:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066785.553876:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608a1d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da10 expref: 29 pid: 8112 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.553885:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608a1d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da10 expref: 29 pid: 8112 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746066785.553904:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1200/0xfb36a14ee608a2b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da87 expref: 20 pid: 21203 timeout: 846 lvb_type: 0 00000100:00100000:1.0:1746066785.553921:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7202 00000100:00100000:1.0:1746066785.553926:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882976748544:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066785.553933:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066785.553944:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5895600/0xfb36a14ee608a248 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da56 expref: 26 pid: 21203 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746066785.553951:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5895600/0xfb36a14ee608a248 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da56 expref: 26 pid: 21203 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746066785.553969:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5895600/0xfb36a14ee608a248 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da56 expref: 26 pid: 21203 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746066785.553985:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066785.554019:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882976748544:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 93us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.554025:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7202 00000100:00100000:1.0:1746066785.554037:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7203 00000100:00100000:1.0:1746066785.554042:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882976748032:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066785.554047:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066785.554054:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1200/0xfb36a14ee608a2b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da87 expref: 20 pid: 21203 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746066785.554062:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1200/0xfb36a14ee608a2b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da87 expref: 20 pid: 21203 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746066785.554076:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1200/0xfb36a14ee608a2b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da87 expref: 20 pid: 21203 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746066785.554083:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066785.554095:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882976748032:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 53us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.554099:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7203 00000100:00100000:1.0:1746066785.554108:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 690 00000100:00100000:1.0:1746066785.554112:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882976748928:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066785.554119:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066785.554129:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881200/0xfb36a14ee608a33d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dad4 expref: 21 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.554138:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066785.554141:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066785.554151:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882976748928:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 39us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.554156:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 690 00010000:00010000:1.0:1746066785.554175:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608a279 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da72 expref: 13 pid: 21973 timeout: 846 lvb_type: 1 00000100:00100000:1.0:1746066785.554192:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7204 00000100:00100000:1.0:1746066785.554197:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882976747904:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066785.554202:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066785.554209:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608a279 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da72 expref: 13 pid: 21973 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746066785.554216:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608a279 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da72 expref: 13 pid: 21973 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746066785.554225:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608a279 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da72 expref: 13 pid: 21973 timeout: 846 lvb_type: 1 00010000:00010000:1.0:1746066785.554233:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.554234:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.554240:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a3ec400/0xfb36a14ee608a31a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4034559) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dacd expref: 18 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.554248:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a3ec400/0xfb36a14ee608a31a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4034559) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dacd expref: 18 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.554273:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012a3ec400/0xfb36a14ee608a31a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3493888->4034559) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dacd expref: 18 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066785.554284:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099712680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976775936:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066785.554324:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3600 going to sleep for 11 seconds 00010000:00010000:0.0:1746066785.554783:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608a1d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da10 expref: 29 pid: 8112 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746066785.554807:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066785.554808:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066785.554813:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d36bc00/0xfb36a14ee608a321 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2846720->3039231) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dac6 expref: 28 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066785.554819:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d36bc00/0xfb36a14ee608a321 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2846720->3039231) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dac6 expref: 28 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066785.554836:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d36bc00/0xfb36a14ee608a321 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2846720->3039231) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dac6 expref: 28 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066785.554844:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976776192:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066785.554879:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066785.556128:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976749184 00000100:00100000:0.0:1746066785.556133:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976749184 00000100:00100000:0.0:1746066785.556162:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14120 00000100:00100000:0.0:1746066785.556169:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882976749184:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066785.556178:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066785.556187:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009917be00/0xfb36a14ee608a352 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dae2 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066785.556212:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976776320:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066785.556257:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066785.556970:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.556995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.557047:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976776192:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066785.557048:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099712680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976775936:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066785.557058:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066785.557060:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066785.557075:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882976748288:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3227us (3365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.557077:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882976747904:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2880us (3601us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066785.557082:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7200 00000100:00100000:1.0:1746066785.557092:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7204 00000100:00100000:0.0:1746066785.557142:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.557342:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14122 00000100:00100000:0.0:1746066785.557348:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:1966:x1830882976749440:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066785.557355:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066785.557364:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009917ba00/0xfb36a14ee608a360 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97daf0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066785.557385:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976776576:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066785.557406:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066785.557734:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976749696 00000100:00100000:0.0:1746066785.557738:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976749696 00002000:00100000:0.0:1746066785.557762:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2846720->2850815) req@ffff880135e5ca80 x1830882976749696/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:191/0 lens 488/0 e 0 to 0 dl 1746066796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066785.557769:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ca80 with x1830882976749696 ext(2846720->2850815) 00002000:00010000:0.0:1746066785.557773:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5ca80 00000100:00100000:0.0:1746066785.557791:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6354 00000100:00100000:0.0:1746066785.557796:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882976749696:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066785.557913:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882976749696:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 117us (770us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066785.557919:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6354 00002000:00100000:0.0:1746066785.557924:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2846720->2850815) req@ffff880135e5ca80 x1830882976749696/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:191/0 lens 488/4536 e 0 to 0 dl 1746066796 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066785.557931:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ca80 with x1830882976749696 ext(2846720->2850815) 00002000:00010000:0.0:1746066785.557933:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5ca80 00000100:00100000:0.0:1746066785.561168:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00010000:1.0:1746066785.561276:0:8452:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime: 1746066784 -> 1746066785 00002000:00010000:1.0:1746066785.561280:0:8452:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime: 1746066784 -> 1746066785 00002000:00010000:1.0:1746066785.561282:0:8452:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime: 1746066784 -> 1746066785 00000100:00100000:1.0:1746066785.561299:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976776576:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066785.561329:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009917ba00/0xfb36a14ee608a360 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97daf0 expref: 20 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.561341:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009917ba00/0xfb36a14ee608a360 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97daf0 expref: 20 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.561360:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009917ba00, rc 0) 00000100:00100000:1.0:1746066785.561393:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882976749440:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4045us (4396us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066785.561400:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14122 00000100:00100000:0.0:1746066785.573811:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.573922:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976750336 00000100:00100000:1.0:1746066785.573929:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976750336 00000100:00100000:1.0:1746066785.573973:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9879 00000100:00100000:1.0:1746066785.573980:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:31402:x1830882976750336:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066785.573999:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066785.574012:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498000/0xfb36a14ee608a367 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97daf7 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.574096:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d499600/0xfb36a14ee608a36e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574107:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d499600/0xfb36a14ee608a36e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574120:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d499600/0xfb36a14ee608a36e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574131:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498600/0xfb36a14ee608a375 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574136:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498600/0xfb36a14ee608a375 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574141:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498600/0xfb36a14ee608a375 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574230:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed35400/0xfb36a14ee608a37c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574238:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed35400/0xfb36a14ee608a37c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574243:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed35400/0xfb36a14ee608a37c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:1.0:1746066785.574250:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066785.574319:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d499600/0xfb36a14ee608a36e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574325:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d499600/0xfb36a14ee608a36e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574331:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d499600/0xfb36a14ee608a36e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574336:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d499600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066785.574339:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d499600/0xfb36a14ee608a36e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574346:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d499600/0xfb36a14ee608a36e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574356:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066785.574358:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066785.574361:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d499600/0xfb36a14ee608a36e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574366:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d499600/0xfb36a14ee608a36e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574392:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498600/0xfb36a14ee608a375 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574397:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498600/0xfb36a14ee608a375 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574401:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498600/0xfb36a14ee608a375 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574405:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d498600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066785.574407:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498600/0xfb36a14ee608a375 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574411:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498600/0xfb36a14ee608a375 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574416:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec74500) 00010000:00010000:1.0:1746066785.574418:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066785.574420:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498600/0xfb36a14ee608a375 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574424:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498600/0xfb36a14ee608a375 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.574455:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498000/0xfb36a14ee608a367 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97daf7 expref: 264 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.574464:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed35400/0xfb36a14ee608a37c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97daf7 expref: 263 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.574471:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066785.574472:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066785.574474:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed35400, rc 0) 00000100:00100000:1.0:1746066785.574510:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:31402:x1830882976750336:12345-192.168.202.57@tcp:101:cat.0 Request processed in 530us (698us total) trans 8589943905 rc 0/0 00000100:00100000:1.0:1746066785.574516:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9879 00000100:00100000:1.0:1746066785.576594:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976750720 00000100:00100000:1.0:1746066785.576598:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976750720 00002000:00100000:1.0:1746066785.576617:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (4030464->4034559) req@ffff88009bae9500 x1830882976750720/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:191/0 lens 488/0 e 0 to 0 dl 1746066796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066785.576623:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae9500 with x1830882976750720 ext(4030464->4034559) 00002000:00010000:1.0:1746066785.576626:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae9500 00000100:00100000:1.0:1746066785.576639:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6356 00000100:00100000:1.0:1746066785.576645:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882976750464:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066785.576800:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882976750464:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 155us (3000us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066785.576806:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6356 00002000:00100000:1.0:1746066785.576811:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3035136->3039231) req@ffff88009baea300 x1830882976750464/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:191/0 lens 488/4536 e 0 to 0 dl 1746066796 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066785.576822:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baea300 with x1830882976750464 ext(3035136->3039231) 00002000:00010000:1.0:1746066785.576825:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baea300 00000100:00100000:1.0:1746066785.576836:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6357 00000100:00100000:1.0:1746066785.576840:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882976750720:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066785.577892:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882976750720:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 1048us (4041us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066785.577899:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6357 00002000:00100000:1.0:1746066785.577904:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (4030464->4034559) req@ffff88009bae9500 x1830882976750720/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:191/0 lens 488/4536 e 0 to 0 dl 1746066796 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066785.577911:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae9500 with x1830882976750720 ext(4030464->4034559) 00002000:00010000:1.0:1746066785.577914:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae9500 00000100:00100000:0.0:1746066785.580525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.584316:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.591018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.591054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.591133:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.591195:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976751232 00000100:00100000:1.0:1746066785.591244:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976751232 00000100:00100000:0.0:1746066785.591304:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 691 00000100:00100000:0.0:1746066785.591314:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:1963:x1830882976751232:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066785.591322:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066785.591340:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed35400/0xfb36a14ee608a37c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97daf7 expref: 263 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066785.591362:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066785.591366:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066785.591386:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:1963:x1830882976751232:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 77us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066785.591392:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 691 00000100:00100000:0.0:1746066785.591654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.598353:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.603799:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.614958:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.625622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.632292:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.634736:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.640635:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.641179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.648955:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.659227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.663163:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.664802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.670294:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.677915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.678718:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.678787:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.678861:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976754304 00000100:00100000:1.0:1746066785.678868:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976754304 00000100:00100000:1.0:1746066785.678896:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976754176 00000100:00100000:1.0:1746066785.678898:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976754176 00000100:00100000:1.0:1746066785.678910:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14130 00000100:00100000:1.0:1746066785.678916:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882976754304:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066785.678929:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066785.678944:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d498000/0xfb36a14ee608a3bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97db36 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066785.678980:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099710a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976777600:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066785.679038:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066785.685750:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.688604:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.688642:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.688721:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.696449:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.698331:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.699953:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976755456 00000100:00100000:1.0:1746066785.699964:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976755456 00002000:00100000:1.0:1746066785.700003:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135f83480 x1830882976755456/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:191/0 lens 504/0 e 0 to 0 dl 1746066796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066785.700013:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f83480 with x1830882976755456 ext(3145728->4194303) 00002000:00010000:1.0:1746066785.700018:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135f83480 00000100:00100000:1.0:1746066785.700232:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6366 00000100:00100000:1.0:1746066785.700241:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882976755456:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066785.728638:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976755968 00000100:00100000:0.0:1746066785.728647:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976755968 00000100:00100000:0.0:1746066785.729898:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9880 00000100:00100000:0.0:1746066785.729907:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:31407:x1830882976755968:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066785.729925:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066785.729951:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498e00/0xfb36a14ee608a3d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97db44 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066785.730034:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498c00/0xfb36a14ee608a3d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730044:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498c00/0xfb36a14ee608a3d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730054:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498c00/0xfb36a14ee608a3d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730064:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498000/0xfb36a14ee608a3de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730069:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498000/0xfb36a14ee608a3de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730074:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498000/0xfb36a14ee608a3de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730160:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f319600/0xfb36a14ee608a3e5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730168:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f319600/0xfb36a14ee608a3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730173:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f319600/0xfb36a14ee608a3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:0.0:1746066785.730181:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066785.730245:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498c00/0xfb36a14ee608a3d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730251:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498c00/0xfb36a14ee608a3d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730255:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498c00/0xfb36a14ee608a3d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730260:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d498c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066785.730263:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498c00/0xfb36a14ee608a3d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730269:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498c00/0xfb36a14ee608a3d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730277:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066785.730279:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066785.730283:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498c00/0xfb36a14ee608a3d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730287:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498c00/0xfb36a14ee608a3d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730321:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498000/0xfb36a14ee608a3de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730325:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498000/0xfb36a14ee608a3de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730329:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498000/0xfb36a14ee608a3de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730333:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d498000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066785.730335:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498000/0xfb36a14ee608a3de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730339:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498000/0xfb36a14ee608a3de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730344:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebec300) 00010000:00010000:0.0:1746066785.730346:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066785.730348:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498000/0xfb36a14ee608a3de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730352:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498000/0xfb36a14ee608a3de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066785.730381:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d498e00/0xfb36a14ee608a3d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db44 expref: 266 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066785.730389:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f319600/0xfb36a14ee608a3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db44 expref: 265 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066785.730394:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066785.730396:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066785.730398:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f319600, rc 0) 00000100:00100000:0.0:1746066785.730429:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:31407:x1830882976755968:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 525us (2981us total) trans 8589943907 rc 0/0 00000100:00100000:0.0:1746066785.730434:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9880 00000100:00100000:1.0:1746066785.735111:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882976755456:12345-192.168.202.57@tcp:3:cat.0 Request processed in 34871us (38668us total) trans 0 rc 507904/507904 00000100:00100000:1.0:1746066785.735116:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6366 00002000:00100000:1.0:1746066785.735124:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135f83480 x1830882976755456/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:191/0 lens 504/440 e 0 to 0 dl 1746066796 ref 1 fl Complete:/200/0 rc 507904/507904 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066785.735130:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f83480 with x1830882976755456 ext(3145728->4194303) 00002000:00010000:1.0:1746066785.735132:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135f83480 00000100:00100000:0.0:1746066785.735787:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.736545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.739393:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.739466:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.739647:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976756480 00000100:00100000:1.0:1746066785.739651:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976756480 00002000:00100000:1.0:1746066785.739712:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3493888->4034559) req@ffff88009e634a80 x1830882976756480/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:191/0 lens 488/0 e 0 to 0 dl 1746066796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066785.739720:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e634a80 with x1830882976756480 ext(3493888->4034559) 00010000:00010000:1.0:1746066785.739726:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a3ec400/0xfb36a14ee608a31a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3493888->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dacd expref: 20 pid: 21973 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746066785.739737:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a3ec400/0xfb36a14ee608a31a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dacd expref: 20 pid: 21973 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746066785.739743:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e634a80 00000100:00100000:1.0:1746066785.739763:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2087 00000100:00100000:1.0:1746066785.739768:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882976756480:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066785.740653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.746746:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882976756480:12345-192.168.202.57@tcp:4:cat.0 Request processed in 6968us (7270us total) trans 21474840845 rc 0/0 00000100:00100000:1.0:1746066785.751866:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2087 00002000:00100000:1.0:1746066785.751887:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3493888->4034559) req@ffff88009e634a80 x1830882976756480/t21474840845(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:191/0 lens 488/448 e 0 to 0 dl 1746066796 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066785.751896:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e634a80 with x1830882976756480 ext(3493888->4034559) 00010000:00010000:1.0:1746066785.751906:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a3ec400/0xfb36a14ee608a31a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dacd expref: 22 pid: 21973 timeout: 846 lvb_type: 0 00010000:00010000:1.0:1746066785.751920:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a3ec400/0xfb36a14ee608a31a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3493888->4034559) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dacd expref: 22 pid: 21973 timeout: 846 lvb_type: 0 00002000:00010000:1.0:1746066785.751926:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e634a80 00000100:00100000:0.0:1746066785.753507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.756048:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976756992 00000100:00100000:1.0:1746066785.756053:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976756992 00002000:00100000:1.0:1746066785.756081:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009baeaa00 x1830882976756992/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:191/0 lens 488/0 e 0 to 0 dl 1746066796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066785.756090:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baeaa00 with x1830882976756992 ext(4194304->5091327) 00002000:00010000:1.0:1746066785.756094:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baeaa00 00000100:00100000:1.0:1746066785.757067:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6368 00000100:00100000:1.0:1746066785.757077:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882976756992:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066785.758043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.762227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.762261:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.762291:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.776149:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882976756992:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19065us (20180us total) trans 0 rc 897024/897024 00000100:00100000:1.0:1746066785.776160:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6368 00002000:00100000:1.0:1746066785.776170:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009baeaa00 x1830882976756992/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:191/0 lens 488/440 e 0 to 0 dl 1746066796 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066785.776179:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baeaa00 with x1830882976756992 ext(4194304->5091327) 00002000:00010000:1.0:1746066785.776185:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009baeaa00 00000100:00100000:0.0:1746066785.784578:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.795782:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.795827:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.798976:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.811960:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.819388:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.821544:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.821875:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976759424 00000100:00100000:1.0:1746066785.821881:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976759424 00000100:00100000:1.0:1746066785.821911:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9881 00000100:00100000:1.0:1746066785.821917:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:31410:x1830882976759424:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066785.821932:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066785.821946:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef73000/0xfb36a14ee608a41d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97db75 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.822023:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef73a00/0xfb36a14ee608a424 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822034:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef73a00/0xfb36a14ee608a424 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822043:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef73a00/0xfb36a14ee608a424 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822054:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72000/0xfb36a14ee608a42b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822058:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72000/0xfb36a14ee608a42b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822063:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72000/0xfb36a14ee608a42b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822145:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72400/0xfb36a14ee608a432 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822152:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72400/0xfb36a14ee608a432 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822157:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72400/0xfb36a14ee608a432 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:1.0:1746066785.822164:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066785.822227:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef73a00/0xfb36a14ee608a424 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822232:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef73a00/0xfb36a14ee608a424 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822237:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef73a00/0xfb36a14ee608a424 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822241:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef73a00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066785.822244:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef73a00/0xfb36a14ee608a424 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822248:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef73a00/0xfb36a14ee608a424 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822257:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066785.822259:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066785.822262:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef73a00/0xfb36a14ee608a424 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822269:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef73a00/0xfb36a14ee608a424 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822281:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72000/0xfb36a14ee608a42b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822286:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72000/0xfb36a14ee608a42b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822289:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72000/0xfb36a14ee608a42b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822293:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef72000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066785.822295:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72000/0xfb36a14ee608a42b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822298:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72000/0xfb36a14ee608a42b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822303:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec74700) 00010000:00010000:1.0:1746066785.822304:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066785.822306:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72000/0xfb36a14ee608a42b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822310:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72000/0xfb36a14ee608a42b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066785.822337:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef73000/0xfb36a14ee608a41d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db75 expref: 24 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.822347:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72400/0xfb36a14ee608a432 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db75 expref: 23 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.822357:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066785.822359:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066785.822360:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef72400, rc 0) 00000100:00100000:1.0:1746066785.822400:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:31410:x1830882976759424:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 483us (860us total) trans 8589943910 rc 0/0 00000100:00100000:1.0:1746066785.822405:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9881 00000100:00100000:0.0:1746066785.828320:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.828736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.841918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.846771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.848355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.861854:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.862089:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976760320 00000100:00100000:1.0:1746066785.862095:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976760320 00010000:00010000:1.0:1746066785.862117:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb6e000/0xfb36a14ee608a3b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db28 expref: 22 pid: 21973 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746066785.862145:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7209 00000100:00100000:1.0:1746066785.862151:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882976760320:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066785.862161:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066785.862173:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cb6e000/0xfb36a14ee608a3b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db28 expref: 22 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.862182:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cb6e000/0xfb36a14ee608a3b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db28 expref: 22 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.862199:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cb6e000/0xfb36a14ee608a3b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db28 expref: 22 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.862223:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066785.862243:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:1965:x1830882976760320:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 93us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.862249:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7209 00000100:00100000:0.0:1746066785.870813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.873380:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.873547:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976760704 00000100:00100000:0.0:1746066785.873552:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976760704 00010000:00010000:0.0:1746066785.873573:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e880a00/0xfb36a14ee608a3c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db3d expref: 32 pid: 21973 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746066785.873772:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7210 00000100:00100000:0.0:1746066785.873779:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099712d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882976760704:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066785.873788:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066785.873804:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e880a00/0xfb36a14ee608a3c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db3d expref: 32 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066785.873813:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e880a00/0xfb36a14ee608a3c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db3d expref: 32 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066785.873830:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e880a00/0xfb36a14ee608a3c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db3d expref: 32 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066785.873845:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066785.873847:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066785.873853:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa28a00/0xfb36a14ee608a447 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2617343) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db83 expref: 20 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066785.873860:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa28a00/0xfb36a14ee608a447 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2617343) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db83 expref: 20 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.873900:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa28a00/0xfb36a14ee608a447 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2617343) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db83 expref: 20 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066785.873911:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099710700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976779392:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066785.873966:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066785.876550:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099710700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976779392:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066785.876561:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066785.876577:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066785.876627:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099712d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882976760704:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2848us (3247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.876638:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7210 00000100:00100000:0.0:1746066785.904765:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.911572:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.914045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.915261:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976761728 00000100:00100000:1.0:1746066785.915268:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976761728 00010000:00010000:1.0:1746066785.915296:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880000/0xfb36a14ee608a2e9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dab8 expref: 24 pid: 20127 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746066785.915332:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7211 00000100:00100000:1.0:1746066785.915339:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882976761728:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066785.915351:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066785.915356:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880000/0xfb36a14ee608a2e9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dab8 expref: 24 pid: 20127 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.915367:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880000/0xfb36a14ee608a2e9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dab8 expref: 24 pid: 20127 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.915389:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880000/0xfb36a14ee608a2e9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dab8 expref: 24 pid: 20127 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.915413:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066785.915417:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28200/0xfb36a14ee608a46a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066785.915425:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28200/0xfb36a14ee608a46a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066785.915430:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28200/0xfb36a14ee608a46a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066785.915454:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066785.915482:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882976761728:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 144us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.915487:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7211 00000100:00100000:0.0:1746066785.919926:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.919961:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.919995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.920655:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.920702:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976762240 00000100:00100000:0.0:1746066785.920705:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976762240 00000100:00100000:0.0:1746066785.920723:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14145 00000100:00100000:0.0:1746066785.920727:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882976762240:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066785.920732:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066785.920738:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f319800/0xfb36a14ee608a486 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dbad expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066785.920758:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094129180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976779776:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066785.920783:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066785.925144:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094129180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976779776:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066785.925178:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f319800/0xfb36a14ee608a486 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbad expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066785.925191:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f319800/0xfb36a14ee608a486 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbad expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066785.925918:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f319800, rc 0) 00000100:00100000:1.0:1746066785.925952:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882976762240:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 5224us (5297us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066785.925956:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14145 00000100:00100000:0.0:1746066785.933555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.940238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.948338:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.953775:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.953979:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976763008 00000100:00100000:1.0:1746066785.953987:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976763008 00000100:00100000:1.0:1746066785.954038:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9885 00000100:00100000:1.0:1746066785.954046:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:31413:x1830882976763008:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066785.954064:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066785.954079:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72800/0xfb36a14ee608a4b7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dbc2 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.954130:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72800/0xfb36a14ee608a4b7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbc2 expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.954141:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72800/0xfb36a14ee608a4b7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbc2 expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.954156:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066785.954159:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066785.954162:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef72800, rc 0) 00000100:00100000:1.0:1746066785.954196:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31413:x1830882976763008:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 151us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.954201:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9885 00000100:00100000:0.0:1746066785.959451:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.959485:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.959508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.959535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.959548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.959570:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.959811:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976763136 00000100:00100000:1.0:1746066785.959819:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976763136 00000100:00100000:1.0:1746066785.959848:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976763264 00000100:00100000:1.0:1746066785.959850:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976763264 00000100:00100000:1.0:1746066785.959868:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976763392 00000100:00100000:1.0:1746066785.959871:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976763392 00000100:00100000:1.0:1746066785.959879:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976763520 00000100:00100000:1.0:1746066785.959881:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976763520 00000100:00100000:1.0:1746066785.959889:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976763648 00000100:00100000:1.0:1746066785.959890:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976763648 00000100:00100000:1.0:1746066785.959895:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976763776 00000100:00100000:1.0:1746066785.959897:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976763776 00000100:00100000:1.0:1746066785.959905:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14146 00000100:00100000:1.0:1746066785.959912:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882976763136:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066785.959945:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ef73200/0xfb36a14ee608a4be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.959964:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935c0200/0xfb36a14ee608a034 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d922 expref: 30 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.959972:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092490800/0xfb36a14ee608a21e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da2c expref: 15 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.959978:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608a07a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d937 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.959984:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.959985:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.959988:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef73200/0xfb36a14ee608a4be lrc: 6/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.960015:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608a07a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d937 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.960025:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608a07a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d937 expref: 20 pid: 8112 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746066785.960035:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099710700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976780032:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.960103:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092490800/0xfb36a14ee608a21e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da2c expref: 15 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.960110:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092490800/0xfb36a14ee608a21e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da2c expref: 15 pid: 21973 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746066785.960122:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099711180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976780160:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.960143:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800935c0200/0xfb36a14ee608a034 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d922 expref: 30 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.960150:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800935c0200/0xfb36a14ee608a034 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d922 expref: 30 pid: 8112 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746066785.960157:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099713800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976780288:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.960171:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066785.960189:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14147 00000100:00100000:1.0:1746066785.960195:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882976763264:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066785.960212:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ef72e00/0xfb36a14ee608a4c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.960221:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608a1f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da1e expref: 20 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.960228:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a2b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da8e expref: 28 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.960234:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608a225 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da33 expref: 15 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.960239:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.960241:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.960243:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef72e00/0xfb36a14ee608a4c5 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.960258:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608a225 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da33 expref: 15 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.960265:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608a225 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da33 expref: 15 pid: 20532 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746066785.960273:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976780416:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.960296:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a2b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da8e expref: 28 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.960303:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608a2b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da8e expref: 28 pid: 21973 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746066785.960310:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099710380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976780544:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.960330:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608a1f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da1e expref: 20 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.960337:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608a1f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da1e expref: 20 pid: 20532 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746066785.960343:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099711f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976780672:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.960357:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066785.960373:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14148 00000100:00100000:1.0:1746066785.960378:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882976763392:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066785.960391:0:21203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608a4cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.960399:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e881600/0xfb36a14ee608a38a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dafe expref: 20 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.960405:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa28e00/0xfb36a14ee608a471 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db98 expref: 15 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.960411:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e400/0xfb36a14ee608a3a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db1a expref: 28 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.960416:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.960417:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.960419:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608a4cc lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.960433:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e400/0xfb36a14ee608a3a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db1a expref: 28 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.960440:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e400/0xfb36a14ee608a3a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db1a expref: 28 pid: 21973 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746066785.960448:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099713b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976780800:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.960470:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa28e00/0xfb36a14ee608a471 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db98 expref: 15 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066785.960477:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa28e00/0xfb36a14ee608a471 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db98 expref: 15 pid: 20532 timeout: 847 lvb_type: 1 00000100:00100000:1.0:1746066785.960484:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099712a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976780928:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.960505:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e881600/0xfb36a14ee608a38a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dafe expref: 20 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.960511:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e881600/0xfb36a14ee608a38a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dafe expref: 20 pid: 21973 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746066785.960518:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099713480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976781056:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.960528:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066785.964975:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099711880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976780416:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.964985:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099710380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976780544:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.964992:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099711f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976780672:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.965021:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ef72e00/0xfb36a14ee608a4c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066785.965042:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099713b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976780800:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.965049:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099712a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976780928:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066785.965054:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099713480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976781056:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066785.965074:0:21203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608a4cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066785.966748:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.966864:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.973964:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976765056 00000100:00100000:0.0:1746066785.973970:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976765056 00010000:00010000:0.0:1746066785.973997:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608a1f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da1e expref: 21 pid: 20532 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746066785.974016:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976765312 00000100:00100000:0.0:1746066785.974017:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976765312 00010000:00010000:0.0:1746066785.974025:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e881600/0xfb36a14ee608a38a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dafe expref: 22 pid: 21973 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746066785.974034:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976764672 00000100:00100000:0.0:1746066785.974036:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976764672 00010000:00010000:0.0:1746066785.974043:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb6ee00/0xfb36a14ee608a3ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db21 expref: 31 pid: 21973 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746066785.974055:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7215 00000100:00100000:0.0:1746066785.974060:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882976765056:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066785.974071:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066785.974088:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608a1f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da1e expref: 22 pid: 20532 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066785.974102:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608a1f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da1e expref: 22 pid: 20532 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066785.974120:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608a1f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da1e expref: 22 pid: 20532 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066785.974134:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066785.974163:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:1965:x1830882976765056:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 103us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066785.974168:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7215 00000100:00100000:0.0:1746066785.974202:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7216 00000100:00100000:0.0:1746066785.974207:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1965:x1830882976765312:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066785.974212:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066785.974220:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e881600/0xfb36a14ee608a38a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dafe expref: 20 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066785.974227:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e881600/0xfb36a14ee608a38a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dafe expref: 20 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066785.974236:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e881600/0xfb36a14ee608a38a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dafe expref: 20 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066785.974242:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066785.974252:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882976765312:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 46us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066785.974260:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7216 00000100:00100000:0.0:1746066785.974267:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7217 00000100:00100000:0.0:1746066785.974271:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1965:x1830882976764672:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066785.974276:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066785.974285:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cb6ee00/0xfb36a14ee608a3ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db21 expref: 31 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066785.974292:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cb6ee00/0xfb36a14ee608a3ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db21 expref: 31 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066785.974302:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cb6ee00/0xfb36a14ee608a3ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db21 expref: 31 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066785.974310:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066785.974318:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1965:x1830882976764672:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 48us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066785.974323:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7217 00000100:00100000:1.0:1746066785.977649:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976765440 00000100:00100000:1.0:1746066785.977651:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976765440 00010000:00010000:1.0:1746066785.977661:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e881400/0xfb36a14ee608a3fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db52 expref: 32 pid: 21973 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746066785.977691:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7218 00000100:00100000:1.0:1746066785.977697:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882976764160:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066785.977708:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066785.977723:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e400/0xfb36a14ee608a3a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db1a expref: 32 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.977731:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e400/0xfb36a14ee608a3a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db1a expref: 32 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.977747:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e400/0xfb36a14ee608a3a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db1a expref: 32 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.977761:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.977763:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.977766:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608a4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.977773:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608a4cc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.977793:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066785.977823:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882976764160:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 126us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.977829:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7218 00000100:00100000:1.0:1746066785.977841:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7219 00000100:00100000:1.0:1746066785.977845:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1964:x1830882976764416:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066785.977852:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066785.977860:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608a225 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da33 expref: 15 pid: 20532 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746066785.977867:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608a225 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da33 expref: 15 pid: 20532 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746066785.977876:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608a225 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97da33 expref: 15 pid: 20532 timeout: 847 lvb_type: 1 00010000:00010000:1.0:1746066785.977884:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066785.977896:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882976764416:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 50us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.977901:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7219 00000100:00100000:1.0:1746066785.977908:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7220 00000100:00100000:1.0:1746066785.977912:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882976764800:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066785.977918:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066785.977928:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608a07a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d937 expref: 21 pid: 8112 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.977936:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608a07a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d937 expref: 21 pid: 8112 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.977947:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608a07a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d937 expref: 21 pid: 8112 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.977955:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066785.977966:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882976764800:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 53us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.977970:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7220 00000100:00100000:1.0:1746066785.977978:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7221 00000100:00100000:1.0:1746066785.977982:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882976765440:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066785.977986:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066785.977995:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e881400/0xfb36a14ee608a3fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db52 expref: 30 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.978002:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e881400/0xfb36a14ee608a3fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db52 expref: 30 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.978012:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e881400/0xfb36a14ee608a3fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db52 expref: 30 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.978020:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066785.978031:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882976765440:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 50us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.978038:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7221 00010000:00010000:1.0:1746066785.978059:0:21203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608a4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.978066:0:21203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608a4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.978081:0:21203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608a4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.978088:0:21203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608a4cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.978094:0:21203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608a4cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.978100:0:21203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e880e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066785.978103:0:21203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608a4cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.978109:0:21203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608a4cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.978119:0:21203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608a4cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.978124:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608a4cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066785.978163:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882976763392:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 17785us (18655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.978170:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14148 00000100:00100000:1.0:1746066785.979298:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976764928 00000100:00100000:1.0:1746066785.979302:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976764928 00002000:00100000:1.0:1746066785.979323:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2334720->2617343) req@ffff88009baeb800 x1830882976764928/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:191/0 lens 488/0 e 0 to 0 dl 1746066796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066785.979332:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baeb800 with x1830882976764928 ext(2334720->2617343) 00010000:00010000:1.0:1746066785.979337:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa28a00/0xfb36a14ee608a447 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db83 expref: 20 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.979345:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa28a00/0xfb36a14ee608a447 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db83 expref: 20 pid: 21973 timeout: 847 lvb_type: 0 00002000:00010000:1.0:1746066785.979350:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009baeb800 00000100:00100000:1.0:1746066785.979373:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2089 00000100:00100000:1.0:1746066785.979378:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882976764928:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066785.984745:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.985368:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066785.987405:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ef72e00/0xfb36a14ee608a4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.987412:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef72e00/0xfb36a14ee608a4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.987426:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ef72e00/0xfb36a14ee608a4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.987433:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef72e00/0xfb36a14ee608a4c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.987438:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ef72e00/0xfb36a14ee608a4c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.987443:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef72e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066785.987445:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ef72e00/0xfb36a14ee608a4c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.987450:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ef72e00/0xfb36a14ee608a4c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.987459:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ef72e00/0xfb36a14ee608a4c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.987464:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef72e00/0xfb36a14ee608a4c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066785.987495:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882976763264:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 27300us (28009us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.987500:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14147 00000100:00100000:1.0:1746066785.989733:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882976764928:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 10350us (10935us total) trans 17179873527 rc 0/0 00000100:00100000:1.0:1746066785.989739:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2089 00002000:00100000:1.0:1746066785.989746:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2334720->2617343) req@ffff88009baeb800 x1830882976764928/t17179873527(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:191/0 lens 488/448 e 0 to 0 dl 1746066796 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066785.989754:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baeb800 with x1830882976764928 ext(2334720->2617343) 00010000:00010000:1.0:1746066785.989760:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa28a00/0xfb36a14ee608a447 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db83 expref: 21 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.989770:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa28a00/0xfb36a14ee608a447 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db83 expref: 21 pid: 21973 timeout: 847 lvb_type: 0 00002000:00010000:1.0:1746066785.989776:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009baeb800 00000100:00100000:0.0:1746066785.992799:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066785.995295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066785.996016:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976765952 00000100:00100000:1.0:1746066785.996022:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976765952 00010000:00010000:1.0:1746066785.996045:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa28a00/0xfb36a14ee608a447 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db83 expref: 21 pid: 21973 timeout: 847 lvb_type: 0 00000100:00100000:1.0:1746066785.996076:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7227 00000100:00100000:1.0:1746066785.996083:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1966:x1830882976765952:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066785.996091:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066785.996106:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa28a00/0xfb36a14ee608a447 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2617343) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db83 expref: 21 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.996114:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa28a00/0xfb36a14ee608a447 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2617343) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db83 expref: 21 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.996129:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa28a00/0xfb36a14ee608a447 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2617343) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97db83 expref: 21 pid: 21973 timeout: 847 lvb_type: 0 00010000:00010000:1.0:1746066785.996145:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.996146:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066785.996149:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa28400/0xfb36a14ee608a4da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.996157:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa28400/0xfb36a14ee608a4da lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066785.996182:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066785.996215:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882976765952:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 132us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066785.996221:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7227 00000100:00100000:0.0:1746066786.002632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066786.014007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066786.014041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066786.014069:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066786.014082:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066786.014100:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976766464 00000100:00100000:0.0:1746066786.014106:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976766464 00010000:00010000:0.0:1746066786.014135:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5893600/0xfb36a14ee608a122 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9bc expref: 266 pid: 809 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746066786.014153:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976766720 00000100:00100000:0.0:1746066786.014155:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976766720 00010000:00010000:0.0:1746066786.014162:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b165800/0xfb36a14ee608a0ab lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d953 expref: 267 pid: 16018 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746066786.014181:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976766336 00000100:00100000:0.0:1746066786.014184:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976766336 00010000:00010000:0.0:1746066786.014193:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895c00/0xfb36a14ee608a14c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9ca expref: 23 pid: 809 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746066786.014201:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976766592 00000100:00100000:0.0:1746066786.014202:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976766592 00010000:00010000:0.0:1746066786.014209:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a800/0xfb36a14ee608a0b9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d968 expref: 24 pid: 809 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746066786.014218:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7228 00000100:00100000:0.0:1746066786.014225:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:1963:x1830882976766464:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066786.014235:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066786.014240:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5893600/0xfb36a14ee608a122 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9bc expref: 267 pid: 809 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066786.014248:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5893600/0xfb36a14ee608a122 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9bc expref: 267 pid: 809 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066786.014274:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5893600/0xfb36a14ee608a122 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9bc expref: 267 pid: 809 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066786.014315:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066786.014320:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092e00/0xfb36a14ee608a4e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066786.014327:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066786.014357:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:1963:x1830882976766464:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 132us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066786.014363:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7228 00000100:00100000:0.0:1746066786.014424:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7230 00000100:00100000:0.0:1746066786.014431:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882976766336:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066786.014437:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066786.014440:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895c00/0xfb36a14ee608a14c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9ca expref: 24 pid: 809 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066786.014447:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895c00/0xfb36a14ee608a14c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9ca expref: 24 pid: 809 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066786.014456:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5895c00/0xfb36a14ee608a14c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d9ca expref: 24 pid: 809 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066786.014462:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066786.014465:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092e00/0xfb36a14ee608a4e8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066786.014469:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066786.014479:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882976766336:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 49us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066786.014486:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7230 00000100:00100000:0.0:1746066786.014558:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066786.014572:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976766848 00000100:00100000:0.0:1746066786.014575:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976766848 00010000:00010000:0.0:1746066786.014584:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1000/0xfb36a14ee608a09d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97d94c expref: 22 pid: 20127 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746066786.015105:0:20127:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092e00/0xfb36a14ee608a4e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066786.015111:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092e00/0xfb36a14ee608a4e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000040:00080000:0.0:1746066786.015708:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3052, 88 off257824 00000004:00080000:0.0:1746066786.015715:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747193038926ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066786.015748:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3073, 88 off259584 00000004:00080000:0.0:1746066786.016356:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747193679616ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066786.016389:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3074, 88 off259672 00000004:00080000:0.0:1746066786.016392:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747193716022ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066786.016401:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3053, 88 off257912 00000004:00080000:0.0:1746066786.016403:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747193727196ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066786.016424:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3054, 88 off258000 00000004:00080000:0.0:1746066786.016427:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747193750624ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066786.016437:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3075, 88 off259760 00000004:00080000:0.0:1746066786.016440:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747193763682ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066786.016456:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3076, 88 off259848 00000004:00080000:0.0:1746066786.016458:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747193782367ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066786.016464:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3077, 88 off259936 00000004:00080000:0.0:1746066786.016467:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747193791204ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066786.016476:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3055, 88 off258088 00000004:00080000:0.0:1746066786.016478:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747193802054ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066786.016484:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3078, 88 off260024 00000004:00080000:0.0:1746066786.016486:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747193810212ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066786.016493:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3056, 88 off258176 00000004:00080000:0.0:1746066786.016495:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747193819452ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066786.016501:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3079, 88 off260112 00000004:00080000:0.0:1746066786.016503:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747193827547ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066786.016509:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3057, 88 off258264 00000004:00080000:0.0:1746066786.016511:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747193835549ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066786.016518:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3058, 88 off258352 00000004:00080000:0.0:1746066786.016520:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747193843804ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066786.016525:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3059, 88 off258440 00000004:00080000:0.0:1746066786.016527:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747193850852ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066786.016532:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3060, 88 off258528 00000004:00080000:0.0:1746066786.016535:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 747193858900ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066786.016540:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3080, 88 off260200 00000004:00080000:0.0:1746066786.016542:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747193866509ns, next at 739495247010ns, rc = 0 00010000:00010000:1.0:1746066786.046072:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092e00/0xfb36a14ee608a4e8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066786.046079:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092e00/0xfb36a14ee608a4e8 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066786.046086:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092e00/0xfb36a14ee608a4e8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066786.046090:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b092e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066786.046094:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092e00/0xfb36a14ee608a4e8 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066786.046099:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092e00/0xfb36a14ee608a4e8 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066786.046111:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066786.046113:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066786.046117:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092e00/0xfb36a14ee608a4e8 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066786.046121:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092e00/0xfb36a14ee608a4e8 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00000100:00100000:1.0:1746066786.046138:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14153 00000100:00100000:1.0:1746066786.046143:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800992a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3294:x1830882976782592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066786.046236:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800992a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3294:x1830882976782592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (314us total) trans 17179873528 rc 0/0 00000100:00100000:1.0:1746066786.046241:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14153 00000100:00100000:1.0:1746066786.046832:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066786.046851:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976783616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066786.046865:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066786.046871:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976784128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066786.046886:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066786.046907:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe1500/2, rc 0, transno 17179873528 00000100:00100000:1.0:1746066786.046914:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976782592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066786.046936:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976783104 00000100:00100000:1.0:1746066786.046938:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976783104 00000100:00100000:1.0:1746066786.047752:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14168 00000100:00100000:1.0:1746066786.047758:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3294:x1830882976783104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066786.047830:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3294:x1830882976783104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (997us total) trans 17179873536 rc 0/0 00000100:00100000:1.0:1746066786.047835:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14168 00000004:00080000:1.0:1746066786.047853:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe3b80/2, rc 0, transno 17179873536 00000100:00100000:1.0:1746066786.047855:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976783104:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066786.047863:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bae8e00/2, rc 0, transno 21474840851 00000100:00100000:1.0:1746066786.047866:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976783616:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066786.047871:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe2d80/2, rc 0, transno 17179873531 00000100:00100000:1.0:1746066786.047874:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976784128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066786.048358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066786.051809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066786.054832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066786.054860:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066786.054873:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066786.054884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066786.054896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066786.054954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066786.055009:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976767744 00000100:00100000:1.0:1746066786.055012:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976767744 00000100:00100000:1.0:1746066786.055024:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14170 00000100:00100000:1.0:1746066786.055028:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882976767616:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066786.055035:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066786.055044:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba4200/0xfb36a14ee608a50b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dbec expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066786.055056:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 2097152, mtime: 0x6812dd61, atime: 0x6812dd5f, ctime: 0x6812dd61, blocks: 0x81d 00010000:00010000:1.0:1746066786.055062:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066786.055063:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066786.055067:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba4200/0xfb36a14ee608a50b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbec expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066786.055074:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba4200/0xfb36a14ee608a50b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbec expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066786.055080:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ba4200, rc 0) 00000100:00100000:1.0:1746066786.055092:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882976767616:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 63us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066786.055100:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14170 00000100:00100000:1.0:1746066786.055107:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14172 00000100:00100000:1.0:1746066786.055110:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882976767232:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066786.055115:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066786.055120:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013510a400/0xfb36a14ee608a519 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dbd7 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066786.055128:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd5f, atime: 0x6812dd5f, ctime: 0x6812dd60, blocks: 0x7e1 00010000:00010000:1.0:1746066786.055133:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066786.055134:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066786.055137:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013510a400/0xfb36a14ee608a519 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbd7 expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066786.055144:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013510a400/0xfb36a14ee608a519 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbd7 expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066786.055150:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013510a400, rc 0) 00000100:00100000:1.0:1746066786.055159:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882976767232:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 48us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066786.055163:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14172 00000100:00100000:1.0:1746066786.055215:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14173 00000100:00100000:1.0:1746066786.055220:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882976767488:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066786.055225:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066786.055232:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608a527 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dbe5 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066786.055244:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd61, atime: 0x6812dd61, ctime: 0x6812dd61, blocks: 0x821 00010000:00010000:1.0:1746066786.055249:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066786.055250:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066786.055253:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608a527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbe5 expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066786.055260:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608a527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbe5 expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066786.055266:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e83a00, rc 0) 00000100:00100000:1.0:1746066786.055278:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882976767488:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 59us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066786.055289:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14173 00010000:00010000:1.0:1746066786.203794:0:9850:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066787.076818:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.082460:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.082502:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.082533:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.082748:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.082921:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.091400:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.092067:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.092097:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976769280 00000100:00100000:0.0:1746066787.092105:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976769280 00000100:00100000:0.0:1746066787.099231:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976769536 00000100:00100000:0.0:1746066787.099241:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976769536 00000100:00100000:1.0:1746066787.100349:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976769408 00000100:00100000:1.0:1746066787.100356:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976769408 00000100:00100000:1.0:1746066787.100399:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6381 00000100:00100000:1.0:1746066787.100407:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:f09a0c46-01bd-4197-bc90-17b6ceef920b+18:1965:x1830882976769280:12345-192.168.202.57@tcp:3:mirror_io.0 00010000:00010000:1.0:1746066787.100439:0:1992:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608a551 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.100453:0:1992:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.100454:0:1992:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.100458:0:1992:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608a551 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.100469:0:1992:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608a551 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066787.101551:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6382 00000100:00100000:1.0:1746066787.101559:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+19:1965:x1830882976769536:12345-192.168.202.57@tcp:3:mirror_io.0 00010000:00010000:1.0:1746066787.101579:0:8455:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e881800/0xfb36a14ee608a558 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.101588:0:8455:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.101589:0:8455:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.101592:0:8455:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881800/0xfb36a14ee608a558 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.101601:0:8455:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e881800/0xfb36a14ee608a558 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066787.102717:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6383 00000100:00100000:1.0:1746066787.102724:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+20:1965:x1830882976769408:12345-192.168.202.57@tcp:3:mirror_io.0 00010000:00010000:1.0:1746066787.102742:0:21550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e880c00/0xfb36a14ee608a55f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.102749:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.102751:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.102754:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e880c00/0xfb36a14ee608a55f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.102761:0:21550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e880c00/0xfb36a14ee608a55f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.133556:0:1993:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fa28e00/0xfb36a14ee608a543 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.133571:0:1993:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa28e00/0xfb36a14ee608a543 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.133578:0:1993:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fa28e00/0xfb36a14ee608a543 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.135581:0:1993:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa28e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066787.135586:0:1993:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa28e00/0xfb36a14ee608a543 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.135595:0:1993:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa28e00/0xfb36a14ee608a543 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.135613:0:1993:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fa28e00/0xfb36a14ee608a543 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.135619:0:1993:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa28e00/0xfb36a14ee608a543 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066787.135744:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1965:x1830882976768896:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 49294us (52991us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066787.135754:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6380 00010000:00010000:0.0:1746066787.141023:0:31365:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ba5a00/0xfb36a14ee608a54a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.141038:0:31365:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ba5a00/0xfb36a14ee608a54a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.141045:0:31365:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4ba5a00/0xfb36a14ee608a54a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.141051:0:31365:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ba5a00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066787.141054:0:31365:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4ba5a00/0xfb36a14ee608a54a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.141060:0:31365:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4ba5a00/0xfb36a14ee608a54a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.141076:0:31365:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4ba5a00/0xfb36a14ee608a54a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.141082:0:31365:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ba5a00/0xfb36a14ee608a54a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066787.141159:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1965:x1830882976768384:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 56795us (58703us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066787.141171:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6377 00010000:00010000:1.0:1746066787.145904:0:1992:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608a551 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.145919:0:1992:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608a551 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.145927:0:1992:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608a551 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.145932:0:1992:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e881e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066787.145936:0:1992:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608a551 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.145942:0:1992:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608a551 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.145958:0:1992:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608a551 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.145963:0:1992:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608a551 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066787.146040:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:f09a0c46-01bd-4197-bc90-17b6ceef920b+18:1965:x1830882976769280:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 45629us (63114us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066787.146049:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6381 00010000:00010000:1.0:1746066787.151837:0:8455:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e881800/0xfb36a14ee608a558 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.151850:0:8455:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881800/0xfb36a14ee608a558 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.151862:0:8455:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e881800/0xfb36a14ee608a558 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.151867:0:8455:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e881800 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066787.151871:0:8455:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e881800/0xfb36a14ee608a558 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.151877:0:8455:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e881800/0xfb36a14ee608a558 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.151893:0:8455:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e881800/0xfb36a14ee608a558 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.151898:0:8455:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e881800/0xfb36a14ee608a558 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066787.151978:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1965:x1830882976769536:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 50416us (60579us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066787.151986:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6382 00010000:00010000:1.0:1746066787.154615:0:21550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e880c00/0xfb36a14ee608a55f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.154629:0:21550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e880c00/0xfb36a14ee608a55f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.154637:0:21550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e880c00/0xfb36a14ee608a55f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.154644:0:21550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e880c00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066787.154648:0:21550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e880c00/0xfb36a14ee608a55f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.154664:0:21550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e880c00/0xfb36a14ee608a55f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.154716:0:21550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e880c00/0xfb36a14ee608a55f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.154722:0:21550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e880c00/0xfb36a14ee608a55f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066787.154791:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1965:x1830882976769408:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 52064us (62720us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066787.154801:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6383 00000100:00100000:0.0:1746066787.160664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066787.161173:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066787.162922:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.165302:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.180576:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066787.182335:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746066787.182496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.183016:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976770816 00000100:00100000:0.0:1746066787.183021:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976770816 00000100:00100000:0.0:1746066787.183081:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9890 00000100:00100000:0.0:1746066787.183089:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+250:31425:x1830882976770816:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066787.183105:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066787.183115:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881800/0xfb36a14ee608a589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dc08 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.183177:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881200/0xfb36a14ee608a590 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183185:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881200/0xfb36a14ee608a590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183193:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881200/0xfb36a14ee608a590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183201:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a597 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183211:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183216:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000100:00080000:1.0:1746066787.183270:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746066787.183397:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880a00/0xfb36a14ee608a59e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183404:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880a00/0xfb36a14ee608a59e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183410:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880a00/0xfb36a14ee608a59e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:0.0:1746066787.183416:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066787.183471:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881200/0xfb36a14ee608a590 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183476:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881200/0xfb36a14ee608a590 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183480:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881200/0xfb36a14ee608a590 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183485:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e881200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066787.183487:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881200/0xfb36a14ee608a590 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183492:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881200/0xfb36a14ee608a590 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183500:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066787.183503:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066787.183505:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881200/0xfb36a14ee608a590 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183510:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881200/0xfb36a14ee608a590 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183537:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a597 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183541:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a597 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183546:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183550:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e881e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066787.183553:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a597 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183557:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a597 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183563:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d3b8500) 00010000:00010000:0.0:1746066787.183565:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066787.183567:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a597 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183571:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a597 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.183598:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881800/0xfb36a14ee608a589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc08 expref: 253 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.183607:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880a00/0xfb36a14ee608a59e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc08 expref: 252 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.183611:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066787.183614:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066787.183616:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e880a00, rc 0) 00000100:00100000:0.0:1746066787.183664:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31425:x1830882976770816:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 576us (1170us total) trans 8589943920 rc 0/0 00000100:00100000:0.0:1746066787.183670:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9890 00000100:00100000:1.0:1746066787.186596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.186639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.186911:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.186933:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976771328 00000100:00100000:0.0:1746066787.186939:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976771328 00000100:00100000:1.0:1746066787.187016:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.187641:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9891 00000100:00100000:0.0:1746066787.187661:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+8:31421:x1830882976771328:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066787.187697:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066787.187711:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881c00/0xfb36a14ee608a5ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dc1d expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.187875:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608a5b3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.187887:0:20127:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a4fd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbd0 expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.187893:0:20127:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b093400/0xfb36a14ee608a57b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc01 expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066787.187904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066787.187904:0:20127:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880a00/0xfb36a14ee608a59e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc08 expref: 251 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.187910:0:20127:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608a5b3 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00000100:00100000:1.0:1746066787.187933:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066787.187934:0:20127:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880a00/0xfb36a14ee608a59e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc08 expref: 251 pid: 20127 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066787.187946:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066787.187947:0:20127:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880a00/0xfb36a14ee608a59e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc08 expref: 251 pid: 20127 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746066787.187958:0:20127:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c22e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976784768:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066787.188016:0:20127:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b093400/0xfb36a14ee608a57b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc01 expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.188023:0:20127:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b093400/0xfb36a14ee608a57b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc01 expref: 9 pid: 14550 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746066787.188030:0:20127:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c22ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976784896:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066787.188064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066787.188076:0:20127:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a4fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbd0 expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.188083:0:20127:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a4fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbd0 expref: 9 pid: 14550 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746066787.188090:0:20127:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c22df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976785024:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066787.188105:0:20127:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066787.188133:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976772096 00000100:00100000:1.0:1746066787.188137:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976772096 00000100:00100000:1.0:1746066787.188167:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9892 00000100:00100000:1.0:1746066787.188173:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31427:x1830882976772096:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066787.188181:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066787.188187:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1600/0xfb36a14ee608a5ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dc40 expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.188217:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1400/0xfb36a14ee608a5c1 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066787.188224:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1400/0xfb36a14ee608a5c1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066787.188233:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1400/0xfb36a14ee608a5c1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:1.0:1746066787.188242:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066787.188324:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1600/0xfb36a14ee608a5ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc40 expref: 255 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.188337:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1400/0xfb36a14ee608a5c1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc40 expref: 254 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.188343:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066787.188345:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746066787.188347:0:16018:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608a5b3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066787.188353:0:16018:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608a5b3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066787.188357:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b1400, rc 0) 00000100:00100000:1.0:1746066787.188371:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:31427:x1830882976772096:12345-192.168.202.57@tcp:101:cat.0 Request processed in 199us (438us total) trans 8589943921 rc 0/0 00000100:00100000:1.0:1746066787.188375:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9892 00000100:00100000:1.0:1746066787.188391:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14177 00000100:00100000:1.0:1746066787.188395:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976771456:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066787.188399:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066787.188404:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1800/0xfb36a14ee608a5dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dc24 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.188412:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.188413:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.188417:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1800/0xfb36a14ee608a5dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc24 expref: 23 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.188424:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1800/0xfb36a14ee608a5dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc24 expref: 23 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.188430:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b1800, rc 0) 00000100:00100000:1.0:1746066787.188439:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976771456:12345-192.168.202.57@tcp:101:cat.0 Request processed in 45us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066787.188444:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14177 00000100:00100000:1.0:1746066787.188451:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14179 00000100:00100000:1.0:1746066787.188454:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882976771712:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066787.188458:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066787.188463:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1200/0xfb36a14ee608a5eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dc32 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.188474:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.188476:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.188478:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1200/0xfb36a14ee608a5eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc32 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.188485:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1200/0xfb36a14ee608a5eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc32 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.188491:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b1200, rc 0) 00000100:00100000:1.0:1746066787.188500:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882976771712:12345-192.168.202.57@tcp:101:cat.0 Request processed in 46us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066787.188505:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14179 00000100:00080000:1.0:1746066787.188519:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746066787.188521:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066787.191025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.191057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.191608:0:20127:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c22e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976784768:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066787.191619:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b093400/0xfb36a14ee608a57b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc01 expref: 9 pid: 14550 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746066787.191630:0:20127:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c22ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976784896:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066787.191637:0:20127:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c22df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976785024:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066787.191696:0:20127:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608a5b3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20127 initiator: MDT0 00000100:00100000:0.0:1746066787.192466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.192825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.192861:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.193160:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7235 00000100:00100000:0.0:1746066787.193171:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976772608:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066787.193176:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066787.193179:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a4fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbd0 expref: 10 pid: 14550 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746066787.193212:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a4fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbd0 expref: 10 pid: 14550 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746066787.193225:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a4fd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbd0 expref: 10 pid: 14550 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746066787.193288:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066787.193345:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608a5b3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.193352:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608a5b3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.193380:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608a5b3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.193386:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092e00/0xfb36a14ee608a600 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066787.193390:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092e00/0xfb36a14ee608a600 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066787.193394:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092e00/0xfb36a14ee608a600 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066787.193463:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066787.193477:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976772608:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 309us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.193483:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7235 00010000:00010000:1.0:1746066787.193767:0:20127:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608a5b3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066787.193774:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608a5b3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20127 initiator: MDT0 00000004:00200000:1.0:1746066787.193792:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066787.193899:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881c00/0xfb36a14ee608a5ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc1d expref: 11 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.193912:0:20127:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608a5b3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc1d expref: 10 pid: 20127 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746066787.193923:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608a5b3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc1d expref: 10 pid: 20127 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746066787.193927:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e881000, rc 0) 00000100:00100000:1.0:1746066787.193944:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+10:31421:x1830882976771328:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6296us (7647us total) trans 8589943922 rc 0/0 00000100:00100000:1.0:1746066787.193949:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9891 00000100:00100000:0.0:1746066787.196646:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.203713:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.203742:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.203954:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976773120 00000100:00100000:1.0:1746066787.203963:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976773120 00002000:00100000:1.0:1746066787.204008:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88012c0fe680 x1830882976773120/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.204017:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fe680 with x1830882976773120 ext(0->1048575) 00002000:00010000:1.0:1746066787.204022:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fe680 00000100:00100000:1.0:1746066787.204042:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976773376 00000100:00100000:1.0:1746066787.204283:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976773376 00002000:00100000:1.0:1746066787.204299:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88012c0fe300 x1830882976773376/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.204306:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fe300 with x1830882976773376 ext(1048576->2097151) 00002000:00010000:1.0:1746066787.204309:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fe300 00000100:00100000:0.0:1746066787.204417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.204434:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976773504 00000100:00100000:0.0:1746066787.204437:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976773504 00002000:00100000:0.0:1746066787.204456:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88012c0fce00 x1830882976773504/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066787.204463:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fce00 with x1830882976773504 ext(1048576->2097151) 00002000:00010000:0.0:1746066787.204466:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fce00 00000100:00100000:0.0:1746066787.204477:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6385 00000100:00100000:0.0:1746066787.204482:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882976773376:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066787.204999:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6386 00000100:00100000:1.0:1746066787.205008:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882976773504:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066787.207006:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.207034:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.207230:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.208708:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.209996:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.210012:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976774400 00000100:00100000:0.0:1746066787.210016:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976774400 00000100:00100000:0.0:1746066787.210155:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14184 00000100:00100000:0.0:1746066787.210163:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1966:x1830882976774400:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066787.210172:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066787.210182:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d8b000/0xfb36a14ee608a62a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dc6a expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.210198:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.210199:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.210204:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d8b000/0xfb36a14ee608a62a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc6a expref: 31 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.210213:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d8b000/0xfb36a14ee608a62a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc6a expref: 31 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.210219:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d8b000, rc 0) 00000100:00100000:0.0:1746066787.210235:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882976774400:12345-192.168.202.57@tcp:101:cat.0 Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.210241:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14184 00000100:00080000:1.0:1746066787.212125:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746066787.212132:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066787.212153:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.212594:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.212623:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976774656 00000100:00100000:0.0:1746066787.212627:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976774656 00000100:00100000:0.0:1746066787.212648:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14186 00000100:00100000:0.0:1746066787.212664:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1965:x1830882976774656:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066787.212674:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066787.212707:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092488e00/0xfb36a14ee608a631 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dc78 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.212725:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.212727:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.212734:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092488e00/0xfb36a14ee608a631 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc78 expref: 30 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.212746:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092488e00/0xfb36a14ee608a631 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc78 expref: 30 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.212756:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092488e00, rc 0) 00000100:00100000:0.0:1746066787.212780:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1965:x1830882976774656:12345-192.168.202.57@tcp:101:cat.0 Request processed in 127us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.212786:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14186 00000100:00100000:1.0:1746066787.235553:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976773504:12345-192.168.202.57@tcp:3:cat.0 Request processed in 30542us (31133us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066787.235560:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6386 00002000:00100000:1.0:1746066787.235566:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88012c0fce00 x1830882976773504/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/440 e 0 to 0 dl 1746066798 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.235573:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fce00 with x1830882976773504 ext(1048576->2097151) 00002000:00010000:1.0:1746066787.235577:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fce00 00000100:00100000:0.0:1746066787.236110:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.236204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.237150:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.237267:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976775168 00000100:00100000:1.0:1746066787.237272:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976775168 00002000:00100000:1.0:1746066787.237299:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88012c0fd880 x1830882976775168/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.237307:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fd880 with x1830882976775168 ext(1048576->2097151) 00002000:00010000:1.0:1746066787.237311:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fd880 00000100:00100000:1.0:1746066787.237385:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6389 00000100:00100000:1.0:1746066787.237391:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882976775168:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066787.239278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.261917:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882976775168:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24517us (25704us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066787.261928:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6389 00002000:00100000:1.0:1746066787.261939:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88012c0fd880 x1830882976775168/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:193/0 lens 488/440 e 0 to 0 dl 1746066798 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.261952:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fd880 with x1830882976775168 ext(1048576->2097151) 00002000:00010000:1.0:1746066787.261958:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fd880 00000100:00100000:0.0:1746066787.272373:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.273996:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882976775680:12345-192.168.202.57@tcp:3:cat.0 Request processed in 34134us (34720us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066787.274003:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6391 00002000:00100000:0.0:1746066787.274010:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88012c0fc000 x1830882976775680/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:193/0 lens 488/440 e 0 to 0 dl 1746066798 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066787.274018:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fc000 with x1830882976775680 ext(1048576->2097151) 00002000:00010000:0.0:1746066787.274022:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fc000 00000100:00100000:0.0:1746066787.277136:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.277808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.277843:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066787.278401:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a646 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066787.278406:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a646 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000040:00080000:0.0:1746066787.279926:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3061, 88 off258616 00000004:00080000:0.0:1746066787.279933:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748457256066ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066787.279969:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3081, 88 off260288 00000004:00080000:0.0:1746066787.279972:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748457296149ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066787.281402:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3082, 88 off260376 00000004:00080000:0.0:1746066787.281408:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748458731733ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066787.281419:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3062, 88 off258704 00000004:00080000:0.0:1746066787.281422:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748458745933ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066787.281888:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3063, 88 off258792 00000004:00080000:0.0:1746066787.281892:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748459216029ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066787.281899:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3083, 88 off260464 00000004:00080000:0.0:1746066787.281902:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748459225766ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066787.282452:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3084, 88 off260552 00000004:00080000:0.0:1746066787.282456:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748459779930ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066787.282463:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3085, 88 off260640 00000004:00080000:0.0:1746066787.282466:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748459789596ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066787.282473:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3064, 88 off258880 00000004:00080000:0.0:1746066787.282475:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748459799121ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066787.282481:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3086, 88 off260728 00000004:00080000:0.0:1746066787.282483:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748459807381ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066787.282489:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3065, 88 off258968 00000004:00080000:0.0:1746066787.282492:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748459816027ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066787.282497:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3087, 88 off260816 00000004:00080000:0.0:1746066787.282499:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748459823591ns, next at 739495247010ns, rc = 0 00000040:00080000:0.0:1746066787.282505:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3066, 88 off259056 00000004:00080000:0.0:1746066787.282508:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748459831659ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066787.282514:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3067, 88 off259144 00000004:00080000:0.0:1746066787.282516:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748459840326ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066787.282524:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3068, 88 off259232 00000004:00080000:0.0:1746066787.282527:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748459850701ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066787.282533:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3069, 88 off259320 00000004:00080000:0.0:1746066787.282535:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 748459859120ns, next at 739496263195ns, rc = 0 00000040:00080000:0.0:1746066787.282541:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3088, 88 off260904 00000004:00080000:0.0:1746066787.282543:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 748459866990ns, next at 739495247010ns, rc = 0 00000100:00100000:0.0:1746066787.283324:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.283342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.283862:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.314360:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.314381:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976777600 00000100:00100000:1.0:1746066787.314389:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976777600 00000100:00100000:1.0:1746066787.314420:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9897 00000100:00100000:1.0:1746066787.314426:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+11:31426:x1830882976777600:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066787.314442:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066787.314456:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1c00/0xfb36a14ee608a654 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dc8d expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.314508:0:20127:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1c00/0xfb36a14ee608a654 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc8d expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.314517:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1c00/0xfb36a14ee608a654 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc8d expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.314527:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066787.314530:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066787.314533:0:20127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b165400/0xfb36a14ee608a64d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc86 expref: 252 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.314538:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b1c00, rc 0) 00000100:00100000:1.0:1746066787.314570:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+12:31426:x1830882976777600:12345-192.168.202.57@tcp:101:cat.0 Request processed in 143us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066787.314575:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9897 00000100:00100000:0.0:1746066787.334279:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976785664 00000100:00100000:0.0:1746066787.334282:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976785664 00000100:00100000:0.0:1746066787.334304:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976786304 00000100:00100000:0.0:1746066787.334306:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976786304 00000100:00100000:0.0:1746066787.334315:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976785792 00000100:00100000:0.0:1746066787.334316:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976785792 00000100:00100000:0.0:1746066787.334326:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1746066787.334330:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830882976785664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066787.334349:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830882976785664:12345-0@lo:400:kworker.0 Request processed in 19us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.334354:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1746066787.334361:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1746066787.334365:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830882976786304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066787.334383:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830882976786304:12345-0@lo:400:kworker.0 Request processed in 18us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.334387:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1746066787.334399:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976786432 00000100:00100000:0.0:1746066787.334400:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976786432 00000100:00100000:0.0:1746066787.334414:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1746066787.334418:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3293:x1830882976786432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746066787.334439:0:8453:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 540082176 pending 25559040 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746066787.334459:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3293:x1830882976786432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.334463:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1746066787.334752:0:14544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976785536 00000100:00100000:1.0:1746066787.334756:0:14544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976785536 00000100:00100000:1.0:1746066787.334775:0:14544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1746066787.334779:0:14544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980aefe6-2860-4e29-9b4a-3d9c65563e6f+18:3295:x1830882976785536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066787.334805:0:14544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980aefe6-2860-4e29-9b4a-3d9c65563e6f+18:3295:x1830882976785536:12345-0@lo:400:kworker.0 Request processed in 26us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066787.334810:0:14544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:1.0:1746066787.334830:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066787.336362:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976785920 00000100:00100000:0.0:1746066787.336366:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976785920 00000100:00100000:0.0:1746066787.336386:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1746066787.336391:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+68:3294:x1830882976785920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746066787.336402:0:8454:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490536960 pending 22151168 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746066787.336434:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+68:3294:x1830882976785920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.336438:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1746066787.336463:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976785920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1746066787.340385:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a646 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc7f expref: 12 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.340398:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066787.340401:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746066787.340404:0:809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b165400/0xfb36a14ee608a64d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc86 expref: 252 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.340413:0:809:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b165400/0xfb36a14ee608a64d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc86 expref: 252 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.340418:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b165400/0xfb36a14ee608a64d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc86 expref: 252 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.340427:0:809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1c00/0xfb36a14ee608a654 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc8d expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.340432:0:809:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1c00/0xfb36a14ee608a654 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc8d expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.340437:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1c00/0xfb36a14ee608a654 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc8d expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.340465:0:809:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1c00/0xfb36a14ee608a654 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc8d expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066787.340476:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976786560:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066787.340549:0:809:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b165400/0xfb36a14ee608a64d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc86 expref: 252 pid: 16018 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066787.340557:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976786688:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066787.340573:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066787.340733:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976786944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066787.340749:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976787200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066787.340762:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066787.340772:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976787712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066787.340783:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066787.340805:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976786816 00000100:00100000:0.0:1746066787.340810:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976786816 00000100:00100000:0.0:1746066787.340835:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976787200 00000100:00100000:0.0:1746066787.340837:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976787200 00000100:00100000:0.0:1746066787.340846:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976787072 00000100:00100000:0.0:1746066787.340847:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976787072 00000100:00100000:0.0:1746066787.340858:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14187 00000100:00100000:0.0:1746066787.340863:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+72:3295:x1830882976786816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066787.340978:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14190 00000100:00100000:0.0:1746066787.340983:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+74:3293:x1830882976787072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066787.341048:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:0.0:1746066787.341050:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066787.341052:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066787.341053:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066787.341055:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5921 -> 5921 00000100:00100000:0.0:1746066787.341074:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+75:3293:x1830882976787072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (273us total) trans 17179873539 rc 0/0 00000100:00100000:0.0:1746066787.341078:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14190 00000100:00100000:0.0:1746066787.341093:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066787.341104:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976787456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066787.341119:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066787.341135:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976786944 00000100:00100000:0.0:1746066787.341137:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976786944 00000100:00100000:0.0:1746066787.341148:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976787456 00000100:00100000:0.0:1746066787.341150:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976787456 00000100:00100000:0.0:1746066787.341157:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14193 00000100:00100000:0.0:1746066787.341161:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800992a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3296:x1830882976786944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066787.341228:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066787.341230:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066787.341233:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066787.341234:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066787.341236:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746066787.341254:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800992a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+78:3296:x1830882976786944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (160us total) trans 17179873541 rc 0/0 00000100:00100000:0.0:1746066787.341259:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14193 00000004:00080000:0.0:1746066787.341276:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5c1180/2, rc 0, transno 17179873541 00000100:00100000:0.0:1746066787.341279:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976786944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066787.341300:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746066787.341305:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976787840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066787.341320:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066787.341333:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976787840 00000100:00100000:0.0:1746066787.341335:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976787840 00000100:00100000:0.0:1746066787.341348:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14195 00000100:00100000:0.0:1746066787.341352:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3296:x1830882976787840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066787.341429:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+78:3296:x1830882976787840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (108us total) trans 17179873544 rc 0/0 00000100:00100000:0.0:1746066787.341434:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14195 00002000:00010000:0.0:1746066787.341460:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066787.341462:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066787.341464:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066783 -> 1746066783 00002000:00010000:0.0:1746066787.341466:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066784 -> 1746066784 00002000:00010000:0.0:1746066787.341467:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2017 -> 2017 00000100:00100000:0.0:1746066787.341483:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3295:x1830882976786816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 621us (736us total) trans 17179873538 rc 0/0 00000100:00100000:0.0:1746066787.341488:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14187 00000100:00100000:0.0:1746066787.341585:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976788608 00000100:00100000:0.0:1746066787.341587:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976788608 00000100:00100000:0.0:1746066787.341595:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976788224 00000100:00100000:0.0:1746066787.341597:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976788224 00000100:00100000:0.0:1746066787.341604:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14196 00000100:00100000:0.0:1746066787.341607:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:3293:x1830882976788608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066787.341630:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14198 00000100:00100000:0.0:1746066787.341634:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+64:3293:x1830882976788224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066787.341719:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066787.341721:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066787.341723:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066787.341724:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066785 -> 1746066785 00002000:00010000:0.0:1746066787.341726:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746066787.341744:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3293:x1830882976788224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (189us total) trans 21474840856 rc 0/0 00000100:00100000:0.0:1746066787.341748:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14198 00000100:00100000:0.0:1746066787.341807:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3293:x1830882976788608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (273us total) trans 21474840858 rc 0/0 00000100:00100000:0.0:1746066787.341811:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14196 00000004:00080000:0.0:1746066787.341825:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5c3800/2, rc 0, transno 17179873542 00000100:00100000:0.0:1746066787.341827:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976787200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066787.341833:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a5c2d80/2, rc 0, transno 17179873537 00000100:00100000:0.0:1746066787.341836:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976787712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066787.343093:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976788352 00000100:00100000:1.0:1746066787.343097:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976788352 00000100:00100000:1.0:1746066787.343938:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976788864 00000100:00100000:1.0:1746066787.343942:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976788864 00000100:00100000:1.0:1746066787.343958:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976787968 00000100:00100000:1.0:1746066787.343959:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976787968 00000100:00100000:1.0:1746066787.343967:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976788480 00000100:00100000:1.0:1746066787.343970:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976788480 00000100:00100000:1.0:1746066787.343980:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14200 00000100:00100000:1.0:1746066787.343986:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3295:x1830882976788352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066787.343989:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14201 00000100:00100000:0.0:1746066787.343999:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3295:x1830882976788864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066787.344077:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14202 00000100:00100000:0.0:1746066787.344083:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3295:x1830882976787968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066787.344092:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+69:3295:x1830882976788352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (1853us total) trans 21474840859 rc 0/0 00000100:00100000:1.0:1746066787.344097:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14200 00000100:00100000:1.0:1746066787.344108:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14203 00000100:00100000:1.0:1746066787.344112:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3295:x1830882976788480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066787.344155:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066787.344157:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066784 -> 1746066784 00002000:00010000:0.0:1746066787.344159:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066784 -> 1746066784 00002000:00010000:0.0:1746066787.344160:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066784 -> 1746066784 00002000:00010000:0.0:1746066787.344162:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746066787.344180:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+70:3295:x1830882976787968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (1251us total) trans 21474840860 rc 0/0 00000100:00100000:0.0:1746066787.344185:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14202 00000100:00100000:0.0:1746066787.344249:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+70:3295:x1830882976788864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 254us (1971us total) trans 21474840862 rc 0/0 00000100:00100000:0.0:1746066787.344254:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14201 00000100:00100000:1.0:1746066787.344278:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+69:3295:x1830882976788480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 165us (1197us total) trans 21474840861 rc 0/0 00000100:00100000:1.0:1746066787.344282:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14203 00000100:00100000:0.0:1746066787.344710:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976786688:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066787.344790:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.344801:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976777728 00000100:00100000:1.0:1746066787.344803:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.344804:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976777728 00000100:00100000:1.0:1746066787.344823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.344824:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976777984 00000100:00100000:0.0:1746066787.344826:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976777984 00000100:00100000:0.0:1746066787.344838:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4103 00000100:00100000:1.0:1746066787.344841:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4104 00000100:00100000:0.0:1746066787.344842:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:31427:x1830882976777728:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:1.0:1746066787.344845:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:31426:x1830882976777984:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:1.0:1746066787.344911:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:31426:x1830882976777984:12345-192.168.202.57@tcp:49:cat.0 Request processed in 65us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.344911:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:31427:x1830882976777728:12345-192.168.202.57@tcp:49:cat.0 Request processed in 69us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.344916:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4103 00000100:00100000:1.0:1746066787.345317:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4104 00000100:00100000:0.0:1746066787.352105:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.361891:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.361918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.361989:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.368617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.368632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.368646:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.368670:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.368723:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.368750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.368772:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976779008 00000100:00100000:0.0:1746066787.368778:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976779008 00010000:00010000:0.0:1746066787.368811:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8646e00/0xfb36a14ee608a5e4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc2b expref: 25 pid: 20532 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.368839:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976779136 00000100:00100000:0.0:1746066787.368842:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976779136 00010000:00010000:0.0:1746066787.368852:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d8b000/0xfb36a14ee608a62a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc6a expref: 34 pid: 21973 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.368860:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976779392 00000100:00100000:0.0:1746066787.368862:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976779392 00010000:00010000:0.0:1746066787.368869:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba4200/0xfb36a14ee608a50b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbec expref: 14 pid: 21203 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.368875:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976779520 00000100:00100000:0.0:1746066787.368877:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976779520 00010000:00010000:0.0:1746066787.368884:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b093000/0xfb36a14ee608a638 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc71 expref: 35 pid: 4614 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.368891:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976779648 00000100:00100000:0.0:1746066787.368893:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976779648 00010000:00010000:0.0:1746066787.368900:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b093200/0xfb36a14ee608a520 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbf3 expref: 15 pid: 9776 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.368916:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7240 00000100:00100000:0.0:1746066787.368923:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882976779008:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066787.368934:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066787.368952:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8646e00/0xfb36a14ee608a5e4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc2b expref: 25 pid: 20532 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.368961:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8646e00/0xfb36a14ee608a5e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc2b expref: 25 pid: 20532 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.368981:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066787.369015:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882976779008:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 93us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.369021:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7240 00000100:00100000:0.0:1746066787.369034:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7241 00000100:00100000:0.0:1746066787.369040:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1965:x1830882976779136:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066787.369045:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066787.369052:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d8b000/0xfb36a14ee608a62a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc6a expref: 35 pid: 21973 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.369060:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d8b000/0xfb36a14ee608a62a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc6a expref: 35 pid: 21973 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.369069:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066787.369079:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1965:x1830882976779136:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 41us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.369084:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7241 00000100:00100000:0.0:1746066787.369113:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7242 00000100:00100000:0.0:1746066787.369119:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882976779392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066787.369124:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066787.369130:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba4200/0xfb36a14ee608a50b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbec expref: 15 pid: 21203 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.369136:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba4200/0xfb36a14ee608a50b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbec expref: 15 pid: 21203 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.369144:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.369146:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.369151:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0e00/0xfb36a14ee608a662 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1212416->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc9b expref: 34 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.369159:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0e00/0xfb36a14ee608a662 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1212416->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc9b expref: 34 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.369182:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0e00/0xfb36a14ee608a662 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1212416->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc9b expref: 34 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066787.369191:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094128a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976789760:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066787.369235:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066787.369250:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7243 00000100:00100000:0.0:1746066787.369257:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882976779520:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066787.369265:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066787.369274:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b093000/0xfb36a14ee608a638 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc71 expref: 34 pid: 4614 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.369281:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b093000/0xfb36a14ee608a638 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc71 expref: 34 pid: 4614 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.369291:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066787.369302:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882976779520:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 47us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.369306:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7243 00000100:00100000:0.0:1746066787.369315:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7244 00000100:00100000:0.0:1746066787.369320:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882976779648:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066787.369325:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066787.369331:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b093200/0xfb36a14ee608a520 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbf3 expref: 15 pid: 9776 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.369337:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b093200/0xfb36a14ee608a520 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbf3 expref: 15 pid: 9776 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.369344:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066787.369354:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882976779648:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 35us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.369359:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7244 00000100:00100000:0.0:1746066787.377229:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6398 00000100:00100000:0.0:1746066787.377238:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882976779904:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066787.378176:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094128a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976789760:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066787.378194:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066787.378214:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882976779392:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 9096us (9543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066787.378222:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7242 00000100:00100000:0.0:1746066787.387274:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.395497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.396015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.396804:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976780672 00000100:00100000:1.0:1746066787.396808:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976780672 00010000:00010000:1.0:1746066787.396821:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1200/0xfb36a14ee608a5eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc32 expref: 24 pid: 8450 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746066787.397378:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7245 00000100:00100000:1.0:1746066787.397384:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882976780672:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066787.397392:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066787.397410:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1200/0xfb36a14ee608a5eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc32 expref: 24 pid: 8450 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746066787.397420:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1200/0xfb36a14ee608a5eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc32 expref: 24 pid: 8450 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746066787.397434:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1200/0xfb36a14ee608a5eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc32 expref: 24 pid: 8450 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746066787.397458:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.397460:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.397464:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ef72400/0xfb36a14ee608a669 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2813952->3145727] (req 2813952->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dca2 expref: 23 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.397471:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef72400/0xfb36a14ee608a669 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2813952->3145727] (req 2813952->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dca2 expref: 23 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.397495:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ef72400/0xfb36a14ee608a669 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2813952->3145727] (req 2813952->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dca2 expref: 23 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066787.397505:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e851180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976789888:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066787.397561:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066787.400465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.400516:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.400596:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e851180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976789888:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066787.400610:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066787.400631:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882976780672:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3248us (5135us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066787.400638:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7245 00000100:00100000:0.0:1746066787.409402:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14208 00000100:00100000:0.0:1746066787.409411:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882976781568:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066787.409418:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066787.409431:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093678e00/0xfb36a14ee608a67e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dcb7 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.409474:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093678e00/0xfb36a14ee608a67e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dcb7 expref: 34 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.409482:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093678e00/0xfb36a14ee608a67e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dcb7 expref: 34 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.409501:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093678e00, rc 0) 00000100:00100000:0.0:1746066787.409519:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882976781568:12345-192.168.202.57@tcp:101:cat.0 Request processed in 111us (406us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066787.409524:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14208 00000100:00100000:1.0:1746066787.409621:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.409785:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976781696 00000100:00100000:0.0:1746066787.409789:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976781696 00000100:00100000:0.0:1746066787.409818:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14209 00000100:00100000:0.0:1746066787.409823:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+22:31421:x1830882976781696:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066787.409830:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066787.409839:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608a685 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dcbe expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.409853:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b092800/0xfb36a14ee608a512 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbfa expref: 13 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.409860:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092488e00/0xfb36a14ee608a631 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc78 expref: 29 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.409865:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8646600/0xfb36a14ee608a5f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc39 expref: 23 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.409870:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.409871:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.409874:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608a685 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->2392063] (req 2097152->2392063) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dcbe expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.409895:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8646600/0xfb36a14ee608a5f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc39 expref: 23 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.409905:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8646600/0xfb36a14ee608a5f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc39 expref: 23 pid: 20532 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.409914:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094128e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976790016:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066787.409983:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092488e00/0xfb36a14ee608a631 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc78 expref: 29 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.409991:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092488e00/0xfb36a14ee608a631 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc78 expref: 29 pid: 21973 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.409999:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094128a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976790144:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066787.410024:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b092800/0xfb36a14ee608a512 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbfa expref: 13 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.410031:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b092800/0xfb36a14ee608a512 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbfa expref: 13 pid: 9776 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.410038:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976790272:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066787.410055:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066787.413333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.415077:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.415103:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.415133:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.416451:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.417494:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.421584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.422458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.423106:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976782976 00000100:00100000:1.0:1746066787.423110:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976782976 00000100:00100000:1.0:1746066787.423689:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4105 00000100:00100000:1.0:1746066787.423696:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:31425:x1830882976782976:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:1.0:1746066787.423910:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31425:x1830882976782976:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 215us (2327us total) trans 8589943924 rc 0/0 00000100:00100000:1.0:1746066787.423919:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4105 00000100:00100000:0.0:1746066787.424969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.425027:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976783360 00000100:00100000:1.0:1746066787.425032:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976783360 00002000:00100000:1.0:1746066787.425053:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2387968->2392063) req@ffff88008c395c00 x1830882976783360/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.425061:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395c00 with x1830882976783360 ext(2387968->2392063) 00002000:00010000:1.0:1746066787.425065:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c395c00 00000100:00100000:1.0:1746066787.425088:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6405 00000100:00100000:1.0:1746066787.425093:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882976783360:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066787.425209:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882976783360:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 115us (241us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066787.425215:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6405 00002000:00100000:1.0:1746066787.425220:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2387968->2392063) req@ffff88008c395c00 x1830882976783360/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/4536 e 0 to 0 dl 1746066798 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.425227:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395c00 with x1830882976783360 ext(2387968->2392063) 00002000:00010000:1.0:1746066787.425230:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c395c00 00000100:00100000:0.0:1746066787.430254:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.430762:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976783616 00000100:00100000:1.0:1746066787.430770:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976783616 00002000:00100000:1.0:1746066787.430805:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (2097152->2113535) req@ffff88008c394000 x1830882976783616/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:193/0 lens 16872/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.430815:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394000 with x1830882976783616 ext(2097152->2113535) 00010000:00010000:1.0:1746066787.430823:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a85bf200/0xfb36a14ee608a677 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->2801663] (req 2097152->2113535) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dcb0 expref: 34 pid: 4614 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746066787.431078:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a85bf200/0xfb36a14ee608a677 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->2801663] (req 2097152->2113535) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dcb0 expref: 34 pid: 4614 timeout: 848 lvb_type: 0 00002000:00010000:1.0:1746066787.431084:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c394000 00000100:00100000:1.0:1746066787.431150:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2091 00000100:00100000:1.0:1746066787.431158:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882976783616:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066787.431671:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882976783616:12345-192.168.202.57@tcp:4:cat.0 Request processed in 512us (1422us total) trans 17179873546 rc 0/0 00000100:00100000:1.0:1746066787.431695:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2091 00002000:00100000:1.0:1746066787.431701:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (2097152->2113535) req@ffff88008c394000 x1830882976783616/t17179873546(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:193/0 lens 16872/448 e 0 to 0 dl 1746066798 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.431708:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394000 with x1830882976783616 ext(2097152->2113535) 00010000:00010000:1.0:1746066787.431714:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a85bf200/0xfb36a14ee608a677 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->2801663] (req 2097152->2113535) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dcb0 expref: 36 pid: 4614 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746066787.431721:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a85bf200/0xfb36a14ee608a677 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->2801663] (req 2097152->2113535) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dcb0 expref: 36 pid: 4614 timeout: 848 lvb_type: 0 00002000:00010000:1.0:1746066787.431727:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c394000 00000100:00100000:0.0:1746066787.432146:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.432201:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976783488 00000100:00100000:1.0:1746066787.432205:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976783488 00002000:00100000:1.0:1746066787.432220:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (2813952->3145727) req@ffff88008c397b80 x1830882976783488/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.432227:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c397b80 with x1830882976783488 ext(2813952->3145727) 00010000:00010000:1.0:1746066787.432232:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ef72400/0xfb36a14ee608a669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2813952->3145727] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dca2 expref: 23 pid: 4614 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746066787.432240:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ef72400/0xfb36a14ee608a669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2813952->3145727] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dca2 expref: 23 pid: 4614 timeout: 848 lvb_type: 0 00002000:00010000:1.0:1746066787.432482:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c397b80 00000100:00100000:1.0:1746066787.432504:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2092 00000100:00100000:1.0:1746066787.432510:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882976783488:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066787.437494:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.441960:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882976783488:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 9445us (9809us total) trans 17179873547 rc 0/0 00000100:00100000:0.0:1746066787.441970:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2092 00002000:00100000:0.0:1746066787.441981:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (2813952->3145727) req@ffff88008c397b80 x1830882976783488/t17179873547(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/448 e 0 to 0 dl 1746066798 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066787.441990:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c397b80 with x1830882976783488 ext(2813952->3145727) 00010000:00010000:0.0:1746066787.441999:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ef72400/0xfb36a14ee608a669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2813952->3145727] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dca2 expref: 25 pid: 4614 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746066787.442010:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ef72400/0xfb36a14ee608a669 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2813952->3145727] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dca2 expref: 25 pid: 4614 timeout: 848 lvb_type: 0 00002000:00010000:0.0:1746066787.442017:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c397b80 00000100:00100000:1.0:1746066787.442227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.442279:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.442437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.451244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.459041:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.459066:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976784768 00000100:00100000:0.0:1746066787.459073:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976784768 00002000:00100000:0.0:1746066787.459108:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88008c395f80 x1830882976784768/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066787.459116:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395f80 with x1830882976784768 ext(4194304->5091327) 00002000:00010000:0.0:1746066787.459120:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c395f80 00000100:00100000:0.0:1746066787.459150:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6406 00000100:00100000:0.0:1746066787.459158:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882976784768:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066787.463619:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.469026:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882976784768:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9862us (9985us total) trans 0 rc 897024/897024 00000100:00100000:1.0:1746066787.469036:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6406 00002000:00100000:1.0:1746066787.469046:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88008c395f80 x1830882976784768/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/440 e 0 to 0 dl 1746066798 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.469054:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395f80 with x1830882976784768 ext(4194304->5091327) 00002000:00010000:1.0:1746066787.469058:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c395f80 00000100:00100000:0.0:1746066787.475471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.475525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.476326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.479746:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.485821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.488777:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.489924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.490154:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.490287:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976786048 00000100:00100000:1.0:1746066787.490291:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976786048 00000100:00100000:1.0:1746066787.490315:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14220 00000100:00100000:1.0:1746066787.490321:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882976786048:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066787.490328:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066787.490336:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b093000/0xfb36a14ee608a6ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dd12 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.490353:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b093000/0xfb36a14ee608a6ee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd12 expref: 24 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.490360:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b093000/0xfb36a14ee608a6ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd12 expref: 24 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.490379:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b093000, rc 0) 00000100:00100000:1.0:1746066787.490397:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882976786048:12345-192.168.202.57@tcp:101:cat.0 Request processed in 77us (475us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066787.490402:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14220 00000100:00100000:0.0:1746066787.491210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.491223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.491240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.496496:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.496569:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976786688 00000100:00100000:1.0:1746066787.496575:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976786688 00000100:00100000:1.0:1746066787.496613:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4107 00000100:00100000:1.0:1746066787.496619:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+9:31426:x1830882976786688:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:1.0:1746066787.496762:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:31426:x1830882976786688:12345-192.168.202.57@tcp:35:cat.0 Request processed in 143us (266us total) trans 8589943926 rc 0/0 00000100:00100000:1.0:1746066787.496767:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4107 00000100:00100000:0.0:1746066787.497601:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.500416:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.500617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.507086:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.507131:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.507862:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.507997:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6409 00000100:00100000:0.0:1746066787.508007:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882976787968:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066787.509593:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.516382:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.530151:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.530176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.530254:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976788352 00000100:00100000:1.0:1746066787.530262:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976788352 00000100:00100000:1.0:1746066787.530294:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976788480 00000100:00100000:1.0:1746066787.530297:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976788480 00000100:00100000:1.0:1746066787.530313:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14224 00000100:00100000:1.0:1746066787.530319:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1966:x1830882976788352:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066787.530334:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066787.530349:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d8ba00/0xfb36a14ee608a72d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dd3c expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066787.530393:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976791936:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066787.530453:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066787.530470:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14225 00000100:00100000:1.0:1746066787.530475:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1966:x1830882976788480:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066787.530482:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066787.530490:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d8a600/0xfb36a14ee608a734 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dd43 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.530500:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.530502:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.530510:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d8a600/0xfb36a14ee608a734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd43 expref: 14 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.530523:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d8a600/0xfb36a14ee608a734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd43 expref: 14 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.530531:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d8a600, rc 0) 00000100:00100000:1.0:1746066787.530549:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1966:x1830882976788480:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 75us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066787.530554:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14225 00000100:00100000:1.0:1746066787.532768:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976791936:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066787.532793:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d8ba00/0xfb36a14ee608a72d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd3c expref: 14 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.532804:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d8ba00/0xfb36a14ee608a72d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd3c expref: 14 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.532830:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d8ba00, rc 0) 00000100:00100000:1.0:1746066787.532862:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1966:x1830882976788352:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2543us (2717us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066787.532868:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14224 00000100:00100000:0.0:1746066787.539496:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.539543:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.549904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.549971:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976789120 00000100:00100000:1.0:1746066787.549977:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976789120 00000100:00100000:1.0:1746066787.550017:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14226 00000100:00100000:1.0:1746066787.550023:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1966:x1830882976789120:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:1.0:1746066787.550054:0:4614:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d3ff000/0xfb36a14ee608a750 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.550068:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013510a400/0xfb36a14ee608a519 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbd7 expref: 13 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.550075:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b093800/0xfb36a14ee608a615 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc55 expref: 35 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.550081:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800934ea000/0xfb36a14ee608a5cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc0f expref: 24 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.550086:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.550087:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.550089:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3ff000/0xfb36a14ee608a750 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.550111:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800934ea000/0xfb36a14ee608a5cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc0f expref: 24 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.550121:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800934ea000/0xfb36a14ee608a5cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc0f expref: 24 pid: 20532 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746066787.550131:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976792064:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066787.550178:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b093800/0xfb36a14ee608a615 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc55 expref: 34 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.550185:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b093800/0xfb36a14ee608a615 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc55 expref: 34 pid: 4614 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746066787.550192:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976792192:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066787.550212:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013510a400/0xfb36a14ee608a519 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbd7 expref: 13 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.550219:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013510a400/0xfb36a14ee608a519 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbd7 expref: 13 pid: 21203 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746066787.550226:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976792320:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066787.550241:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066787.551902:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.551930:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.551956:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.551968:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.552001:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.552017:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976789376 00000100:00100000:0.0:1746066787.552021:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976789376 00000100:00100000:0.0:1746066787.552046:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976789632 00000100:00100000:0.0:1746066787.552048:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976789632 00000100:00100000:0.0:1746066787.552058:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976789248 00000100:00100000:0.0:1746066787.552059:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976789248 00000100:00100000:0.0:1746066787.552068:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976789504 00000100:00100000:0.0:1746066787.552070:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976789504 00000100:00100000:0.0:1746066787.552077:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976789760 00000100:00100000:0.0:1746066787.552079:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976789760 00000100:00100000:0.0:1746066787.552088:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14227 00000100:00100000:0.0:1746066787.552093:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1966:x1830882976789376:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:0.0:1746066787.552118:0:8112:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d36bc00/0xfb36a14ee608a757 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.552131:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608a527 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbe5 expref: 16 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.552139:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e881800/0xfb36a14ee608a623 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc63 expref: 29 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.552146:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1800/0xfb36a14ee608a5dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc24 expref: 23 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.552151:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.552152:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.552155:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d36bc00/0xfb36a14ee608a757 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.552174:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1800/0xfb36a14ee608a5dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc24 expref: 23 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.552183:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1800/0xfb36a14ee608a5dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc24 expref: 23 pid: 8450 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.552192:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976792448:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066787.552243:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e881800/0xfb36a14ee608a623 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc63 expref: 29 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.552251:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e881800/0xfb36a14ee608a623 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc63 expref: 29 pid: 8451 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.552258:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976792576:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066787.552278:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608a527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbe5 expref: 16 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.552285:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608a527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbe5 expref: 16 pid: 21203 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.552292:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976792704:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066787.552306:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066787.552321:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14228 00000100:00100000:0.0:1746066787.552327:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1966:x1830882976789632:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:0.0:1746066787.552342:0:10402:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135d8a000/0xfb36a14ee608a75e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.552355:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ef73400/0xfb36a14ee608a693 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dccc expref: 33 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.552361:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ef73c00/0xfb36a14ee608a6fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd20 expref: 15 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.552368:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8647400/0xfb36a14ee608a6bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dcef expref: 24 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.552374:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a85be200/0xfb36a14ee608a670 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dca9 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.552380:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066787.552381:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066787.552383:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d8a000/0xfb36a14ee608a75e lrc: 7/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.552396:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a85be200/0xfb36a14ee608a670 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dca9 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.552405:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a85be200/0xfb36a14ee608a670 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dca9 expref: 24 pid: 4614 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746066787.552413:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976792832:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066787.552435:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8647400/0xfb36a14ee608a6bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dcef expref: 24 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.552442:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8647400/0xfb36a14ee608a6bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dcef expref: 24 pid: 4614 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.552449:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976792960:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066787.552465:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ef73c00/0xfb36a14ee608a6fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd20 expref: 15 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.552472:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ef73c00/0xfb36a14ee608a6fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd20 expref: 15 pid: 20532 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.552479:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976793088:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066787.552495:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ef73400/0xfb36a14ee608a693 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dccc expref: 33 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.552502:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ef73400/0xfb36a14ee608a693 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dccc expref: 33 pid: 20532 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746066787.552510:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976793216:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066787.552521:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066787.552534:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14229 00000100:00100000:0.0:1746066787.552540:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1966:x1830882976789248:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:0.0:1746066787.552552:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a765 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.552565:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b093600/0xfb36a14ee608a504 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbde expref: 16 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.552572:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b093c00/0xfb36a14ee608a61c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc5c expref: 29 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.552578:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800934ebc00/0xfb36a14ee608a5d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc16 expref: 23 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.552582:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.552583:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.552585:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a765 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.552597:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800934ebc00/0xfb36a14ee608a5d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc16 expref: 23 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.554870:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800934ebc00/0xfb36a14ee608a5d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc16 expref: 23 pid: 20532 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.554889:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976793344:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066787.554970:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b093c00/0xfb36a14ee608a61c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc5c expref: 29 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.554981:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b093c00/0xfb36a14ee608a61c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc5c expref: 29 pid: 4614 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.554997:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976793984:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066787.555022:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b093600/0xfb36a14ee608a504 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbde expref: 16 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.555029:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b093600/0xfb36a14ee608a504 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbde expref: 16 pid: 9776 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.555039:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976794112:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066787.555050:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066787.555261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.555715:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976792064:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066787.555728:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b093800/0xfb36a14ee608a615 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc55 expref: 33 pid: 4614 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746066787.555746:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976792192:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066787.555758:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976792320:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066787.555781:0:4614:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d3ff000/0xfb36a14ee608a750 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066787.566899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.566921:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976790656 00000100:00100000:0.0:1746066787.566926:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976790656 00000100:00100000:1.0:1746066787.566929:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976792832:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066787.566937:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976792960:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066787.567875:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976793088:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066787.567883:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef73400/0xfb36a14ee608a693 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dccc expref: 32 pid: 20532 timeout: 848 lvb_type: 0 00000100:00100000:1.0:1746066787.567894:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976793216:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066787.567910:0:10402:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135d8a000/0xfb36a14ee608a75e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066787.567913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.568425:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.568447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.568469:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.568480:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976791424 00000100:00100000:0.0:1746066787.568480:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976789888 00000100:00100000:1.0:1746066787.568482:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976791424 00000100:00100000:0.0:1746066787.568482:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976789888 00010000:00010000:1.0:1746066787.568494:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d8a600/0xfb36a14ee608a734 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd43 expref: 17 pid: 8452 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.568494:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800934ea000/0xfb36a14ee608a5cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc0f expref: 25 pid: 20532 timeout: 848 lvb_type: 1 00000100:00100000:1.0:1746066787.568508:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7259 00000100:00100000:1.0:1746066787.568512:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882976789888:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066787.568517:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7260 00010000:00010000:1.0:1746066787.568518:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066787.568521:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:1965:x1830882976791424:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066787.568525:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800934ea000/0xfb36a14ee608a5cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc0f expref: 25 pid: 20532 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.568526:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066787.568534:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d8a600/0xfb36a14ee608a734 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd43 expref: 17 pid: 8452 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746066787.568537:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800934ea000/0xfb36a14ee608a5cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc0f expref: 25 pid: 20532 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.568541:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d8a600/0xfb36a14ee608a734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd43 expref: 17 pid: 8452 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746066787.568547:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800934ea000/0xfb36a14ee608a5cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc0f expref: 25 pid: 20532 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.568548:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d8a600/0xfb36a14ee608a734 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd43 expref: 17 pid: 8452 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746066787.568554:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.568555:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.568558:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066787.568559:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3ff000/0xfb36a14ee608a750 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.568565:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3ff000/0xfb36a14ee608a750 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066787.568570:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1965:x1830882976791424:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 49us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.568574:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7260 00010000:00010000:1.0:1746066787.568579:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066787.568589:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976791168 00000100:00100000:1.0:1746066787.568591:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882976789888:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 79us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.568591:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976791168 00000100:00100000:1.0:1746066787.568595:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7259 00002000:00100000:0.0:1746066787.568612:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x390:0x0] (1212416->2097151) req@ffff88009a4ec380 x1830882976791168/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746066787.568613:0:4614:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d3ff000/0xfb36a14ee608a750 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.568619:0:4614:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d3ff000/0xfb36a14ee608a750 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746066787.568620:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ec380 with x1830882976791168 ext(1212416->2097151) 00010000:00010000:0.0:1746066787.568624:0:1992:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0e00/0xfb36a14ee608a662 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc9b expref: 32 pid: 21203 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746066787.568631:0:1992:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0e00/0xfb36a14ee608a662 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc9b expref: 32 pid: 21203 timeout: 848 lvb_type: 0 00010000:00010000:1.0:1746066787.568633:0:4614:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d3ff000/0xfb36a14ee608a750 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066787.568636:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a4ec380 00010000:00010000:1.0:1746066787.568643:0:4614:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3ff000/0xfb36a14ee608a750 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066787.568646:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2094 00010000:00010000:1.0:1746066787.568663:0:4614:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d3ff000/0xfb36a14ee608a750 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066787.568663:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1965:x1830882976791168:12345-192.168.202.57@tcp:4:cat.0 00010000:00010000:1.0:1746066787.568668:0:4614:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3ff000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066787.568671:0:4614:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d3ff000/0xfb36a14ee608a750 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.568691:0:4614:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d3ff000/0xfb36a14ee608a750 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.568699:0:4614:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d3ff000/0xfb36a14ee608a750 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.568704:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3ff000/0xfb36a14ee608a750 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066787.568734:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1966:x1830882976789120:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 18711us (18836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066787.568739:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14226 00000100:00100000:1.0:1746066787.570003:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976792064 00000100:00100000:1.0:1746066787.570006:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976792064 00010000:00010000:1.0:1746066787.570018:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b093c00/0xfb36a14ee608a61c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc5c expref: 28 pid: 4614 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746066787.572455:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800934ebc00/0xfb36a14ee608a5d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc16 expref: 21 pid: 20532 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.572473:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976793344:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066787.572480:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976793984:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066787.572488:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b093600/0xfb36a14ee608a504 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dbde expref: 12 pid: 9776 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746066787.572495:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976794112:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066787.572519:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a765 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066787.572664:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7269 00000100:00100000:1.0:1746066787.572686:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882976792064:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066787.572699:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066787.572715:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b093c00/0xfb36a14ee608a61c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc5c expref: 28 pid: 4614 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746066787.572724:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b093c00/0xfb36a14ee608a61c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc5c expref: 28 pid: 4614 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746066787.572739:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b093c00/0xfb36a14ee608a61c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc5c expref: 28 pid: 4614 timeout: 848 lvb_type: 1 00010000:00010000:1.0:1746066787.572748:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.572749:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.572752:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.572758:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a765 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.572780:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066787.572796:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882976792064:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 124us (2846us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066787.572801:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7269 00010000:00010000:1.0:1746066787.572839:0:10402:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135d8a000/0xfb36a14ee608a75e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.572846:0:10402:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d8a000/0xfb36a14ee608a75e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.572863:0:10402:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135d8a000/0xfb36a14ee608a75e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.572870:0:10402:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135d8a000/0xfb36a14ee608a75e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.572876:0:10402:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135d8a000/0xfb36a14ee608a75e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.572881:0:10402:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d8a000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066787.572883:0:10402:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135d8a000/0xfb36a14ee608a75e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.572889:0:10402:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135d8a000/0xfb36a14ee608a75e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.572898:0:10402:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135d8a000/0xfb36a14ee608a75e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.572902:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d8a000/0xfb36a14ee608a75e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066787.572931:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1966:x1830882976789632:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 20604us (21000us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066787.572936:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14228 00010000:00010000:0.0:1746066787.573190:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.573198:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.573212:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.573218:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.573224:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.573230:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa29600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066787.573233:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.573237:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a765 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.573245:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a765 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.573251:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608a765 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066787.573295:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882976789248:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 20754us (21337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.573301:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14229 00000100:00100000:0.0:1746066787.575530:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976792576 00000100:00100000:0.0:1746066787.575537:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976792576 00000100:00100000:0.0:1746066787.575588:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14234 00000100:00100000:0.0:1746066787.575595:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:31427:x1830882976792576:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066787.575609:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066787.575622:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093d01400/0xfb36a14ee608a7a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dd66 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066787.575639:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 5090560, mtime: 0x6812dd63, atime: 0x6812dd63, ctime: 0x6812dd63, blocks: 0x1721 00010000:00010000:0.0:1746066787.575661:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.575662:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.575668:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093d01400/0xfb36a14ee608a7a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd66 expref: 35 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.575701:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093d01400/0xfb36a14ee608a7a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd66 expref: 35 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.576609:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d01400, rc 0) 00000100:00100000:0.0:1746066787.576647:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:31427:x1830882976792576:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1052us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.576661:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14234 00010000:00010000:0.0:1746066787.580508:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8647200/0xfb36a14ee608a742 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd4a expref: 9 pid: 14548 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746066787.580528:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c22d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976794240:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066787.580544:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be800/0xfb36a14ee608a79d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.580551:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be800/0xfb36a14ee608a79d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.580556:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be800/0xfb36a14ee608a79d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746066787.580714:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000100:00100000:1.0:1746066787.580819:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976793216 00000100:00100000:1.0:1746066787.580823:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976793216 00000100:00100000:1.0:1746066787.580843:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976793472 00000100:00100000:1.0:1746066787.580844:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976793472 00000100:00100000:1.0:1746066787.580859:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976793344 00000100:00100000:1.0:1746066787.580861:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976793344 00000100:00100000:1.0:1746066787.580895:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14236 00000100:00100000:1.0:1746066787.580900:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882976793472:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066787.580908:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066787.580919:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d498c00/0xfb36a14ee608a7b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dd89 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066787.580953:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976794368:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066787.580997:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14237 00000100:00100000:1.0:1746066787.581002:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066787.581005:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1964:x1830882976793088:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066787.581013:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066787.581014:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14238 00000100:00100000:1.0:1746066787.581019:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882976793344:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066787.581020:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608a7c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dd74 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.581023:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066787.581029:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e400/0xfb36a14ee608a7c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dd82 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066787.581032:0:21973:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd5f, atime: 0x6812dd5f, ctime: 0x6812dd60, blocks: 0x7e1 00002000:00010000:1.0:1746066787.581039:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd61, atime: 0x6812dd61, ctime: 0x6812dd61, blocks: 0x821 00010000:00010000:0.0:1746066787.581040:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.581041:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.581044:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.581045:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608a7c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd74 expref: 38 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.581046:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066787.581049:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e400/0xfb36a14ee608a7c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd82 expref: 30 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.581053:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608a7c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd74 expref: 38 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066787.581059:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d00600, rc 0) 00010000:00010000:1.0:1746066787.581061:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e400/0xfb36a14ee608a7c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd82 expref: 30 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.581067:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb6e400, rc 0) 00000100:00100000:0.0:1746066787.581312:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882976793088:12345-192.168.202.57@tcp:101:cat.0 Request processed in 309us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.581317:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14237 00010000:00010000:0.0:1746066787.581385:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be800/0xfb36a14ee608a79d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581391:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be800/0xfb36a14ee608a79d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581397:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be800/0xfb36a14ee608a79d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581402:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a85be800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066787.581405:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be800/0xfb36a14ee608a79d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581413:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be800/0xfb36a14ee608a79d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746066787.581419:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882976793344:12345-192.168.202.57@tcp:101:cat.0 Request processed in 399us (586us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066787.581422:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00000100:00100000:1.0:1746066787.581423:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14238 00010000:00010000:0.0:1746066787.581424:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066787.581427:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be800/0xfb36a14ee608a79d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581431:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be800/0xfb36a14ee608a79d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581444:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8647c00/0xfb36a14ee608a78f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581449:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8647c00/0xfb36a14ee608a78f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581453:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8647c00/0xfb36a14ee608a78f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581456:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8647c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066787.581458:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8647c00/0xfb36a14ee608a78f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581461:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8647c00/0xfb36a14ee608a78f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581466:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066787.581645:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066787.581657:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8647c00/0xfb36a14ee608a78f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581662:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8647c00/0xfb36a14ee608a78f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581671:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85bf200/0xfb36a14ee608a796 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581696:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85bf200/0xfb36a14ee608a796 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581700:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85bf200/0xfb36a14ee608a796 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581704:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a85bf200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066787.581706:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85bf200/0xfb36a14ee608a796 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581710:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85bf200/0xfb36a14ee608a796 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581717:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b74300) 00010000:00010000:0.0:1746066787.581720:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066787.581722:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85bf200/0xfb36a14ee608a796 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.581970:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85bf200/0xfb36a14ee608a796 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066787.582003:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8646600/0xfb36a14ee608a788 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd5f expref: 254 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.582009:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8646600/0xfb36a14ee608a788 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd5f expref: 254 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.582015:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8646600, rc 0) 00000100:00100000:0.0:1746066787.582120:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31434:x1830882976792448:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 13254us (14179us total) trans 8589943929 rc 301/301 00000100:00100000:0.0:1746066787.582125:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9903 00000100:00100000:0.0:1746066787.583532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.583698:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976792960 00000100:00100000:1.0:1746066787.583703:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976792960 00000100:00100000:1.0:1746066787.583731:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9904 00000100:00100000:1.0:1746066787.583736:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+10:31436:x1830882976792960:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066787.583752:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066787.583763:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28200/0xfb36a14ee608a7d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dd6d expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.583839:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29e00/0xfb36a14ee608a7dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.583847:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29e00/0xfb36a14ee608a7dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.583855:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29e00/0xfb36a14ee608a7dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.583863:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608a7e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.583867:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608a7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.583872:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608a7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.583950:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28a00/0xfb36a14ee608a7ea lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.583957:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28a00/0xfb36a14ee608a7ea lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.583962:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28a00/0xfb36a14ee608a7ea lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066787.583969:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066787.584014:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28a00/0xfb36a14ee608a7ea lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584019:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28a00/0xfb36a14ee608a7ea lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584024:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28a00/0xfb36a14ee608a7ea lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584028:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa28a00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066787.584031:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28a00/0xfb36a14ee608a7ea lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584036:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28a00/0xfb36a14ee608a7ea lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584045:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066787.584047:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066787.584049:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28a00/0xfb36a14ee608a7ea lrc: 2/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584057:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28a00/0xfb36a14ee608a7ea lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584074:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29e00/0xfb36a14ee608a7dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584078:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29e00/0xfb36a14ee608a7dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584081:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29e00/0xfb36a14ee608a7dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584085:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa29e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066787.584086:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29e00/0xfb36a14ee608a7dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584089:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29e00/0xfb36a14ee608a7dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584094:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066787.584095:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066787.584097:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29e00/0xfb36a14ee608a7dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584101:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29e00/0xfb36a14ee608a7dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584108:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608a7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584112:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608a7e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584116:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608a7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584120:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa29c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066787.584122:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608a7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584126:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608a7e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584130:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ffed300) 00010000:00010000:1.0:1746066787.584131:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066787.584133:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608a7e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584136:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608a7e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.584164:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28200/0xfb36a14ee608a7d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd6d expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.584170:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28200/0xfb36a14ee608a7d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd6d expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.584177:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa28200, rc 0) 00000100:00100000:1.0:1746066787.584217:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+11:31436:x1830882976792960:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 481us (688us total) trans 8589943930 rc 301/301 00000100:00100000:1.0:1746066787.584222:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9904 00000100:00100000:1.0:1746066787.585977:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976794368:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066787.586001:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d498c00/0xfb36a14ee608a7b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd89 expref: 37 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.586016:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d498c00/0xfb36a14ee608a7b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd89 expref: 37 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066787.586025:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d498c00, rc 0) 00000100:00100000:1.0:1746066787.586050:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882976793472:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5149us (5242us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066787.586056:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14236 00000100:00100000:0.0:1746066787.587579:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.587659:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976793728 00000100:00100000:1.0:1746066787.587665:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976793728 00000100:00100000:1.0:1746066787.587711:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14240 00000100:00100000:1.0:1746066787.587716:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:31434:x1830882976793728:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066787.587728:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066787.587738:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa28e00/0xfb36a14ee608a7f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dd97 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.587757:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066787.587760:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8646400/0xfb36a14ee608a76c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.587765:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746066787.587768:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa28e00/0xfb36a14ee608a7f8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1290240->1355775] (req 1290240->1355775) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd97 expref: 37 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.587780:0:10402:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff8800a8646400/0xfb36a14ee608a76c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.587794:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa28e00/0xfb36a14ee608a7f8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1290240->1355775] (req 1290240->1355775) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd97 expref: 37 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.587802:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa28e00, rc 0) 00000100:00100000:1.0:1746066787.587824:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:31434:x1830882976793728:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 108us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066787.587828:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14240 00000100:00100000:0.0:1746066787.588530:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.588647:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976793984 00000100:00100000:1.0:1746066787.588660:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976793984 00002000:00100000:1.0:1746066787.588701:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (5087232->5091327) req@ffff88009a4eed80 x1830882976793984/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.588709:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4eed80 with x1830882976793984 ext(5087232->5091327) 00002000:00010000:1.0:1746066787.588713:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4eed80 00000100:00100000:1.0:1746066787.588938:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6412 00000100:00100000:1.0:1746066787.588944:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1964:x1830882976793984:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066787.589163:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1964:x1830882976793984:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 218us (634us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066787.589168:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6412 00002000:00100000:1.0:1746066787.589172:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (5087232->5091327) req@ffff88009a4eed80 x1830882976793984/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:193/0 lens 488/4536 e 0 to 0 dl 1746066798 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.589179:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4eed80 with x1830882976793984 ext(5087232->5091327) 00002000:00010000:1.0:1746066787.589181:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4eed80 00000100:00100000:0.0:1746066787.591595:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.594129:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.594184:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976794368 00000100:00100000:1.0:1746066787.594189:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976794368 00000100:00100000:1.0:1746066787.594229:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4108 00000100:00100000:1.0:1746066787.594235:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31427:x1830882976794368:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:1.0:1746066787.594389:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:31427:x1830882976794368:12345-192.168.202.57@tcp:35:cat.0 Request processed in 153us (265us total) trans 8589943931 rc 0/0 00000100:00100000:1.0:1746066787.594395:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4108 00000100:00100000:0.0:1746066787.595234:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.595252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.597911:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.597931:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.598497:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976794880 00000100:00100000:1.0:1746066787.598502:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976794880 00002000:00100000:1.0:1746066787.598529:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x390:0x0] (1290240->1294335) req@ffff88009a4edf80 x1830882976794880/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.598537:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4edf80 with x1830882976794880 ext(1290240->1294335) 00002000:00010000:1.0:1746066787.598540:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4edf80 00000100:00100000:1.0:1746066787.598561:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976795136 00000100:00100000:1.0:1746066787.598564:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976795136 00002000:00100000:1.0:1746066787.598575:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38e:0x0] (1200128->1204223) req@ffff88009a4eca80 x1830882976795136/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.598581:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4eca80 with x1830882976795136 ext(1200128->1204223) 00002000:00010000:1.0:1746066787.598583:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4eca80 00000100:00100000:1.0:1746066787.598593:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6413 00000100:00100000:1.0:1746066787.598598:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882976794880:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066787.598768:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882976794880:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 169us (861us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066787.598774:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6413 00002000:00100000:1.0:1746066787.598779:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x390:0x0] (1290240->1294335) req@ffff88009a4edf80 x1830882976794880/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:193/0 lens 488/4536 e 0 to 0 dl 1746066798 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.598790:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4edf80 with x1830882976794880 ext(1290240->1294335) 00002000:00010000:1.0:1746066787.598792:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4edf80 00000100:00100000:1.0:1746066787.598802:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6414 00000100:00100000:1.0:1746066787.598813:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976795136:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066787.598876:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976795136:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 68us (944us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066787.598881:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6414 00002000:00100000:1.0:1746066787.598885:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38e:0x0] (1200128->1204223) req@ffff88009a4eca80 x1830882976795136/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/4536 e 0 to 0 dl 1746066798 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.598891:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4eca80 with x1830882976795136 ext(1200128->1204223) 00002000:00010000:1.0:1746066787.598893:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4eca80 00000100:00100000:0.0:1746066787.601642:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.601733:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.601967:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976795648 00000100:00100000:1.0:1746066787.601970:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976795648 00000100:00100000:1.0:1746066787.601992:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9905 00000100:00100000:1.0:1746066787.601997:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31431:x1830882976795648:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:1.0:1746066787.602027:0:20127:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066787.602047:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef72400/0xfb36a14ee608a726 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd35 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.602059:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066787.602062:0:20127:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066787.602097:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31431:x1830882976795648:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 100us (364us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746066787.602103:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9905 00000100:00100000:0.0:1746066787.603069:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.606799:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.606876:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.606941:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976796416 00000100:00100000:1.0:1746066787.606949:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976796416 00000100:00100000:1.0:1746066787.606988:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976796160 00000100:00100000:1.0:1746066787.606990:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976796160 00000100:00100000:1.0:1746066787.607004:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4109 00000100:00100000:1.0:1746066787.607010:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:31434:x1830882976796416:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:1.0:1746066787.607170:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31434:x1830882976796416:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 158us (377us total) trans 8589943932 rc 0/0 00000100:00100000:1.0:1746066787.607176:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4109 00000100:00100000:1.0:1746066787.607190:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4110 00000100:00100000:1.0:1746066787.607194:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31431:x1830882976796160:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:1.0:1746066787.607249:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31431:x1830882976796160:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 54us (373us total) trans 8589943933 rc 0/0 00000100:00100000:1.0:1746066787.607254:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4110 00000100:00100000:0.0:1746066787.611011:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.611097:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.651868:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.738398:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976797312 00000100:00100000:1.0:1746066787.738407:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976797312 00000100:00100000:1.0:1746066787.738445:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9906 00000100:00100000:1.0:1746066787.738452:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:31446:x1830882976797312:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066787.738470:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066787.738484:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608a806 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dda5 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.738560:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28600/0xfb36a14ee608a80d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.738572:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28600/0xfb36a14ee608a80d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.738583:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28600/0xfb36a14ee608a80d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.738594:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608a814 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.738599:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608a814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.738604:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608a814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739560:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e893c00/0xfb36a14ee608a81b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739570:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e893c00/0xfb36a14ee608a81b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739577:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e893c00/0xfb36a14ee608a81b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066787.739585:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066787.739659:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28600/0xfb36a14ee608a80d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739665:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28600/0xfb36a14ee608a80d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739671:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28600/0xfb36a14ee608a80d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739721:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa28600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066787.739725:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28600/0xfb36a14ee608a80d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739732:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28600/0xfb36a14ee608a80d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739741:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066787.739743:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066787.739747:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28600/0xfb36a14ee608a80d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739752:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa28600/0xfb36a14ee608a80d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739765:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608a814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739770:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608a814 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739775:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608a814 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739779:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cb3c400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066787.739781:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608a814 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739785:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608a814 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739790:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ffed300) 00010000:00010000:1.0:1746066787.739792:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066787.739794:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608a814 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739799:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608a814 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.739834:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608a806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dda5 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.739846:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e893c00/0xfb36a14ee608a81b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dda5 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.739851:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066787.739853:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066787.739855:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e893c00, rc 0) 00000100:00100000:1.0:1746066787.739899:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+14:31446:x1830882976797312:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1447us (3000us total) trans 8589943936 rc 0/0 00000100:00100000:1.0:1746066787.739906:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9906 00000100:00100000:1.0:1746066787.751663:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976797568 00000100:00100000:1.0:1746066787.751667:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976797568 00000100:00100000:1.0:1746066787.751701:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9907 00000100:00100000:1.0:1746066787.751706:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31445:x1830882976797568:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066787.751717:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066787.751726:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e893e00/0xfb36a14ee608a84c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ddac expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.751798:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a200/0xfb36a14ee608a853 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.751808:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a200/0xfb36a14ee608a853 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.751816:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a200/0xfb36a14ee608a853 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.751828:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a400/0xfb36a14ee608a85a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.751832:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a400/0xfb36a14ee608a85a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.751837:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a400/0xfb36a14ee608a85a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.751907:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2400/0xfb36a14ee608a861 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.751912:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2400/0xfb36a14ee608a861 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.751917:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2400/0xfb36a14ee608a861 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066787.751923:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066787.751977:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a200/0xfb36a14ee608a853 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.751988:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a200/0xfb36a14ee608a853 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.751995:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a200/0xfb36a14ee608a853 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.752000:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee2a200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066787.752002:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a200/0xfb36a14ee608a853 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.752007:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a200/0xfb36a14ee608a853 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.752015:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066787.752017:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066787.752020:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a200/0xfb36a14ee608a853 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.752024:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a200/0xfb36a14ee608a853 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.752033:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a400/0xfb36a14ee608a85a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.752154:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a400/0xfb36a14ee608a85a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.752160:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a400/0xfb36a14ee608a85a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.752163:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee2a400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066787.752165:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a400/0xfb36a14ee608a85a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.752169:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a400/0xfb36a14ee608a85a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.752175:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009d6bd800) 00010000:00010000:1.0:1746066787.752177:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066787.752178:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a400/0xfb36a14ee608a85a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.752182:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee2a400/0xfb36a14ee608a85a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.752208:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e893e00/0xfb36a14ee608a84c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddac expref: 258 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.752219:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2400/0xfb36a14ee608a861 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddac expref: 257 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.752224:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066787.752226:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066787.752227:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea2400, rc 0) 00000100:00100000:1.0:1746066787.752248:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:31445:x1830882976797568:12345-192.168.202.57@tcp:101:cat.0 Request processed in 542us (1513us total) trans 8589943937 rc 0/0 00000100:00100000:1.0:1746066787.752253:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9907 00000100:00100000:0.0:1746066787.775905:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.787746:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.787763:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.787812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.787832:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976798592 00000100:00100000:0.0:1746066787.787838:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976798592 00002000:00100000:0.0:1746066787.787880:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009284b800 x1830882976798592/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066787.787894:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284b800 with x1830882976798592 ext(0->1048575) 00002000:00010000:0.0:1746066787.787899:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284b800 00000100:00100000:0.0:1746066787.787914:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976798848 00000100:00100000:0.0:1746066787.787916:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976798848 00002000:00100000:0.0:1746066787.787928:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880092848a80 x1830882976798848/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066787.787934:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092848a80 with x1830882976798848 ext(1048576->2097151) 00002000:00010000:0.0:1746066787.787937:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092848a80 00000100:00100000:0.0:1746066787.787945:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976799104 00000100:00100000:0.0:1746066787.787947:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976799104 00002000:00100000:0.0:1746066787.787956:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880092849500 x1830882976799104/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 504/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066787.787962:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849500 with x1830882976799104 ext(1048576->2097151) 00002000:00010000:0.0:1746066787.787964:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092849500 00000100:00100000:0.0:1746066787.787975:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6417 00000100:00100000:0.0:1746066787.787982:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882976798592:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066787.788583:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6419 00000100:00100000:0.0:1746066787.788589:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882976799104:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066787.819741:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.839123:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882976798592:12345-192.168.202.57@tcp:3:cat.0 Request processed in 51133us (51376us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066787.839133:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6417 00002000:00100000:0.0:1746066787.839144:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009284b800 x1830882976798592/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/440 e 0 to 0 dl 1746066798 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066787.839158:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284b800 with x1830882976798592 ext(0->1048575) 00002000:00010000:0.0:1746066787.839163:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284b800 00000100:00100000:1.0:1746066787.839538:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882976798848:12345-192.168.202.57@tcp:3:cat.0 Request processed in 51007us (51772us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066787.839544:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6418 00002000:00100000:1.0:1746066787.839550:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880092848a80 x1830882976798848/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/440 e 0 to 0 dl 1746066798 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.839557:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092848a80 with x1830882976798848 ext(1048576->2097151) 00002000:00010000:1.0:1746066787.839559:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092848a80 00000100:00100000:1.0:1746066787.853067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.853075:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.853094:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.853111:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976800384 00000100:00100000:0.0:1746066787.853117:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976800384 00010000:00010000:0.0:1746066787.853149:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e893c00/0xfb36a14ee608a81b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dda5 expref: 14 pid: 14548 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746066787.853168:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976800256 00000100:00100000:0.0:1746066787.853170:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976800256 00010000:00010000:0.0:1746066787.853177:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2400/0xfb36a14ee608a861 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddac expref: 259 pid: 14548 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746066787.853189:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7273 00000100:00100000:0.0:1746066787.853195:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+14:1965:x1830882976800384:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066787.853206:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066787.853210:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e893c00/0xfb36a14ee608a81b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dda5 expref: 14 pid: 14548 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066787.853219:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e893c00/0xfb36a14ee608a81b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dda5 expref: 14 pid: 14548 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066787.853237:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066787.853240:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aa9e00/0xfb36a14ee608a87d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.853247:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aa9e00/0xfb36a14ee608a87d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.853253:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066787.853282:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+14:1965:x1830882976800384:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 87us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.853288:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7273 00000100:00100000:0.0:1746066787.853299:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7274 00000100:00100000:0.0:1746066787.853303:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:1965:x1830882976800256:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066787.853310:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066787.853313:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2400/0xfb36a14ee608a861 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddac expref: 259 pid: 14548 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066787.853320:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2400/0xfb36a14ee608a861 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddac expref: 259 pid: 14548 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066787.853328:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066787.853330:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aa9e00/0xfb36a14ee608a87d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.853336:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aa9e00/0xfb36a14ee608a87d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.853341:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aa9e00/0xfb36a14ee608a87d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066787.853353:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066787.853362:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:1965:x1830882976800256:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 59us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066787.853366:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7274 00000100:00100000:1.0:1746066787.853772:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976800128 00000100:00100000:1.0:1746066787.853776:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976800128 00000100:00100000:1.0:1746066787.853803:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9909 00000100:00100000:1.0:1746066787.853808:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+13:31450:x1830882976800128:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066787.853822:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066787.853831:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96e00/0xfb36a14ee608a88b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dde4 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.853883:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96a00/0xfb36a14ee608a892 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.853892:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96a00/0xfb36a14ee608a892 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066787.853898:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96a00/0xfb36a14ee608a892 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066787.853903:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000100:00100000:0.0:1746066787.853918:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1966:x1830882976799360:12345-192.168.202.57@tcp:3:cat.0 Request processed in 47157us (47289us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066787.853925:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6420 00002000:00100000:0.0:1746066787.853932:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88012c22fb80 x1830882976799360/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:193/0 lens 488/440 e 0 to 0 dl 1746066798 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066787.853941:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22fb80 with x1830882976799360 ext(0->1048575) 00002000:00010000:0.0:1746066787.853945:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c22fb80 00010000:00010000:1.0:1746066787.853949:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96e00/0xfb36a14ee608a88b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dde4 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.853957:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96a00/0xfb36a14ee608a892 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dde4 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066787.853962:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066787.853964:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1746066787.853966:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb96a00, rc 0) 00000100:00100000:1.0:1746066787.853986:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:31450:x1830882976800128:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 178us (926us total) trans 8589943939 rc 0/0 00000100:00100000:1.0:1746066787.853991:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9909 00000001:00080000:1.0:1746066787.877180:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873538 is committed 00000001:00080000:1.0:1746066787.877189:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873544 is committed 00000001:00080000:1.0:1746066787.877202:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873503 is committed 00000001:00080000:1.0:1746066787.877217:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873547 is committed 00000001:00080000:1.0:1746066787.877224:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873546 is committed 00000001:00080000:1.0:1746066787.877268:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873548 is committed 00000001:00080000:1.0:1746066787.877324:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873545 is committed 00000100:00100000:0.0:1746066787.881294:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.892516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.908750:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.911258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.911595:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.916437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.916471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.916489:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976801152 00000100:00100000:0.0:1746066787.916494:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976801152 00010000:00010000:0.0:1746066787.916521:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f02ea00/0xfb36a14ee608a845 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddcf expref: 8 pid: 21203 timeout: 849 lvb_type: 1 00000100:00100000:0.0:1746066787.916539:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976801280 00000100:00100000:0.0:1746066787.916541:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976801280 00010000:00010000:0.0:1746066787.916550:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef72c00/0xfb36a14ee608a7ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd90 expref: 17 pid: 8450 timeout: 849 lvb_type: 1 00000100:00100000:0.0:1746066787.916574:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7276 00000100:00100000:0.0:1746066787.916580:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+8:1964:x1830882976801152:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066787.916592:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066787.916609:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f02ea00/0xfb36a14ee608a845 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddcf expref: 8 pid: 21203 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746066787.916618:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f02ea00/0xfb36a14ee608a845 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddcf expref: 8 pid: 21203 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746066787.919940:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f02ea00/0xfb36a14ee608a845 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddcf expref: 8 pid: 21203 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746066787.919962:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.919964:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066787.919970:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dee1400/0xfb36a14ee608a8a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4182015) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddf2 expref: 14 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.919983:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dee1400/0xfb36a14ee608a8a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4182015) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddf2 expref: 14 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066787.920018:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008dee1400/0xfb36a14ee608a8a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4182015) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddf2 expref: 14 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066787.920030:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976796032:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066787.920138:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066787.920388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.920424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.920467:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976801408 00000100:00100000:0.0:1746066787.920472:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976801408 00002000:00100000:0.0:1746066787.920504:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1200128->1265663) req@ffff8800924d0000 x1830882976801408/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066787.920512:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d0000 with x1830882976801408 ext(1200128->1265663) 00010000:00010000:0.0:1746066787.920518:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093d00a00/0xfb36a14ee608a7ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd9e expref: 8 pid: 20532 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066787.920528:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093d00a00/0xfb36a14ee608a7ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd9e expref: 8 pid: 20532 timeout: 849 lvb_type: 0 00002000:00010000:0.0:1746066787.920534:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924d0000 00000100:00100000:0.0:1746066787.920547:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976801664 00000100:00100000:0.0:1746066787.920549:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976801664 00002000:00100000:0.0:1746066787.920570:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff8800924d1880 x1830882976801664/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066787.920576:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d1880 with x1830882976801664 ext(1048576->2097151) 00002000:00010000:0.0:1746066787.920579:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d1880 00000100:00100000:0.0:1746066787.920591:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6422 00000100:00100000:0.0:1746066787.920597:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+9:1965:x1830882976801664:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066787.922785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.922817:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976796032:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066787.922833:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066787.922874:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:1964:x1830882976801152:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6294us (6443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066787.922881:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7276 00000100:00100000:0.0:1746066787.944727:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976802176 00000100:00100000:0.0:1746066787.944735:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976802176 00002000:00100000:0.0:1746066787.944772:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (4177920->4182015) req@ffff88009e841f80 x1830882976802176/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:193/0 lens 488/0 e 0 to 0 dl 1746066798 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066787.944781:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e841f80 with x1830882976802176 ext(4177920->4182015) 00002000:00010000:0.0:1746066787.944786:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e841f80 00000100:00100000:0.0:1746066787.944807:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6424 00000100:00100000:0.0:1746066787.944814:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1964:x1830882976802176:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066787.945135:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1964:x1830882976802176:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 321us (780us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066787.945143:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6424 00002000:00100000:0.0:1746066787.945148:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38f:0x0] (4177920->4182015) req@ffff88009e841f80 x1830882976802176/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:193/0 lens 488/4536 e 0 to 0 dl 1746066798 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066787.945155:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e841f80 with x1830882976802176 ext(4177920->4182015) 00002000:00010000:0.0:1746066787.945157:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e841f80 00000100:00100000:1.0:1746066787.945506:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+9:1965:x1830882976801664:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24908us (25079us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066787.945513:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6422 00002000:00100000:1.0:1746066787.945518:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff8800924d1880 x1830882976801664/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:193/0 lens 488/440 e 0 to 0 dl 1746066798 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066787.945525:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d1880 with x1830882976801664 ext(1048576->2097151) 00002000:00010000:1.0:1746066787.945528:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d1880 00000100:00100000:0.0:1746066787.951488:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066787.953285:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976802304 00000100:00100000:1.0:1746066787.953294:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976802304 00010000:00010000:1.0:1746066787.953327:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093d00a00/0xfb36a14ee608a7ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd9e expref: 9 pid: 20532 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746066787.966306:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066787.966355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.014115:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14251 00000100:00100000:1.0:1746066788.014127:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:31445:x1830882976802944:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066788.014141:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.014156:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1a00/0xfb36a14ee608a8b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97de00 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.014176:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.014178:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.014186:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1a00/0xfb36a14ee608a8b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de00 expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.014197:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1a00/0xfb36a14ee608a8b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de00 expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.014205:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b1a00, rc 0) 00000100:00100000:1.0:1746066788.014252:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31445:x1830882976802944:12345-192.168.202.57@tcp:101:cat.0 Request processed in 129us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.014257:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14251 00000100:00100000:1.0:1746066788.014272:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14252 00000100:00100000:1.0:1746066788.014276:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:31446:x1830882976803072:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066788.014282:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.014290:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608a8bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97de07 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.014302:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dee1400/0xfb36a14ee608a8a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4182015) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddf2 expref: 13 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.014308:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066788.014309:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066788.014311:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608a8bc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de07 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.014332:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dee1400/0xfb36a14ee608a8a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4182015) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddf2 expref: 13 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.014342:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dee1400/0xfb36a14ee608a8a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3588096->4182015) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddf2 expref: 13 pid: 9776 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.014352:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976796288:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066788.015520:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066788.017891:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976796288:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066788.017917:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608a8bc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de07 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.017933:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b0000, rc 0) 00000100:00100000:1.0:1746066788.017978:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+9:31446:x1830882976803072:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3700us (5102us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.018109:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14252 00000100:00100000:0.0:1746066788.021428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.021469:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.055974:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.069033:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.071911:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.071938:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.071970:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.071982:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976804352 00000100:00100000:0.0:1746066788.071984:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976804352 00002000:00100000:0.0:1746066788.071998:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009b472680 x1830882976804352/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066788.072007:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b472680 with x1830882976804352 ext(3145728->4194303) 00002000:00010000:0.0:1746066788.072012:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b472680 00000100:00100000:0.0:1746066788.072554:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6429 00000100:00100000:0.0:1746066788.072563:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+10:1966:x1830882976804096:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066788.090853:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.097360:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976804736 00000100:00100000:1.0:1746066788.097372:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976804736 00000100:00100000:1.0:1746066788.097430:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14253 00000100:00100000:1.0:1746066788.097438:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+11:31450:x1830882976804736:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066788.097452:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.097465:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1800/0xfb36a14ee608a8c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97de0e expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.097487:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093d01400/0xfb36a14ee608a7a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd66 expref: 23 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.097494:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f02e800/0xfb36a14ee608a83e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddc8 expref: 12 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.097504:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.097506:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.097508:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1800/0xfb36a14ee608a8c3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2142208->3108863] (req 2142208->3108863) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de0e expref: 12 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.097534:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f02e800/0xfb36a14ee608a83e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddc8 expref: 12 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.097544:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f02e800/0xfb36a14ee608a83e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddc8 expref: 12 pid: 21203 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746066788.097554:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976796544:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066788.097636:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093d01400/0xfb36a14ee608a7a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd66 expref: 23 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.097657:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093d01400/0xfb36a14ee608a7a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd66 expref: 23 pid: 8451 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.097664:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976796672:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066788.097704:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066788.105385:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976796544:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066788.105709:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976796672:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066788.105735:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1800/0xfb36a14ee608a8c3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2142208->3108863] (req 2142208->3108863) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de0e expref: 12 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.105754:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b1800, rc 0) 00000100:00100000:1.0:1746066788.105785:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:31450:x1830882976804736:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 8347us (14938us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.105792:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14253 00000100:00100000:0.0:1746066788.117471:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976804864 00000100:00100000:0.0:1746066788.117477:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976804864 00000100:00100000:0.0:1746066788.117510:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14254 00000100:00100000:0.0:1746066788.117516:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:31445:x1830882976804864:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066788.117527:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066788.117538:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f319400/0xfb36a14ee608a8ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97de15 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.117555:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.117556:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.117562:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f319400/0xfb36a14ee608a8ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de15 expref: 16 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.117573:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f319400/0xfb36a14ee608a8ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de15 expref: 16 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.117580:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f319400, rc 0) 00000100:00100000:0.0:1746066788.117601:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:31445:x1830882976804864:12345-192.168.202.57@tcp:101:cat.0 Request processed in 86us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.117606:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14254 00000100:00100000:0.0:1746066788.123064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.129517:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.129563:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.130470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.130542:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6432 00000100:00100000:0.0:1746066788.130553:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1964:x1830882976805504:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066788.143338:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976806016 00000100:00100000:0.0:1746066788.143350:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976806016 00002000:00100000:0.0:1746066788.143395:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x391:0x0] (2142208->2146303) req@ffff88009e843b80 x1830882976806016/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066788.143404:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e843b80 with x1830882976806016 ext(2142208->2146303) 00002000:00010000:0.0:1746066788.143409:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e843b80 00000100:00100000:0.0:1746066788.144054:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6434 00000100:00100000:0.0:1746066788.144063:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882976806016:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066788.145319:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882976806016:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 1256us (3812us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066788.145325:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6434 00002000:00100000:0.0:1746066788.145333:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x391:0x0] (2142208->2146303) req@ffff88009e843b80 x1830882976806016/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 488/4536 e 0 to 0 dl 1746066799 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066788.145341:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e843b80 with x1830882976806016 ext(2142208->2146303) 00002000:00010000:0.0:1746066788.145344:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e843b80 00000100:00100000:1.0:1746066788.147950:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1964:x1830882976805504:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17394us (18378us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066788.147959:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6432 00002000:00100000:1.0:1746066788.147967:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009b473b80 x1830882976805504/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:194/0 lens 488/440 e 0 to 0 dl 1746066799 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.147976:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b473b80 with x1830882976805504 ext(2097152->3145727) 00002000:00010000:1.0:1746066788.147980:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b473b80 00000100:00100000:0.0:1746066788.152450:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.160335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.160373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.160413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.164312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.165780:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976806912 00000100:00100000:1.0:1746066788.165788:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976806912 00002000:00100000:1.0:1746066788.165824:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135431880 x1830882976806912/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.165834:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135431880 with x1830882976806912 ext(3145728->4194303) 00002000:00010000:1.0:1746066788.165838:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135431880 00000100:00100000:1.0:1746066788.165870:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6436 00000100:00100000:1.0:1746066788.165877:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882976806912:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066788.167256:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.176794:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976807424 00000100:00100000:0.0:1746066788.176801:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976807424 00002000:00100000:0.0:1746066788.176840:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e840a80 x1830882976807424/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066788.176849:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e840a80 with x1830882976807424 ext(4194304->5091327) 00002000:00010000:0.0:1746066788.176854:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e840a80 00000100:00100000:0.0:1746066788.176870:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6438 00000100:00100000:0.0:1746066788.176877:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+10:1965:x1830882976807424:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066788.189581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.192377:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882976806912:12345-192.168.202.57@tcp:3:cat.0 Request processed in 26497us (28069us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066788.192385:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6436 00002000:00100000:1.0:1746066788.192392:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135431880 x1830882976806912/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:194/0 lens 488/440 e 0 to 0 dl 1746066799 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.192402:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135431880 with x1830882976806912 ext(3145728->4194303) 00002000:00010000:1.0:1746066788.192406:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135431880 00000100:00100000:0.0:1746066788.205322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.205402:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.205422:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976808064 00000100:00100000:0.0:1746066788.205428:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976808064 00000100:00100000:0.0:1746066788.205464:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14259 00000100:00100000:0.0:1746066788.205471:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882976808064:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066788.205484:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066788.205498:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1800/0xfb36a14ee608a910 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97de3f expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.205521:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1800/0xfb36a14ee608a910 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de3f expref: 23 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066788.205530:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1800/0xfb36a14ee608a910 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de3f expref: 23 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066788.205542:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af1800, rc 0) 00000100:00100000:0.0:1746066788.205560:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882976808064:12345-192.168.202.57@tcp:101:cat.0 Request processed in 91us (158us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066788.205565:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14259 00000100:00100000:0.0:1746066788.209573:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.211517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066788.213515:0:9851:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066788.231012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.241179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.243887:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.248214:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.266263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.268132:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976809344 00000100:00100000:1.0:1746066788.268143:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976809344 00000100:00100000:1.0:1746066788.268197:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4115 00000100:00100000:1.0:1746066788.268205:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:31445:x1830882976809344:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:1.0:1746066788.268400:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:31445:x1830882976809344:12345-192.168.202.57@tcp:35:cat.0 Request processed in 196us (2146us total) trans 8589943943 rc 0/0 00000100:00100000:1.0:1746066788.268406:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4115 00000100:00100000:0.0:1746066788.307952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.311256:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.314152:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.314366:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7283 00000100:00100000:0.0:1746066788.314375:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1964:x1830882976809728:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066788.314382:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066788.314390:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ef72a00/0xfb36a14ee608a7b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd7b expref: 17 pid: 8112 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746066788.314398:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ef72a00/0xfb36a14ee608a7b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd7b expref: 17 pid: 8112 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746066788.314408:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef72a00/0xfb36a14ee608a7b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd7b expref: 17 pid: 8112 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746066788.314421:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.314423:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.314428:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a85bfe00/0xfb36a14ee608a933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de62 expref: 16 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.314436:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85bfe00/0xfb36a14ee608a933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de62 expref: 16 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.314458:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a85bfe00/0xfb36a14ee608a933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de62 expref: 16 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066788.314467:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976797184:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066788.314510:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066788.316781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.316869:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976797184:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066788.316886:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066788.316999:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1964:x1830882976809728:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2627us (2847us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.317009:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7283 00000100:00100000:0.0:1746066788.324109:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.325492:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.332332:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.332350:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.332884:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976810752 00000100:00100000:1.0:1746066788.332887:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976810752 00010000:00010000:1.0:1746066788.332904:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aa9e00/0xfb36a14ee608a87d lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dddd expref: 261 pid: 20127 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.332921:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7284 00000100:00100000:1.0:1746066788.332926:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:1965:x1830882976810752:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066788.332936:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066788.332940:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aa9e00/0xfb36a14ee608a87d lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dddd expref: 261 pid: 20127 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.332947:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aa9e00/0xfb36a14ee608a87d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dddd expref: 261 pid: 20127 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.332966:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066788.332971:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1800/0xfb36a14ee608a956 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066788.332977:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1800/0xfb36a14ee608a956 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066788.332981:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1800/0xfb36a14ee608a956 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066788.332985:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066788.333902:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:1965:x1830882976810752:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 974us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.333908:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7284 00000100:00100000:1.0:1746066788.334308:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976810368 00000100:00100000:1.0:1746066788.334312:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976810368 00010000:00010000:1.0:1746066788.334325:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85be800/0xfb36a14ee608a8df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de2a expref: 9 pid: 8452 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746066788.334339:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976810880 00000100:00100000:1.0:1746066788.334340:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976810880 00010000:00010000:1.0:1746066788.334347:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608a8ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddf9 expref: 17 pid: 21973 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.334359:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7285 00000100:00100000:1.0:1746066788.334364:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+9:1964:x1830882976810368:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066788.334371:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066788.334386:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a85be800/0xfb36a14ee608a8df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de2a expref: 9 pid: 8452 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746066788.334394:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a85be800/0xfb36a14ee608a8df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de2a expref: 9 pid: 8452 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746066788.334408:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a85be800/0xfb36a14ee608a8df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de2a expref: 9 pid: 8452 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746066788.334419:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066788.334831:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:1964:x1830882976810368:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 465us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.334837:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7285 00000100:00100000:0.0:1746066788.341158:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.342872:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.344609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.351613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.351658:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.351705:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.351723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.351735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.351757:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.366843:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.373310:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.373368:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976812800 00000100:00100000:1.0:1746066788.373375:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976812800 00010000:00010000:1.0:1746066788.373400:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1800/0xfb36a14ee608a956 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de69 expref: 14 pid: 20127 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.373432:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7288 00000100:00100000:1.0:1746066788.373438:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882976812800:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066788.373449:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066788.373453:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1800/0xfb36a14ee608a956 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de69 expref: 14 pid: 20127 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.373463:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1800/0xfb36a14ee608a956 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de69 expref: 14 pid: 20127 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.373482:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1800/0xfb36a14ee608a956 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de69 expref: 14 pid: 20127 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.373511:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066788.373515:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4893000/0xfb36a14ee608a995 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066788.373522:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4893000/0xfb36a14ee608a995 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066788.373528:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4893000/0xfb36a14ee608a995 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066788.373552:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066788.373582:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882976812800:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 144us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.373587:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7288 00000100:00100000:0.0:1746066788.377203:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.378279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.379012:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9914 00000100:00100000:1.0:1746066788.379020:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:31457:x1830882976812928:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066788.379040:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.379053:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aaab600/0xfb36a14ee608a9aa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97deaf expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.379108:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aaaaa00/0xfb36a14ee608a9b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.379119:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4893000/0xfb36a14ee608a995 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dea8 expref: 14 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.379125:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aaaaa00/0xfb36a14ee608a9b1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.379151:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4893000/0xfb36a14ee608a995 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dea8 expref: 14 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.379160:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4893000/0xfb36a14ee608a995 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dea8 expref: 14 pid: 809 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.379170:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976798336:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066788.379475:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066788.381663:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976813440 00000100:00100000:0.0:1746066788.381669:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976813440 00010000:00010000:0.0:1746066788.381702:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4893000/0xfb36a14ee608a995 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dea8 expref: 15 pid: 809 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.381762:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976798336:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066788.381776:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009aaaaa00/0xfb36a14ee608a9b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746066788.381909:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7289 00000100:00100000:0.0:1746066788.381916:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1964:x1830882976813440:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066788.381924:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066788.381928:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4893000/0xfb36a14ee608a995 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dea8 expref: 15 pid: 809 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.381937:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4893000/0xfb36a14ee608a995 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dea8 expref: 15 pid: 809 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.381949:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4893000/0xfb36a14ee608a995 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dea8 expref: 15 pid: 809 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.381962:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066788.381965:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aaaaa00/0xfb36a14ee608a9b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.381971:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aaaaa00/0xfb36a14ee608a9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.381976:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aaaaa00/0xfb36a14ee608a9b1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.381981:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099791a00/0xfb36a14ee608a9db lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066788.381985:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099791a00/0xfb36a14ee608a9db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066788.381992:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099791a00/0xfb36a14ee608a9db lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066788.382234:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066788.382259:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882976813440:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 344us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.382265:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7289 00010000:00010000:1.0:1746066788.382343:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009aaaaa00/0xfb36a14ee608a9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.382348:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aaaaa00/0xfb36a14ee608a9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066788.382363:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:1.0:1746066788.382365:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746066788.382371:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009aaaaa00/0xfb36a14ee608a9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.382387:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aaab600/0xfb36a14ee608a9aa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97deaf expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.382409:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aaaaa00/0xfb36a14ee608a9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97deaf expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.382418:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066788.382420:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746066788.382422:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aaaaa00, rc 0) 00000100:00100000:1.0:1746066788.382440:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:31457:x1830882976812928:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 3421us (5242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.382444:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9914 00000100:00100000:0.0:1746066788.384353:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.384369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.384513:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.385992:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.387108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.387554:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.387568:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976814080 00000100:00100000:1.0:1746066788.387571:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976814080 00000100:00100000:1.0:1746066788.387761:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976814208 00000100:00100000:1.0:1746066788.387764:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976814208 00000100:00100000:0.0:1746066788.387837:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14276 00000100:00100000:0.0:1746066788.387847:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:1963:x1830882976814080:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066788.387854:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066788.387861:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800925a3000/0xfb36a14ee608a9fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dee0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066788.387883:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976798848:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066788.387911:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066788.390552:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976798848:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066788.390568:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800925a3000/0xfb36a14ee608a9fe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dee0 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.390576:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800925a3000/0xfb36a14ee608a9fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dee0 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.390585:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925a3000, rc 0) 00000100:00100000:1.0:1746066788.390600:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+8:1963:x1830882976814080:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2758us (3495us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066788.390606:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14276 00000100:00100000:0.0:1746066788.395118:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.395983:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.403556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.403593:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.403621:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.403634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.403657:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.403704:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.404408:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14282 00000100:00100000:1.0:1746066788.404414:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882976814720:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:1.0:1746066788.404432:0:21973:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009aaaa000/0xfb36a14ee608aa3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.404441:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608a7c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd74 expref: 21 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.404448:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4892600/0xfb36a14ee608a980 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de7e expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.404454:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8646e00/0xfb36a14ee608a829 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddb3 expref: 9 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.404458:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.404460:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.404461:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009aaaa000/0xfb36a14ee608aa3d lrc: 6/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.404480:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8646e00/0xfb36a14ee608a829 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddb3 expref: 9 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.404488:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8646e00/0xfb36a14ee608a829 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddb3 expref: 9 pid: 9776 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746066788.404495:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976799488:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066788.405825:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4892600/0xfb36a14ee608a980 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de7e expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.405837:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4892600/0xfb36a14ee608a980 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de7e expref: 9 pid: 8450 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746066788.405845:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976799872:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066788.405870:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608a7c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd74 expref: 21 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.405876:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608a7c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dd74 expref: 21 pid: 21973 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746066788.405883:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976800128:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066788.405898:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066788.406322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.424354:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976799488:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066788.424914:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.424929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.424952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.424964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.424975:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.424988:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976815744 00000100:00100000:1.0:1746066788.424992:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976815744 00010000:00010000:1.0:1746066788.425013:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e83a00/0xfb36a14ee608a972 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de93 expref: 10 pid: 8112 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746066788.425027:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976816256 00000100:00100000:1.0:1746066788.425029:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976816256 00010000:00010000:1.0:1746066788.425037:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099790c00/0xfb36a14ee608a987 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dea1 expref: 9 pid: 8452 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746066788.425044:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976816384 00000100:00100000:1.0:1746066788.425045:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976816384 00010000:00010000:1.0:1746066788.425053:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8646e00/0xfb36a14ee608a829 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddb3 expref: 10 pid: 9776 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746066788.425059:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976816128 00000100:00100000:1.0:1746066788.425061:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976816128 00010000:00010000:1.0:1746066788.425066:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a32800/0xfb36a14ee608a8a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ddeb expref: 11 pid: 9776 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.425072:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976816512 00000100:00100000:1.0:1746066788.425073:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976816512 00010000:00010000:1.0:1746066788.425077:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4892600/0xfb36a14ee608a980 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de7e expref: 11 pid: 8450 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746066788.425085:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7290 00000100:00100000:1.0:1746066788.425089:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1965:x1830882976815744:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066788.425098:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066788.425111:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e83a00/0xfb36a14ee608a972 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de93 expref: 11 pid: 8112 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746066788.425118:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e83a00/0xfb36a14ee608a972 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de93 expref: 11 pid: 8112 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746066788.425134:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e83a00/0xfb36a14ee608a972 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de93 expref: 11 pid: 8112 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746066788.425150:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066788.425167:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1965:x1830882976815744:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 78us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.425172:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7290 00000100:00100000:1.0:1746066788.425198:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7291 00000100:00100000:1.0:1746066788.425203:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1965:x1830882976816256:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066788.425209:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066788.425531:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4892600/0xfb36a14ee608a980 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de7e expref: 8 pid: 8450 timeout: 849 lvb_type: 1 00000100:00100000:0.0:1746066788.425552:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976799872:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066788.425562:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976800128:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066788.425608:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099790c00/0xfb36a14ee608a987 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dea1 expref: 9 pid: 8452 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746066788.425615:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099790c00/0xfb36a14ee608a987 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dea1 expref: 9 pid: 8452 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746066788.425625:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099790c00/0xfb36a14ee608a987 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dea1 expref: 9 pid: 8452 timeout: 849 lvb_type: 1 00010000:00010000:1.0:1746066788.425635:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066788.425655:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882976816256:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 452us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.425659:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7291 00000100:00100000:1.0:1746066788.425698:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.425740:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.425759:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.425786:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066788.425913:0:21973:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009aaaa000/0xfb36a14ee608aa3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066788.428045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.431337:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.431367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066788.433038:0:21973:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009aaaa000/0xfb36a14ee608aa3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.433047:0:21973:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009aaaa000/0xfb36a14ee608aa3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.433063:0:21973:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009aaaa000/0xfb36a14ee608aa3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.433070:0:21973:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009aaaa000/0xfb36a14ee608aa3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.433076:0:21973:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009aaaa000/0xfb36a14ee608aa3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.433082:0:21973:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aaaa000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066788.433085:0:21973:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009aaaa000/0xfb36a14ee608aa3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.433096:0:21973:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009aaaa000/0xfb36a14ee608aa3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.433106:0:21973:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009aaaa000/0xfb36a14ee608aa3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.433111:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009aaaa000/0xfb36a14ee608aa3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066788.433148:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1966:x1830882976814720:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 28734us (29512us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.433154:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14282 00000100:00100000:1.0:1746066788.434089:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.434106:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.434137:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.434211:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976816896 00000100:00100000:0.0:1746066788.434214:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976816896 00010000:00010000:0.0:1746066788.434233:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f319400/0xfb36a14ee608a8ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de15 expref: 20 pid: 8452 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746066788.434246:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976817152 00000100:00100000:0.0:1746066788.434248:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976817152 00010000:00010000:0.0:1746066788.434255:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608a8bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de07 expref: 9 pid: 8452 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746066788.434265:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976817536 00000100:00100000:0.0:1746066788.434267:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976817536 00010000:00010000:0.0:1746066788.434273:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85bfe00/0xfb36a14ee608a933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de62 expref: 21 pid: 9776 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746066788.434288:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7299 00000100:00100000:0.0:1746066788.434293:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882976816896:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066788.434300:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066788.434310:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f319400/0xfb36a14ee608a8ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de15 expref: 21 pid: 8452 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.434317:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f319400/0xfb36a14ee608a8ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de15 expref: 21 pid: 8452 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.434327:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f319400/0xfb36a14ee608a8ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de15 expref: 21 pid: 8452 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.434337:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066788.434350:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882976816896:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 58us (2983us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.434355:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7299 00000100:00100000:0.0:1746066788.434363:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7300 00000100:00100000:0.0:1746066788.434367:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+9:1965:x1830882976817152:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066788.434372:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066788.434376:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608a8bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de07 expref: 9 pid: 8452 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.434383:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608a8bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de07 expref: 9 pid: 8452 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.434395:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608a8bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de07 expref: 9 pid: 8452 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.434401:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.434403:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.434405:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4892400/0xfb36a14ee608aa36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.434411:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4892400/0xfb36a14ee608aa36 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.434423:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066788.434431:0:21203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4892400/0xfb36a14ee608aa36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.434436:0:21203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4892400/0xfb36a14ee608aa36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.434446:0:21203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4892400/0xfb36a14ee608aa36 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.434451:0:21203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4892400/0xfb36a14ee608aa36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.434456:0:21203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4892400/0xfb36a14ee608aa36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.434465:0:21203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4892400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066788.434467:0:21203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4892400/0xfb36a14ee608aa36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.434472:0:21203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4892400/0xfb36a14ee608aa36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.434479:0:21203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4892400/0xfb36a14ee608aa36 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.434484:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4892400/0xfb36a14ee608aa36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066788.434510:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1966:x1830882976815360:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 30184us (30888us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.434515:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14281 00000100:00100000:0.0:1746066788.434531:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:1965:x1830882976817152:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 164us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.434535:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7300 00000100:00100000:0.0:1746066788.434541:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7301 00000100:00100000:0.0:1746066788.434546:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1965:x1830882976817536:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066788.434550:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066788.434558:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a85bfe00/0xfb36a14ee608a933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de62 expref: 19 pid: 9776 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.434568:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a85bfe00/0xfb36a14ee608a933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de62 expref: 19 pid: 9776 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.434578:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a85bfe00/0xfb36a14ee608a933 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de62 expref: 19 pid: 9776 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.434585:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.434586:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.434591:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4892200/0xfb36a14ee608aa0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97def5 expref: 7 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.434598:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4892200/0xfb36a14ee608aa0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97def5 expref: 7 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.434615:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4892200/0xfb36a14ee608aa0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97def5 expref: 7 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.434622:0:7109:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4892200/0xfb36a14ee608aa0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97def5 expref: 7 pid: 20532 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746066788.434630:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976801024:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066788.434663:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066788.442548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.443260:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976801024:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066788.443273:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066788.443303:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1965:x1830882976817536:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8756us (9164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.443312:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7301 00000100:00100000:0.0:1746066788.443332:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976817664 00000100:00100000:0.0:1746066788.443337:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976817664 00010000:00010000:0.0:1746066788.443357:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1800/0xfb36a14ee608aa1a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97deee expref: 15 pid: 809 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746066788.443388:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7302 00000100:00100000:0.0:1746066788.443394:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1963:x1830882976817664:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066788.443404:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066788.443408:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1800/0xfb36a14ee608aa1a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97deee expref: 15 pid: 809 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.443417:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1800/0xfb36a14ee608aa1a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97deee expref: 15 pid: 809 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.443854:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066788.443952:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1800/0xfb36a14ee608aa1a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97deee expref: 15 pid: 809 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.444083:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066788.444087:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009904d200/0xfb36a14ee608aa67 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066788.444095:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009904d200/0xfb36a14ee608aa67 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066788.444101:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009904d200/0xfb36a14ee608aa67 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066788.444125:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066788.444143:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882976817664:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 749us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.444147:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7302 00000100:00100000:0.0:1746066788.457376:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.457396:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976818048 00000100:00100000:0.0:1746066788.457402:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976818048 00010000:00010000:0.0:1746066788.457429:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e83c00/0xfb36a14ee608a94f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de70 expref: 18 pid: 9776 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746066788.457462:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7303 00000100:00100000:0.0:1746066788.457469:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1966:x1830882976818048:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066788.457480:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066788.457495:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e83c00/0xfb36a14ee608a94f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de70 expref: 18 pid: 9776 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.457504:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e83c00/0xfb36a14ee608a94f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de70 expref: 18 pid: 9776 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.457521:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e83c00/0xfb36a14ee608a94f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1425407) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97de70 expref: 18 pid: 9776 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.457533:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.457534:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.457538:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099790600/0xfb36a14ee608aa44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.457550:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099790600/0xfb36a14ee608aa44 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.457567:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066788.457587:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1966:x1830882976818048:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 119us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.457592:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7303 00000100:00100000:0.0:1746066788.461208:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.461236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.463730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.466350:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.466423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.468797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.470410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.471170:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.472243:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.475858:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.475888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.481368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.481556:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976820480 00000100:00100000:0.0:1746066788.481564:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976820480 00000100:00100000:0.0:1746066788.481602:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4120 00000100:00100000:0.0:1746066788.481608:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:31457:x1830882976820480:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:0.0:1746066788.481792:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:31457:x1830882976820480:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 183us (429us total) trans 8589943952 rc 0/0 00000100:00100000:0.0:1746066788.481797:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4120 00000100:00100000:1.0:1746066788.495932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.499897:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.536671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.544843:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.544878:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.544901:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.544919:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976821504 00000100:00100000:1.0:1746066788.544926:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976821504 00002000:00100000:1.0:1746066788.544961:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a8694e00 x1830882976821504/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.544970:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8694e00 with x1830882976821504 ext(2097152->3145727) 00002000:00010000:1.0:1746066788.544974:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8694e00 00000100:00100000:1.0:1746066788.545000:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976821760 00000100:00100000:1.0:1746066788.545002:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976821760 00002000:00100000:1.0:1746066788.545013:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a8696a00 x1830882976821760/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.545019:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8696a00 with x1830882976821760 ext(3145728->4194303) 00002000:00010000:1.0:1746066788.545022:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8696a00 00000100:00100000:1.0:1746066788.545031:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6446 00000100:00100000:1.0:1746066788.545037:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:1964:x1830882976821504:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066788.545411:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.545512:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.545530:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976822272 00000100:00100000:1.0:1746066788.545532:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976822272 00000100:00100000:1.0:1746066788.545550:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14289 00000100:00100000:1.0:1746066788.545554:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1964:x1830882976822272:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066788.545561:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.545575:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b19b400/0xfb36a14ee608aab4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97df26 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066788.545590:0:10402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd5f, atime: 0x6812dd5f, ctime: 0x6812dd60, blocks: 0x7e1 00010000:00010000:1.0:1746066788.545601:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.545603:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.545609:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b19b400/0xfb36a14ee608aab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df26 expref: 20 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.545620:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b19b400/0xfb36a14ee608aab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df26 expref: 20 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.545628:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19b400, rc 0) 00000100:00100000:1.0:1746066788.545671:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882976822272:12345-192.168.202.57@tcp:101:cat.0 Request processed in 116us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.545697:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14289 00000100:00100000:0.0:1746066788.548868:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976822144 00000100:00100000:0.0:1746066788.548877:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976822144 00002000:00100000:0.0:1746066788.548918:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4186111) req@ffff8800a8697100 x1830882976822144/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066788.548930:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8697100 with x1830882976822144 ext(3145728->4186111) 00002000:00010000:0.0:1746066788.548935:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8697100 00000100:00100000:0.0:1746066788.549028:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6449 00000100:00100000:0.0:1746066788.549037:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882976822144:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066788.550157:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.550174:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.550195:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.550597:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.551157:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976822656 00000100:00100000:1.0:1746066788.551160:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976822656 00000100:00100000:1.0:1746066788.551174:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14291 00000100:00100000:1.0:1746066788.551184:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1964:x1830882976822528:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066788.551192:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.551201:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608aac2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97df34 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.551214:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.551215:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.551219:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608aac2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df34 expref: 20 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.551228:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608aac2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df34 expref: 20 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.551234:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19b200, rc 0) 00000100:00100000:1.0:1746066788.551252:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882976822528:12345-192.168.202.57@tcp:101:cat.0 Request processed in 74us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.551257:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14291 00000100:00100000:1.0:1746066788.551266:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14293 00000100:00100000:1.0:1746066788.551269:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882976822656:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066788.551274:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.551280:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b19b800/0xfb36a14ee608aad0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97df3b expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.551287:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.551288:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.551291:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b19b800/0xfb36a14ee608aad0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df3b expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.551300:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b19b800/0xfb36a14ee608aad0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df3b expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.551306:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19b800, rc 0) 00000100:00100000:1.0:1746066788.551318:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882976822656:12345-192.168.202.57@tcp:101:cat.0 Request processed in 49us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.551323:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14293 00000100:00100000:1.0:1746066788.561767:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882976821504:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16724us (16926us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066788.561776:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6446 00002000:00100000:1.0:1746066788.561785:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a8694e00 x1830882976821504/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 488/440 e 0 to 0 dl 1746066799 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.561793:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8694e00 with x1830882976821504 ext(2097152->3145727) 00002000:00010000:1.0:1746066788.561797:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8694e00 00000100:00100000:0.0:1746066788.583300:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.583400:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.591494:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.591538:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.591610:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976823680 00000100:00100000:1.0:1746066788.591618:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976823680 00002000:00100000:1.0:1746066788.591664:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88008efb4380 x1830882976823680/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.591673:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb4380 with x1830882976823680 ext(1048576->2097151) 00002000:00010000:1.0:1746066788.591698:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb4380 00000100:00100000:1.0:1746066788.591723:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976823936 00000100:00100000:1.0:1746066788.591726:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976823936 00002000:00100000:1.0:1746066788.591738:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88008efb7b80 x1830882976823936/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.591750:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb7b80 with x1830882976823936 ext(1048576->2097151) 00002000:00010000:1.0:1746066788.591753:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb7b80 00000100:00100000:1.0:1746066788.591763:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6452 00000100:00100000:1.0:1746066788.591768:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882976823680:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066788.605208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.605334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.605385:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976824320 00000100:00100000:0.0:1746066788.605388:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976824320 00000100:00100000:0.0:1746066788.605409:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14296 00000100:00100000:0.0:1746066788.605415:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+10:1963:x1830882976824320:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066788.605421:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066788.605429:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009391e800/0xfb36a14ee608aae5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97df57 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.605441:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.605442:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.605447:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009391e800/0xfb36a14ee608aae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df57 expref: 11 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066788.605460:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009391e800/0xfb36a14ee608aae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df57 expref: 11 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066788.605466:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009391e800, rc 0) 00000100:00100000:0.0:1746066788.605481:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882976824320:12345-192.168.202.57@tcp:101:cat.0 Request processed in 67us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.605485:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14296 00000100:00100000:0.0:1746066788.619597:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.619611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.619658:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.619734:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976824576 00000100:00100000:0.0:1746066788.619738:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976824576 00010000:00010000:0.0:1746066788.619756:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009917b400/0xfb36a14ee608aaa6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df1f expref: 265 pid: 14548 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746066788.619773:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7306 00000100:00100000:0.0:1746066788.619780:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882976824704:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066788.619790:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066788.619795:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099791a00/0xfb36a14ee608a9db lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97debd expref: 20 pid: 809 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.619804:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099791a00/0xfb36a14ee608a9db lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97debd expref: 20 pid: 809 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.619822:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066788.619826:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4892200/0xfb36a14ee608aaf3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066788.619834:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4892200/0xfb36a14ee608aaf3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066788.619838:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066788.619869:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882976824704:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.619874:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7306 00000100:00100000:0.0:1746066788.619887:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7307 00000100:00100000:0.0:1746066788.619892:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:1963:x1830882976824576:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066788.619898:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066788.619901:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009917b400/0xfb36a14ee608aaa6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df1f expref: 265 pid: 14548 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.619908:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009917b400/0xfb36a14ee608aaa6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df1f expref: 265 pid: 14548 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.619917:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009917b400/0xfb36a14ee608aaa6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df1f expref: 265 pid: 14548 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.619930:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066788.619933:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4892200/0xfb36a14ee608aaf3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066788.619937:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4892200/0xfb36a14ee608aaf3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066788.619942:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066788.619955:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:1963:x1830882976824576:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 63us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.619960:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7307 00000100:00100000:0.0:1746066788.619971:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7308 00000100:00100000:0.0:1746066788.619976:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1966:x1830882976824832:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066788.619982:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066788.619985:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009aaaaa00/0xfb36a14ee608a9b1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97deaf expref: 15 pid: 14548 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.619992:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009aaaaa00/0xfb36a14ee608a9b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97deaf expref: 15 pid: 14548 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.620001:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066788.620003:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4892200/0xfb36a14ee608aaf3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066788.620009:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4892200/0xfb36a14ee608aaf3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066788.620014:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4892200/0xfb36a14ee608aaf3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066788.620027:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066788.620039:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1966:x1830882976824832:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 64us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.620043:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7308 00000100:00100000:0.0:1746066788.621211:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.621724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.639218:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976825472 00000100:00100000:1.0:1746066788.639225:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976825472 00000100:00100000:1.0:1746066788.639260:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14297 00000100:00100000:1.0:1746066788.639268:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882976825472:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066788.639281:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.639366:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e41a000/0xfb36a14ee608ab24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97df6c expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066788.639414:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976801792:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066788.639481:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066788.641001:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+11:1966:x1830882976825344:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18965us (19273us total) trans 0 rc 610304/610304 00000100:00100000:0.0:1746066788.641012:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6454 00002000:00100000:0.0:1746066788.641021:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4481024->5091327) req@ffff880135f80000 x1830882976825344/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 488/440 e 0 to 0 dl 1746066799 ref 1 fl Complete:/200/0 rc 610304/610304 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066788.641032:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f80000 with x1830882976825344 ext(4481024->5091327) 00002000:00010000:0.0:1746066788.641035:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135f80000 00000100:00100000:0.0:1746066788.648278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.648458:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976825856 00000100:00100000:1.0:1746066788.648465:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976825856 00000100:00100000:1.0:1746066788.648514:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4121 00000100:00100000:1.0:1746066788.648522:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:31461:x1830882976825856:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:1.0:1746066788.648898:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:31461:x1830882976825856:12345-192.168.202.57@tcp:35:cat.0 Request processed in 376us (627us total) trans 8589943956 rc 0/0 00000100:00100000:1.0:1746066788.648905:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4121 00000100:00100000:0.0:1746066788.653893:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.659735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.681972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.690420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.690516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.690598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.690632:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976826368 00000100:00100000:1.0:1746066788.690638:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976826368 00010000:00010000:1.0:1746066788.690697:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008deb0a00/0xfb36a14ee608aa83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df11 expref: 14 pid: 8112 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.690722:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976826496 00000100:00100000:1.0:1746066788.690725:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976826496 00010000:00010000:1.0:1746066788.690736:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e83200/0xfb36a14ee608aa8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df18 expref: 15 pid: 8450 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.690748:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976826624 00000100:00100000:1.0:1746066788.690750:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976826624 00010000:00010000:1.0:1746066788.690759:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b19b800/0xfb36a14ee608aad0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df3b expref: 22 pid: 4614 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746066788.690771:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7309 00000100:00100000:1.0:1746066788.690777:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882976826368:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066788.690787:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066788.690804:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008deb0a00/0xfb36a14ee608aa83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df11 expref: 15 pid: 8112 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.690813:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008deb0a00/0xfb36a14ee608aa83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df11 expref: 15 pid: 8112 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.690830:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008deb0a00/0xfb36a14ee608aa83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4481023) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df11 expref: 15 pid: 8112 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.690846:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.690848:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.690854:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ab32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df7a expref: 22 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.690860:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ab32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df7a expref: 22 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.691986:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ab32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df7a expref: 21 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066788.691994:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976802560:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066788.692017:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066788.694849:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976802560:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066788.694867:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066788.695149:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882976826368:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4370us (4733us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.695158:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7309 00000100:00100000:0.0:1746066788.695470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.695508:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.697103:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.702306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.702346:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.702429:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976827520 00000100:00100000:1.0:1746066788.702437:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976827520 00000100:00100000:1.0:1746066788.702475:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14302 00000100:00100000:1.0:1746066788.702482:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+12:31473:x1830882976827520:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066788.702498:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.702512:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608ab47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97df8f expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.702535:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ab32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df7a expref: 22 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.702546:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.702548:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.702551:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608ab47 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df8f expref: 13 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.702578:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ab32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df7a expref: 22 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.702587:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ab32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df7a expref: 22 pid: 10402 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.702597:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976802944:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066788.702664:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066788.705114:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.706507:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976802944:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066788.706525:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608ab47 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->2637823] (req 2097152->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df8f expref: 13 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.706534:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e41b600, rc 0) 00000100:00100000:1.0:1746066788.706554:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+13:31473:x1830882976827520:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4073us (4207us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.706559:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14302 00000100:00100000:0.0:1746066788.710071:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976827904 00000100:00100000:0.0:1746066788.710077:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976827904 00002000:00100000:0.0:1746066788.710111:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1937408->1941503) req@ffff880092709f80 x1830882976827904/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066788.710119:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092709f80 with x1830882976827904 ext(1937408->1941503) 00002000:00010000:0.0:1746066788.710122:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092709f80 00000100:00100000:0.0:1746066788.710137:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6457 00000100:00100000:0.0:1746066788.710145:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1966:x1830882976827904:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066788.710262:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1966:x1830882976827904:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 117us (255us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066788.710267:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6457 00002000:00100000:0.0:1746066788.710272:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1937408->1941503) req@ffff880092709f80 x1830882976827904/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:194/0 lens 488/4536 e 0 to 0 dl 1746066799 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066788.710279:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092709f80 with x1830882976827904 ext(1937408->1941503) 00002000:00010000:0.0:1746066788.710282:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092709f80 00000100:00100000:0.0:1746066788.710876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.710913:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976828032 00000100:00100000:1.0:1746066788.710916:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976828032 00000100:00100000:1.0:1746066788.710947:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14303 00000100:00100000:1.0:1746066788.710952:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:31468:x1830882976828032:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066788.710961:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.710974:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e41a400/0xfb36a14ee608ab4e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97df96 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.710995:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57c6600/0xfb36a14ee608aa75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df03 expref: 8 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.711001:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066788.711002:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066788.711005:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e41a400/0xfb36a14ee608ab4e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df96 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.711027:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57c6600/0xfb36a14ee608aa75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df03 expref: 8 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.711036:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57c6600/0xfb36a14ee608aa75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df03 expref: 8 pid: 8112 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.711045:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976803200:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066788.711105:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066788.713295:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.713934:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976803200:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066788.713955:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e41a400/0xfb36a14ee608ab4e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df96 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066788.713961:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066788.713966:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e41a400, rc 0) 00000100:00100000:0.0:1746066788.713991:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.713994:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:31468:x1830882976828032:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3042us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.714000:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14303 00000100:00100000:1.0:1746066788.714013:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976828416 00000100:00100000:1.0:1746066788.714015:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976828416 00000100:00100000:1.0:1746066788.714028:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14304 00000100:00100000:1.0:1746066788.714032:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:31471:x1830882976828416:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066788.714115:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.714126:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e41bc00/0xfb36a14ee608ab55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97df9d expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.714141:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57c7200/0xfb36a14ee608aa7c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df0a expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.714149:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608aac2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df34 expref: 21 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.714154:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.714156:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.714159:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e41bc00/0xfb36a14ee608ab55 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->1384447] (req 1048576->1384447) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df9d expref: 21 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.714178:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608aac2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df34 expref: 21 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.714186:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608aac2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df34 expref: 21 pid: 4614 timeout: 849 lvb_type: 1 00000100:00100000:1.0:1746066788.714196:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976803328:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066788.714253:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57c7200/0xfb36a14ee608aa7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df0a expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.714260:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57c7200/0xfb36a14ee608aa7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df0a expref: 8 pid: 4614 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.714267:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976803456:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066788.714285:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066788.714395:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976828288 00000100:00100000:1.0:1746066788.714398:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976828288 00002000:00100000:1.0:1746066788.714417:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (4186112->4194303) req@ffff88009e635f80 x1830882976828288/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 8680/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.714425:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e635f80 with x1830882976828288 ext(4186112->4194303) 00010000:00010000:1.0:1746066788.714430:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a57c6600/0xfb36a14ee608aa75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df03 expref: 9 pid: 8112 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.714438:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a57c6600/0xfb36a14ee608aa75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df03 expref: 9 pid: 8112 timeout: 849 lvb_type: 0 00002000:00010000:1.0:1746066788.714444:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e635f80 00000100:00100000:1.0:1746066788.714468:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2103 00000100:00100000:1.0:1746066788.714473:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+9:1963:x1830882976828288:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:1.0:1746066788.715002:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882976828288:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 471us (983us total) trans 21474840868 rc 0/0 00000100:00100000:1.0:1746066788.715009:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2103 00002000:00100000:1.0:1746066788.715015:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (4186112->4194303) req@ffff88009e635f80 x1830882976828288/t21474840868(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 8680/448 e 0 to 0 dl 1746066799 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.715022:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e635f80 with x1830882976828288 ext(4186112->4194303) 00010000:00010000:1.0:1746066788.715027:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a57c6600/0xfb36a14ee608aa75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df03 expref: 11 pid: 8112 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.715034:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a57c6600/0xfb36a14ee608aa75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df03 expref: 11 pid: 8112 timeout: 849 lvb_type: 0 00002000:00010000:1.0:1746066788.715039:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e635f80 00000100:00100000:1.0:1746066788.716151:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976803456:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066788.717339:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976803328:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066788.717361:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e41bc00/0xfb36a14ee608ab55 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->1384447] (req 1048576->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df9d expref: 21 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.717373:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e41bc00, rc 0) 00000100:00100000:1.0:1746066788.717397:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:31471:x1830882976828416:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3364us (3405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.717402:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14304 00000100:00100000:0.0:1746066788.719116:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976828544 00000100:00100000:0.0:1746066788.719123:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976828544 00010000:00010000:0.0:1746066788.719149:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608aac2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df34 expref: 21 pid: 4614 timeout: 849 lvb_type: 1 00000100:00100000:0.0:1746066788.719367:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7315 00000100:00100000:0.0:1746066788.719375:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882976828544:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066788.719386:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066788.719405:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608aac2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df34 expref: 21 pid: 4614 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746066788.719413:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608aac2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df34 expref: 21 pid: 4614 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746066788.719436:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608aac2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df34 expref: 21 pid: 4614 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746066788.719668:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066788.719722:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882976828544:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 348us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.719727:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7315 00000100:00100000:0.0:1746066788.725581:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.725627:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.725715:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976828800 00000100:00100000:1.0:1746066788.725723:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976828800 00010000:00010000:1.0:1746066788.725754:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57c6600/0xfb36a14ee608aa75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df03 expref: 11 pid: 8112 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.725776:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976828672 00000100:00100000:1.0:1746066788.725778:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976828672 00010000:00010000:1.0:1746066788.725786:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57c7200/0xfb36a14ee608aa7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df0a expref: 12 pid: 4614 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.725804:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7316 00000100:00100000:1.0:1746066788.725811:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882976828800:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066788.725823:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066788.725840:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57c6600/0xfb36a14ee608aa75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df03 expref: 12 pid: 8112 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.725850:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57c6600/0xfb36a14ee608aa75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df03 expref: 12 pid: 8112 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.725869:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57c6600/0xfb36a14ee608aa75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4186112->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df03 expref: 12 pid: 8112 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746066788.725911:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7317 00000100:00100000:0.0:1746066788.725922:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882976828672:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066788.725928:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066788.725937:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57c7200/0xfb36a14ee608aa7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df0a expref: 11 pid: 4614 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.725945:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57c7200/0xfb36a14ee608aa7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df0a expref: 11 pid: 4614 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.725955:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57c7200/0xfb36a14ee608aa7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df0a expref: 11 pid: 4614 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746066788.725965:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.725967:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.725973:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e41bc00/0xfb36a14ee608ab55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df9d expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.725984:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e41bc00/0xfb36a14ee608ab55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df9d expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.726010:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e41bc00/0xfb36a14ee608ab55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df9d expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066788.726020:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976803712:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066788.726073:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049a80 going to sleep for 11 seconds 00010000:00010000:1.0:1746066788.726895:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.726898:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.726904:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e41a400/0xfb36a14ee608ab4e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df96 expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.726912:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e41a400/0xfb36a14ee608ab4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df96 expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.726930:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e41a400/0xfb36a14ee608ab4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df96 expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066788.726938:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976803840:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066788.726961:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066788.733186:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.733751:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976829056 00000100:00100000:1.0:1746066788.733757:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976829056 00000100:00100000:1.0:1746066788.733784:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4122 00000100:00100000:1.0:1746066788.733789:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:31473:x1830882976829056:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:1.0:1746066788.733923:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:31473:x1830882976829056:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 133us (744us total) trans 8589943957 rc 0/0 00000100:00100000:1.0:1746066788.733928:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4122 00000100:00100000:1.0:1746066788.733947:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976803840:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066788.733954:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066788.733964:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:1964:x1830882976828800:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8154us (8392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.733969:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7316 00000100:00100000:0.0:1746066788.734107:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.734881:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976829312 00000100:00100000:1.0:1746066788.734886:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976829312 00002000:00100000:1.0:1746066788.734915:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800942d8700 x1830882976829312/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.734924:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942d8700 with x1830882976829312 ext(2097152->3145727) 00002000:00010000:1.0:1746066788.734927:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942d8700 00000100:00100000:0.0:1746066788.735358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.736560:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976829568 00000100:00100000:1.0:1746066788.736565:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976829568 00002000:00100000:1.0:1746066788.736583:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1380352->1384447) req@ffff8800942d9880 x1830882976829568/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.736590:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942d9880 with x1830882976829568 ext(1380352->1384447) 00002000:00010000:1.0:1746066788.736593:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942d9880 00000100:00100000:1.0:1746066788.736610:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6458 00000100:00100000:1.0:1746066788.736615:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882976829312:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066788.744893:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882976829312:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 8270us (10783us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066788.744904:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6458 00002000:00100000:1.0:1746066788.744913:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800942d8700 x1830882976829312/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:194/0 lens 488/440 e 0 to 0 dl 1746066799 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.744921:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942d8700 with x1830882976829312 ext(2097152->3145727) 00002000:00010000:1.0:1746066788.744926:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942d8700 00000100:00100000:0.0:1746066788.752524:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.752931:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976829696 00000100:00100000:1.0:1746066788.752939:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976829696 00000100:00100000:1.0:1746066788.752989:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14305 00000100:00100000:1.0:1746066788.752997:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:31468:x1830882976829696:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066788.753012:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.753029:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013510bc00/0xfb36a14ee608ab5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dfa4 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.753054:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608ab47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df8f expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.753060:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066788.753061:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066788.753064:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013510bc00/0xfb36a14ee608ab5c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfa4 expref: 21 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.753088:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608ab47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df8f expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.753097:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608ab47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df8f expref: 12 pid: 8112 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.753107:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976803968:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066788.753425:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066788.758367:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976803968:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066788.758395:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013510bc00/0xfb36a14ee608ab5c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfa4 expref: 21 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.758415:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013510bc00, rc 0) 00000100:00100000:1.0:1746066788.758453:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:31468:x1830882976829696:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5457us (5934us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.758461:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14305 00000100:00100000:0.0:1746066788.760594:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.760813:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976829824 00000100:00100000:1.0:1746066788.760821:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976829824 00002000:00100000:1.0:1746066788.760856:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2097152->2637823) req@ffff8800942da300 x1830882976829824/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.760864:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942da300 with x1830882976829824 ext(2097152->2637823) 00010000:00010000:1.0:1746066788.760873:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608ab47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df8f expref: 13 pid: 8112 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.760884:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608ab47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df8f expref: 13 pid: 8112 timeout: 849 lvb_type: 0 00002000:00010000:1.0:1746066788.760894:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942da300 00000100:00100000:1.0:1746066788.760924:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2104 00000100:00100000:1.0:1746066788.760931:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+13:1966:x1830882976829824:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:1.0:1746066788.766448:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882976829824:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 5509us (5852us total) trans 17179873552 rc 0/0 00000100:00100000:1.0:1746066788.766460:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2104 00002000:00100000:1.0:1746066788.766470:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2097152->2637823) req@ffff8800942da300 x1830882976829824/t17179873552(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 488/448 e 0 to 0 dl 1746066799 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.766478:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942da300 with x1830882976829824 ext(2097152->2637823) 00010000:00010000:1.0:1746066788.766487:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608ab47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df8f expref: 15 pid: 8112 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.766501:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608ab47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df8f expref: 15 pid: 8112 timeout: 849 lvb_type: 0 00002000:00010000:1.0:1746066788.766507:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800942da300 00000100:00100000:0.0:1746066788.770789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.770881:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976829952 00000100:00100000:1.0:1746066788.770889:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976829952 00010000:00010000:1.0:1746066788.770920:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608ab47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df8f expref: 15 pid: 8112 timeout: 849 lvb_type: 0 00000100:00100000:1.0:1746066788.770955:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7318 00000100:00100000:1.0:1746066788.770962:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882976829952:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066788.770976:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066788.770992:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608ab47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df8f expref: 15 pid: 8112 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.771002:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608ab47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df8f expref: 15 pid: 8112 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.771021:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608ab47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2637823) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df8f expref: 15 pid: 8112 timeout: 849 lvb_type: 0 00010000:00010000:1.0:1746066788.772254:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.772257:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066788.772266:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013510bc00/0xfb36a14ee608ab5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfa4 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.772275:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013510bc00/0xfb36a14ee608ab5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfa4 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.772310:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013510bc00/0xfb36a14ee608ab5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfa4 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066788.772321:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976804096:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066788.774273:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066788.780837:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976804096:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066788.780857:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066788.780905:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+14:1966:x1830882976829952:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 9942us (10120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.780916:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7318 00000100:00100000:0.0:1746066788.781292:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.781520:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976830336 00000100:00100000:1.0:1746066788.781526:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976830336 00002000:00100000:1.0:1746066788.781808:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800942dad80 x1830882976830336/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.781819:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942dad80 with x1830882976830336 ext(3145728->4194303) 00002000:00010000:1.0:1746066788.781823:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942dad80 00000100:00100000:1.0:1746066788.782084:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6460 00000100:00100000:1.0:1746066788.782092:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882976830336:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066788.789323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.791894:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882976830336:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 9798us (10598us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066788.791903:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6460 00002000:00100000:1.0:1746066788.791911:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800942dad80 x1830882976830336/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:194/0 lens 488/440 e 0 to 0 dl 1746066799 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.791920:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942dad80 with x1830882976830336 ext(3145728->4194303) 00002000:00010000:1.0:1746066788.791923:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942dad80 00000100:00100000:0.0:1746066788.809383:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.809601:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976830592 00000100:00100000:1.0:1746066788.809609:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976830592 00000100:00100000:1.0:1746066788.809703:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14306 00000100:00100000:1.0:1746066788.809711:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1965:x1830882976830592:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066788.809727:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.809741:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e200/0xfb36a14ee608ab63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dfab expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066788.809791:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976804224:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066788.810073:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed6c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746066788.810998:0:8112:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime: 1746066787 -> 1746066788 00002000:00010000:1.0:1746066788.811002:0:8112:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime: 1746066787 -> 1746066788 00002000:00010000:1.0:1746066788.811004:0:8112:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime: 1746066787 -> 1746066788 00000100:00100000:1.0:1746066788.811020:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976804224:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066788.811040:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e200/0xfb36a14ee608ab63 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfab expref: 22 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.811050:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e200/0xfb36a14ee608ab63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfab expref: 22 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.811071:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1e200, rc 0) 00000100:00100000:1.0:1746066788.811108:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1965:x1830882976830592:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1397us (1731us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066788.811114:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14306 00000100:00100000:0.0:1746066788.813437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.821128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.821188:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976830976 00000100:00100000:1.0:1746066788.821196:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976830976 00000100:00100000:1.0:1746066788.821248:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14307 00000100:00100000:1.0:1746066788.821255:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882976830976:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066788.821269:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.821284:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ea00/0xfb36a14ee608ab6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dfb2 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066788.821324:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976804352:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066788.821398:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066788.822598:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976804352:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066788.822620:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ea00/0xfb36a14ee608ab6a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfb2 expref: 22 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.822631:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ea00/0xfb36a14ee608ab6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfb2 expref: 22 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.822665:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1ea00, rc 0) 00000100:00100000:1.0:1746066788.822722:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882976830976:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1467us (1600us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066788.822728:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14307 00000100:00100000:0.0:1746066788.824278:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.824343:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976831104 00000100:00100000:1.0:1746066788.824349:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976831104 00000100:00100000:1.0:1746066788.824383:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14308 00000100:00100000:1.0:1746066788.824389:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882976831104:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066788.824400:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.824412:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f400/0xfb36a14ee608ab71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dfb9 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066788.824444:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976804480:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066788.824509:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066788.825909:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976804480:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066788.825931:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f400/0xfb36a14ee608ab71 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfb9 expref: 22 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.825947:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f400/0xfb36a14ee608ab71 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfb9 expref: 22 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.825956:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1f400, rc 0) 00000100:00100000:1.0:1746066788.825994:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882976831104:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1604us (1718us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066788.826000:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14308 00000100:00100000:0.0:1746066788.830095:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976831360 00000100:00100000:0.0:1746066788.830102:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976831360 00000100:00100000:0.0:1746066788.830149:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4123 00000100:00100000:0.0:1746066788.830156:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:31468:x1830882976831360:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:0.0:1746066788.830337:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:31468:x1830882976831360:12345-192.168.202.57@tcp:35:cat.0 Request processed in 180us (306us total) trans 8589943958 rc 0/0 00000100:00100000:0.0:1746066788.830344:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4123 00000100:00100000:0.0:1746066788.884543:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.888411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.888469:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976831744 00000100:00100000:1.0:1746066788.888476:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976831744 00000100:00100000:1.0:1746066788.888527:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 696 00000100:00100000:1.0:1746066788.888533:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882976831744:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066788.888545:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066788.888563:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b093c00/0xfb36a14ee608ab8d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfc0 expref: 25 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.889286:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066788.889290:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066788.889328:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882976831744:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 794us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.889334:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 696 00000100:00100000:0.0:1746066788.890290:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976832000 00000100:00100000:0.0:1746066788.890295:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976832000 00000100:00100000:0.0:1746066788.890328:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9924 00000100:00100000:0.0:1746066788.890334:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:31482:x1830882976832000:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066788.890351:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066788.890362:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36ac00/0xfb36a14ee608ab9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dfc7 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.890435:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36b800/0xfb36a14ee608aba2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890445:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36b800/0xfb36a14ee608aba2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890453:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36b800/0xfb36a14ee608aba2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890462:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba5600/0xfb36a14ee608aba9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890467:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba5600/0xfb36a14ee608aba9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890472:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba5600/0xfb36a14ee608aba9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890545:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba4200/0xfb36a14ee608abb0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890555:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba4200/0xfb36a14ee608abb0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890561:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba4200/0xfb36a14ee608abb0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746066788.890567:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066788.890625:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36b800/0xfb36a14ee608aba2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890631:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36b800/0xfb36a14ee608aba2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890648:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36b800/0xfb36a14ee608aba2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890653:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d36b800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066788.890656:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36b800/0xfb36a14ee608aba2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890661:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36b800/0xfb36a14ee608aba2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890667:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066788.890669:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066788.890672:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36b800/0xfb36a14ee608aba2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890707:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36b800/0xfb36a14ee608aba2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890720:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba5600/0xfb36a14ee608aba9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890728:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba5600/0xfb36a14ee608aba9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890732:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba5600/0xfb36a14ee608aba9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890736:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ba5600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066788.890738:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba5600/0xfb36a14ee608aba9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890742:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba5600/0xfb36a14ee608aba9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890747:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800901e3b00) 00010000:00010000:0.0:1746066788.890749:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066788.890751:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba5600/0xfb36a14ee608aba9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890755:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba5600/0xfb36a14ee608aba9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066788.890779:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d36ac00/0xfb36a14ee608ab9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfc7 expref: 27 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.890789:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ba4200/0xfb36a14ee608abb0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfc7 expref: 26 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.890795:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066788.890797:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066788.890799:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ba4200, rc 0) 00000100:00100000:0.0:1746066788.891531:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+26:31482:x1830882976832000:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1195us (1923us total) trans 8589943960 rc 0/0 00000100:00100000:0.0:1746066788.891538:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9924 00000100:00100000:1.0:1746066788.892289:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976832128 00000100:00100000:1.0:1746066788.892294:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976832128 00000100:00100000:1.0:1746066788.892325:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14309 00000100:00100000:1.0:1746066788.892330:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+9:31479:x1830882976832128:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066788.892341:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.892352:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e000/0xfb36a14ee608abbe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dfce expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.892371:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e41bc00/0xfb36a14ee608ab55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df9d expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.892378:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066788.892379:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066788.892383:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e000/0xfb36a14ee608abbe lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1695744->1818623] (req 1695744->1818623) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfce expref: 10 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.892404:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e41bc00/0xfb36a14ee608ab55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df9d expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.892413:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e41bc00/0xfb36a14ee608ab55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df9d expref: 19 pid: 8112 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746066788.892423:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976804608:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066788.892488:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066788.894358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.894390:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.894975:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976804608:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066788.894994:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e000/0xfb36a14ee608abbe lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1695744->1818623] (req 1695744->1818623) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfce expref: 10 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.895004:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1e000, rc 0) 00000100:00100000:1.0:1746066788.895022:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+10:31479:x1830882976832128:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2692us (3362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066788.895028:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14309 00000100:00100000:0.0:1746066788.898123:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.898825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.898841:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.898846:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976832512 00000100:00100000:1.0:1746066788.898852:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976832512 00000100:00100000:0.0:1746066788.898872:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.898889:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976832640 00000100:00100000:1.0:1746066788.898891:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976832640 00000100:00100000:1.0:1746066788.898898:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976832768 00000100:00100000:1.0:1746066788.898900:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976832768 00000100:00100000:0.0:1746066788.898906:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976832896 00000100:00100000:0.0:1746066788.898908:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976832896 00000100:00100000:1.0:1746066788.898915:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14310 00000100:00100000:1.0:1746066788.898921:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882976832512:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:0.0:1746066788.898930:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14311 00000100:00100000:0.0:1746066788.898934:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882976832768:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066788.898935:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066788.898939:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066788.898950:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba5600/0xfb36a14ee608abc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dfe3 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.898968:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.898969:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.898976:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba5600/0xfb36a14ee608abc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfe3 expref: 15 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066788.898989:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba5600/0xfb36a14ee608abc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfe3 expref: 15 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066788.898998:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ba5600, rc 0) 00000100:00100000:0.0:1746066788.899028:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882976832768:12345-192.168.202.57@tcp:101:cat.0 Request processed in 93us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.899033:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14311 00000100:00100000:0.0:1746066788.899046:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14312 00000100:00100000:0.0:1746066788.899051:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882976832896:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066788.899056:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066788.899063:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d36ac00/0xfb36a14ee608abcc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dfea expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066788.899073:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.899074:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066788.899078:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d36ac00/0xfb36a14ee608abcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfea expref: 13 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066788.899087:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d36ac00/0xfb36a14ee608abcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfea expref: 13 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066788.899094:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d36ac00, rc 0) 00000100:00100000:0.0:1746066788.899106:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882976832896:12345-192.168.202.57@tcp:101:cat.0 Request processed in 56us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066788.899111:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14312 00010000:00010000:1.0:1746066788.899177:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e800/0xfb36a14ee608abd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dfd5 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066788.899211:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976804736:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066788.899251:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066788.899273:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14313 00000100:00100000:1.0:1746066788.899278:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882976832640:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066788.899284:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.899289:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee1f400/0xfb36a14ee608abda lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dfdc expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066788.899309:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976804864:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066788.899327:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed240 going to sleep for 11 seconds 00002000:00010000:1.0:1746066788.902359:0:20532:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime: 1746066784 -> 1746066788 00000100:00100000:1.0:1746066788.902377:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976804736:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066788.902399:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e800/0xfb36a14ee608abd3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfd5 expref: 14 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.902415:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e800/0xfb36a14ee608abd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfd5 expref: 14 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066788.902427:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1e800, rc 0) 00000100:00100000:1.0:1746066788.902464:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882976832512:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3543us (4347us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066788.902470:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14310 00000100:00100000:0.0:1746066788.906730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.911382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.911473:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.920089:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.921415:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976833792 00000100:00100000:1.0:1746066788.921425:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976833792 00002000:00100000:1.0:1746066788.921462:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1814528->1818623) req@ffff88009a0d1180 x1830882976833792/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.921471:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d1180 with x1830882976833792 ext(1814528->1818623) 00002000:00010000:1.0:1746066788.921476:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a0d1180 00000100:00100000:1.0:1746066788.921507:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6465 00000100:00100000:1.0:1746066788.921722:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882976833792:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066788.921873:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882976833792:12345-192.168.202.57@tcp:3:cat.0 Request processed in 358us (1791us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066788.921879:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6465 00002000:00100000:1.0:1746066788.921884:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1814528->1818623) req@ffff88009a0d1180 x1830882976833792/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 488/4536 e 0 to 0 dl 1746066799 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.921891:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d1180 with x1830882976833792 ext(1814528->1818623) 00002000:00010000:1.0:1746066788.921894:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a0d1180 00000100:00100000:0.0:1746066788.923920:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.927843:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.931360:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.936727:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.944598:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976834944 00000100:00100000:1.0:1746066788.944604:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976834944 00002000:00100000:1.0:1746066788.944647:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880092709c00 x1830882976834944/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 504/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.944657:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092709c00 with x1830882976834944 ext(1048576->2097151) 00002000:00010000:1.0:1746066788.944661:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092709c00 00000100:00100000:1.0:1746066788.944706:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976835200 00000100:00100000:1.0:1746066788.944709:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976835200 00002000:00100000:1.0:1746066788.944721:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2072575) req@ffff88009270aa00 x1830882976835200/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:194/0 lens 488/0 e 0 to 0 dl 1746066799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066788.944729:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009270aa00 with x1830882976835200 ext(1048576->2072575) 00002000:00010000:1.0:1746066788.944732:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009270aa00 00000100:00100000:0.0:1746066788.995081:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.995174:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976835456 00000100:00100000:1.0:1746066788.995182:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976835456 00000100:00100000:1.0:1746066788.995233:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9925 00000100:00100000:1.0:1746066788.995241:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:31485:x1830882976835456:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066788.995261:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066788.995276:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209800/0xfb36a14ee608abe8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dff8 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.995371:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608abef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995381:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608abef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995390:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608abef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995398:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208200/0xfb36a14ee608abf6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995403:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208200/0xfb36a14ee608abf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995407:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208200/0xfb36a14ee608abf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995478:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608abfd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995485:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608abfd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995489:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608abfd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066788.995496:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066788.995553:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608abef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995558:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608abef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995563:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608abef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995567:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f209200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066788.995570:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608abef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995574:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608abef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995581:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066788.995584:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066788.995587:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608abef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995592:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608abef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995616:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208200/0xfb36a14ee608abf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995620:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208200/0xfb36a14ee608abf6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995624:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208200/0xfb36a14ee608abf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995628:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f208200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066788.995630:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208200/0xfb36a14ee608abf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995634:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208200/0xfb36a14ee608abf6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995648:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b4323f00) 00010000:00010000:1.0:1746066788.995649:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066788.995651:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208200/0xfb36a14ee608abf6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995655:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208200/0xfb36a14ee608abf6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066788.995709:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209800/0xfb36a14ee608abe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dff8 expref: 268 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.995728:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608abfd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dff8 expref: 267 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066788.995734:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066788.995736:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066788.995737:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f208600, rc 0) 00000100:00100000:1.0:1746066788.995777:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:31485:x1830882976835456:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 537us (703us total) trans 8589943962 rc 0/0 00000100:00100000:1.0:1746066788.995783:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9925 00000100:00100000:0.0:1746066788.997877:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.997915:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.997941:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066788.997963:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066788.998621:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6472 00000100:00100000:1.0:1746066788.998627:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1965:x1830882976836480:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066789.004071:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.060803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.063056:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976836992 00000100:00100000:1.0:1746066789.063068:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976836992 00000100:00100000:1.0:1746066789.063221:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9926 00000100:00100000:1.0:1746066789.063232:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+26:31487:x1830882976836992:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066789.063257:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.063275:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092610e00/0xfb36a14ee608ac0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97dfff expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.063371:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092610000/0xfb36a14ee608ac12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063384:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092610000/0xfb36a14ee608ac12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063393:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092610000/0xfb36a14ee608ac12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063407:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092610200/0xfb36a14ee608ac19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063413:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092610200/0xfb36a14ee608ac19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063418:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092610200/0xfb36a14ee608ac19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063524:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092611600/0xfb36a14ee608ac20 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063534:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092611600/0xfb36a14ee608ac20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063540:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092611600/0xfb36a14ee608ac20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066789.063549:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066789.063634:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092610000/0xfb36a14ee608ac12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063653:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092610000/0xfb36a14ee608ac12 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063659:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092610000/0xfb36a14ee608ac12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063664:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092610000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066789.063667:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092610000/0xfb36a14ee608ac12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063673:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092610000/0xfb36a14ee608ac12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063740:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066789.063743:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066789.063747:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092610000/0xfb36a14ee608ac12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063752:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092610000/0xfb36a14ee608ac12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063771:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092610200/0xfb36a14ee608ac19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063777:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092610200/0xfb36a14ee608ac19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063781:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092610200/0xfb36a14ee608ac19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063784:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092610200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066789.063787:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092610200/0xfb36a14ee608ac19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063791:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092610200/0xfb36a14ee608ac19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063798:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b4323f00) 00010000:00010000:1.0:1746066789.063799:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066789.063802:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092610200/0xfb36a14ee608ac19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063806:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092610200/0xfb36a14ee608ac19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.063843:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092610e00/0xfb36a14ee608ac0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfff expref: 29 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.063856:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092611600/0xfb36a14ee608ac20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfff expref: 28 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.063863:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066789.063865:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066789.063868:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092611600, rc 0) 00000100:00100000:1.0:1746066789.063933:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+28:31487:x1830882976836992:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 702us (3136us total) trans 8589943964 rc 0/0 00000100:00100000:1.0:1746066789.063940:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9926 00000100:00100000:0.0:1746066789.066596:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.068924:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.074908:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.078387:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.078437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.078475:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.078510:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.078792:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976837888 00000100:00100000:1.0:1746066789.078800:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976837888 00000100:00100000:1.0:1746066789.078843:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976838016 00000100:00100000:1.0:1746066789.078846:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976838016 00000100:00100000:1.0:1746066789.078858:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976838144 00000100:00100000:1.0:1746066789.078860:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976838144 00000100:00100000:1.0:1746066789.078880:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14315 00000100:00100000:1.0:1746066789.078887:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882976837888:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066789.078903:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.078920:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092610600/0xfb36a14ee608ac51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e00d expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.078941:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.078942:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.078950:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092610600/0xfb36a14ee608ac51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e00d expref: 24 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066789.078964:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092610600/0xfb36a14ee608ac51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e00d expref: 24 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066789.078974:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092610600, rc 0) 00000100:00100000:1.0:1746066789.079014:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882976837888:12345-192.168.202.57@tcp:101:cat.0 Request processed in 128us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.079020:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14315 00000100:00100000:1.0:1746066789.079038:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14316 00000100:00100000:1.0:1746066789.079043:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882976838016:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066789.079049:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.079055:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092611c00/0xfb36a14ee608ac58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e014 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066789.079090:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976805376:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066789.079150:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed540 going to sleep for 11 seconds 00000100:00080000:1.0:1746066789.079166:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746066789.079169:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066789.079263:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14317 00000100:00100000:1.0:1746066789.079268:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882976838144:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066789.079276:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.079286:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092610200/0xfb36a14ee608ac5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e01b expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066789.079308:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976805504:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066789.079333:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066789.079758:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882976837504:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10640us (10833us total) trans 0 rc 897024/897024 00000100:00100000:1.0:1746066789.079768:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6473 00002000:00100000:1.0:1746066789.079777:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a45e7480 x1830882976837504/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/440 e 0 to 0 dl 1746066800 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.079784:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e7480 with x1830882976837504 ext(4194304->5091327) 00002000:00010000:1.0:1746066789.079788:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a45e7480 00000100:00100000:1.0:1746066789.081646:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976805504:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066789.081667:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092610200/0xfb36a14ee608ac5f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e01b expref: 22 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066789.081700:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092610200/0xfb36a14ee608ac5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e01b expref: 22 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066789.081712:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092610200, rc 0) 00000100:00100000:1.0:1746066789.081878:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882976838144:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2607us (3365us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066789.081886:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14317 00000100:00100000:0.0:1746066789.094034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.094491:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976838400 00000100:00100000:1.0:1746066789.094499:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976838400 00002000:00100000:1.0:1746066789.094535:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009ed72300 x1830882976838400/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066789.094540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:1.0:1746066789.094544:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed72300 with x1830882976838400 ext(1048576->2097151) 00002000:00010000:1.0:1746066789.094549:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed72300 00000100:00100000:1.0:1746066789.094578:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6474 00000100:00100000:1.0:1746066789.094585:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882976838400:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066789.096094:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066789.098352:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066789.098392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.101465:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976805632:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066789.101487:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608ac7b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.101737:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608ac7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.101744:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608ac7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746066789.101775:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:0.0:1746066789.101779:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746066789.101790:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608ac7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.101798:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608ac7b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.101806:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608ac6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.101811:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608ac6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.101815:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608ac6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.101819:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f209000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066789.101822:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608ac6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.101827:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608ac6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.101835:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066789.101837:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066789.101839:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608ac6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.101843:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608ac6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.101859:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608ac74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.101863:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608ac74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.101867:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608ac74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746066789.102088:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882976838400:12345-192.168.202.57@tcp:3:cat.0 Request processed in 7502us (8060us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066789.102095:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6474 00002000:00100000:1.0:1746066789.102102:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009ed72300 x1830882976838400/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/440 e 0 to 0 dl 1746066800 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.102109:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed72300 with x1830882976838400 ext(1048576->2097151) 00002000:00010000:1.0:1746066789.102113:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed72300 00010000:00010000:0.0:1746066789.106560:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f209600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066789.106568:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608ac74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.106578:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608ac74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.106593:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012dc13300) 00010000:00010000:0.0:1746066789.106595:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066789.106598:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608ac74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.106603:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608ac74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066789.106663:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208a00/0xfb36a14ee608ac66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e029 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.106691:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608ac7b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e029 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.106696:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066789.106698:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066789.106700:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f208000, rc 0) 00000100:00100000:0.0:1746066789.106756:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:31491:x1830882976838656:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 10453us (10665us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066789.106764:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9928 00000100:00100000:0.0:1746066789.110003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.110057:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976839168 00000100:00100000:1.0:1746066789.110064:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976839168 00000100:00100000:0.0:1746066789.110081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.110100:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976839296 00000100:00080000:0.0:1746066789.110100:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066789.110102:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976839296 00000100:00100000:1.0:1746066789.110138:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14319 00000100:00100000:1.0:1746066789.110145:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1964:x1830882976839296:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066789.110159:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.110173:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800925dd400/0xfb36a14ee608ac89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e030 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.110190:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.110192:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.110199:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925dd400/0xfb36a14ee608ac89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e030 expref: 6 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066789.110210:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800925dd400/0xfb36a14ee608ac89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e030 expref: 6 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066789.110217:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925dd400, rc 0) 00000100:00100000:1.0:1746066789.110249:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882976839296:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 105us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.110254:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14319 00002000:00100000:1.0:1746066789.110292:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1695744->1818623) req@ffff88009ed71c00 x1830882976839168/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.110299:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed71c00 with x1830882976839168 ext(1695744->1818623) 00010000:00010000:1.0:1746066789.110650:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e000/0xfb36a14ee608abbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfce expref: 12 pid: 8112 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.110661:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e000/0xfb36a14ee608abbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfce expref: 12 pid: 8112 timeout: 850 lvb_type: 0 00002000:00010000:1.0:1746066789.110667:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed71c00 00000100:00100000:1.0:1746066789.110696:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2107 00000100:00100000:1.0:1746066789.110703:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:1966:x1830882976839168:12345-192.168.202.57@tcp:4:cat.0 00000100:00080000:0.0:1746066789.110758:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746066789.111163:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066789.111926:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.114431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.117063:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:1966:x1830882976839168:12345-192.168.202.57@tcp:4:cat.0 Request processed in 6354us (7060us total) trans 21474840871 rc 0/0 00000100:00100000:1.0:1746066789.117073:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2107 00002000:00100000:1.0:1746066789.117083:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1695744->1818623) req@ffff88009ed71c00 x1830882976839168/t21474840871(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/448 e 0 to 0 dl 1746066800 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.117093:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed71c00 with x1830882976839168 ext(1695744->1818623) 00010000:00010000:1.0:1746066789.117101:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e000/0xfb36a14ee608abbe lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfce expref: 14 pid: 8112 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.117118:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e000/0xfb36a14ee608abbe lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->1818623) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfce expref: 14 pid: 8112 timeout: 850 lvb_type: 0 00002000:00010000:1.0:1746066789.117124:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed71c00 00000100:00100000:0.0:1746066789.117281:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.119844:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976840064 00000100:00100000:1.0:1746066789.119852:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976840064 00000100:00100000:0.0:1746066789.119870:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.120651:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.124438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.131758:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.131804:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.131876:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976840704 00000100:00100000:1.0:1746066789.131884:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976840704 00000100:00100000:1.0:1746066789.131921:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9929 00000100:00100000:1.0:1746066789.131927:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:31491:x1830882976840704:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066789.131944:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.131959:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925dcc00/0xfb36a14ee608acba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e061 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.132033:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925dd200/0xfb36a14ee608acc1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.132045:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608ac7b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e029 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.132051:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925dd200/0xfb36a14ee608acc1 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.132076:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608ac7b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e029 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.132084:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608ac7b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e029 expref: 16 pid: 14548 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746066789.132098:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976806400:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066789.132157:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066789.132173:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976840448 00000100:00100000:1.0:1746066789.132175:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976840448 00002000:00100000:1.0:1746066789.132195:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1634304->1638399) req@ffff88009ed71500 x1830882976840448/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.132203:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed71500 with x1830882976840448 ext(1634304->1638399) 00010000:00010000:1.0:1746066789.132210:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b093800/0xfb36a14ee608ac82 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e022 expref: 25 pid: 20532 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.132219:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b093800/0xfb36a14ee608ac82 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e022 expref: 25 pid: 20532 timeout: 850 lvb_type: 0 00002000:00010000:1.0:1746066789.132225:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed71500 00000100:00100000:1.0:1746066789.132236:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2108 00000100:00100000:1.0:1746066789.132241:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882976840448:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066789.132352:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882976840448:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 110us (548us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066789.132358:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2108 00002000:00100000:1.0:1746066789.132363:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1634304->1638399) req@ffff88009ed71500 x1830882976840448/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/4536 e 0 to 0 dl 1746066800 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.132369:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed71500 with x1830882976840448 ext(1634304->1638399) 00010000:00010000:1.0:1746066789.132373:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b093800/0xfb36a14ee608ac82 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e022 expref: 25 pid: 20532 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.132381:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b093800/0xfb36a14ee608ac82 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e022 expref: 25 pid: 20532 timeout: 850 lvb_type: 0 00002000:00010000:1.0:1746066789.132386:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed71500 00000100:00100000:0.0:1746066789.137008:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066789.139012:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608ac7b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e029 expref: 17 pid: 14548 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746066789.139351:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976806400:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066789.139368:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800925dd200/0xfb36a14ee608acc1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.139374:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800925dd200/0xfb36a14ee608acc1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.139378:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925dd200/0xfb36a14ee608acc1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066789.139392:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066789.139504:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925dcc00/0xfb36a14ee608acba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e061 expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.139520:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925dd200/0xfb36a14ee608acc1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e061 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.139527:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066789.139529:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066789.139531:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925dd200, rc 0) 00000100:00100000:1.0:1746066789.139557:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:31491:x1830882976840704:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 7631us (7807us total) trans 8589943967 rc 0/0 00000100:00100000:1.0:1746066789.139564:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9929 00000100:00100000:0.0:1746066789.142235:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.143380:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976841088 00000100:00100000:1.0:1746066789.143389:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976841088 00002000:00100000:1.0:1746066789.143427:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38e:0x0] (1634304->2097151) req@ffff88009ed70700 x1830882976841088/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.143436:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed70700 with x1830882976841088 ext(1634304->2097151) 00010000:00010000:1.0:1746066789.143444:0:31365:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b093800/0xfb36a14ee608ac82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e022 expref: 25 pid: 20532 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.143456:0:31365:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b093800/0xfb36a14ee608ac82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e022 expref: 25 pid: 20532 timeout: 850 lvb_type: 0 00002000:00010000:1.0:1746066789.143462:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed70700 00000100:00100000:0.0:1746066789.143981:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.144057:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976841344 00000100:00100000:1.0:1746066789.144061:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976841344 00000100:00100000:1.0:1746066789.144083:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9930 00000100:00100000:1.0:1746066789.144089:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:31491:x1830882976841344:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066789.144105:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.144107:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066789.144126:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925dd200/0xfb36a14ee608acc1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e061 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.144142:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066789.144145:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066789.144154:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608accf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e068 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.144228:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608acd6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.144238:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608acd6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.144244:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608acd6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.144253:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608acd6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.144257:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608acd6 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.144262:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608acd6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.144267:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b5f800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066789.144270:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608acd6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.144275:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608acd6 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.144280:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066789.144282:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066789.144284:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608acd6 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.144288:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608acd6 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.144307:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608accf lrc: 1/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e068 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.144312:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608accf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e068 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.144318:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5e600, rc 0) 00000100:00100000:1.0:1746066789.146280:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:31491:x1830882976841344:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 2186us (2296us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066789.146287:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9930 00000100:00100000:0.0:1746066789.150281:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.151010:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.151060:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976841856 00000100:00100000:1.0:1746066789.151064:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976841856 00002000:00100000:1.0:1746066789.151083:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x390:0x0] (2072576->2097151) req@ffff88009ed73800 x1830882976841856/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.151091:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73800 with x1830882976841856 ext(2072576->2097151) 00010000:00010000:1.0:1746066789.151097:0:31365:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ab39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df81 expref: 15 pid: 10402 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.151107:0:31365:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ab39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df81 expref: 15 pid: 10402 timeout: 850 lvb_type: 0 00002000:00010000:1.0:1746066789.151113:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed73800 00000100:00100000:1.0:1746066789.151126:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2110 00000100:00100000:1.0:1746066789.151130:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882976841856:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066789.153481:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882976841856:12345-192.168.202.57@tcp:4:cat.0 Request processed in 2343us (2464us total) trans 17179873553 rc 0/0 00000100:00100000:1.0:1746066789.153490:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2110 00002000:00100000:1.0:1746066789.153499:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x390:0x0] (2072576->2097151) req@ffff88009ed73800 x1830882976841856/t17179873553(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/448 e 0 to 0 dl 1746066800 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.153507:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73800 with x1830882976841856 ext(2072576->2097151) 00010000:00010000:1.0:1746066789.153514:0:31365:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ab39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df81 expref: 17 pid: 10402 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.153524:0:31365:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ab39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df81 expref: 17 pid: 10402 timeout: 850 lvb_type: 0 00002000:00010000:1.0:1746066789.153529:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed73800 00000100:00100000:0.0:1746066789.166455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.171922:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.172044:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976842112 00000100:00100000:1.0:1746066789.172051:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976842112 00010000:00010000:1.0:1746066789.172079:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ab39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df81 expref: 17 pid: 10402 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746066789.172103:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7325 00000100:00100000:1.0:1746066789.172110:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882976842112:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066789.172121:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066789.172139:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ab39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df81 expref: 17 pid: 10402 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.172150:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ab39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df81 expref: 17 pid: 10402 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.172175:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ab39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df81 expref: 17 pid: 10402 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746066789.172239:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066789.172661:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.172663:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.172670:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f209400/0xfb36a14ee608acdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e06f expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.172696:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f209400/0xfb36a14ee608acdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e06f expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.172723:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f209400/0xfb36a14ee608acdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e06f expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066789.173089:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976806784:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066789.173104:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066789.180151:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976806784:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066789.180168:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066789.180214:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882976842112:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8103us (8297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.180225:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7325 00000100:00100000:1.0:1746066789.184754:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976842880 00000100:00100000:1.0:1746066789.184758:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976842880 00002000:00100000:1.0:1746066789.184779:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x390:0x0] (1126400->1130495) req@ffff88009a4eea00 x1830882976842880/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.184791:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4eea00 with x1830882976842880 ext(1126400->1130495) 00002000:00010000:1.0:1746066789.184794:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4eea00 00000100:00100000:1.0:1746066789.184811:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6476 00000100:00100000:1.0:1746066789.184815:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882976842880:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066789.184929:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882976842880:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 113us (905us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066789.184934:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6476 00002000:00100000:1.0:1746066789.184938:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x390:0x0] (1126400->1130495) req@ffff88009a4eea00 x1830882976842880/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/4536 e 0 to 0 dl 1746066800 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.184944:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4eea00 with x1830882976842880 ext(1126400->1130495) 00002000:00010000:1.0:1746066789.184947:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4eea00 00000100:00100000:0.0:1746066789.190324:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.190355:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.190417:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976843648 00000100:00100000:1.0:1746066789.190423:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976843648 00000100:00100000:1.0:1746066789.190554:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4128 00000100:00100000:1.0:1746066789.190560:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:31485:x1830882976843648:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:1.0:1746066789.190733:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+269:31485:x1830882976843648:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 172us (376us total) trans 8589943969 rc 0/0 00000100:00100000:1.0:1746066789.190738:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4128 00000100:00100000:0.0:1746066789.194228:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.194315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.206553:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.208391:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.208407:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976844416 00000100:00100000:0.0:1746066789.208410:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976844416 00010000:00010000:0.0:1746066789.208430:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba5600/0xfb36a14ee608abc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfe3 expref: 17 pid: 21203 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746066789.208448:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7330 00000100:00100000:0.0:1746066789.208564:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882976844416:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066789.208573:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066789.208587:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba5600/0xfb36a14ee608abc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfe3 expref: 17 pid: 21203 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.208596:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba5600/0xfb36a14ee608abc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfe3 expref: 17 pid: 21203 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.208612:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ba5600/0xfb36a14ee608abc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dfe3 expref: 17 pid: 21203 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.208625:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066789.208656:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882976844416:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 202us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.209163:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.209227:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7330 00000100:00100000:0.0:1746066789.209236:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976844160 00000100:00100000:0.0:1746066789.209238:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976844160 00010000:00010000:0.0:1746066789.209248:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b247c00/0xfb36a14ee608ac97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e04c expref: 7 pid: 8451 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746066789.209260:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7331 00000100:00100000:0.0:1746066789.209263:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976844160:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066789.209268:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066789.209274:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b247c00/0xfb36a14ee608ac97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e04c expref: 7 pid: 8451 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.209281:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b247c00/0xfb36a14ee608ac97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e04c expref: 7 pid: 8451 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.209288:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b247c00/0xfb36a14ee608ac97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e04c expref: 7 pid: 8451 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.209293:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.209295:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.209299:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f209e00/0xfb36a14ee608aceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4857855) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e07d expref: 15 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.209304:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f209e00/0xfb36a14ee608aceb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4857855) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e07d expref: 15 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.209321:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f209e00/0xfb36a14ee608aceb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4857855) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e07d expref: 15 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066789.209328:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976807808:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066789.209370:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746066789.212435:0:9849:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066789.216776:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.217552:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.219737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.223373:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.224313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.229151:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.245558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.250212:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.258897:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882976845824:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8508us (8681us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066789.258909:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6480 00002000:00100000:0.0:1746066789.258919:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880093213b80 x1830882976845824/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/440 e 0 to 0 dl 1746066800 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066789.258928:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093213b80 with x1830882976845824 ext(2097152->3145727) 00002000:00010000:0.0:1746066789.258933:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093213b80 00000100:00100000:0.0:1746066789.265611:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.271138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.283577:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.304463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.304552:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.306178:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.306200:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976846976 00000100:00100000:0.0:1746066789.306204:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976846976 00002000:00100000:0.0:1746066789.306228:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a590ce00 x1830882976846976/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066789.306235:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590ce00 with x1830882976846976 ext(3145728->4194303) 00002000:00010000:0.0:1746066789.306238:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590ce00 00000100:00100000:0.0:1746066789.306252:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6482 00000100:00100000:0.0:1746066789.306258:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882976846464:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066789.306317:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6483 00000100:00100000:1.0:1746066789.306326:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882976846976:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066789.330199:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882976846976:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23872us (24020us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066789.330207:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6483 00002000:00100000:1.0:1746066789.330213:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a590ce00 x1830882976846976/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/440 e 0 to 0 dl 1746066800 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.330220:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590ce00 with x1830882976846976 ext(3145728->4194303) 00002000:00010000:1.0:1746066789.330224:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590ce00 00000100:00100000:0.0:1746066789.356548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.357828:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976847232 00000100:00100000:1.0:1746066789.357834:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976847232 00000100:00100000:1.0:1746066789.357878:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9931 00000100:00100000:1.0:1746066789.357884:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+269:31497:x1830882976847232:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066789.357900:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.357912:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ad0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e0a0 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.357991:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ad15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358001:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ad15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358010:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ad15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358020:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fa00/0xfb36a14ee608ad1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358024:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fa00/0xfb36a14ee608ad1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358028:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fa00/0xfb36a14ee608ad1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358108:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f600/0xfb36a14ee608ad23 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358115:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f600/0xfb36a14ee608ad23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358119:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f600/0xfb36a14ee608ad23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066789.358126:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066789.358192:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ad15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358198:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ad15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358202:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ad15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358207:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b5fe00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066789.358210:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ad15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358215:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ad15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358223:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066789.358225:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066789.358228:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ad15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358232:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ad15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358248:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fa00/0xfb36a14ee608ad1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358253:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fa00/0xfb36a14ee608ad1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358257:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fa00/0xfb36a14ee608ad1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358260:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b5fa00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066789.358262:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fa00/0xfb36a14ee608ad1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358266:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fa00/0xfb36a14ee608ad1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358271:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b4323200) 00010000:00010000:1.0:1746066789.358273:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066789.358275:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fa00/0xfb36a14ee608ad1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358279:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fa00/0xfb36a14ee608ad1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.358310:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ad0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0a0 expref: 272 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.358318:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f600/0xfb36a14ee608ad23 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0a0 expref: 271 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.358323:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066789.358326:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066789.358328:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5f600, rc 0) 00000100:00100000:1.0:1746066789.358365:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+271:31497:x1830882976847232:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 480us (1825us total) trans 8589943971 rc 0/0 00000100:00100000:1.0:1746066789.358370:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9931 00000100:00100000:0.0:1746066789.364319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.373107:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.373189:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.375940:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.375972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.375994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.376027:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976848128 00000100:00100000:0.0:1746066789.376030:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976848128 00000100:00100000:0.0:1746066789.376053:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14334 00000100:00100000:0.0:1746066789.376059:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882976848000:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:0.0:1746066789.376078:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14336 00000100:00100000:0.0:1746066789.376082:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882976848256:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066789.376088:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066789.376097:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092610000/0xfb36a14ee608ad62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e0c3 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.376111:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.376113:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.376118:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092610000/0xfb36a14ee608ad62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0c3 expref: 16 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066789.376129:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092610000/0xfb36a14ee608ad62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0c3 expref: 16 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066789.376136:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092610000, rc 0) 00000100:00100000:0.0:1746066789.376172:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882976848256:12345-192.168.202.57@tcp:101:cat.0 Request processed in 89us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066789.376177:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14336 00010000:00010000:0.0:1746066789.376190:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066789.376198:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092611800/0xfb36a14ee608ad69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e0b5 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066789.376226:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976808704:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066789.376565:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066789.402609:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.402660:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.402721:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.402799:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976848768 00000100:00100000:1.0:1746066789.402807:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976848768 00000100:00100000:1.0:1746066789.402843:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4130 00000100:00100000:1.0:1746066789.402850:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7f6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+271:31490:x1830882976848768:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:1.0:1746066789.403027:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7f6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+272:31490:x1830882976848768:12345-192.168.202.57@tcp:35:cat.0 Request processed in 176us (365us total) trans 8589943973 rc 0/0 00000100:00100000:1.0:1746066789.403033:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4130 00000100:00100000:0.0:1746066789.413738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.413774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.413860:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.413882:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976849152 00000100:00100000:0.0:1746066789.413889:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976849152 00010000:00010000:0.0:1746066789.413926:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800925dd400/0xfb36a14ee608ac89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e030 expref: 6 pid: 21973 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746066789.413948:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976849024 00000100:00100000:0.0:1746066789.413950:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976849024 00010000:00010000:0.0:1746066789.413961:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009391e800/0xfb36a14ee608aae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df57 expref: 18 pid: 10402 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746066789.413974:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976849280 00000100:00100000:0.0:1746066789.413976:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976849280 00010000:00010000:0.0:1746066789.413985:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b19b400/0xfb36a14ee608aab4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df26 expref: 24 pid: 10402 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746066789.413998:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7334 00000100:00100000:0.0:1746066789.414004:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1966:x1830882976849152:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066789.414014:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066789.414035:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800925dd400/0xfb36a14ee608ac89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e030 expref: 6 pid: 21973 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.414044:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800925dd400/0xfb36a14ee608ac89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e030 expref: 6 pid: 21973 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.414063:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800925dd400/0xfb36a14ee608ac89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e030 expref: 6 pid: 21973 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.414077:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066789.414092:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1966:x1830882976849152:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 89us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066789.414097:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7334 00000100:00100000:0.0:1746066789.414110:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7335 00000100:00100000:0.0:1746066789.414115:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a530fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882976849024:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066789.414121:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066789.414127:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009391e800/0xfb36a14ee608aae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df57 expref: 18 pid: 10402 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.414135:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009391e800/0xfb36a14ee608aae5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df57 expref: 18 pid: 10402 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.414145:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009391e800/0xfb36a14ee608aae5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df57 expref: 18 pid: 10402 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.414152:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066789.414170:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a530fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882976849024:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 56us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066789.414176:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7335 00000100:00100000:0.0:1746066789.414206:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7336 00000100:00100000:0.0:1746066789.414211:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1966:x1830882976849280:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066789.414217:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066789.414223:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b19b400/0xfb36a14ee608aab4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df26 expref: 23 pid: 10402 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.414231:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b19b400/0xfb36a14ee608aab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df26 expref: 23 pid: 10402 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.414241:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b19b400/0xfb36a14ee608aab4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df26 expref: 23 pid: 10402 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746066789.414249:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.414251:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.414256:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608ad70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 417792->839679) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ca expref: 22 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.414263:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608ad70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 417792->839679) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ca expref: 22 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.414299:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608ad70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 417792->839679) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ca expref: 22 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066789.414309:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976809216:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066789.414361:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066789.419431:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976809216:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066789.419453:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066789.419469:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882976849280:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5258us (5609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066789.419476:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7336 00000100:00100000:0.0:1746066789.424123:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.431587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.431745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.431881:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6487 00000100:00100000:1.0:1746066789.431891:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1965:x1830882976849920:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066789.433299:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1965:x1830882976849920:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 1408us (1717us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066789.433308:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6487 00002000:00100000:1.0:1746066789.433314:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x38e:0x0] (835584->839679) req@ffff8800a590c700 x1830882976849920/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/4536 e 0 to 0 dl 1746066800 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.433322:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590c700 with x1830882976849920 ext(835584->839679) 00002000:00010000:1.0:1746066789.433325:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590c700 00000100:00100000:0.0:1746066789.437985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.438099:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976850304 00000100:00100000:1.0:1746066789.438105:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976850304 00000100:00100000:1.0:1746066789.438132:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4131 00000100:00100000:1.0:1746066789.438137:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+272:31497:x1830882976850304:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:1.0:1746066789.438305:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+273:31497:x1830882976850304:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 168us (321us total) trans 8589943974 rc 0/0 00000100:00100000:1.0:1746066789.438310:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4131 00000100:00100000:0.0:1746066789.444736:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.448866:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009270b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976809472:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066789.448883:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066789.448915:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882976850432:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3930us (4187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066789.448924:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7337 00000100:00100000:1.0:1746066789.461625:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.466377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.466420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.491302:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.491349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.491440:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976851456 00000100:00100000:1.0:1746066789.491447:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976851456 00002000:00100000:1.0:1746066789.491483:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009bb2dc00 x1830882976851456/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.491491:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2dc00 with x1830882976851456 ext(2097152->3145727) 00002000:00010000:1.0:1746066789.491496:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2dc00 00000100:00100000:1.0:1746066789.491524:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976851712 00000100:00100000:1.0:1746066789.491526:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976851712 00002000:00100000:1.0:1746066789.491537:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009bb2ca80 x1830882976851712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.491543:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ca80 with x1830882976851712 ext(3145728->4194303) 00002000:00010000:1.0:1746066789.491545:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2ca80 00000100:00100000:1.0:1746066789.491554:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6489 00000100:00100000:1.0:1746066789.491560:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882976851456:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066789.493734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.499928:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.527900:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.532547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.535364:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.540935:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.552241:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.555821:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976853120 00000100:00100000:1.0:1746066789.555831:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976853120 00000100:00100000:1.0:1746066789.555885:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 700 00000100:00100000:1.0:1746066789.555892:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+274:1964:x1830882976853120:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066789.555904:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066789.555925:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb55200/0xfb36a14ee608adaf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0e6 expref: 274 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.555953:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066789.555957:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066789.555997:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+273:1964:x1830882976853120:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 106us (3762us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.556002:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 700 00000100:00100000:1.0:1746066789.573820:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.573861:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.574351:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6495 00000100:00100000:0.0:1746066789.574362:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882976853504:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066789.583716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.584469:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882976853504:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10109us (10605us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066789.584478:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6495 00002000:00100000:1.0:1746066789.584487:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff880135e5b100 x1830882976853504/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/440 e 0 to 0 dl 1746066800 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.584500:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5b100 with x1830882976853504 ext(1048576->2097151) 00002000:00010000:1.0:1746066789.584505:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5b100 00000100:00100000:0.0:1746066789.591292:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.602753:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.602805:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.602858:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976854400 00000100:00100000:1.0:1746066789.602863:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976854400 00000100:00100000:1.0:1746066789.603166:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4133 00000100:00100000:1.0:1746066789.603173:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+273:31507:x1830882976854400:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:1.0:1746066789.603374:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+274:31507:x1830882976854400:12345-192.168.202.57@tcp:35:cat.0 Request processed in 202us (568us total) trans 8589943977 rc 0/0 00000100:00100000:1.0:1746066789.603380:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4133 00000100:00100000:0.0:1746066789.612583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.621473:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.621872:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.629964:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976854912 00000100:00100000:0.0:1746066789.629972:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976854912 00000100:00100000:0.0:1746066789.630023:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14344 00000100:00100000:0.0:1746066789.630032:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+18:31503:x1830882976854912:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066789.630047:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066789.630062:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e109 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.630085:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f208800/0xfb36a14ee608ad00 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e092 expref: 23 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.630093:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4ac00/0xfb36a14ee608ad5b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0bc expref: 19 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066789.630098:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.630100:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.630103:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->3432447] (req 3145728->3432447) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 19 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.630134:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed4ac00/0xfb36a14ee608ad5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0bc expref: 19 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066789.630144:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed4ac00/0xfb36a14ee608ad5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0bc expref: 19 pid: 8450 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746066789.630155:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f619880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976810624:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066789.630243:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f208800/0xfb36a14ee608ad00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e092 expref: 23 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.630250:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f208800/0xfb36a14ee608ad00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e092 expref: 23 pid: 20532 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746066789.630257:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976810752:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066789.630274:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066789.638524:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.639060:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.639187:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976855168 00000100:00100000:1.0:1746066789.639190:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976855168 00010000:00010000:1.0:1746066789.639205:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f208800/0xfb36a14ee608ad00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e092 expref: 24 pid: 20532 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746066789.639220:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7343 00000100:00100000:1.0:1746066789.639225:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1966:x1830882976855168:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066789.639231:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066789.639240:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f208800/0xfb36a14ee608ad00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e092 expref: 24 pid: 20532 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.639247:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f208800/0xfb36a14ee608ad00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e092 expref: 24 pid: 20532 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.639258:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f208800/0xfb36a14ee608ad00 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e092 expref: 24 pid: 20532 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.639271:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.639273:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.639278:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.639285:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.639309:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066789.639318:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976810880:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066789.639367:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066789.644896:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976810880:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066789.644918:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066789.645361:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.645441:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1966:x1830882976855168:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6214us (6379us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.645451:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7343 00000100:00100000:0.0:1746066789.672147:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.681011:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.681066:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976855808 00000100:00100000:1.0:1746066789.681073:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976855808 00000100:00100000:1.0:1746066789.681124:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 701 00000100:00100000:1.0:1746066789.681131:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+276:1963:x1830882976855808:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066789.681151:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066789.681170:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb54200/0xfb36a14ee608adf5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e110 expref: 276 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.681198:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066789.681202:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066789.681241:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+275:1963:x1830882976855808:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 111us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.681247:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 701 00000100:00100000:0.0:1746066789.683342:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.697041:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.699512:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976856064 00000100:00100000:1.0:1746066789.699520:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976856064 00010000:00010000:1.0:1746066789.699544:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b246e00/0xfb36a14ee608ac9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e037 expref: 6 pid: 8451 timeout: 850 lvb_type: 1 00000100:00100000:1.0:1746066789.699568:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7345 00000100:00100000:1.0:1746066789.699575:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882976856064:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066789.699586:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066789.699600:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b246e00/0xfb36a14ee608ac9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e037 expref: 6 pid: 8451 timeout: 850 lvb_type: 1 00010000:00010000:1.0:1746066789.699609:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b246e00/0xfb36a14ee608ac9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e037 expref: 6 pid: 8451 timeout: 850 lvb_type: 1 00010000:00010000:1.0:1746066789.699626:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b246e00/0xfb36a14ee608ac9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e037 expref: 6 pid: 8451 timeout: 850 lvb_type: 1 00010000:00010000:1.0:1746066789.699882:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066789.699920:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1964:x1830882976856064:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 345us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.699925:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7345 00000100:00100000:0.0:1746066789.700358:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.701012:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976856320 00000100:00100000:1.0:1746066789.701016:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976856320 00010000:00010000:1.0:1746066789.701032:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b093600/0xfb36a14ee608abe1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dff1 expref: 16 pid: 8112 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746066789.701060:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7346 00000100:00100000:1.0:1746066789.701066:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f619180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882976856320:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066789.701073:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066789.701084:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b093600/0xfb36a14ee608abe1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dff1 expref: 16 pid: 8112 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.701093:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b093600/0xfb36a14ee608abe1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dff1 expref: 16 pid: 8112 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.701107:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b093600/0xfb36a14ee608abe1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dff1 expref: 16 pid: 8112 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.701116:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.701118:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.701123:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1a00/0xfb36a14ee608ae03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1363968->1503231) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e117 expref: 24 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.701129:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1a00/0xfb36a14ee608ae03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1363968->1503231) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e117 expref: 24 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.701156:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1a00/0xfb36a14ee608ae03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1363968->1503231) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e117 expref: 24 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066789.701166:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976811392:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066789.701225:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066789.705203:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976811392:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066789.705224:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066789.705266:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f619180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882976856320:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4199us (4908us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.705276:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7346 00000100:00100000:0.0:1746066789.706120:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.709912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.710398:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976856832 00000100:00100000:1.0:1746066789.710405:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976856832 00002000:00100000:1.0:1746066789.710435:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38d:0x0] (1499136->1503231) req@ffff88009f61aa00 x1830882976856832/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.710449:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f61aa00 with x1830882976856832 ext(1499136->1503231) 00002000:00010000:1.0:1746066789.710454:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f61aa00 00000100:00100000:1.0:1746066789.710484:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6498 00000100:00100000:1.0:1746066789.710491:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882976856832:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066789.710643:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882976856832:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 152us (737us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066789.710650:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6498 00002000:00100000:1.0:1746066789.710655:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38d:0x0] (1499136->1503231) req@ffff88009f61aa00 x1830882976856832/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/4536 e 0 to 0 dl 1746066800 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.710661:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f61aa00 with x1830882976856832 ext(1499136->1503231) 00002000:00010000:1.0:1746066789.710664:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f61aa00 00000100:00100000:0.0:1746066789.713512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.768969:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.772470:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.772658:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976857472 00000100:00100000:1.0:1746066789.772664:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976857472 00000100:00100000:1.0:1746066789.772787:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4135 00000100:00100000:1.0:1746066789.772795:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+33:13378:x1830882976857472:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066789.773738:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+34:13378:x1830882976857472:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 941us (1271us total) trans 8589943981 rc 0/0 00000100:00100000:1.0:1746066789.773756:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4135 00000100:00100000:0.0:1746066789.778816:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.779028:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976857600 00000100:00100000:1.0:1746066789.779035:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976857600 00010000:00010000:1.0:1746066789.779065:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb54c00/0xfb36a14ee608ad85 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0d8 expref: 34 pid: 809 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746066789.779102:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7347 00000100:00100000:1.0:1746066789.779109:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a530f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+34:1964:x1830882976857600:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066789.779121:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066789.779126:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb54c00/0xfb36a14ee608ad85 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0d8 expref: 34 pid: 809 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.779136:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb54c00/0xfb36a14ee608ad85 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0d8 expref: 34 pid: 809 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.779153:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb54c00/0xfb36a14ee608ad85 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0d8 expref: 34 pid: 809 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.779254:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066789.779259:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb55200/0xfb36a14ee608ae1f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066789.779267:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb55200/0xfb36a14ee608ae1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066789.779272:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb55200/0xfb36a14ee608ae1f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066789.779290:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066789.779576:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a530f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+33:1964:x1830882976857600:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 466us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.779583:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7347 00000100:00100000:1.0:1746066789.782669:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14347 00000100:00100000:1.0:1746066789.782688:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882976858112:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066789.782695:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.782703:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4a00/0xfb36a14ee608ae2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e13a expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.782714:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.782715:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.782721:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4a00/0xfb36a14ee608ae2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e13a expref: 7 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066789.782732:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4a00/0xfb36a14ee608ae2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e13a expref: 7 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066789.782739:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecc4a00, rc 0) 00000100:00100000:1.0:1746066789.782765:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976858112:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 92us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.782770:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14347 00000100:00100000:1.0:1746066789.782781:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14348 00000100:00100000:1.0:1746066789.782784:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976858368:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066789.782788:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.782793:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5a00/0xfb36a14ee608ae34 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e148 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066789.782816:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976811648:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066789.782852:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066789.783401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.783412:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976858240 00000100:00100000:1.0:1746066789.783415:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976858240 00000100:00100000:1.0:1746066789.783428:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14351 00000100:00100000:1.0:1746066789.783431:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976858240:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066789.783439:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.783444:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4e00/0xfb36a14ee608ae49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e141 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066789.783460:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976811904:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066789.783475:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed6c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746066789.788023:0:8451:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime: 1746066788 -> 1746066789 00002000:00010000:1.0:1746066789.788026:0:8451:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime: 1746066788 -> 1746066789 00002000:00010000:1.0:1746066789.788028:0:8451:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime: 1746066788 -> 1746066789 00000100:00100000:1.0:1746066789.788039:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976811648:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066789.788054:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5a00/0xfb36a14ee608ae34 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e148 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066789.788061:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5a00/0xfb36a14ee608ae34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e148 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066789.788070:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecc5a00, rc 0) 00000100:00100000:1.0:1746066789.788086:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976858368:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 5301us (5654us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066789.788090:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14348 00000100:00100000:0.0:1746066789.795737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.802305:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.802447:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976858752 00000100:00100000:1.0:1746066789.802453:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976858752 00010000:00010000:1.0:1746066789.802479:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb55200/0xfb36a14ee608ae1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e11e expref: 19 pid: 809 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746066789.802510:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7348 00000100:00100000:1.0:1746066789.802517:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+19:1965:x1830882976858752:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066789.802527:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066789.802532:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb55200/0xfb36a14ee608ae1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e11e expref: 19 pid: 809 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.802541:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb55200/0xfb36a14ee608ae1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e11e expref: 19 pid: 809 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.802559:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb55200/0xfb36a14ee608ae1f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e11e expref: 19 pid: 809 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.802574:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066789.802578:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb54000/0xfb36a14ee608ae57 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066789.802585:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb54000/0xfb36a14ee608ae57 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066789.802591:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb54000/0xfb36a14ee608ae57 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066789.803389:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066789.803438:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+18:1965:x1830882976858752:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 920us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.803446:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7348 00000100:00100000:0.0:1746066789.806196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.814342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.814609:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976859008 00000100:00100000:1.0:1746066789.814615:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976859008 00010000:00010000:1.0:1746066789.814651:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb54000/0xfb36a14ee608ae57 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e14f expref: 20 pid: 809 timeout: 850 lvb_type: 0 00000100:00100000:1.0:1746066789.814713:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7349 00000100:00100000:1.0:1746066789.814720:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+20:1963:x1830882976859008:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066789.814731:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066789.814736:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb54000/0xfb36a14ee608ae57 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e14f expref: 20 pid: 809 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.814745:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb54000/0xfb36a14ee608ae57 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e14f expref: 20 pid: 809 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.814763:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb54000/0xfb36a14ee608ae57 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e14f expref: 20 pid: 809 timeout: 850 lvb_type: 0 00010000:00010000:1.0:1746066789.814781:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066789.814785:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1e00/0xfb36a14ee608ae6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066789.814792:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1e00/0xfb36a14ee608ae6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066789.814797:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1e00/0xfb36a14ee608ae6c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066789.814820:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066789.814852:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+19:1963:x1830882976859008:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 132us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.814858:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7349 00000100:00100000:0.0:1746066789.820327:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.820365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.820387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.820419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.825235:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14355 00000100:00100000:1.0:1746066789.825242:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976859392:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066789.825249:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.825257:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4000/0xfb36a14ee608ae88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e16b expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066789.825276:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976812800:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066789.825295:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066789.840637:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.840708:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.840783:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976859776 00000100:00100000:1.0:1746066789.840788:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976859776 00000100:00100000:1.0:1746066789.840816:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976860032 00000100:00100000:1.0:1746066789.840818:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976860032 00000100:00100000:1.0:1746066789.840829:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9939 00000100:00100000:1.0:1746066789.840834:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+33:31522:x1830882976859776:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066789.840851:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.840864:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc4e00/0xfb36a14ee608ae8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e179 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.840947:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5a00/0xfb36a14ee608ae96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.840957:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5a00/0xfb36a14ee608ae96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.840966:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5a00/0xfb36a14ee608ae96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.840976:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5400/0xfb36a14ee608ae9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.840981:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5400/0xfb36a14ee608ae9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.840989:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5400/0xfb36a14ee608ae9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841062:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee608aea4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841068:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee608aea4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841073:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee608aea4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066789.841080:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066789.841140:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5a00/0xfb36a14ee608ae96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841145:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5a00/0xfb36a14ee608ae96 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841150:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5a00/0xfb36a14ee608ae96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841154:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ecc5a00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066789.841156:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5a00/0xfb36a14ee608ae96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841161:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5a00/0xfb36a14ee608ae96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841168:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066789.841170:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066789.841173:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5a00/0xfb36a14ee608ae96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841185:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5a00/0xfb36a14ee608ae96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841199:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5400/0xfb36a14ee608ae9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841203:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5400/0xfb36a14ee608ae9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841207:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5400/0xfb36a14ee608ae9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841210:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ecc5400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066789.841211:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5400/0xfb36a14ee608ae9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841215:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5400/0xfb36a14ee608ae9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841219:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b4323f00) 00010000:00010000:1.0:1746066789.841221:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066789.841222:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5400/0xfb36a14ee608ae9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841225:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc5400/0xfb36a14ee608ae9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841249:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc4e00/0xfb36a14ee608ae8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e179 expref: 36 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.841258:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee608aea4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e179 expref: 35 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.841267:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066789.841268:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066789.841270:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee0000, rc 0) 00000100:00100000:1.0:1746066789.841296:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+35:31522:x1830882976859776:12345-192.168.202.57@tcp:101:cat.0 Request processed in 462us (672us total) trans 8589943983 rc 0/0 00000100:00100000:1.0:1746066789.841301:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9939 00000100:00100000:1.0:1746066789.841311:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9940 00000100:00100000:1.0:1746066789.841315:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+276:31523:x1830882976860032:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066789.841323:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.841327:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1800/0xfb36a14ee608aeb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e180 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.841353:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0400/0xfb36a14ee608aeb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841359:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0400/0xfb36a14ee608aeb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841364:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0400/0xfb36a14ee608aeb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841370:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee608aec0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841374:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee608aec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841378:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee608aec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841414:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc4c00/0xfb36a14ee608aec7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841419:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc4c00/0xfb36a14ee608aec7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841423:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc4c00/0xfb36a14ee608aec7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066789.841427:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066789.841450:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0400/0xfb36a14ee608aeb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841454:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0400/0xfb36a14ee608aeb9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841458:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0400/0xfb36a14ee608aeb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841462:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dee0400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066789.841464:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0400/0xfb36a14ee608aeb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841467:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0400/0xfb36a14ee608aeb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841472:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066789.841473:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066789.841475:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0400/0xfb36a14ee608aeb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841478:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0400/0xfb36a14ee608aeb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841486:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee608aec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841490:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee608aec0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841494:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee608aec0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841497:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dee1200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066789.841499:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee608aec0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841502:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee608aec0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841506:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009acdd600) 00010000:00010000:1.0:1746066789.841508:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066789.841509:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee608aec0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841513:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1200/0xfb36a14ee608aec0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066789.841531:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1800/0xfb36a14ee608aeb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e180 expref: 279 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.841539:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc4c00/0xfb36a14ee608aec7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e180 expref: 278 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.841545:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066789.841547:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066789.841549:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecc4c00, rc 0) 00000100:00100000:1.0:1746066789.841564:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+278:31523:x1830882976860032:12345-192.168.202.57@tcp:101:cat.0 Request processed in 249us (856us total) trans 8589943984 rc 0/0 00000100:00100000:1.0:1746066789.841569:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9940 00000100:00100000:1.0:1746066789.841607:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976812800:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066789.841622:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4000/0xfb36a14ee608ae88 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e16b expref: 9 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066789.841640:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4000/0xfb36a14ee608ae88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e16b expref: 9 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066789.841647:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecc4000, rc 0) 00000100:00100000:1.0:1746066789.841664:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976859392:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 16424us (21245us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066789.841669:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14355 00000100:00100000:0.0:1746066789.851566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.851731:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.851752:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.851768:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.851795:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.852952:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14358 00000100:00100000:1.0:1746066789.852959:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882976860416:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066789.852966:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.852973:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5800/0xfb36a14ee608aef8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e195 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066789.852995:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976813184:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066789.853027:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066789.853041:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14359 00000100:00100000:1.0:1746066789.853046:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882976860544:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066789.853052:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.853060:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b19b400/0xfb36a14ee608aeff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e19c expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066789.853078:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976813312:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066789.853095:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066789.857507:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976861056 00000100:00100000:1.0:1746066789.857515:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976861056 00000100:00100000:1.0:1746066789.857551:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9942 00000100:00100000:1.0:1746066789.857558:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+278:31521:x1830882976861056:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066789.857576:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066789.857591:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19bc00/0xfb36a14ee608af06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e1aa expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.857703:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a000/0xfb36a14ee608af0d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066789.857715:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1e00/0xfb36a14ee608ae6c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e156 expref: 19 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.857722:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee608aea4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e179 expref: 34 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.857727:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc4c00/0xfb36a14ee608aec7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e180 expref: 279 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.857733:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00600/0xfb36a14ee608aeea lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1a3 expref: 19 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.857742:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a000/0xfb36a14ee608af0d lrc: 7/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066789.857767:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00600/0xfb36a14ee608aeea lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1a3 expref: 19 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.857777:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00600/0xfb36a14ee608aeea lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1a3 expref: 19 pid: 809 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066789.857787:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f619180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976813440:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066789.857851:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc4c00/0xfb36a14ee608aec7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e180 expref: 279 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.857858:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ecc4c00/0xfb36a14ee608aec7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e180 expref: 279 pid: 14548 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066789.857865:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976813568:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066789.857889:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee608aea4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e179 expref: 34 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.857896:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee608aea4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e179 expref: 34 pid: 14548 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066789.857902:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976813696:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066789.857921:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1e00/0xfb36a14ee608ae6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e156 expref: 19 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.857931:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1e00/0xfb36a14ee608ae6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e156 expref: 19 pid: 809 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066789.857938:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976813824:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066789.857950:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a72789c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066789.859738:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976813312:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066789.859751:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b19b400/0xfb36a14ee608aeff lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e19c expref: 26 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066789.859758:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b19b400/0xfb36a14ee608aeff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e19c expref: 26 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066789.859767:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19b400, rc 0) 00000100:00100000:0.0:1746066789.859779:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882976860544:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6734us (7984us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066789.859783:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14359 00000100:00100000:0.0:1746066789.859792:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14365 00000100:00100000:0.0:1746066789.859800:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976861696:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:0.0:1746066789.859809:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800925a3a00/0xfb36a14ee608af37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.859816:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.859821:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066789.859822:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066789.859825:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925a3a00/0xfb36a14ee608af37 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.859836:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.859842:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 17 pid: 20532 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746066789.859850:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976814720:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066789.859879:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066789.868539:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976813568:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066789.868550:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976813696:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066789.868558:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976813824:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066789.869852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.870085:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.870218:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.870289:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.870810:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f619180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976813440:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066789.870828:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a000/0xfb36a14ee608af0d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746066789.870928:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.870941:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.870953:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976863104 00000100:00100000:1.0:1746066789.870956:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976863104 00002000:00100000:1.0:1746066789.870977:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->3432447) req@ffff880093210a80 x1830882976863104/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.870985:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093210a80 with x1830882976863104 ext(3145728->3432447) 00010000:00010000:1.0:1746066789.870990:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 18 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066789.870999:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 18 pid: 20532 timeout: 851 lvb_type: 0 00002000:00010000:1.0:1746066789.871005:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093210a80 00000100:00100000:1.0:1746066789.871014:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2114 00000100:00100000:1.0:1746066789.871018:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882976863104:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:1.0:1746066789.871269:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.871277:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976862976 00000100:00100000:1.0:1746066789.871280:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976862976 00002000:00100000:1.0:1746066789.871290:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x38e:0x0] (417792->839679) req@ffff880093210380 x1830882976862976/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.871297:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093210380 with x1830882976862976 ext(417792->839679) 00010000:00010000:1.0:1746066789.871301:0:31365:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608ad70 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 417792->839679) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ca expref: 22 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066789.871309:0:31365:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608ad70 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 417792->839679) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ca expref: 22 pid: 20532 timeout: 851 lvb_type: 0 00002000:00010000:1.0:1746066789.871313:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093210380 00000100:00100000:1.0:1746066789.871322:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2115 00000100:00100000:1.0:1746066789.871325:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882976862976:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066789.872186:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976814720:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066789.872199:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800925a3a00/0xfb36a14ee608af37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066789.879588:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.879887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.879914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.879930:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976862080 00000100:00100000:0.0:1746066789.879936:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976862080 00010000:00010000:0.0:1746066789.879967:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee608aea4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e179 expref: 35 pid: 14548 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746066789.879990:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7355 00000100:00100000:0.0:1746066789.879996:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+35:1964:x1830882976862080:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066789.880005:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066789.880009:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee608aea4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e179 expref: 35 pid: 14548 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066789.880018:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee608aea4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e179 expref: 35 pid: 14548 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066789.880034:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0000/0xfb36a14ee608aea4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e179 expref: 35 pid: 14548 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066789.880049:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066789.880053:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a000/0xfb36a14ee608af0d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066789.880061:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a000/0xfb36a14ee608af0d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066789.880066:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a000/0xfb36a14ee608af0d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066789.880083:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066789.880114:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+34:1964:x1830882976862080:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 118us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066789.880120:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7355 00000100:00100000:0.0:1746066789.880147:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.880184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.880193:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976862592 00000100:00100000:0.0:1746066789.880196:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976862592 00010000:00010000:0.0:1746066789.880208:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4a00/0xfb36a14ee608ae2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e13a expref: 9 pid: 8451 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746066789.880222:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7356 00000100:00100000:0.0:1746066789.880226:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976862592:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066789.880233:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066789.880249:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4a00/0xfb36a14ee608ae2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e13a expref: 9 pid: 8451 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746066789.880255:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4a00/0xfb36a14ee608ae2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e13a expref: 9 pid: 8451 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746066789.880266:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4a00/0xfb36a14ee608ae2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e13a expref: 9 pid: 8451 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746066789.880275:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.880277:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.880280:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a08a00/0xfb36a14ee608af1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.880290:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a08a00/0xfb36a14ee608af1b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.880301:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066789.880312:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976862592:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 85us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066789.880316:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7356 00000100:00100000:0.0:1746066789.880334:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.880341:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976863232 00000100:00100000:0.0:1746066789.880343:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976863232 00010000:00010000:0.0:1746066789.880351:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed4b200/0xfb36a14ee608ad54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ae expref: 15 pid: 8450 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746066789.880362:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7357 00000100:00100000:0.0:1746066789.880366:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882976863232:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066789.880371:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066789.880381:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed4b200/0xfb36a14ee608ad54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ae expref: 15 pid: 8450 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746066789.880387:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed4b200/0xfb36a14ee608ad54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ae expref: 15 pid: 8450 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746066789.886997:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882976863104:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 15970us (16047us total) trans 17179873556 rc 0/0 00000100:00100000:1.0:1746066789.887010:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2114 00002000:00100000:1.0:1746066789.887019:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->3432447) req@ffff880093210a80 x1830882976863104/t17179873556(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/448 e 0 to 0 dl 1746066800 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.887027:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093210a80 with x1830882976863104 ext(3145728->3432447) 00010000:00010000:1.0:1746066789.887036:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 20 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066789.887047:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 20 pid: 20532 timeout: 851 lvb_type: 0 00002000:00010000:1.0:1746066789.887052:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093210a80 00010000:00010000:1.0:1746066789.887083:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a000/0xfb36a14ee608af0d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066789.887088:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a000/0xfb36a14ee608af0d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746066789.887100:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066789.887179:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19bc00/0xfb36a14ee608af06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1aa expref: 280 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.887209:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a000/0xfb36a14ee608af0d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1aa expref: 279 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.887216:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066789.887218:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066789.887220:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19a000, rc 0) 00000100:00100000:1.0:1746066789.887236:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+279:31521:x1830882976861056:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 29679us (29939us total) trans 8589943986 rc 0/0 00000100:00100000:1.0:1746066789.887241:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9942 00000100:00100000:1.0:1746066789.887285:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.887391:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.887406:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.887420:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.887441:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066789.887930:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed4b200/0xfb36a14ee608ad54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ae expref: 17 pid: 8450 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746066789.887940:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066789.887958:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882976863232:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7591us (7623us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066789.887965:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7357 00000100:00100000:0.0:1746066789.888176:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.888187:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976864384 00000100:00100000:0.0:1746066789.888192:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976864384 00010000:00010000:0.0:1746066789.888212:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f209800/0xfb36a14ee608aca5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e05a expref: 27 pid: 8450 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746066789.888229:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7358 00000100:00100000:0.0:1746066789.888235:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882976864384:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066789.888245:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066789.888259:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f209800/0xfb36a14ee608aca5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e05a expref: 27 pid: 8450 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066789.888266:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f209800/0xfb36a14ee608aca5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e05a expref: 27 pid: 8450 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066789.888277:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f209800/0xfb36a14ee608aca5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e05a expref: 27 pid: 8450 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066789.888284:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066789.888298:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882976864384:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 64us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066789.888303:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7358 00000100:00100000:0.0:1746066789.888343:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.888355:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976864256 00000100:00100000:0.0:1746066789.888358:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976864256 00010000:00010000:0.0:1746066789.888369:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb54c00/0xfb36a14ee608ae42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e133 expref: 9 pid: 8112 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746066789.888381:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7359 00000100:00100000:0.0:1746066789.888386:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976864256:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066789.888391:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066789.888398:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eb54c00/0xfb36a14ee608ae42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e133 expref: 9 pid: 8112 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746066789.888406:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eb54c00/0xfb36a14ee608ae42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e133 expref: 9 pid: 8112 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746066789.888415:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb54c00/0xfb36a14ee608ae42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e133 expref: 9 pid: 8112 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746066789.888423:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.888424:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.888428:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a02e600/0xfb36a14ee608af30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.888435:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a02e600/0xfb36a14ee608af30 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066789.891257:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1966:x1830882976862976:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 19925us (19983us total) trans 17179873557 rc 0/0 00000100:00100000:1.0:1746066789.891265:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2115 00002000:00100000:1.0:1746066789.891272:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x38e:0x0] (417792->839679) req@ffff880093210380 x1830882976862976/t17179873557(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/448 e 0 to 0 dl 1746066800 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.891281:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093210380 with x1830882976862976 ext(417792->839679) 00010000:00010000:1.0:1746066789.891287:0:31365:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608ad70 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 417792->839679) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ca expref: 29 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066789.891297:0:31365:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608ad70 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 417792->839679) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ca expref: 29 pid: 20532 timeout: 851 lvb_type: 0 00002000:00010000:1.0:1746066789.891303:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093210380 00010000:00010000:0.0:1746066789.891696:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066789.891713:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976864256:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3326us (3369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066789.891719:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7359 00000100:00100000:0.0:1746066789.891805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.903610:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882976862336:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 20684us (23455us total) trans 21474840874 rc 0/0 00000100:00100000:0.0:1746066789.903619:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2117 00002000:00100000:0.0:1746066789.903636:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1363968->1503231) req@ffff88009ef5d500 x1830882976862336/t21474840874(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/448 e 0 to 0 dl 1746066800 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066789.903645:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5d500 with x1830882976862336 ext(1363968->1503231) 00010000:00010000:0.0:1746066789.903653:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1a00/0xfb36a14ee608ae03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1363968->1503231) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e117 expref: 28 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066789.903662:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1a00/0xfb36a14ee608ae03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1363968->1503231) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e117 expref: 28 pid: 20532 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746066789.903667:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef5d500 00000100:00100000:0.0:1746066789.913158:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.913189:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.913342:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976865024 00000100:00100000:1.0:1746066789.913347:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976865024 00010000:00010000:1.0:1746066789.913371:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1a00/0xfb36a14ee608ae03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1363968->1503231) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e117 expref: 28 pid: 20532 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746066789.913373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.913391:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976864768 00000100:00100000:1.0:1746066789.913394:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976864768 00000100:00100000:0.0:1746066789.913398:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976864896 00010000:00010000:1.0:1746066789.913401:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608ad70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 417792->839679) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ca expref: 26 pid: 20532 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746066789.913401:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976864896 00000100:00100000:1.0:1746066789.913414:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7360 00010000:00010000:0.0:1746066789.913419:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 20 pid: 20532 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066789.913420:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882976865024:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066789.913429:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066789.913438:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7361 00010000:00010000:1.0:1746066789.913441:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1a00/0xfb36a14ee608ae03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1363968->1503231) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e117 expref: 28 pid: 20532 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746066789.913443:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a540a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1965:x1830882976864768:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066789.913449:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1a00/0xfb36a14ee608ae03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1363968->1503231) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e117 expref: 28 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066789.913451:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066789.913461:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608ad70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 417792->839679) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ca expref: 26 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066789.913464:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1a00/0xfb36a14ee608ae03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1363968->1503231) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e117 expref: 28 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066789.913470:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608ad70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 417792->839679) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ca expref: 26 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066789.913477:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.913478:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.913481:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608ad70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 417792->839679) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e0ca expref: 26 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066789.913482:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608af14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.913490:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608af14 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.913490:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.913492:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.913495:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb55000/0xfb36a14ee608af29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.913502:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb55000/0xfb36a14ee608af29 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.913507:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066789.913521:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066789.913535:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882976865024:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 115us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066789.913535:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a540a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882976864768:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 93us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066789.913541:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7361 00000100:00100000:1.0:1746066789.914209:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7360 00000100:00100000:0.0:1746066789.914216:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7362 00000100:00100000:0.0:1746066789.914224:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f619180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1965:x1830882976864896:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066789.914231:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066789.914239:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 20 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066789.914245:0:21203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608af14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.914246:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 20 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066789.914252:0:21203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608af14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.914258:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dee1600/0xfb36a14ee608add9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e109 expref: 20 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066789.914264:0:21203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608af14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.914266:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066789.914267:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.914270:0:21203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608af14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.914270:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800925a3a00/0xfb36a14ee608af37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.914276:0:21203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608af14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066789.914276:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925a3a00/0xfb36a14ee608af37 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.914280:0:21203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f2b0000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066789.914283:0:21203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608af14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.914288:0:21203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608af14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.914297:0:21203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608af14 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.914477:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b0000/0xfb36a14ee608af14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066789.914521:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882976861312:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 56217us (56354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.914527:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14360 00010000:00010000:0.0:1746066789.916920:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066789.916956:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f619180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882976864896:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2732us (3580us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066789.916964:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7362 00000100:00100000:0.0:1746066789.918763:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.919925:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.921477:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.921551:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976865536 00000100:00100000:1.0:1746066789.921556:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976865536 00010000:00010000:1.0:1746066789.921574:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1600/0xfb36a14ee608add2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e102 expref: 16 pid: 20532 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066789.921592:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7363 00000100:00100000:1.0:1746066789.921597:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882976865536:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066789.921605:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066789.921622:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1600/0xfb36a14ee608add2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2514944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e102 expref: 16 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066789.921641:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1600/0xfb36a14ee608add2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2514944->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e102 expref: 16 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066789.921656:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f2b1600/0xfb36a14ee608add2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2514944->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e102 expref: 16 pid: 20532 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066789.921667:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.921668:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066789.921671:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb54000/0xfb36a14ee608af22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.921692:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb54000/0xfb36a14ee608af22 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066789.921721:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066789.921744:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882976865536:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 146us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066789.921749:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7363 00000100:00100000:0.0:1746066789.925319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.925414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.925922:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976865792 00000100:00100000:1.0:1746066789.925925:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976865792 00002000:00100000:1.0:1746066789.925950:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009f61b480 x1830882976865792/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.925958:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f61b480 with x1830882976865792 ext(0->1048575) 00002000:00010000:1.0:1746066789.925962:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f61b480 00000100:00100000:1.0:1746066789.925982:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6500 00000100:00100000:1.0:1746066789.925987:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882976865792:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066789.935480:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976866432 00000100:00100000:1.0:1746066789.935488:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976866432 00002000:00100000:1.0:1746066789.935520:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x391:0x0] (3117056->3121151) req@ffff88009ef59180 x1830882976866432/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.935528:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef59180 with x1830882976866432 ext(3117056->3121151) 00002000:00010000:1.0:1746066789.935532:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef59180 00000100:00100000:1.0:1746066789.935547:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6501 00000100:00100000:1.0:1746066789.935552:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882976866432:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066789.936164:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882976866432:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 611us (746us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066789.936170:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6501 00002000:00100000:1.0:1746066789.936176:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x391:0x0] (3117056->3121151) req@ffff88009ef59180 x1830882976866432/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/4536 e 0 to 0 dl 1746066800 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.936183:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef59180 with x1830882976866432 ext(3117056->3121151) 00002000:00010000:1.0:1746066789.936185:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef59180 00000100:00100000:0.0:1746066789.936686:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882976865280:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16568us (17909us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066789.936693:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6499 00002000:00100000:0.0:1746066789.936699:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009f61bb80 x1830882976865280/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/440 e 0 to 0 dl 1746066800 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066789.936706:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f61bb80 with x1830882976865280 ext(0->1048575) 00002000:00010000:0.0:1746066789.936710:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f61bb80 00000100:00100000:0.0:1746066789.947953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.950046:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.950090:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.950144:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976866944 00000100:00100000:1.0:1746066789.950151:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976866944 00000100:00100000:1.0:1746066789.950191:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4136 00000100:00100000:1.0:1746066789.950197:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+18:31514:x1830882976866944:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:1.0:1746066789.950352:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+19:31514:x1830882976866944:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 155us (262us total) trans 8589943988 rc 0/0 00000100:00100000:1.0:1746066789.950358:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4136 00000100:00100000:0.0:1746066789.950917:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.957377:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.966794:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.967068:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.967093:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.968421:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976867840 00000100:00100000:1.0:1746066789.968426:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976867840 00002000:00100000:1.0:1746066789.968450:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009f619880 x1830882976867840/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.968459:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f619880 with x1830882976867840 ext(1048576->2097151) 00002000:00010000:1.0:1746066789.968464:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f619880 00000100:00100000:1.0:1746066789.969302:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976868096 00000100:00100000:1.0:1746066789.969306:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976868096 00002000:00100000:1.0:1746066789.969323:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38f:0x0] (2375680->2379775) req@ffff8800929cd180 x1830882976868096/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.969330:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cd180 with x1830882976868096 ext(2375680->2379775) 00002000:00010000:1.0:1746066789.969333:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929cd180 00000100:00100000:1.0:1746066789.969346:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6503 00000100:00100000:1.0:1746066789.969352:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1966:x1830882976867840:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066789.970353:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6504 00000100:00100000:1.0:1746066789.970359:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882976868096:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066789.970431:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882976868096:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 72us (3336us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066789.970437:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6504 00002000:00100000:1.0:1746066789.970442:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2375680->2379775) req@ffff8800929cd180 x1830882976868096/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/4536 e 0 to 0 dl 1746066800 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.970448:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cd180 with x1830882976868096 ext(2375680->2379775) 00002000:00010000:1.0:1746066789.970451:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929cd180 00000100:00100000:0.0:1746066789.983796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.985897:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1966:x1830882976867840:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16544us (18827us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066789.985906:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6503 00002000:00100000:1.0:1746066789.985913:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009f619880 x1830882976867840/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:195/0 lens 488/440 e 0 to 0 dl 1746066800 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.985921:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f619880 with x1830882976867840 ext(1048576->2097151) 00002000:00010000:1.0:1746066789.985925:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f619880 00000100:00100000:1.0:1746066789.986433:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.989055:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.994290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066789.994441:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976868736 00000100:00100000:1.0:1746066789.994448:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976868736 00002000:00100000:1.0:1746066789.994480:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (3117056->3145727) req@ffff8800929cd880 x1830882976868736/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/0 e 0 to 0 dl 1746066800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066789.994490:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cd880 with x1830882976868736 ext(3117056->3145727) 00010000:00010000:1.0:1746066789.994497:0:1992:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb09800/0xfb36a14ee608af99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1e9 expref: 20 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066789.994508:0:1992:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb09800/0xfb36a14ee608af99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1e9 expref: 20 pid: 4614 timeout: 851 lvb_type: 0 00002000:00010000:1.0:1746066789.994515:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800929cd880 00000100:00100000:1.0:1746066789.994899:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2118 00000100:00100000:1.0:1746066789.994906:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882976868736:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066789.996882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066789.998111:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.001314:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882976868736:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 6404us (7025us total) trans 17179873558 rc 0/0 00000100:00100000:1.0:1746066790.001322:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2118 00002000:00100000:1.0:1746066790.001330:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (3117056->3145727) req@ffff8800929cd880 x1830882976868736/t17179873558(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:195/0 lens 488/448 e 0 to 0 dl 1746066800 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.001337:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cd880 with x1830882976868736 ext(3117056->3145727) 00010000:00010000:1.0:1746066790.001344:0:1992:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb09800/0xfb36a14ee608af99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1e9 expref: 22 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.001355:0:1992:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb09800/0xfb36a14ee608af99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1e9 expref: 22 pid: 4614 timeout: 851 lvb_type: 0 00002000:00010000:1.0:1746066790.001360:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800929cd880 00000100:00100000:0.0:1746066790.002739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.002772:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.002822:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976869504 00000100:00100000:1.0:1746066790.002828:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976869504 00002000:00100000:1.0:1746066790.002854:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff8800929cf100 x1830882976869504/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.002863:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cf100 with x1830882976869504 ext(1048576->2097151) 00002000:00010000:1.0:1746066790.002867:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929cf100 00000100:00100000:1.0:1746066790.002888:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976869632 00000100:00100000:1.0:1746066790.002890:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976869632 00002000:00100000:1.0:1746066790.002899:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800929cce00 x1830882976869632/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.002906:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cce00 with x1830882976869632 ext(1048576->2097151) 00002000:00010000:1.0:1746066790.002908:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929cce00 00000100:00100000:1.0:1746066790.002917:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6506 00000100:00100000:1.0:1746066790.002922:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882976869504:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066790.009151:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.022391:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882976869504:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 19467us (19655us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066790.022401:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6506 00002000:00100000:0.0:1746066790.022409:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff8800929cf100 x1830882976869504/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/440 e 0 to 0 dl 1746066801 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066790.022416:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cf100 with x1830882976869504 ext(1048576->2097151) 00002000:00010000:0.0:1746066790.022421:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929cf100 00000100:00100000:0.0:1746066790.023448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.025797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.031663:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.034047:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.034312:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.034392:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976870912 00000100:00100000:1.0:1746066790.034396:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976870912 00002000:00100000:1.0:1746066790.034413:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2748416->2752511) req@ffff88009ec2e680 x1830882976870912/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.034420:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2e680 with x1830882976870912 ext(2748416->2752511) 00002000:00010000:1.0:1746066790.034424:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2e680 00000100:00100000:1.0:1746066790.034442:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6511 00000100:00100000:1.0:1746066790.034448:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1965:x1830882976870912:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066790.034639:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1965:x1830882976870912:12345-192.168.202.57@tcp:3:cat.0 Request processed in 178us (314us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066790.034645:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6511 00002000:00100000:1.0:1746066790.034650:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2748416->2752511) req@ffff88009ec2e680 x1830882976870912/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/4536 e 0 to 0 dl 1746066801 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.034656:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2e680 with x1830882976870912 ext(2748416->2752511) 00002000:00010000:1.0:1746066790.034659:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2e680 00000100:00100000:0.0:1746066790.037376:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.037457:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976871168 00000100:00100000:1.0:1746066790.037464:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976871168 00002000:00100000:1.0:1746066790.037499:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2752512->3145727) req@ffff88009ec2f800 x1830882976871168/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.037508:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2f800 with x1830882976871168 ext(2752512->3145727) 00002000:00010000:1.0:1746066790.037512:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2f800 00000100:00100000:1.0:1746066790.037537:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6512 00000100:00100000:1.0:1746066790.037544:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882976871168:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066790.044111:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882976871168:12345-192.168.202.57@tcp:3:cat.0 Request processed in 6559us (6733us total) trans 0 rc 393216/393216 00000100:00100000:1.0:1746066790.044120:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6512 00002000:00100000:1.0:1746066790.044129:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2752512->3145727) req@ffff88009ec2f800 x1830882976871168/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/440 e 0 to 0 dl 1746066801 ref 1 fl Complete:/200/0 rc 393216/393216 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.044137:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2f800 with x1830882976871168 ext(2752512->3145727) 00002000:00010000:1.0:1746066790.044142:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2f800 00000100:00100000:0.0:1746066790.045975:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.048172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.049424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.051944:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.052203:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976871680 00000100:00100000:1.0:1746066790.052209:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976871680 00002000:00100000:1.0:1746066790.052234:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2154496->2752511) req@ffff88009ec2fb80 x1830882976871680/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.052242:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2fb80 with x1830882976871680 ext(2154496->2752511) 00010000:00010000:1.0:1746066790.052248:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ec01600/0xfb36a14ee608afb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2752511) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e205 expref: 26 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.052257:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ec01600/0xfb36a14ee608afb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2752511) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e205 expref: 26 pid: 4614 timeout: 851 lvb_type: 0 00002000:00010000:1.0:1746066790.052268:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ec2fb80 00000100:00100000:1.0:1746066790.052290:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2120 00000100:00100000:1.0:1746066790.052296:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882976871680:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066790.061126:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882976871680:12345-192.168.202.57@tcp:4:cat.0 Request processed in 8827us (9182us total) trans 17179873559 rc 0/0 00000100:00100000:1.0:1746066790.061134:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2120 00002000:00100000:1.0:1746066790.061143:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2154496->2752511) req@ffff88009ec2fb80 x1830882976871680/t17179873559(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/448 e 0 to 0 dl 1746066801 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.061151:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2fb80 with x1830882976871680 ext(2154496->2752511) 00010000:00010000:1.0:1746066790.061158:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ec01600/0xfb36a14ee608afb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2752511) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e205 expref: 28 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.061168:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ec01600/0xfb36a14ee608afb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->2752511) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e205 expref: 28 pid: 4614 timeout: 851 lvb_type: 0 00002000:00010000:1.0:1746066790.061173:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ec2fb80 00000100:00100000:0.0:1746066790.061961:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.062126:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976872064 00000100:00100000:1.0:1746066790.062132:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976872064 00002000:00100000:1.0:1746066790.062565:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ec2c000 x1830882976872064/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.062573:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2c000 with x1830882976872064 ext(2097152->3145727) 00002000:00010000:1.0:1746066790.062577:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2c000 00000100:00100000:1.0:1746066790.062607:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6513 00000100:00100000:1.0:1746066790.062614:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882976872064:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066790.063748:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.069763:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.073968:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882976872064:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11347us (12001us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066790.073978:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6513 00002000:00100000:1.0:1746066790.073986:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ec2c000 x1830882976872064/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/440 e 0 to 0 dl 1746066801 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.073995:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2c000 with x1830882976872064 ext(2097152->3145727) 00002000:00010000:1.0:1746066790.073999:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2c000 00000100:00100000:0.0:1746066790.081910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.089055:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.089089:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.089148:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976872704 00000100:00100000:0.0:1746066790.089155:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976872704 00000100:00100000:0.0:1746066790.089199:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14384 00000100:00100000:0.0:1746066790.089205:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:31522:x1830882976872704:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066790.089220:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066790.089234:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb09e00/0xfb36a14ee608afe6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e236 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066790.089254:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066790.089255:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066790.089261:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb09e00/0xfb36a14ee608afe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e236 expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066790.089274:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eb09e00/0xfb36a14ee608afe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e236 expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066790.089283:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb09e00, rc 0) 00000100:00100000:0.0:1746066790.089321:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:31522:x1830882976872704:12345-192.168.202.57@tcp:101:cat.0 Request processed in 115us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066790.089326:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14384 00000100:00100000:1.0:1746066790.089529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.090035:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6516 00000100:00100000:0.0:1746066790.090042:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882976873216:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066790.098124:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.098159:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.098193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.098831:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6518 00000100:00100000:0.0:1746066790.098841:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+21:1966:x1830882976873728:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066790.099483:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6519 00000100:00100000:1.0:1746066790.099491:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882976873984:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066790.103373:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882976873216:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13332us (13843us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066790.103379:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6516 00002000:00100000:0.0:1746066790.103383:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009ed72a00 x1830882976873216/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/440 e 0 to 0 dl 1746066801 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066790.103389:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed72a00 with x1830882976873216 ext(3145728->4194303) 00002000:00010000:0.0:1746066790.103393:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed72a00 00000100:00100000:0.0:1746066790.121052:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.124322:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882976873728:12345-192.168.202.57@tcp:3:cat.0 Request processed in 25477us (26154us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066790.124331:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6518 00002000:00100000:1.0:1746066790.124341:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009ec2ed80 x1830882976873728/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:196/0 lens 488/440 e 0 to 0 dl 1746066801 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.124350:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2ed80 with x1830882976873728 ext(3145728->4194303) 00002000:00010000:1.0:1746066790.124356:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2ed80 00000100:00100000:1.0:1746066790.131046:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882976873984:12345-192.168.202.57@tcp:3:cat.0 Request processed in 31548us (32844us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066790.131057:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6519 00002000:00100000:1.0:1746066790.131067:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009ec2ca80 x1830882976873984/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:196/0 lens 488/440 e 0 to 0 dl 1746066801 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.131075:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2ca80 with x1830882976873984 ext(3145728->4194303) 00002000:00010000:1.0:1746066790.131079:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2ca80 00000100:00100000:0.0:1746066790.142516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.143313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.158619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.192009:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.204977:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.212006:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.216148:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.216186:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.216396:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.216706:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976876288 00000100:00100000:1.0:1746066790.216710:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976876288 00000100:00100000:0.0:1746066790.216757:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14385 00000100:00100000:0.0:1746066790.216769:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1965:x1830882976875776:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066790.216783:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066790.216798:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608b009 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e24b expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066790.216817:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066790.216819:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066790.216825:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608b009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e24b expref: 7 pid: 8451 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066790.217230:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14387 00000100:00100000:1.0:1746066790.217236:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882976876288:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066790.217242:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066790.217249:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b46fc00/0xfb36a14ee608b017 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e267 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.217258:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.217259:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.217263:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b46fc00/0xfb36a14ee608b017 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e267 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.217272:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b46fc00/0xfb36a14ee608b017 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e267 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.217278:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b46fc00, rc 0) 00000100:00100000:1.0:1746066790.217294:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882976876288:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 58us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066790.217298:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14387 00010000:00010000:0.0:1746066790.217417:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608b009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e24b expref: 7 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066790.217424:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec00c00, rc 0) 00000100:00100000:0.0:1746066790.217439:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882976875776:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 676us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066790.217444:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14385 00000100:00100000:0.0:1746066790.217481:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.217520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.217565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.220436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.222583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.222649:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976876800 00000100:00100000:0.0:1746066790.222652:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976876800 00000100:00100000:0.0:1746066790.222698:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9947 00000100:00100000:0.0:1746066790.222704:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+21:31531:x1830882976876800:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066790.222712:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066790.222718:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00000/0xfb36a14ee608b056 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e275 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066790.222752:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01600/0xfb36a14ee608b05d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066790.222760:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f387a00/0xfb36a14ee608b002 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e23d expref: 22 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066790.222765:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f386400/0xfb36a14ee608b048 lrc: 2/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066790.222769:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01600/0xfb36a14ee608b05d lrc: 5/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066790.222779:0:809:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f386400/0xfb36a14ee608b048 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066790.222796:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f387a00/0xfb36a14ee608b002 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e23d expref: 22 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066790.222805:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f387a00/0xfb36a14ee608b002 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e23d expref: 22 pid: 20127 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746066790.222813:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e869880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976816768:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066790.222868:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066790.224155:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e869880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976816768:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066790.224171:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01600/0xfb36a14ee608b05d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:0.0:1746066790.227768:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976876928 00000100:00100000:0.0:1746066790.227775:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976876928 00010000:00010000:0.0:1746066790.227805:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f387a00/0xfb36a14ee608b002 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e23d expref: 23 pid: 20127 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746066790.228398:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7368 00000100:00100000:0.0:1746066790.228407:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a530ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+23:1964:x1830882976876928:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066790.228419:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066790.228424:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f387a00/0xfb36a14ee608b002 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e23d expref: 23 pid: 20127 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066790.228435:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f387a00/0xfb36a14ee608b002 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e23d expref: 23 pid: 20127 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066790.228453:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f387a00/0xfb36a14ee608b002 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e23d expref: 23 pid: 20127 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066790.228824:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066790.228828:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01600/0xfb36a14ee608b05d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066790.228835:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01600/0xfb36a14ee608b05d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066790.228841:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066790.228878:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a530ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+22:1964:x1830882976876928:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 473us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066790.228884:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7368 00000100:00100000:0.0:1746066790.229433:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976877056 00000100:00100000:0.0:1746066790.229438:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976877056 00010000:00010000:0.0:1746066790.229452:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f386400/0xfb36a14ee608b048 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e26e expref: 39 pid: 20127 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746066790.229467:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7369 00000100:00100000:0.0:1746066790.229472:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+39:1965:x1830882976877056:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066790.229478:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066790.229481:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f386400/0xfb36a14ee608b048 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e26e expref: 39 pid: 20127 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066790.229488:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f386400/0xfb36a14ee608b048 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e26e expref: 39 pid: 20127 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066790.229499:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f386400/0xfb36a14ee608b048 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e26e expref: 39 pid: 20127 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066790.229510:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066790.229513:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01600/0xfb36a14ee608b05d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066790.229519:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01600/0xfb36a14ee608b05d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066790.229525:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01600/0xfb36a14ee608b05d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066790.229540:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066790.229557:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+38:1965:x1830882976877056:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 85us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066790.229564:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7369 00010000:00010000:0.0:1746066790.229579:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01600/0xfb36a14ee608b05d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066790.229584:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01600/0xfb36a14ee608b05d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:0.0:1746066790.229598:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066790.230602:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00000/0xfb36a14ee608b056 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e275 expref: 23 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066790.230617:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01600/0xfb36a14ee608b05d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e275 expref: 22 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066790.230623:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066790.230634:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066790.230637:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec01600, rc 0) 00000100:00100000:0.0:1746066790.230668:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+22:31531:x1830882976876800:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 7963us (8086us total) trans 8589943995 rc 0/0 00000100:00100000:0.0:1746066790.230694:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9947 00000100:00100000:0.0:1746066790.232671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.236157:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.238912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.244571:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.261795:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.290859:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.290963:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976878336 00000100:00100000:1.0:1746066790.290971:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976878336 00000100:00100000:1.0:1746066790.291023:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9951 00000100:00100000:1.0:1746066790.291031:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+38:31539:x1830882976878336:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066790.291053:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066790.291068:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b200/0xfb36a14ee608b0aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e291 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.291153:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b600/0xfb36a14ee608b0b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291165:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b600/0xfb36a14ee608b0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291176:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b600/0xfb36a14ee608b0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291189:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b000/0xfb36a14ee608b0b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291195:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b000/0xfb36a14ee608b0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291201:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b000/0xfb36a14ee608b0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291293:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009288be00/0xfb36a14ee608b0bf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291300:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009288be00/0xfb36a14ee608b0bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291306:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009288be00/0xfb36a14ee608b0bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066790.291313:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066790.291378:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b600/0xfb36a14ee608b0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291384:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b600/0xfb36a14ee608b0b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291389:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b600/0xfb36a14ee608b0b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291394:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009288b600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066790.291397:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b600/0xfb36a14ee608b0b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291402:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b600/0xfb36a14ee608b0b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291410:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066790.291412:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066790.291415:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b600/0xfb36a14ee608b0b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291419:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b600/0xfb36a14ee608b0b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291445:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b000/0xfb36a14ee608b0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291450:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b000/0xfb36a14ee608b0b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291454:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b000/0xfb36a14ee608b0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291457:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009288b000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066790.291459:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b000/0xfb36a14ee608b0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291467:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b000/0xfb36a14ee608b0b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291472:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebeb500) 00010000:00010000:1.0:1746066790.291473:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066790.291475:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b000/0xfb36a14ee608b0b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291479:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b000/0xfb36a14ee608b0b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066790.291508:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009288b200/0xfb36a14ee608b0aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e291 expref: 41 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.291517:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009288be00/0xfb36a14ee608b0bf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e291 expref: 40 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.291522:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066790.291524:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066790.291526:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009288be00, rc 0) 00000100:00100000:1.0:1746066790.291574:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+40:31539:x1830882976878336:12345-192.168.202.57@tcp:101:cat.0 Request processed in 542us (718us total) trans 8589943998 rc 0/0 00000100:00100000:1.0:1746066790.291581:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9951 00000100:00100000:1.0:1746066790.325018:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.353034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.354710:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976878720 00000100:00100000:1.0:1746066790.354720:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976878720 00000100:00100000:1.0:1746066790.354769:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14391 00000100:00100000:1.0:1746066790.354776:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:31533:x1830882976878720:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066790.354795:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066790.354810:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009288b800/0xfb36a14ee608b0cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e298 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.354834:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009904c400/0xfb36a14ee608afd1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e221 expref: 27 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.354842:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b46fc00/0xfb36a14ee608b017 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e267 expref: 7 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.354847:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb09e00/0xfb36a14ee608afe6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e236 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.354853:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.354854:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.354857:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009288b800/0xfb36a14ee608b0cd lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2203648->3117055] (req 2203648->3117055) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e298 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.354883:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb09e00/0xfb36a14ee608afe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e236 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.354892:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009eb09e00/0xfb36a14ee608afe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e236 expref: 21 pid: 4614 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066790.354901:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976817024:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.354983:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b46fc00/0xfb36a14ee608b017 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e267 expref: 7 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.354993:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b46fc00/0xfb36a14ee608b017 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e267 expref: 7 pid: 4614 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746066790.355000:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976817152:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.355018:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009904c400/0xfb36a14ee608afd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e221 expref: 27 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.355025:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009904c400/0xfb36a14ee608afd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e221 expref: 27 pid: 4614 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066790.355030:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976817280:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.355041:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066790.356274:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976817024:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.356283:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976817152:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.356289:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976817280:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.356308:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009288b800/0xfb36a14ee608b0cd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2203648->3117055] (req 2203648->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e298 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.356319:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009288b800, rc 0) 00000100:00100000:1.0:1746066790.356521:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:31533:x1830882976878720:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 1744us (3492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066790.356528:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14391 00000100:00100000:0.0:1746066790.360633:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.362003:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.362078:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.362103:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976878976 00000100:00100000:1.0:1746066790.362107:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976878976 00010000:00010000:1.0:1746066790.362121:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b46fc00/0xfb36a14ee608b017 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e267 expref: 8 pid: 4614 timeout: 851 lvb_type: 1 00000100:00100000:1.0:1746066790.362135:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976879104 00000100:00100000:1.0:1746066790.362137:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976879104 00010000:00010000:1.0:1746066790.362144:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009904c400/0xfb36a14ee608afd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e221 expref: 28 pid: 4614 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066790.362155:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7372 00000100:00100000:1.0:1746066790.362159:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882976878976:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066790.362165:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066790.362175:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b46fc00/0xfb36a14ee608b017 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e267 expref: 8 pid: 4614 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746066790.362182:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b46fc00/0xfb36a14ee608b017 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e267 expref: 8 pid: 4614 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746066790.362194:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b46fc00/0xfb36a14ee608b017 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e267 expref: 8 pid: 4614 timeout: 851 lvb_type: 1 00010000:00010000:1.0:1746066790.362205:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066790.362231:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882976878976:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 71us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066790.362236:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7372 00000100:00100000:1.0:1746066790.362249:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7373 00000100:00100000:1.0:1746066790.362253:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882976879104:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066790.362259:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066790.362266:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009904c400/0xfb36a14ee608afd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e221 expref: 28 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.362273:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009904c400/0xfb36a14ee608afd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e221 expref: 28 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.362283:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009904c400/0xfb36a14ee608afd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e221 expref: 28 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.362292:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.362293:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.362299:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009288b800/0xfb36a14ee608b0cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2203648->3117055) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e298 expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.362305:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009288b800/0xfb36a14ee608b0cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2203648->3117055) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e298 expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.362330:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009288b800/0xfb36a14ee608b0cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2203648->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e298 expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066790.362339:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976817408:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066790.362375:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066790.365662:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.365667:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976817408:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066790.365698:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066790.365723:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1966:x1830882976879104:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3468us (3645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066790.365729:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7373 00000100:00100000:0.0:1746066790.367795:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.377594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.377897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.377957:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976879744 00000100:00100000:0.0:1746066790.377964:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976879744 00000100:00100000:0.0:1746066790.378361:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14392 00000100:00100000:0.0:1746066790.378368:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882976879744:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066790.378376:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066790.378389:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec01c00/0xfb36a14ee608b0e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e2a6 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066790.378425:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976817536:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066790.378465:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066790.381314:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.392033:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.392105:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976880512 00000100:00100000:1.0:1746066790.392113:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976880512 00002000:00100000:1.0:1746066790.392149:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009e868700 x1830882976880512/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.392157:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e868700 with x1830882976880512 ext(2097152->3145727) 00002000:00010000:1.0:1746066790.392161:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e868700 00000100:00100000:1.0:1746066790.392651:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6524 00000100:00100000:1.0:1746066790.392659:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882976880512:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066790.402622:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882976880512:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9953us (10588us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066790.402646:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6524 00002000:00100000:1.0:1746066790.402660:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009e868700 x1830882976880512/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/440 e 0 to 0 dl 1746066801 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.402669:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e868700 with x1830882976880512 ext(2097152->3145727) 00002000:00010000:1.0:1746066790.402707:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e868700 00000100:00100000:0.0:1746066790.409156:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.413481:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.423580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.431090:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.431308:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976881024 00000100:00100000:1.0:1746066790.431316:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976881024 00010000:00010000:1.0:1746066790.431348:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009288b800/0xfb36a14ee608b0cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2203648->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e298 expref: 22 pid: 4614 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066790.431441:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7374 00000100:00100000:1.0:1746066790.431448:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f619180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1966:x1830882976881024:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066790.431460:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066790.431477:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009288b800/0xfb36a14ee608b0cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2203648->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e298 expref: 22 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.431488:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009288b800/0xfb36a14ee608b0cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2203648->3117055) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e298 expref: 22 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.431506:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009288b800/0xfb36a14ee608b0cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2203648->3117055) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e298 expref: 22 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.431532:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.431533:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.431540:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d198000/0xfb36a14ee608b0f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2ad expref: 28 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.431547:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d198000/0xfb36a14ee608b0f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2ad expref: 28 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.431573:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d198000/0xfb36a14ee608b0f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2ad expref: 28 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.431582:0:21351:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d198000/0xfb36a14ee608b0f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2ad expref: 28 pid: 4614 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066790.431597:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976817920:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066790.431697:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066790.433973:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976817920:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066790.433988:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066790.434015:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f619180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:1966:x1830882976881024:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2567us (2931us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066790.434023:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7374 00000100:00100000:0.0:1746066790.436176:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.436215:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.453533:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.462506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.462559:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.462648:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976881920 00000100:00100000:1.0:1746066790.462655:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976881920 00000100:00100000:1.0:1746066790.462713:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976882048 00000100:00100000:1.0:1746066790.462716:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976882048 00000100:00100000:1.0:1746066790.463124:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14395 00000100:00100000:1.0:1746066790.463132:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882976881920:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066790.463145:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066790.463159:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009288ae00/0xfb36a14ee608b113 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e2c2 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.463178:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.463188:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009288ae00/0xfb36a14ee608b113 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2c2 expref: 22 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.463197:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009288ae00/0xfb36a14ee608b113 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2c2 expref: 22 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.463211:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009288ae00, rc 0) 00000100:00100000:0.0:1746066790.463483:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14396 00000100:00100000:0.0:1746066790.463495:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:31543:x1830882976882048:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066790.463502:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066790.463508:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec01400/0xfb36a14ee608b11a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e2c9 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066790.463520:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066790.463522:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066790.463528:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec01400/0xfb36a14ee608b11a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2c9 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066790.463539:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec01400/0xfb36a14ee608b11a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2c9 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066790.463548:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec01400, rc 0) 00000100:00100000:1.0:1746066790.463767:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882976881920:12345-192.168.202.57@tcp:101:cat.0 Request processed in 635us (1269us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066790.463773:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14395 00000100:00100000:0.0:1746066790.463854:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:31543:x1830882976882048:12345-192.168.202.57@tcp:101:cat.0 Request processed in 364us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066790.463859:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14396 00000100:00100000:0.0:1746066790.464928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.465005:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976882176 00000100:00100000:1.0:1746066790.465010:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976882176 00010000:00010000:1.0:1746066790.465029:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d198000/0xfb36a14ee608b0f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2ad expref: 30 pid: 4614 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066790.465129:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7375 00000100:00100000:1.0:1746066790.465135:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a540a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882976882176:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066790.465144:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066790.465160:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d198000/0xfb36a14ee608b0f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2ad expref: 30 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.465169:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d198000/0xfb36a14ee608b0f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2ad expref: 30 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.465184:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d198000/0xfb36a14ee608b0f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2ad expref: 30 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.465195:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.465196:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.465201:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f386200/0xfb36a14ee608b0f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2146304->3145727] (req 2146304->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2b4 expref: 29 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.465208:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f386200/0xfb36a14ee608b0f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2146304->3145727] (req 2146304->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2b4 expref: 29 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.465237:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f386200/0xfb36a14ee608b0f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2146304->3145727] (req 2146304->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2b4 expref: 29 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066790.465246:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976818048:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066790.466075:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066790.472992:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.473108:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.473392:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976818048:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066790.473407:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066790.473447:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a540a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882976882176:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8312us (8521us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066790.473455:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7375 00000100:00100000:0.0:1746066790.476431:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.476510:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976882816 00000100:00100000:0.0:1746066790.476515:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976882816 00002000:00100000:0.0:1746066790.476547:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (2146304->2150399) req@ffff88009e868000 x1830882976882816/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066790.476555:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e868000 with x1830882976882816 ext(2146304->2150399) 00010000:00010000:0.0:1746066790.476562:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f386200/0xfb36a14ee608b0f7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2146304->3145727] (req 2146304->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2b4 expref: 31 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066790.476575:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f386200/0xfb36a14ee608b0f7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2146304->3145727] (req 2146304->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2b4 expref: 31 pid: 4614 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746066790.476583:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e868000 00000100:00100000:0.0:1746066790.476605:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2124 00000100:00100000:0.0:1746066790.476612:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882976882816:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066790.476727:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882976882816:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 116us (298us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066790.476733:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2124 00002000:00100000:0.0:1746066790.476738:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (2146304->2150399) req@ffff88009e868000 x1830882976882816/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/4536 e 0 to 0 dl 1746066801 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066790.476745:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e868000 with x1830882976882816 ext(2146304->2150399) 00010000:00010000:0.0:1746066790.476749:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f386200/0xfb36a14ee608b0f7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2146304->3145727] (req 2146304->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2b4 expref: 31 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746066790.476757:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f386200/0xfb36a14ee608b0f7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2146304->3145727] (req 2146304->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2b4 expref: 31 pid: 4614 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746066790.476762:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e868000 00000100:00100000:0.0:1746066790.490486:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.490595:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976883072 00000100:00100000:1.0:1746066790.490602:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976883072 00002000:00100000:1.0:1746066790.490647:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (3067904->3071999) req@ffff88009e868e00 x1830882976883072/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.490656:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e868e00 with x1830882976883072 ext(3067904->3071999) 00010000:00010000:1.0:1746066790.491368:0:11692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f386200/0xfb36a14ee608b0f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2146304->3145727] (req 2146304->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2b4 expref: 31 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.491382:0:11692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f386200/0xfb36a14ee608b0f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2146304->3145727] (req 2146304->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2b4 expref: 29 pid: 4614 timeout: 851 lvb_type: 0 00002000:00010000:1.0:1746066790.491388:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e868e00 00000100:00100000:1.0:1746066790.491410:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2125 00000100:00100000:1.0:1746066790.491417:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882976883072:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066790.491522:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882976883072:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 106us (1044us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066790.491527:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2125 00002000:00100000:1.0:1746066790.491533:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (3067904->3071999) req@ffff88009e868e00 x1830882976883072/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/4536 e 0 to 0 dl 1746066801 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.491540:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e868e00 with x1830882976883072 ext(3067904->3071999) 00010000:00010000:1.0:1746066790.491544:0:11692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f386200/0xfb36a14ee608b0f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2146304->3145727] (req 2146304->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2b4 expref: 29 pid: 4614 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.491552:0:11692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f386200/0xfb36a14ee608b0f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2146304->3145727] (req 2146304->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2b4 expref: 29 pid: 4614 timeout: 851 lvb_type: 0 00002000:00010000:1.0:1746066790.491557:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e868e00 00000100:00100000:0.0:1746066790.502528:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.502650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.502727:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.511031:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.518206:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066790.518274:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976884096 00000100:00100000:3.0:1746066790.518282:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976884096 00000100:00100000:3.0:1746066790.518321:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9954 00000100:00100000:3.0:1746066790.518327:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+44:31549:x1830882976884096:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066790.518342:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066790.518355:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b400/0xfb36a14ee608b136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e2e5 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.518422:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b000/0xfb36a14ee608b13d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066790.518434:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d198e00/0xfb36a14ee608b072 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e27c expref: 22 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.518440:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d198800/0xfb36a14ee608b09c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e28a expref: 284 pid: 809 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066790.518630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.518647:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976884224 00000100:00100000:0.0:1746066790.518653:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976884224 00000100:00100000:0.0:1746066790.518710:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14400 00010000:00010000:3.0:1746066790.518737:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009288be00/0xfb36a14ee608b0bf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e291 expref: 45 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.518745:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b000/0xfb36a14ee608b13d lrc: 6/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066790.518771:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009288be00/0xfb36a14ee608b0bf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e291 expref: 45 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.518780:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009288be00/0xfb36a14ee608b0bf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e291 expref: 45 pid: 14548 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746066790.518794:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976818304:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.519056:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882976884224:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066790.519064:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066790.519073:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d198800/0xfb36a14ee608b09c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e28a expref: 284 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.519073:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b144 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e2ec expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.519082:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d198800/0xfb36a14ee608b09c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e28a expref: 284 pid: 809 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746066790.519088:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976818432:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.519090:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b144 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2ec expref: 32 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.519098:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b144 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2ec expref: 32 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.519109:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009288ba00, rc 0) 00010000:00010000:3.0:1746066790.519111:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d198e00/0xfb36a14ee608b072 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e27c expref: 22 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.519117:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d198e00/0xfb36a14ee608b072 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e27c expref: 22 pid: 809 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066790.519122:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882976884224:12345-192.168.202.57@tcp:101:cat.0 Request processed in 407us (502us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066790.519124:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976818560:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.519127:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14400 00000100:00100000:3.0:1746066790.519136:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013733d000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066790.522112:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.522164:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.522180:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.522204:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066790.522906:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009288be00/0xfb36a14ee608b0bf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e291 expref: 45 pid: 14548 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746066790.522926:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976818304:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066790.522934:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d198800/0xfb36a14ee608b09c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e28a expref: 284 pid: 809 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746066790.522941:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976818432:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066790.522948:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d198e00/0xfb36a14ee608b072 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e27c expref: 22 pid: 809 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746066790.522954:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976818560:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066790.522968:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b000/0xfb36a14ee608b13d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066790.522975:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b000/0xfb36a14ee608b13d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066790.522979:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b000/0xfb36a14ee608b13d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:3.0:1746066790.522993:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066790.523097:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b400/0xfb36a14ee608b136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2e5 expref: 46 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.523106:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b000/0xfb36a14ee608b13d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2e5 expref: 45 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.523111:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:3.0:1746066790.523113:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066790.523115:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19b000, rc 0) 00000100:00100000:3.0:1746066790.523136:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+45:31549:x1830882976884096:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4810us (4932us total) trans 8589944004 rc 0/0 00000100:00100000:3.0:1746066790.523142:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9954 00000100:00100000:3.0:1746066790.524600:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976818688:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066790.524614:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066790.524647:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1965:x1830882976884352:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2275us (2540us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066790.524655:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7376 00000100:00100000:0.0:1746066790.529221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.529271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066790.529603:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976884992 00000100:00100000:3.0:1746066790.529611:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976884992 00002000:00100000:3.0:1746066790.529658:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88012c529880 x1830882976884992/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066790.529671:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c529880 with x1830882976884992 ext(2097152->3145727) 00002000:00010000:3.0:1746066790.529701:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c529880 00000100:00100000:3.0:1746066790.529716:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976885248 00000100:00100000:3.0:1746066790.529718:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976885248 00002000:00100000:3.0:1746066790.529729:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88012c52b480 x1830882976885248/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066790.529735:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52b480 with x1830882976885248 ext(3145728->4194303) 00002000:00010000:3.0:1746066790.529737:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c52b480 00000100:00100000:3.0:1746066790.530020:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6526 00000100:00100000:3.0:1746066790.530027:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882976884992:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066790.530387:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6527 00000100:00100000:0.0:1746066790.530398:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882976885248:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066790.540472:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882976884992:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10440us (11253us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066790.540481:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6526 00002000:00100000:3.0:1746066790.540489:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88012c529880 x1830882976884992/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:196/0 lens 488/440 e 0 to 0 dl 1746066801 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066790.540497:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c529880 with x1830882976884992 ext(2097152->3145727) 00002000:00010000:3.0:1746066790.540501:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c529880 00000100:00100000:0.0:1746066790.545592:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.545696:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976885376 00000100:00100000:1.0:1746066790.545703:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976885376 00000100:00100000:1.0:1746066790.545751:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14401 00000100:00100000:1.0:1746066790.545756:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:31549:x1830882976885376:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066790.545771:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066790.545784:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5c00/0xfb36a14ee608b152 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e2f3 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.545807:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e80aa00/0xfb36a14ee608b121 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2d0 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.545814:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec01400/0xfb36a14ee608b11a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2c9 expref: 29 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.545820:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066790.545822:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066790.545824:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5c00/0xfb36a14ee608b152 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3792896->3981311] (req 3792896->3981311) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2f3 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.545848:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec01400/0xfb36a14ee608b11a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2c9 expref: 29 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.545858:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec01400/0xfb36a14ee608b11a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2c9 expref: 29 pid: 21203 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066790.545868:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976818816:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.545936:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e80aa00/0xfb36a14ee608b121 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2d0 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.545944:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e80aa00/0xfb36a14ee608b121 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2d0 expref: 23 pid: 8452 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066790.545950:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976818944:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.545965:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066790.550259:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066790.550433:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976885504 00000100:00100000:3.0:1746066790.550441:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976885504 00010000:00010000:3.0:1746066790.550470:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec01400/0xfb36a14ee608b11a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2c9 expref: 30 pid: 21203 timeout: 851 lvb_type: 0 00000100:00100000:3.0:1746066790.550505:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7380 00000100:00100000:3.0:1746066790.550512:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1966:x1830882976885504:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066790.550523:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066790.550541:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec01400/0xfb36a14ee608b11a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2c9 expref: 30 pid: 21203 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746066790.550552:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec01400/0xfb36a14ee608b11a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2c9 expref: 30 pid: 21203 timeout: 851 lvb_type: 0 00010000:00010000:3.0:1746066790.550572:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066790.550604:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1966:x1830882976885504:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 92us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066790.550609:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7380 00010000:00010000:1.0:1746066790.550840:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec01400/0xfb36a14ee608b11a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2c9 expref: 29 pid: 21203 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066790.550870:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976818816:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.550880:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976818944:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.550900:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5c00/0xfb36a14ee608b152 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3792896->3981311] (req 3792896->3981311) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2f3 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.550910:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d5c00, rc 0) 00000100:00100000:1.0:1746066790.550928:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:31549:x1830882976885376:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 5172us (5343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066790.550934:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14401 00000100:00100000:0.0:1746066790.557152:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.565062:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066790.565191:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976885888 00000100:00100000:3.0:1746066790.565197:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976885888 00002000:00100000:3.0:1746066790.565226:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3792896->3796991) req@ffff88012c529c00 x1830882976885888/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066790.565234:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c529c00 with x1830882976885888 ext(3792896->3796991) 00002000:00010000:3.0:1746066790.565238:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c529c00 00000100:00100000:3.0:1746066790.565259:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6528 00000100:00100000:3.0:1746066790.565264:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882976885888:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066790.565383:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882976885888:12345-192.168.202.57@tcp:3:cat.0 Request processed in 119us (322us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066790.565388:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6528 00002000:00100000:3.0:1746066790.565392:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3792896->3796991) req@ffff88012c529c00 x1830882976885888/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:196/0 lens 488/4536 e 0 to 0 dl 1746066801 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066790.565399:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c529c00 with x1830882976885888 ext(3792896->3796991) 00002000:00010000:3.0:1746066790.565402:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c529c00 00000100:00100000:0.0:1746066790.573142:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.645899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.646288:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976886272 00000100:00100000:1.0:1746066790.646296:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976886272 00000100:00100000:1.0:1746066790.646346:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14402 00000100:00100000:1.0:1746066790.646353:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882976886272:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066790.646368:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066790.646382:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5600/0xfb36a14ee608b159 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e2fa expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066790.646426:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976819200:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066790.646499:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066790.648932:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976819200:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066790.648958:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5600/0xfb36a14ee608b159 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2fa expref: 30 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.648970:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5600/0xfb36a14ee608b159 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2fa expref: 30 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.648994:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d5600, rc 0) 00000100:00100000:1.0:1746066790.649027:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882976886272:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2674us (3135us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066790.649034:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14402 00000100:00100000:0.0:1746066790.662995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.663135:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976886400 00000100:00100000:1.0:1746066790.663142:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976886400 00000100:00100000:1.0:1746066790.663402:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14403 00000100:00100000:1.0:1746066790.663410:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:31556:x1830882976886400:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066790.663425:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066790.663439:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b160 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e301 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.663464:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5c00/0xfb36a14ee608b152 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->3981311) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2f3 expref: 21 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.663476:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066790.663478:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066790.663482:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b160 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e301 expref: 30 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.663508:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5c00/0xfb36a14ee608b152 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->3981311) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2f3 expref: 21 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.663517:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5c00/0xfb36a14ee608b152 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->3981311) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2f3 expref: 21 pid: 8452 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066790.663527:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976819328:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.665736:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066790.668354:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976819328:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.668381:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b160 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e301 expref: 30 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.668397:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d5400, rc 0) 00000100:00100000:1.0:1746066790.668446:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:31556:x1830882976886400:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5036us (5459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066790.668454:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14403 00000100:00100000:0.0:1746066790.672859:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.678950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.679110:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976886656 00000100:00100000:1.0:1746066790.679117:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976886656 00000100:00100000:0.0:1746066790.679119:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.679397:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14404 00000100:00100000:1.0:1746066790.679405:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882976886656:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066790.679419:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066790.679432:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5a00/0xfb36a14ee608b167 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e308 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066790.679617:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976819456:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066790.679881:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473000 going to sleep for 11 seconds 00010000:00010000:1.0:1746066790.681702:0:8452:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.57@tcp) returned -22 from glimpse AST (req@ffff88009ef5ce00 x1830882976819456) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5c00/0xfb36a14ee608b152 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3792896->3981311) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2f3 expref: 25 pid: 8452 timeout: 851 lvb_type: 0 00010000:00010000:1.0:1746066790.681726:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5c00/0xfb36a14ee608b152 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3792896->3981311) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2f3 expref: 25 pid: 8452 timeout: 851 lvb_type: 0 00000100:00100000:1.0:1746066790.681748:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976819456:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066790.681766:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5a00/0xfb36a14ee608b167 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e308 expref: 24 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.681776:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5a00/0xfb36a14ee608b167 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e308 expref: 24 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.681782:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d5a00, rc 0) 00000100:00100000:1.0:1746066790.681799:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882976886656:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2395us (2851us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066790.681804:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14404 00000100:00100000:0.0:1746066790.688369:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.689698:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.690319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066790.690604:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6531 00000100:00100000:3.0:1746066790.690610:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882976887296:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066790.690832:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976887424 00000100:00100000:1.0:1746066790.690835:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976887424 00000100:00100000:1.0:1746066790.690854:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14405 00000100:00100000:1.0:1746066790.690859:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:31559:x1830882976887424:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066790.690866:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066790.690879:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5800/0xfb36a14ee608b16e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e30f expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.690894:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.690896:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.690901:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5800/0xfb36a14ee608b16e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e30f expref: 24 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.690912:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5800/0xfb36a14ee608b16e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e30f expref: 24 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.690919:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d5800, rc 0) 00000100:00100000:1.0:1746066790.690962:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:31559:x1830882976887424:12345-192.168.202.57@tcp:101:cat.0 Request processed in 103us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066790.690968:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14405 00000100:00100000:3.0:1746066790.700387:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882976887296:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9769us (10680us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066790.700397:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6531 00002000:00100000:3.0:1746066790.700407:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880136b40e00 x1830882976887296/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/440 e 0 to 0 dl 1746066801 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066790.700416:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b40e00 with x1830882976887296 ext(3145728->4194303) 00002000:00010000:3.0:1746066790.700421:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b40e00 00000100:00100000:0.0:1746066790.702797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.709966:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066790.710106:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976887936 00000100:00100000:3.0:1746066790.710112:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976887936 00002000:00100000:3.0:1746066790.710138:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880136b41c00 x1830882976887936/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066790.710147:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b41c00 with x1830882976887936 ext(3145728->4194303) 00002000:00010000:3.0:1746066790.710150:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b41c00 00000100:00100000:3.0:1746066790.710180:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6533 00000100:00100000:3.0:1746066790.710187:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882976887936:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066790.732324:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066790.732387:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976888192 00000100:00100000:3.0:1746066790.732396:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976888192 00000100:00100000:3.0:1746066790.732447:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9955 00000100:00100000:3.0:1746066790.732455:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+284:31562:x1830882976888192:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066790.732474:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066790.732487:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ac00/0xfb36a14ee608b175 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e316 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.732555:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b800/0xfb36a14ee608b17c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066790.732565:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b800/0xfb36a14ee608b17c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066790.732574:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b800/0xfb36a14ee608b17c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:3.0:1746066790.732581:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066790.732704:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ac00/0xfb36a14ee608b175 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e316 expref: 287 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.732723:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b800/0xfb36a14ee608b17c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e316 expref: 286 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.732730:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:3.0:1746066790.732732:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066790.732735:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19b800, rc 0) 00000100:00100000:3.0:1746066790.732777:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+286:31562:x1830882976888192:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 323us (461us total) trans 8589944005 rc 0/0 00000100:00100000:3.0:1746066790.732782:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9955 00000100:00100000:0.0:1746066790.930094:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.930588:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976888320 00000100:00100000:1.0:1746066790.930599:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976888320 00000100:00100000:1.0:1746066790.930731:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14406 00000100:00100000:1.0:1746066790.930742:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:31562:x1830882976888320:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066790.930758:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066790.930773:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e31d expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.930797:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b46e200/0xfb36a14ee608afa0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1f0 expref: 23 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.930805:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608b009 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e24b expref: 6 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.930811:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b46e600/0xfb36a14ee608afae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1fe expref: 31 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.930816:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.930818:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.930821:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1671168->2097151] (req 1671168->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.930845:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b46e600/0xfb36a14ee608afae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1fe expref: 31 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.930855:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b46e600/0xfb36a14ee608afae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1fe expref: 31 pid: 8112 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066790.930865:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976819712:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.930949:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608b009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e24b expref: 6 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.930957:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608b009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e24b expref: 6 pid: 8451 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746066790.930965:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976819840:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.930985:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b46e200/0xfb36a14ee608afa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1f0 expref: 23 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.930991:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b46e200/0xfb36a14ee608afa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1f0 expref: 23 pid: 8112 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066790.930998:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976819968:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.931011:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066790.933600:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976819712:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.933611:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976819840:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.933618:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976819968:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.933671:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1671168->2097151] (req 1671168->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.933718:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d5000, rc 0) 00000100:00100000:1.0:1746066790.933757:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:31562:x1830882976888320:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3018us (3673us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066790.933764:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14406 00000100:00100000:0.0:1746066790.936311:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.936344:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.936431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066790.936662:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976888448 00000100:00100000:3.0:1746066790.936670:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976888448 00000100:00100000:1.0:1746066790.936704:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976888704 00000100:00100000:1.0:1746066790.936708:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976888704 00010000:00010000:3.0:1746066790.936723:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608b009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e24b expref: 7 pid: 8451 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066790.936723:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b46e200/0xfb36a14ee608afa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1f0 expref: 24 pid: 8112 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066790.936749:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7383 00000100:00100000:3.0:1746066790.936756:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976888448:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066790.936767:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066790.936784:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608b009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e24b expref: 7 pid: 8451 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746066790.936794:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608b009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e24b expref: 7 pid: 8451 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746066790.936814:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608b009 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e24b expref: 7 pid: 8451 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746066790.936829:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066790.936864:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882976888448:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 104us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066790.936870:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7383 00000100:00100000:3.0:1746066790.936883:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7384 00000100:00100000:3.0:1746066790.936887:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882976888704:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066790.936893:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066790.936900:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b46e200/0xfb36a14ee608afa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1f0 expref: 24 pid: 8112 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066790.936906:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b46e200/0xfb36a14ee608afa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1f0 expref: 24 pid: 8112 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066790.936907:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7385 00000100:00100000:1.0:1746066790.936912:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1965:x1830882976888576:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066790.936917:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b46e200/0xfb36a14ee608afa0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1f0 expref: 24 pid: 8112 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066790.936919:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066790.936926:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b46e600/0xfb36a14ee608afae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1fe expref: 31 pid: 8112 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066790.936928:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066790.936933:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b46e600/0xfb36a14ee608afae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1fe expref: 31 pid: 8112 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066790.936940:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882976888704:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 53us (510us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066790.936943:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b46e600/0xfb36a14ee608afae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1fe expref: 31 pid: 8112 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066790.936944:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7384 00010000:00010000:1.0:1746066790.937105:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.937107:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.937114:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.937121:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.937267:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066790.937279:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976820096:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066790.938257:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066790.941490:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.941693:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976820096:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066790.941710:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066790.941754:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1965:x1830882976888576:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4840us (5408us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066790.941764:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7385 00000100:00100000:0.0:1746066790.948552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.948591:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.948775:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976889344 00000100:00100000:1.0:1746066790.948782:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976889344 00000100:00100000:1.0:1746066790.948833:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14407 00000100:00100000:1.0:1746066790.948840:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:31562:x1830882976889344:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066790.948853:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066790.948872:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e324 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.948898:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608afbc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e20c expref: 22 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.948906:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d199a00/0xfb36a14ee608b025 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e252 expref: 5 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.948912:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a67e6600/0xfb36a14ee608afc3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e213 expref: 31 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.948917:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.948919:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.948921:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->1568767] (req 1048576->1568767) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.948943:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a67e6600/0xfb36a14ee608afc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e213 expref: 31 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.948953:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a67e6600/0xfb36a14ee608afc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e213 expref: 31 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066790.949961:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976820224:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.950010:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d199a00/0xfb36a14ee608b025 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e252 expref: 5 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066790.950018:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d199a00/0xfb36a14ee608b025 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e252 expref: 5 pid: 8112 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746066790.950025:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976820352:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.950039:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608afbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e20c expref: 22 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.950045:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608afbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e20c expref: 22 pid: 8112 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066790.950051:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976820480:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.950061:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066790.961407:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.961751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.961782:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976889472 00000100:00100000:0.0:1746066790.961789:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976889472 00010000:00010000:0.0:1746066790.961825:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d199a00/0xfb36a14ee608b025 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e252 expref: 6 pid: 8112 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746066790.961846:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976889600 00000100:00100000:0.0:1746066790.961848:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976889600 00010000:00010000:0.0:1746066790.961857:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a67e6600/0xfb36a14ee608afc3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e213 expref: 32 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066790.962114:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976820224:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.962123:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976820352:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.962130:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976820480:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.962152:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->1568767] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 32 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.962169:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d4a00, rc 0) 00000100:00100000:1.0:1746066790.962205:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:31562:x1830882976889344:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 13365us (13612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066790.962211:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14407 00000100:00100000:0.0:1746066790.962722:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7386 00000100:00100000:0.0:1746066790.962730:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1965:x1830882976889472:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066790.962742:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066790.962760:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d199a00/0xfb36a14ee608b025 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e252 expref: 6 pid: 8112 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746066790.962769:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d199a00/0xfb36a14ee608b025 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e252 expref: 6 pid: 8112 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746066790.962791:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d199a00/0xfb36a14ee608b025 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e252 expref: 6 pid: 8112 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746066790.963993:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066790.964041:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1965:x1830882976889472:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1311us (2642us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066790.964047:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7386 00000100:00100000:1.0:1746066790.964097:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976889728 00000100:00100000:1.0:1746066790.964101:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976889728 00010000:00010000:1.0:1746066790.964116:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608afbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e20c expref: 23 pid: 8112 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066790.964179:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7388 00000100:00100000:1.0:1746066790.964186:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882976889728:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066790.964198:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066790.964208:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608afbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e20c expref: 23 pid: 8112 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066790.964299:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608afbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e20c expref: 23 pid: 8112 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066790.964313:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608afbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e20c expref: 23 pid: 8112 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066790.964333:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.964335:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066790.964342:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 29 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.964349:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 29 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.964374:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 29 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066790.964384:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976820608:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066790.964434:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066790.964780:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.964820:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976889856 00000100:00100000:1.0:1746066790.964823:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976889856 00000100:00100000:1.0:1746066790.964851:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14408 00000100:00100000:1.0:1746066790.964856:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:31573:x1830882976889856:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066790.964868:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066790.964876:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4800/0xfb36a14ee608b198 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e32b expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.964890:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.964895:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066790.964896:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066790.964898:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4800/0xfb36a14ee608b198 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e32b expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.964917:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.964926:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 31 pid: 21203 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066790.964933:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976820736:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.964964:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066790.971986:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976820736:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.972011:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4800/0xfb36a14ee608b198 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e32b expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.972027:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d4800, rc 0) 00000100:00100000:1.0:1746066790.972064:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:31573:x1830882976889856:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7206us (7284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066790.972070:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14408 00000100:00100000:0.0:1746066790.972390:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.972510:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976889984 00000100:00100000:1.0:1746066790.972515:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976889984 00000100:00100000:1.0:1746066790.972558:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14409 00000100:00100000:1.0:1746066790.972565:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+22:31565:x1830882976889984:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066790.972583:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066790.972595:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b19f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e332 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.972617:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.972632:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066790.972634:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066790.972637:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b19f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1216512->2097151] (req 1216512->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e332 expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.972659:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066790.972668:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 30 pid: 21203 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066790.972704:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976820864:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066790.972765:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066790.975225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.975256:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066790.975317:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976890240 00000100:00100000:3.0:1746066790.975324:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976890240 00000100:00100000:1.0:1746066790.975337:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976820864:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066790.975357:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b19f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1216512->2097151] (req 1216512->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e332 expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066790.975358:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1564672->1568767) req@ffff8800931d1f80 x1830882976890240/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066790.975366:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d1f80 with x1830882976890240 ext(1564672->1568767) 00010000:00010000:1.0:1746066790.975368:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d4e00, rc 0) 00010000:00010000:3.0:1746066790.975372:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 31 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066790.975380:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 31 pid: 21203 timeout: 852 lvb_type: 0 00002000:00010000:3.0:1746066790.975386:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800931d1f80 00000100:00100000:1.0:1746066790.975398:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+23:31565:x1830882976889984:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2833us (3008us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066790.975401:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976890368 00000100:00100000:3.0:1746066790.975404:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976890368 00000100:00100000:1.0:1746066790.975405:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14409 00002000:00100000:3.0:1746066790.975414:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1671168->2097151) req@ffff8800931d3480 x1830882976890368/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066790.975420:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d3480 with x1830882976890368 ext(1671168->2097151) 00010000:00010000:3.0:1746066790.975424:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 32 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066790.975431:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 32 pid: 21203 timeout: 852 lvb_type: 0 00002000:00010000:3.0:1746066790.975436:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800931d3480 00000100:00100000:3.0:1746066790.975447:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2128 00000100:00100000:3.0:1746066790.975453:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882976890240:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066790.975579:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882976890240:12345-192.168.202.57@tcp:3:cat.0 Request processed in 125us (358us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066790.975584:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2128 00002000:00100000:3.0:1746066790.975589:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1564672->1568767) req@ffff8800931d1f80 x1830882976890240/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/4536 e 0 to 0 dl 1746066801 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066790.975596:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d1f80 with x1830882976890240 ext(1564672->1568767) 00010000:00010000:3.0:1746066790.975600:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 32 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066790.975608:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 32 pid: 21203 timeout: 852 lvb_type: 0 00002000:00010000:3.0:1746066790.975612:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800931d1f80 00000100:00100000:0.0:1746066790.979084:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066790.982252:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976890624 00000100:00100000:1.0:1746066790.982532:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976890624 00002000:00100000:1.0:1746066790.983734:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1568767) req@ffff8800931d3100 x1830882976890624/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/0 e 0 to 0 dl 1746066801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.983744:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d3100 with x1830882976890624 ext(1048576->1568767) 00010000:00010000:1.0:1746066790.983753:0:11692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 33 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066790.983765:0:11692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 33 pid: 21203 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746066790.983771:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800931d3100 00000100:00100000:1.0:1746066790.983797:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2130 00000100:00100000:1.0:1746066790.983805:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1965:x1830882976890624:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066790.985548:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882976890368:12345-192.168.202.57@tcp:4:cat.0 Request processed in 10029us (10283us total) trans 21474840880 rc 0/0 00000100:00100000:3.0:1746066790.985558:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2129 00002000:00100000:3.0:1746066790.985567:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1671168->2097151) req@ffff8800931d3480 x1830882976890368/t21474840880(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/448 e 0 to 0 dl 1746066801 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066790.985575:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d3480 with x1830882976890368 ext(1671168->2097151) 00010000:00010000:3.0:1746066790.985582:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 35 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066790.985592:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 35 pid: 21203 timeout: 852 lvb_type: 0 00002000:00010000:3.0:1746066790.985597:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800931d3480 00000100:00100000:0.0:1746066790.989449:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066790.989706:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976890752 00000100:00100000:3.0:1746066790.989713:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976890752 00010000:00010000:3.0:1746066790.989745:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 35 pid: 21203 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066790.989772:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7389 00000100:00100000:3.0:1746066790.989778:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5409c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882976890752:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066790.989789:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066790.989804:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066789 -> 1746066790 00002000:00010000:3.0:1746066790.989806:0:7109:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066788 -> 1746066790 00002000:00010000:3.0:1746066790.989808:0:7109:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066789 -> 1746066790 00010000:00010000:3.0:1746066790.989813:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 35 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066790.989823:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 35 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066790.989841:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b18a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1671168->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e31d expref: 35 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066790.989854:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066790.989856:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066790.989862:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b19f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e332 expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.989869:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b19f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e332 expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.989897:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b19f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e332 expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066790.989906:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976820992:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066790.989958:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d1de40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066790.991359:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1965:x1830882976890624:12345-192.168.202.57@tcp:4:cat.0 Request processed in 7550us (12277us total) trans 21474840881 rc 0/0 00000100:00100000:1.0:1746066790.991369:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2130 00002000:00100000:1.0:1746066790.991377:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1568767) req@ffff8800931d3100 x1830882976890624/t21474840881(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:196/0 lens 488/448 e 0 to 0 dl 1746066801 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066790.991385:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d3100 with x1830882976890624 ext(1048576->1568767) 00010000:00010000:1.0:1746066790.991391:0:11692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 35 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066790.991402:0:11692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 35 pid: 21203 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746066790.991408:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800931d3100 00000100:00100000:3.0:1746066790.993924:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976820992:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066790.993947:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066790.993996:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5409c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882976890752:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4217us (4552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066790.994005:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7389 00000100:00100000:1.0:1746066790.995364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066790.997774:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066790.998117:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976891136 00000100:00100000:3.0:1746066790.998121:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976891136 00010000:00010000:3.0:1746066790.998143:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 34 pid: 21203 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066790.998174:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7390 00000100:00100000:3.0:1746066790.998179:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882976891136:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066790.998189:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066790.998204:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066788 -> 1746066790 00002000:00010000:3.0:1746066790.998207:0:7109:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066788 -> 1746066790 00010000:00010000:3.0:1746066790.998212:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 34 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066790.998221:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 34 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066790.998238:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b191 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e324 expref: 34 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066790.998262:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066790.998264:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066790.998270:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4800/0xfb36a14ee608b198 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e32b expref: 33 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.998278:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4800/0xfb36a14ee608b198 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e32b expref: 33 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066790.998427:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4800/0xfb36a14ee608b198 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e32b expref: 33 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066790.998437:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976821120:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066790.998501:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013733d000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.002481:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.002490:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976821120:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066791.002506:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066791.002550:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882976891136:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4369us (4777us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.002559:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7390 00000100:00080000:1.0:1746066791.003809:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066791.007121:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.007389:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976891520 00000100:00100000:1.0:1746066791.007396:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976891520 00000100:00100000:1.0:1746066791.007466:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14410 00000100:00100000:1.0:1746066791.007473:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+23:31565:x1830882976891520:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066791.007487:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.007501:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9600/0xfb36a14ee608b1a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e339 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.007528:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4800/0xfb36a14ee608b198 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e32b expref: 34 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.007535:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.007536:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.007539:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9600/0xfb36a14ee608b1a6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e339 expref: 24 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.007565:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4800/0xfb36a14ee608b198 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e32b expref: 34 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.007574:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4800/0xfb36a14ee608b198 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e32b expref: 34 pid: 21203 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.007584:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976821248:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066791.007660:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.010368:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976821248:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.010392:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9600/0xfb36a14ee608b1a6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e339 expref: 24 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.010406:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ac9600, rc 0) 00000100:00100000:1.0:1746066791.010910:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+24:31565:x1830882976891520:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3436us (3795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.010916:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14410 00000100:00100000:0.0:1746066791.019765:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.019837:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976891776 00000100:00100000:1.0:1746066791.019845:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976891776 00000100:00100000:3.0:1746066791.019992:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14411 00000100:00100000:3.0:1746066791.020001:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882976891776:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:1.0:1746066791.020016:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066791.020017:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.020032:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f78bc00/0xfb36a14ee608b1ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e347 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.020050:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.020058:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f78bc00/0xfb36a14ee608b1ad lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e347 expref: 34 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.020068:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f78bc00/0xfb36a14ee608b1ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e347 expref: 34 pid: 8452 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066791.020068:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066791.020081:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f78bc00, rc 0) 00000100:00100000:3.0:1746066791.020116:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882976891776:12345-192.168.202.57@tcp:101:cat.0 Request processed in 116us (449us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066791.020121:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14411 00000100:00100000:3.0:1746066791.020132:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976891648 00000100:00100000:3.0:1746066791.020134:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976891648 00000100:00100000:3.0:1746066791.020152:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14412 00000100:00100000:3.0:1746066791.020156:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882976891648:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066791.020162:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.020168:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f386200/0xfb36a14ee608b1b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e340 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.020207:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976821376:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066791.020248:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013733d000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.023124:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976821376:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066791.023148:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f386200/0xfb36a14ee608b1b4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e340 expref: 34 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.023160:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f386200/0xfb36a14ee608b1b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e340 expref: 34 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.023174:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f386200, rc 0) 00000100:00100000:3.0:1746066791.023218:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882976891648:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3060us (3200us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066791.023225:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14412 00000100:00100000:0.0:1746066791.023489:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.024447:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976892160 00000100:00100000:3.0:1746066791.024453:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976892160 00002000:00100000:3.0:1746066791.024482:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38e:0x0] (1212416->1216511) req@ffff8800931d0380 x1830882976892160/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.024490:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0380 with x1830882976892160 ext(1212416->1216511) 00002000:00010000:3.0:1746066791.024494:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800931d0380 00000100:00100000:3.0:1746066791.024509:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6538 00000100:00100000:3.0:1746066791.024514:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882976892160:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066791.025910:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882976892160:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 1394us (2420us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066791.025917:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6538 00002000:00100000:3.0:1746066791.025922:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38e:0x0] (1212416->1216511) req@ffff8800931d0380 x1830882976892160/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/4536 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.025929:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0380 with x1830882976892160 ext(1212416->1216511) 00002000:00010000:3.0:1746066791.025933:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800931d0380 00000100:00100000:0.0:1746066791.026946:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.027005:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.027223:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976892288 00000100:00100000:3.0:1746066791.027228:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976892288 00000100:00100000:3.0:1746066791.027260:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976892416 00000100:00100000:3.0:1746066791.027262:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976892416 00000100:00100000:3.0:1746066791.027274:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14413 00000100:00100000:3.0:1746066791.027279:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1966:x1830882976892288:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066791.027290:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.027302:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0a00/0xfb36a14ee608b1bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e34e expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.027340:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976821632:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066791.027386:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013733d000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.028900:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976821632:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066791.028920:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0a00/0xfb36a14ee608b1bb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e34e expref: 35 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.028928:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0a00/0xfb36a14ee608b1bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e34e expref: 35 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.028936:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a0a00, rc 0) 00000100:00100000:3.0:1746066791.028959:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882976892288:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1679us (2015us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066791.028964:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14413 00000100:00100000:0.0:1746066791.033254:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.033367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.033439:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976892544 00000100:00100000:3.0:1746066791.033443:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976892544 00000100:00100000:3.0:1746066791.033485:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14415 00000100:00100000:3.0:1746066791.033492:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1965:x1830882976892544:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066791.033521:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.033527:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0c00/0xfb36a14ee608b1d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e35c expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.033559:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976822016:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066791.033630:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013733d000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.035133:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976822016:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066791.035151:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0c00/0xfb36a14ee608b1d0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e35c expref: 35 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.035161:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0c00/0xfb36a14ee608b1d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e35c expref: 35 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.035170:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a0c00, rc 0) 00000100:00100000:3.0:1746066791.035206:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882976892544:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1713us (1837us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066791.035212:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14415 00000100:00100000:0.0:1746066791.048890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.048991:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976892800 00000100:00100000:3.0:1746066791.048999:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976892800 00000100:00100000:3.0:1746066791.049084:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9956 00000100:00100000:3.0:1746066791.049092:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+22:31577:x1830882976892800:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066791.049112:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.049127:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a0e00/0xfb36a14ee608b1d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e36a expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.049178:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1000/0xfb36a14ee608b1de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.049188:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1000/0xfb36a14ee608b1de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.049197:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1000/0xfb36a14ee608b1de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.049209:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b1e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.049213:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.049217:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.049301:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b1ec lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.049308:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b000/0xfb36a14ee608b13d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2e5 expref: 44 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.049314:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b800/0xfb36a14ee608b17c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e316 expref: 285 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.049319:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b1ec lrc: 5/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.049342:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b800/0xfb36a14ee608b17c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e316 expref: 285 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.049355:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b800/0xfb36a14ee608b17c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e316 expref: 285 pid: 809 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.049365:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976822144:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.051561:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b000/0xfb36a14ee608b13d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2e5 expref: 44 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.051575:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b000/0xfb36a14ee608b13d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2e5 expref: 44 pid: 809 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.051587:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976822272:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.052244:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013733d000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.053715:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976822144:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066791.053715:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.053722:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976822272:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.053738:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b1ec lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:0.0:1746066791.053754:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.053774:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976893056 00000100:00100000:3.0:1746066791.053851:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976893056 00000100:00080000:0.0:1746066791.053918:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066791.053953:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4146 00000100:00100000:3.0:1746066791.053960:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+286:13378:x1830882976893056:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746066791.054289:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+287:13378:x1830882976893056:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 325us (573us total) trans 8589944007 rc 0/0 00000100:00100000:3.0:1746066791.054296:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4146 00000100:00100000:0.0:1746066791.055503:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.055540:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066791.055978:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b1ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.055984:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b1ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:3.0:1746066791.056015:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066791.056018:0:809:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066791.056030:0:809:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b1ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056038:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b1ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056045:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1000/0xfb36a14ee608b1de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056051:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1000/0xfb36a14ee608b1de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056056:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1000/0xfb36a14ee608b1de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056060:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3a1000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066791.056063:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1000/0xfb36a14ee608b1de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056068:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1000/0xfb36a14ee608b1de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056074:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066791.056077:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066791.056079:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1000/0xfb36a14ee608b1de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056083:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1000/0xfb36a14ee608b1de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056094:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056098:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b1e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056102:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056105:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3a1200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066791.056107:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056110:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b1e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056115:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ffede00) 00010000:00010000:3.0:1746066791.056117:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066791.056119:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b1e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056123:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b1e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.056149:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a0e00/0xfb36a14ee608b1d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e36a expref: 24 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.056159:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b1ec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e36a expref: 23 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.056164:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:3.0:1746066791.056166:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066791.056168:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a1400, rc 0) 00000100:00100000:3.0:1746066791.056190:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+23:31577:x1830882976892800:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 7101us (7310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.056196:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9956 00000100:00100000:0.0:1746066791.058372:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.058400:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.058431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.058505:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976893696 00000100:00100000:1.0:1746066791.058512:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976893696 00000100:00100000:1.0:1746066791.058542:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976893824 00000100:00100000:1.0:1746066791.058544:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976893824 00000100:00100000:1.0:1746066791.058552:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976893952 00000100:00100000:1.0:1746066791.058554:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976893952 00000100:00100000:1.0:1746066791.058571:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14417 00000100:00100000:1.0:1746066791.058577:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976893696:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066791.058590:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.058603:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9800/0xfb36a14ee608b1f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e371 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.058652:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976822400:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066791.058717:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.058730:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14418 00000100:00100000:1.0:1746066791.058735:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976893824:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066791.058743:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.058749:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4a00/0xfb36a14ee608b1fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e378 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.058767:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976822528:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066791.058783:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.058838:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14419 00000100:00100000:3.0:1746066791.058844:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976893952:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066791.058850:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.058856:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0000/0xfb36a14ee608b201 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e37f expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.058867:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.058869:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.058875:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0000/0xfb36a14ee608b201 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e37f expref: 10 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.058886:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0000/0xfb36a14ee608b201 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e37f expref: 10 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.058893:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a0000, rc 0) 00000100:00100000:3.0:1746066791.058910:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976893952:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 66us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.058914:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14419 00000100:00080000:0.0:1746066791.058981:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066791.060483:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976822400:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066791.060507:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9800/0xfb36a14ee608b1f3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e371 expref: 9 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.060518:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9800/0xfb36a14ee608b1f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e371 expref: 9 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.061039:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ac9800, rc 0) 00000100:00100000:1.0:1746066791.061063:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882976893696:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2485us (2696us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066791.061068:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14417 00000100:00100000:0.0:1746066791.062957:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.063159:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976894208 00000100:00100000:3.0:1746066791.063167:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976894208 00000100:00100000:3.0:1746066791.063222:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9957 00000100:00100000:3.0:1746066791.063229:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+23:31577:x1830882976894208:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066791.063250:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.063263:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1c00/0xfb36a14ee608b208 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e386 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.063334:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b20f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.063345:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b1ec lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e36a expref: 24 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.063350:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b20f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.063375:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b1ec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e36a expref: 24 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.063384:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b1ec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e36a expref: 24 pid: 809 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.063395:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976822656:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.063535:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013733df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.064803:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976822656:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.064817:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b20f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:0.0:1746066791.065107:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066791.065979:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b20f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.065986:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b20f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:3.0:1746066791.066004:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066791.066118:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1c00/0xfb36a14ee608b208 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e386 expref: 25 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.066145:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b20f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e386 expref: 24 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.066151:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:3.0:1746066791.066153:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066791.066155:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a1600, rc 0) 00000100:00100000:3.0:1746066791.066184:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+24:31577:x1830882976894208:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2956us (3231us total) trans 8589944008 rc 0/0 00000100:00100000:3.0:1746066791.066190:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9957 00000100:00100000:0.0:1746066791.067854:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.067905:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976894464 00000100:00100000:3.0:1746066791.067911:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976894464 00000100:00100000:3.0:1746066791.067947:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9958 00000100:00100000:3.0:1746066791.067954:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+24:31577:x1830882976894464:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066791.067971:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.067983:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608b21d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e38d expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.068042:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1e00/0xfb36a14ee608b224 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.068053:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b20f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e386 expref: 25 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.068058:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1e00/0xfb36a14ee608b224 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.068082:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b20f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e386 expref: 25 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.068091:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b20f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e386 expref: 25 pid: 809 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.068101:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976822784:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.068482:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013733df00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.070320:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976822784:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066791.070326:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066791.070339:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1e00/0xfb36a14ee608b224 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:1.0:1746066791.070430:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976894592 00000100:00100000:1.0:1746066791.070435:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976894592 00010000:00010000:1.0:1746066791.070456:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b20f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e386 expref: 26 pid: 809 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.070487:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7395 00000100:00100000:1.0:1746066791.070493:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+26:1964:x1830882976894592:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.070504:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.070509:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b20f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e386 expref: 26 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.070518:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b20f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e386 expref: 26 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.070540:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b20f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e386 expref: 26 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.070564:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066791.070568:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1e00/0xfb36a14ee608b224 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066791.070575:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1e00/0xfb36a14ee608b224 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066791.070580:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1e00/0xfb36a14ee608b224 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066791.070601:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066791.070641:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+25:1964:x1830882976894592:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 148us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.070650:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7395 00010000:00010000:3.0:1746066791.070718:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1e00/0xfb36a14ee608b224 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.070724:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1e00/0xfb36a14ee608b224 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:3.0:1746066791.070755:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066791.070758:0:809:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066791.070770:0:809:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1e00/0xfb36a14ee608b224 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.070793:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608b21d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e38d expref: 25 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.070805:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1e00/0xfb36a14ee608b224 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e38d expref: 24 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.070815:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:3.0:1746066791.070817:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066791.070819:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a1e00, rc 0) 00000100:00100000:3.0:1746066791.070841:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+24:31577:x1830882976894464:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2888us (2990us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.070847:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9958 00000100:00100000:0.0:1746066791.073265:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.073305:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.073375:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976894848 00000100:00100000:1.0:1746066791.073385:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976894848 00000100:00100000:1.0:1746066791.073422:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976894720 00000100:00100000:1.0:1746066791.073424:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976894720 00000100:00100000:1.0:1746066791.073447:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14421 00000100:00100000:1.0:1746066791.073451:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976894720:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066791.073456:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.073462:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b19b000/0xfb36a14ee608b232 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e394 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.073497:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976823040:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066791.073627:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.076154:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976823040:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066791.076180:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b19b000/0xfb36a14ee608b232 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e394 expref: 9 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.076191:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b19b000/0xfb36a14ee608b232 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e394 expref: 9 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.076199:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19b000, rc 0) 00000100:00100000:1.0:1746066791.076539:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976894720:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 3085us (3231us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066791.076547:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14421 00000100:00100000:0.0:1746066791.078960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.079067:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976895104 00000100:00100000:3.0:1746066791.079074:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976895104 00000100:00100000:3.0:1746066791.079112:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9959 00000100:00100000:3.0:1746066791.079119:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+24:31577:x1830882976895104:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066791.079134:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.079151:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a0e00/0xfb36a14ee608b239 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e3a2 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.079223:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b240 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.079233:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b240 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.079242:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b240 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:3.0:1746066791.079251:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066791.079344:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a0e00/0xfb36a14ee608b239 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3a2 expref: 27 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.079358:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b240 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3a2 expref: 26 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.079366:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:3.0:1746066791.079369:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066791.079371:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a1200, rc 0) 00000100:00100000:3.0:1746066791.080038:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+26:31577:x1830882976895104:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 916us (1081us total) trans 8589944009 rc 0/0 00000100:00100000:3.0:1746066791.080044:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9959 00000100:00100000:0.0:1746066791.083204:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.083361:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976895360 00000100:00100000:1.0:1746066791.083369:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976895360 00000100:00100000:0.0:1746066791.086025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.086097:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.086111:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976895616 00000100:00100000:0.0:1746066791.086115:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976895616 00000100:00100000:0.0:1746066791.086143:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976895872 00000100:00100000:0.0:1746066791.086145:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976895872 00000100:00100000:0.0:1746066791.086162:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14423 00000100:00100000:0.0:1746066791.086167:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976895616:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:0.0:1746066791.086186:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099790800/0xfb36a14ee608b255 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.086197:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a02f600/0xfb36a14ee608af5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1c6 expref: 27 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066791.086203:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d199800/0xfb36a14ee608b010 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e259 expref: 8 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066791.086209:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009904da00/0xfb36a14ee608afca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e21a expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.086215:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066791.086216:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066791.086218:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099790800/0xfb36a14ee608b255 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.086235:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009904da00/0xfb36a14ee608afca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e21a expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.086243:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009904da00/0xfb36a14ee608afca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e21a expref: 22 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746066791.086251:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976823296:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.086455:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14424 00000100:00100000:3.0:1746066791.086463:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976895872:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066791.086479:0:4614:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b25c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.086488:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b160 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e301 expref: 31 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.086493:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0000/0xfb36a14ee608b201 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e37f expref: 7 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.086499:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5800/0xfb36a14ee608b16e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e30f expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.086504:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.086505:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.086507:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b25c lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.086522:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5800/0xfb36a14ee608b16e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e30f expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.086529:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5800/0xfb36a14ee608b16e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e30f expref: 23 pid: 8452 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.086537:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976823424:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.086570:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0000/0xfb36a14ee608b201 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e37f expref: 7 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.086577:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0000/0xfb36a14ee608b201 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e37f expref: 7 pid: 4614 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746066791.086584:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976823552:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.086606:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b160 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e301 expref: 31 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.086613:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b160 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e301 expref: 31 pid: 8452 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.086629:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976823680:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.086646:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013733df00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.086860:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.086887:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.086918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.087006:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976895232 00000100:00100000:3.0:1746066791.087010:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976895232 00000100:00100000:3.0:1746066791.087027:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976895488 00000100:00100000:3.0:1746066791.087028:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976895488 00000100:00100000:3.0:1746066791.087037:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976895744 00000100:00100000:3.0:1746066791.087038:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976895744 00000100:00100000:3.0:1746066791.087050:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14425 00000100:00100000:3.0:1746066791.087054:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976895232:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066791.087069:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1c00/0xfb36a14ee608b263 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087078:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec01200/0xfb36a14ee608af3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1b1 expref: 22 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087085:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d199600/0xfb36a14ee608b01e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e244 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.087092:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb08200/0xfb36a14ee608af92 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1e2 expref: 27 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087096:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.087097:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.087099:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1c00/0xfb36a14ee608b263 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087114:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb08200/0xfb36a14ee608af92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1e2 expref: 27 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087120:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eb08200/0xfb36a14ee608af92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1e2 expref: 27 pid: 8112 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.087128:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976823808:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.087154:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d199600/0xfb36a14ee608b01e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e244 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.087162:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d199600/0xfb36a14ee608b01e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e244 expref: 10 pid: 8112 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746066791.087168:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976823936:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.087184:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec01200/0xfb36a14ee608af3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1b1 expref: 22 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087191:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec01200/0xfb36a14ee608af3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1b1 expref: 22 pid: 21973 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.087198:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976824064:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.087209:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f5c540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.087222:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14426 00000100:00100000:3.0:1746066791.087228:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976895488:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066791.087241:0:8112:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f78be00/0xfb36a14ee608b26a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087249:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9600/0xfb36a14ee608b1a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e339 expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087254:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066791.087255:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066791.087257:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f78be00/0xfb36a14ee608b26a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087284:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9600/0xfb36a14ee608b1a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e339 expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087291:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9600/0xfb36a14ee608b1a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e339 expref: 23 pid: 21203 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.087298:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976824192:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.087314:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f5c240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.087326:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14427 00000100:00100000:3.0:1746066791.087331:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976895744:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066791.087346:0:8452:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090252400/0xfb36a14ee608b271 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087354:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092bcc800/0xfb36a14ee608afd8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e228 expref: 22 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087360:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d199c00/0xfb36a14ee608b02c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e260 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.087366:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092bcd600/0xfb36a14ee608afdf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e22f expref: 27 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087371:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.087372:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.087374:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090252400/0xfb36a14ee608b271 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087387:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092bcd600/0xfb36a14ee608afdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e22f expref: 27 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087394:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092bcd600/0xfb36a14ee608afdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e22f expref: 27 pid: 8112 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.087401:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976824320:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.087424:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d199c00/0xfb36a14ee608b02c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e260 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.087431:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d199c00/0xfb36a14ee608b02c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e260 expref: 10 pid: 8112 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746066791.087438:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976824448:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.087458:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092bcc800/0xfb36a14ee608afd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e228 expref: 22 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.087464:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092bcc800/0xfb36a14ee608afd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e228 expref: 22 pid: 8112 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.087471:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976824576:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.087484:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f5cc00 going to sleep for 11 seconds 00010000:00010000:0.0:1746066791.088859:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d199800/0xfb36a14ee608b010 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e259 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066791.088870:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d199800/0xfb36a14ee608b010 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e259 expref: 10 pid: 8112 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746066791.088880:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976824704:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066791.089287:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a02f600/0xfb36a14ee608af5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1c6 expref: 27 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066791.089296:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a02f600/0xfb36a14ee608af5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1c6 expref: 27 pid: 10402 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746066791.089309:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976824832:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066791.089328:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049a80 going to sleep for 11 seconds 00000100:00080000:0.0:1746066791.089340:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066791.089420:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976823296:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.090131:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976823424:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.091760:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976824192:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.091770:0:8112:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f78be00/0xfb36a14ee608b26a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.091787:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976823936:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.091794:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976824064:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.100158:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976823808:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.100184:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1c00/0xfb36a14ee608b263 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066791.100246:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976824832:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066791.102165:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.102191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.102204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.102224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.102293:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976896128 00000100:00100000:1.0:1746066791.102300:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976896128 00010000:00010000:1.0:1746066791.102329:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d199600/0xfb36a14ee608b01e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e244 expref: 11 pid: 8112 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746066791.102349:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976896256 00000100:00100000:1.0:1746066791.102351:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976896256 00010000:00010000:1.0:1746066791.102365:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec01200/0xfb36a14ee608af3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1b1 expref: 23 pid: 21973 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.102376:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976897280 00000100:00100000:1.0:1746066791.102378:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976897280 00010000:00010000:1.0:1746066791.102384:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d199800/0xfb36a14ee608b010 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e259 expref: 12 pid: 8112 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746066791.102391:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976897408 00000100:00100000:1.0:1746066791.102392:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976897408 00010000:00010000:1.0:1746066791.102401:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092bcd600/0xfb36a14ee608afdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e22f expref: 28 pid: 8112 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.102409:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7396 00000100:00100000:1.0:1746066791.102415:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5409850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1966:x1830882976896128:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.102425:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.102444:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d199600/0xfb36a14ee608b01e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e244 expref: 12 pid: 8112 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.102453:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d199600/0xfb36a14ee608b01e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e244 expref: 12 pid: 8112 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.102472:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d199600/0xfb36a14ee608b01e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e244 expref: 12 pid: 8112 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.102489:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066791.102521:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5409850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882976896128:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 106us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.102527:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7396 00000100:00100000:1.0:1746066791.102562:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7397 00000100:00100000:1.0:1746066791.102566:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882976896256:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.102571:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.102577:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec01200/0xfb36a14ee608af3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1b1 expref: 23 pid: 21973 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.102584:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec01200/0xfb36a14ee608af3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1b1 expref: 23 pid: 21973 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.102593:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec01200/0xfb36a14ee608af3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e1b1 expref: 23 pid: 21973 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.102600:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066791.102610:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+22:1966:x1830882976896256:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 43us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.102614:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7397 00000100:00100000:1.0:1746066791.102633:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7398 00000100:00100000:1.0:1746066791.102638:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1965:x1830882976897280:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.102643:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.102651:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d199800/0xfb36a14ee608b010 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e259 expref: 10 pid: 8112 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.102657:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d199800/0xfb36a14ee608b010 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e259 expref: 10 pid: 8112 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.102666:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066791.102703:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1965:x1830882976897280:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 64us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.102708:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7398 00000100:00100000:1.0:1746066791.102717:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7399 00000100:00100000:1.0:1746066791.102721:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882976897408:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.102726:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.102733:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092bcd600/0xfb36a14ee608afdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e22f expref: 28 pid: 8112 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.102741:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092bcd600/0xfb36a14ee608afdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e22f expref: 28 pid: 8112 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.102750:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092bcd600/0xfb36a14ee608afdf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e22f expref: 28 pid: 8112 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.102758:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066791.102769:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882976897408:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 48us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.102773:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7399 00010000:00010000:1.0:1746066791.102800:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d199800/0xfb36a14ee608b010 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e259 expref: 9 pid: 8112 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746066791.102808:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976824704:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.102833:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099790800/0xfb36a14ee608b255 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.103138:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976823552:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.103146:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976823680:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.103160:0:4614:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b25c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746066791.103198:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066791.104530:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.104561:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.104584:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.104595:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.104604:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.104615:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.104648:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.104658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.104667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.104706:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066791.106335:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1c00/0xfb36a14ee608b263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106343:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1c00/0xfb36a14ee608b263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106358:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1c00/0xfb36a14ee608b263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106368:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1c00/0xfb36a14ee608b263 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106375:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1c00/0xfb36a14ee608b263 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106380:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3a1c00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066791.106382:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1c00/0xfb36a14ee608b263 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106387:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1c00/0xfb36a14ee608b263 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106396:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1c00/0xfb36a14ee608b263 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106401:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1c00/0xfb36a14ee608b263 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.106455:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882976895232:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 19399us (19595us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.106460:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14425 00010000:00010000:3.0:1746066791.106479:0:4614:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b25c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106486:0:4614:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b25c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106498:0:4614:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b25c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106508:0:4614:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b25c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106513:0:4614:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b25c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106517:0:4614:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3a1a00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066791.106519:0:4614:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b25c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106524:0:4614:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b25c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106531:0:4614:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b25c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.106535:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b25c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.106568:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976895872:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 20106us (20470us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.106572:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14424 00000100:00100000:3.0:1746066791.106590:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2132 00000100:00100000:3.0:1746066791.106595:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882976896512:12345-192.168.202.57@tcp:4:multiop.0 00010000:00010000:0.0:1746066791.106724:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099790800/0xfb36a14ee608b255 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.106732:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099790800/0xfb36a14ee608b255 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.106748:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099790800/0xfb36a14ee608b255 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.106754:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099790800/0xfb36a14ee608b255 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.106759:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099790800/0xfb36a14ee608b255 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.106764:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099790800 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066791.106765:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099790800/0xfb36a14ee608b255 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.106770:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099790800/0xfb36a14ee608b255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.106778:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099790800/0xfb36a14ee608b255 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.106783:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099790800/0xfb36a14ee608b255 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066791.106818:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1963:x1830882976895616:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 20650us (20793us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066791.106823:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14423 00000100:00100000:3.0:1746066791.112562:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882976896512:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 5958us (7991us total) trans 21474840882 rc 0/0 00000100:00100000:3.0:1746066791.112572:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2132 00002000:00100000:3.0:1746066791.112582:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1216511) req@ffff8800996d8000 x1830882976896512/t21474840882(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/448 e 0 to 0 dl 1746066802 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.112591:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8000 with x1830882976896512 ext(1048576->1216511) 00010000:00010000:3.0:1746066791.112600:0:11692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9600/0xfb36a14ee608b1a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e339 expref: 27 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.112615:0:11692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9600/0xfb36a14ee608b1a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e339 expref: 27 pid: 21203 timeout: 852 lvb_type: 0 00002000:00010000:3.0:1746066791.112631:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800996d8000 00000100:00100000:0.0:1746066791.118030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.118995:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976897792 00000100:00100000:1.0:1746066791.119002:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976897792 00010000:00010000:1.0:1746066791.119029:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9600/0xfb36a14ee608b1a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e339 expref: 27 pid: 21203 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.119063:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7408 00000100:00100000:1.0:1746066791.119068:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882976897792:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.119080:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.119093:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9600/0xfb36a14ee608b1a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e339 expref: 28 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.119103:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9600/0xfb36a14ee608b1a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e339 expref: 29 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.119120:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ac9600/0xfb36a14ee608b1a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e339 expref: 29 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.119134:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.119135:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.119138:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f78be00/0xfb36a14ee608b26a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.119145:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f78be00/0xfb36a14ee608b26a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.119648:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066791.119651:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882976896000:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 13803us (15121us total) trans 21474840883 rc 0/0 00000100:00100000:3.0:1746066791.119659:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2131 00000100:00100000:1.0:1746066791.119666:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882976897792:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 598us (1643us total) trans 0 rc 0/0 00002000:00100000:3.0:1746066791.119667:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38d:0x0] (1216512->2097151) req@ffff8800996dbb80 x1830882976896000/t21474840883(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/448 e 0 to 0 dl 1746066802 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746066791.119671:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7408 00002000:00100000:3.0:1746066791.119690:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996dbb80 with x1830882976896000 ext(1216512->2097151) 00010000:00010000:3.0:1746066791.119696:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b19f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e332 expref: 27 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.119705:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b19f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e332 expref: 26 pid: 21203 timeout: 852 lvb_type: 0 00002000:00010000:3.0:1746066791.119711:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800996dbb80 00000100:00100000:0.0:1746066791.123118:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.123199:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976897920 00000100:00100000:1.0:1746066791.123207:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976897920 00010000:00010000:1.0:1746066791.123233:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b19f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e332 expref: 26 pid: 21203 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.123269:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7409 00000100:00100000:1.0:1746066791.123276:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882976897920:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.123288:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.123305:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b19f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e332 expref: 26 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.123315:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b19f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e332 expref: 26 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.123335:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b19f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1216512->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e332 expref: 26 pid: 21203 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.123356:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.123357:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.123360:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e80ac00/0xfb36a14ee608b24e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.123372:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e80ac00/0xfb36a14ee608b24e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.123404:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066791.123436:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882976897920:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 160us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.123441:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7409 00010000:00010000:3.0:1746066791.123576:0:21203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e80ac00/0xfb36a14ee608b24e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.123583:0:21203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e80ac00/0xfb36a14ee608b24e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.123600:0:21203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e80ac00/0xfb36a14ee608b24e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.123606:0:21203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e80ac00/0xfb36a14ee608b24e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.123612:0:21203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e80ac00/0xfb36a14ee608b24e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.123631:0:21203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e80ac00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066791.123635:0:21203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e80ac00/0xfb36a14ee608b24e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.123642:0:21203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e80ac00/0xfb36a14ee608b24e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.123652:0:21203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e80ac00/0xfb36a14ee608b24e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.123661:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e80ac00/0xfb36a14ee608b24e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.123887:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1963:x1830882976895360:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 38723us (40689us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.123894:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14422 00000100:00100000:3.0:1746066791.126308:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976898176 00000100:00100000:3.0:1746066791.126314:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976898176 00000100:00100000:3.0:1746066791.126346:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9960 00000100:00100000:3.0:1746066791.126353:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+26:31577:x1830882976898176:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:3.0:1746066791.126392:0:809:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066791.126411:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1e00/0xfb36a14ee608b224 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e38d expref: 26 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.126429:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:3.0:1746066791.126433:0:809:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066791.126456:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25000/0xfb36a14ee608b278 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.126465:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a646 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc7f expref: 44 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.126471:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b165400/0xfb36a14ee608a64d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc86 expref: 285 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.126478:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1c00/0xfb36a14ee608a654 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc8d expref: 44 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.126488:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f386000/0xfb36a14ee608b0db lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e29f expref: 285 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.126494:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19b200/0xfb36a14ee608b105 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e2bb expref: 44 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.126500:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880e00/0xfb36a14ee608ab0f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df65 expref: 44 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.126506:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608abfd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dff8 expref: 285 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.126511:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25000/0xfb36a14ee608b278 lrc: 10/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.126535:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608abfd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dff8 expref: 285 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.126545:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608abfd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dff8 expref: 285 pid: 14548 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.126555:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976824960:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066791.132949:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.134707:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.134734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.134755:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976898304 00000100:00100000:0.0:1746066791.134761:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976898304 00010000:00010000:0.0:1746066791.134795:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608abfd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dff8 expref: 286 pid: 14548 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746066791.134814:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976898432 00000100:00100000:0.0:1746066791.134817:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976898432 00010000:00010000:0.0:1746066791.134825:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880e00/0xfb36a14ee608ab0f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df65 expref: 45 pid: 14548 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746066791.134841:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7410 00000100:00100000:0.0:1746066791.134848:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5409050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+286:1965:x1830882976898304:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066791.134858:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066791.134863:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608abfd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dff8 expref: 286 pid: 14548 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746066791.134872:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608abfd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dff8 expref: 286 pid: 14548 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746066791.134888:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608abfd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dff8 expref: 286 pid: 14548 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.134943:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7411 00000100:00100000:1.0:1746066791.134948:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+45:1965:x1830882976898432:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.134955:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.134958:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880e00/0xfb36a14ee608ab0f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df65 expref: 45 pid: 14548 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.134965:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880e00/0xfb36a14ee608ab0f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df65 expref: 45 pid: 14548 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.134973:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880e00/0xfb36a14ee608ab0f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97df65 expref: 45 pid: 14548 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.135282:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976898688 00000100:00100000:3.0:1746066791.135287:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976898688 00000100:00100000:3.0:1746066791.135318:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4148 00000100:00100000:3.0:1746066791.135323:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f5aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+45:13378:x1830882976898688:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746066791.135478:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f5aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+46:13378:x1830882976898688:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 153us (2534us total) trans 8589944010 rc 0/0 00000100:00100000:3.0:1746066791.135484:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4148 00000100:00100000:3.0:1746066791.135596:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.135604:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976898944 00000100:00100000:3.0:1746066791.135606:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976898944 00000100:00100000:3.0:1746066791.135628:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4149 00000100:00100000:3.0:1746066791.135632:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+286:27099:x1830882976898944:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746066791.135700:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+287:27099:x1830882976898944:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 67us (103us total) trans 8589944011 rc 0/0 00000100:00100000:3.0:1746066791.135705:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4149 00000100:00100000:3.0:1746066791.135730:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976825344:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.135736:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976825472:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.135742:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976825600:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.135758:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.135767:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976899072 00000100:00100000:3.0:1746066791.135769:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976899072 00010000:00010000:3.0:1746066791.135777:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1c00/0xfb36a14ee608a654 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc8d expref: 46 pid: 20127 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.135789:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7412 00000100:00100000:3.0:1746066791.135793:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+46:1963:x1830882976899072:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066791.135799:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066791.135802:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1c00/0xfb36a14ee608a654 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc8d expref: 46 pid: 20127 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.135813:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1c00/0xfb36a14ee608a654 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc8d expref: 46 pid: 20127 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.135823:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1c00/0xfb36a14ee608a654 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc8d expref: 46 pid: 20127 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.135831:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:3.0:1746066791.135835:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25000/0xfb36a14ee608b278 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.135841:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066791.135853:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+45:1963:x1830882976899072:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 59us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.135857:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7412 00000100:00100000:3.0:1746066791.135913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.135923:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976899328 00000100:00100000:3.0:1746066791.135925:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976899328 00010000:00010000:3.0:1746066791.135934:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b165400/0xfb36a14ee608a64d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc86 expref: 287 pid: 16018 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.135946:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7413 00000100:00100000:3.0:1746066791.135950:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+287:1963:x1830882976899328:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066791.135956:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066791.135959:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b165400/0xfb36a14ee608a64d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc86 expref: 287 pid: 16018 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.135965:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b165400/0xfb36a14ee608a64d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc86 expref: 287 pid: 16018 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.135975:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b165400/0xfb36a14ee608a64d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc86 expref: 287 pid: 16018 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.135983:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:3.0:1746066791.135985:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25000/0xfb36a14ee608b278 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.135990:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066791.136003:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+286:1963:x1830882976899328:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 52us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.136007:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7413 00000100:00100000:3.0:1746066791.136025:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976825728:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.136055:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25000/0xfb36a14ee608b278 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:3.0:1746066791.136094:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.136105:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976899200 00000100:00100000:3.0:1746066791.136108:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976899200 00010000:00010000:3.0:1746066791.136117:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a646 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc7f expref: 45 pid: 809 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.136128:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7414 00000100:00100000:3.0:1746066791.136131:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+45:1963:x1830882976899200:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066791.136137:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066791.136139:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a646 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc7f expref: 45 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.136150:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a646 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc7f expref: 45 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.136161:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881e00/0xfb36a14ee608a646 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97dc7f expref: 45 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.136169:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:3.0:1746066791.136172:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25000/0xfb36a14ee608b278 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.136176:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066791.136190:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+44:1963:x1830882976899200:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 58us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.136195:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7414 00010000:00010000:0.0:1746066791.137229:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066791.137234:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25000/0xfb36a14ee608b278 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066791.137244:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066791.137337:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066791.137341:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25000/0xfb36a14ee608b278 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066791.137346:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066791.137668:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5409050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+285:1965:x1830882976898304:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2815us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066791.137690:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7410 00000100:00100000:1.0:1746066791.137794:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+43:1965:x1830882976898432:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2845us (3058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.137800:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7411 00000100:00100000:0.0:1746066791.139848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.141035:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.143357:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976899456 00000100:00100000:1.0:1746066791.143367:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976899456 00010000:00010000:1.0:1746066791.143439:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f386000/0xfb36a14ee608b0db lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e29f expref: 285 pid: 809 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.143480:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7415 00000100:00100000:1.0:1746066791.143488:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+285:1963:x1830882976899456:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.143504:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.143509:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f386000/0xfb36a14ee608b0db lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e29f expref: 285 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.143518:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f386000/0xfb36a14ee608b0db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e29f expref: 285 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.143541:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f386000/0xfb36a14ee608b0db lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e29f expref: 285 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.143557:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066791.143562:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25000/0xfb36a14ee608b278 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066791.143568:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066791.143606:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+284:1963:x1830882976899456:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 119us (3763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.143612:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7415 00010000:00010000:3.0:1746066791.144006:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25000/0xfb36a14ee608b278 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066791.144012:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25000/0xfb36a14ee608b278 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000040:00080000:3.0:1746066791.144662:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3070, 88 off259408 00000004:00080000:3.0:1746066791.144670:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752321993318ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.144744:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3089, 88 off260992 00000004:00080000:3.0:1746066791.144749:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752322072958ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066791.144761:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3090, 88 off261080 00000004:00080000:3.0:1746066791.144764:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752322088086ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066791.144771:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3071, 88 off259496 00000004:00080000:3.0:1746066791.144773:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752322097533ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.144780:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3072, 88 off259584 00000004:00080000:3.0:1746066791.144782:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752322106030ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.144788:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3091, 88 off261168 00000004:00080000:3.0:1746066791.144790:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752322114370ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066791.144796:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3092, 88 off261256 00000004:00080000:3.0:1746066791.144798:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752322122385ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066791.144804:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3093, 88 off261344 00000004:00080000:3.0:1746066791.144806:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752322130466ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066791.144812:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3073, 88 off259672 00000004:00080000:3.0:1746066791.144814:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752322138070ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.144819:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3094, 88 off261432 00000004:00080000:3.0:1746066791.144821:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752322145043ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066791.144826:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3074, 88 off259760 00000004:00080000:3.0:1746066791.144828:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752322151737ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.144832:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3095, 88 off261520 00000004:00080000:3.0:1746066791.144835:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752322159310ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066791.144840:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3075, 88 off259848 00000004:00080000:3.0:1746066791.144842:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752322165923ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.144847:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3076, 88 off259936 00000004:00080000:3.0:1746066791.144848:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752322172615ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.144854:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3077, 88 off260024 00000004:00080000:3.0:1746066791.144856:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752322180503ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.144862:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3078, 88 off260112 00000004:00080000:3.0:1746066791.144865:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752322188762ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.144871:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3096, 88 off261608 00000004:00080000:3.0:1746066791.144873:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752322197576ns, next at 749511475809ns, rc = 0 00000001:00080000:3.0:1746066791.178376:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943995 is committed 00000001:00080000:3.0:1746066791.178391:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943960 is committed 00000001:00080000:3.0:1746066791.178394:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943958 is committed 00000001:00080000:3.0:1746066791.178404:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943998 is committed 00000001:00080000:3.0:1746066791.178415:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943986 is committed 00000001:00080000:3.0:1746066791.178466:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944006 is committed 00000001:00080000:3.0:1746066791.178475:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943997 is committed 00000001:00080000:3.0:1746066791.178478:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943996 is committed 00000004:00080000:3.0:1746066791.178514:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2343 committed 00000001:00080000:3.0:1746066791.178525:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944012 is committed 00000004:00080000:3.0:1746066791.178528:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2371 committed 00000004:00080000:3.0:1746066791.178532:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2352 committed 00000004:00080000:3.0:1746066791.178534:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2351 committed 00000004:00080000:3.0:1746066791.178535:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2350 committed 00000004:00080000:3.0:1746066791.178536:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2349 committed 00000004:00080000:3.0:1746066791.178538:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2370 committed 00000004:00080000:3.0:1746066791.178539:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2348 committed 00000004:00080000:3.0:1746066791.178541:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2369 committed 00000004:00080000:3.0:1746066791.178542:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2347 committed 00000004:00080000:3.0:1746066791.178543:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2368 committed 00000004:00080000:3.0:1746066791.178544:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2367 committed 00000004:00080000:3.0:1746066791.178546:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2366 committed 00000004:00080000:3.0:1746066791.178547:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2346 committed 00000004:00080000:3.0:1746066791.178548:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2345 committed 00000004:00080000:3.0:1746066791.178549:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2365 committed 00000004:00080000:3.0:1746066791.178550:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2364 committed 00000004:00080000:3.0:1746066791.178552:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2344 committed 00000001:00080000:3.0:1746066791.178555:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944011 is committed 00000001:00080000:3.0:1746066791.178558:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944010 is committed 00000004:00080000:3.0:1746066791.180222:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2363 committed 00000100:00100000:3.0:1746066791.180297:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976825856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.180338:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.181246:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976826368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.181268:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976826240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.181585:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976825856 00000100:00100000:3.0:1746066791.181591:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976825856 00000100:00100000:3.0:1746066791.181798:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976825984 00000100:00100000:3.0:1746066791.181801:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976825984 00000100:00100000:3.0:1746066791.181814:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976826496 00000100:00100000:3.0:1746066791.181815:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976826496 00000100:00100000:3.0:1746066791.181828:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14428 00000100:00100000:3.0:1746066791.181833:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3296:x1830882976825856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.182007:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1830882976825856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (1668us total) trans 21474840884 rc 0/0 00000100:00100000:3.0:1746066791.182014:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14428 00000100:00100000:3.0:1746066791.182027:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14429 00000100:00100000:3.0:1746066791.182032:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3293:x1830882976825984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.182108:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3293:x1830882976825984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (940us total) trans 21474840885 rc 0/0 00000100:00100000:3.0:1746066791.182113:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14429 00000100:00100000:3.0:1746066791.182124:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14430 00000100:00100000:3.0:1746066791.182128:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3293:x1830882976826496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.182201:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3293:x1830882976826496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (842us total) trans 21474840886 rc 0/0 00000100:00100000:3.0:1746066791.182206:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14430 00000004:00080000:2.0:1746066791.183944:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2ea00, transno 17179873520 00000004:00080000:2.0:1746066791.183946:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c396d80, transno 17179873521 00000004:00080000:2.0:1746066791.183948:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe1500, transno 17179873528 00000004:00080000:2.0:1746066791.183950:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe3100, transno 17179873529 00000004:00080000:2.0:1746066791.183952:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe3480, transno 17179873530 00000004:00080000:2.0:1746066791.183954:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe2d80, transno 17179873531 00000004:00080000:2.0:1746066791.183956:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe1c00, transno 17179873532 00000004:00080000:2.0:1746066791.183958:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe3800, transno 17179873533 00000004:00080000:2.0:1746066791.183961:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099713b80, transno 17179873534 00000004:00080000:2.0:1746066791.183963:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe2680, transno 17179873535 00000004:00080000:2.0:1746066791.183965:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe3b80, transno 17179873536 00000004:00080000:2.0:1746066791.183967:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c2d80, transno 17179873537 00000004:00080000:2.0:1746066791.183969:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c0000, transno 17179873538 00000004:00080000:2.0:1746066791.183971:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c1880, transno 17179873539 00000004:00080000:2.0:1746066791.183973:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c3480, transno 17179873540 00000004:00080000:2.0:1746066791.183975:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c1180, transno 17179873541 00000004:00080000:2.0:1746066791.183976:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c3800, transno 17179873542 00000004:00080000:2.0:1746066791.183978:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c0e00, transno 17179873543 00000004:00080000:2.0:1746066791.183980:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5b800, transno 17179873544 00000004:00080000:2.0:1746066791.183982:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a5c0700, transno 17179873545 00000100:00100000:2.0:1746066791.183986:0:3293:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800a590e680 x1830882976827136/t17179873562(17179873562) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066807 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746066791.183992:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a590e680/2, rc 0, transno 17179873562 00000100:00100000:2.0:1746066791.183995:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976827136:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066791.184004:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924d2680/2, rc 0, transno 17179873563 00000100:00100000:2.0:1746066791.184007:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976827648:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066791.184012:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a590f480/2, rc 0, transno 17179873560 00000100:00100000:2.0:1746066791.184014:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976827008:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066791.184019:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924d2300/2, rc 0, transno 17179873561 00000100:00100000:2.0:1746066791.184022:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976827520:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066791.184284:0:14590:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 72 done 00000100:00100000:3.0:1746066791.184530:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.184557:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976826752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.184577:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.184587:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976827264:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.184598:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.184607:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976827776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.184628:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.184640:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746066791.184644:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976827904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.184656:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.184670:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976826240 00000100:00100000:3.0:1746066791.184688:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976826240 00000100:00100000:3.0:1746066791.184706:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976826752 00000100:00100000:3.0:1746066791.184708:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976826752 00000100:00100000:3.0:1746066791.184717:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976827264 00000100:00100000:3.0:1746066791.184718:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976827264 00000100:00100000:3.0:1746066791.184726:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976827776 00000100:00100000:3.0:1746066791.184727:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976827776 00000100:00100000:3.0:1746066791.184733:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976827904 00000100:00100000:3.0:1746066791.184735:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976827904 00000100:00100000:3.0:1746066791.184742:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14437 00000100:00100000:3.0:1746066791.184747:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1830882976826240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.184854:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830882976826240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (324us total) trans 21474840889 rc 0/0 00000100:00100000:3.0:1746066791.184860:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14437 00000100:00100000:3.0:1746066791.184872:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14438 00000100:00100000:3.0:1746066791.184876:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1830882976826752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.184953:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830882976826752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (374us total) trans 21474840890 rc 0/0 00000100:00100000:3.0:1746066791.184961:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14438 00000100:00100000:3.0:1746066791.184970:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14439 00000100:00100000:3.0:1746066791.184974:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1830882976827264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.185053:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830882976827264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (453us total) trans 17179873564 rc 0/0 00000100:00100000:3.0:1746066791.185057:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14439 00000100:00100000:3.0:1746066791.185066:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14440 00000100:00100000:3.0:1746066791.185069:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1830882976827776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.185138:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830882976827776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (520us total) trans 17179873565 rc 0/0 00000100:00100000:3.0:1746066791.185143:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14440 00000100:00100000:3.0:1746066791.185151:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14441 00000100:00100000:3.0:1746066791.185154:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3295:x1830882976827904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.185222:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830882976827904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (564us total) trans 17179873566 rc 0/0 00000100:00100000:3.0:1746066791.185226:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14441 00000004:00080000:3.0:1746066791.185248:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c528380/2, rc 0, transno 17179873566 00000100:00100000:3.0:1746066791.185251:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976827904:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066791.185258:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef58700/2, rc 0, transno 21474840889 00000100:00100000:3.0:1746066791.185261:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976826240:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066791.185266:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef58a80/2, rc 0, transno 21474840890 00000100:00100000:3.0:1746066791.185269:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976826752:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066791.185274:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924d1c00/2, rc 0, transno 17179873564 00000100:00100000:3.0:1746066791.185277:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976827264:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066791.185282:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c4380/2, rc 0, transno 17179873565 00000100:00100000:3.0:1746066791.185284:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976827776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.185299:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.185317:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976826880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.185332:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.185342:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976827392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.185353:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746066791.185370:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef58e00/2, rc 0, transno 21474840884 00000100:00100000:3.0:1746066791.185372:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976825856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.185381:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976826368 00000100:00100000:3.0:1746066791.185384:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976826368 00000100:00100000:3.0:1746066791.185393:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976826880 00000100:00100000:3.0:1746066791.185395:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976826880 00000100:00100000:3.0:1746066791.185401:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976827392 00000100:00100000:3.0:1746066791.185402:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976827392 00000100:00100000:3.0:1746066791.185409:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14442 00000100:00100000:3.0:1746066791.185413:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3296:x1830882976826368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.185495:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830882976826368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (195us total) trans 21474840891 rc 0/0 00000100:00100000:3.0:1746066791.185501:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14442 00000100:00100000:3.0:1746066791.185509:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14443 00000100:00100000:3.0:1746066791.185514:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830882976826880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.185587:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3296:x1830882976826880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (253us total) trans 17179873567 rc 0/0 00000100:00100000:3.0:1746066791.185592:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14443 00000100:00100000:3.0:1746066791.185601:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14444 00000100:00100000:3.0:1746066791.185604:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830882976827392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.185701:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3296:x1830882976827392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (346us total) trans 17179873568 rc 0/0 00000100:00100000:3.0:1746066791.185705:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14444 00000004:00080000:3.0:1746066791.185725:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef58000/2, rc 0, transno 21474840891 00000100:00100000:3.0:1746066791.185728:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976826368:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066791.185734:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a590f100/2, rc 0, transno 17179873567 00000100:00100000:3.0:1746066791.185737:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976826880:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066791.185742:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924d3b80/2, rc 0, transno 17179873568 00000100:00100000:3.0:1746066791.185744:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976827392:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746066791.186017:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746066791.186022:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066791.186197:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.186479:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976899712 00000100:00100000:0.0:1746066791.186483:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976899712 00000100:00100000:0.0:1746066791.186512:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9961 00000100:00100000:0.0:1746066791.186517:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31577:x1830882976899712:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066791.186531:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066791.186544:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b27f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e3a9 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.186587:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b27f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3a9 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.186600:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b27f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3a9 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.186614:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066791.186627:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066791.186630:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d4e00, rc 0) 00000100:00100000:0.0:1746066791.186659:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31577:x1830882976899712:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 142us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066791.186667:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9961 00000100:00100000:2.0:1746066791.190943:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.190989:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976899840 00000100:00100000:1.0:1746066791.190996:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976899840 00000100:00100000:1.0:1746066791.191116:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9962 00000100:00100000:1.0:1746066791.191124:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31577:x1830882976899840:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066791.191141:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.191156:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccae00/0xfb36a14ee608b286 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e3b0 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.191220:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccb000/0xfb36a14ee608b28d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.191231:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccb000/0xfb36a14ee608b28d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.191241:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccb000/0xfb36a14ee608b28d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066791.191261:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:1.0:1746066791.191264:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746066791.191275:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccb000/0xfb36a14ee608b28d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.191296:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccae00/0xfb36a14ee608b286 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3b0 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.191306:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccb000/0xfb36a14ee608b28d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3b0 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.191313:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066791.191316:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066791.191319:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eccb000, rc 0) 00000100:00100000:1.0:1746066791.191809:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31577:x1830882976899840:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 684us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.191815:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9962 00000100:00100000:0.0:1746066791.193739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.193770:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.194533:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976900096 00000100:00100000:2.0:1746066791.194540:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976900096 00000100:00100000:1.0:1746066791.194609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.194792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.194852:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976900352 00000100:00100000:2.0:1746066791.194855:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976900352 00000100:00100000:2.0:1746066791.194871:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976900608 00000100:00100000:2.0:1746066791.194872:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976900608 00000100:00100000:2.0:1746066791.194885:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14445 00000100:00100000:2.0:1746066791.194891:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882976900096:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066791.194904:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.194919:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009354c800/0xfb36a14ee608b294 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e3be expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066791.194938:0:4614:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38d:0x0] initial LVB size: 2097152, mtime: 0x6812dd66, atime: 0x6812dd66, ctime: 0x6812dd66, blocks: 0x821 00010000:00010000:2.0:1746066791.194954:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.194956:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.194963:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009354c800/0xfb36a14ee608b294 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3be expref: 7 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066791.194975:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009354c800/0xfb36a14ee608b294 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3be expref: 7 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066791.194985:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009354c800, rc 0) 00000100:00100000:2.0:1746066791.195020:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976900096:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 129us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.195026:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14445 00000100:00100000:2.0:1746066791.195041:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14446 00000100:00100000:2.0:1746066791.195046:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1964:x1830882976900352:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066791.195052:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.195062:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608b29b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e3cc expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066791.195075:0:4614:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 2097152, mtime: 0x6812dd65, atime: 0x6812dd64, ctime: 0x6812dd64, blocks: 0x821 00010000:00010000:2.0:1746066791.195083:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.195084:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.195088:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608b29b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3cc expref: 6 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066791.195097:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608b29b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3cc expref: 6 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066791.195103:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009354c000, rc 0) 00000100:00100000:2.0:1746066791.195118:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882976900352:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 72us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.195122:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14446 00000100:00100000:2.0:1746066791.195132:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14447 00000100:00100000:2.0:1746066791.195136:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882976900608:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066791.195141:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.195147:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800990f5c00/0xfb36a14ee608b2a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e3da expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066791.195157:0:4614:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38f:0x0] initial LVB size: 4194304, mtime: 0x6812dd66, atime: 0x6812dd66, ctime: 0x6812dd66, blocks: 0x102b 00010000:00010000:2.0:1746066791.195165:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.195166:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.195170:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800990f5c00/0xfb36a14ee608b2a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3da expref: 7 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066791.195178:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800990f5c00/0xfb36a14ee608b2a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3da expref: 7 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066791.195185:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800990f5c00, rc 0) 00000100:00100000:2.0:1746066791.195198:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976900608:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 62us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.195203:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14447 00000100:00100000:1.0:1746066791.195373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.195754:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976899968 00000100:00100000:3.0:1746066791.195759:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976899968 00000100:00100000:3.0:1746066791.195778:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976900224 00000100:00100000:3.0:1746066791.195780:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976900224 00000100:00100000:3.0:1746066791.195790:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14448 00000100:00100000:3.0:1746066791.195794:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882976899968:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066791.195800:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.195808:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b2a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e3b7 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066791.195822:0:21973:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd65, atime: 0x6812dd65, ctime: 0x6812dd65, blocks: 0x7e1 00010000:00010000:3.0:1746066791.195829:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.195831:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.195835:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b2a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3b7 expref: 7 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.195849:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b2a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3b7 expref: 7 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.195855:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009288b000, rc 0) 00000100:00100000:1.0:1746066791.195874:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14449 00000100:00100000:3.0:1746066791.195875:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976899968:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 80us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.195879:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14448 00000100:00100000:1.0:1746066791.195881:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976900224:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066791.195888:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.195897:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecca400/0xfb36a14ee608b2b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e3c5 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066791.195909:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd66, atime: 0x6812dd64, ctime: 0x6812dd66, blocks: 0x821 00010000:00010000:1.0:1746066791.195922:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.195927:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.195931:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecca400/0xfb36a14ee608b2b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3c5 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.195940:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecca400/0xfb36a14ee608b2b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3c5 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.195946:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecca400, rc 0) 00000100:00100000:1.0:1746066791.195967:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976900224:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 88us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.195972:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14449 00000100:00100000:2.0:1746066791.196916:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.196990:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976900480 00000100:00100000:3.0:1746066791.196994:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976900480 00000100:00100000:3.0:1746066791.197009:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14450 00000100:00100000:3.0:1746066791.197014:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976900480:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066791.197020:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.197027:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009288ae00/0xfb36a14ee608b2b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e3d3 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066791.197036:0:4614:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 5090560, mtime: 0x6812dd65, atime: 0x6812dd65, ctime: 0x6812dd65, blocks: 0x1721 00010000:00010000:3.0:1746066791.197043:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.197044:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.197048:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009288ae00/0xfb36a14ee608b2b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3d3 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.197056:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009288ae00/0xfb36a14ee608b2b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3d3 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.197062:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009288ae00, rc 0) 00000100:00100000:3.0:1746066791.197305:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976900480:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 64us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.197310:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14450 00000100:00100000:0.0:1746066791.202671:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.202820:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976900864 00000100:00100000:3.0:1746066791.202828:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976900864 00000100:00100000:3.0:1746066791.203132:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6539 00000100:00100000:3.0:1746066791.203140:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976900864:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:3.0:1746066791.203168:0:21550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b2be lrc: 3/1,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.203179:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.203180:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.203184:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b2be lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.203194:0:21550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b2be lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066791.205912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.205946:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.205970:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.205995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.206013:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976901248 00000100:00100000:0.0:1746066791.206019:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976901248 00000100:00100000:0.0:1746066791.206057:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976901376 00000100:00100000:0.0:1746066791.206059:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976901376 00000100:00100000:0.0:1746066791.206068:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976901760 00000100:00100000:0.0:1746066791.206070:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976901760 00000100:00100000:0.0:1746066791.206082:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976901632 00000100:00100000:0.0:1746066791.206083:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976901632 00000100:00100000:0.0:1746066791.206096:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6540 00000100:00100000:0.0:1746066791.206103:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976901248:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:0.0:1746066791.206134:0:21552:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092d08a00/0xfb36a14ee608b2c5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.206147:0:21552:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066791.206149:0:21552:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066791.206153:0:21552:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d08a00/0xfb36a14ee608b2c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.206165:0:21552:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d08a00/0xfb36a14ee608b2c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066791.207099:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6541 00000100:00100000:0.0:1746066791.207106:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976901376:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:0.0:1746066791.207120:0:1993:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092d09600/0xfb36a14ee608b2cc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.207126:0:1993:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066791.207127:0:1993:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066791.207130:0:1993:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d09600/0xfb36a14ee608b2cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.207137:0:1993:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d09600/0xfb36a14ee608b2cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.207314:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6542 00000100:00100000:3.0:1746066791.207322:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882976901760:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:3.0:1746066791.207339:0:25585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b2d3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.207346:0:25585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.207348:0:25585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.207350:0:25585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b2d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.207358:0:25585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b2d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.207874:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6543 00000100:00100000:1.0:1746066791.207881:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882976901632:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:1.0:1746066791.207895:0:11692:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608b2da lrc: 3/1,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.207902:0:11692:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.207903:0:11692:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.207906:0:11692:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608b2da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.207913:0:11692:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608b2da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.215942:0:9850:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066791.217968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.217999:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.218027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.218056:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976902144 00000100:00100000:3.0:1746066791.218064:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976902144 00000100:00100000:2.0:1746066791.218097:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976902400 00000100:00100000:2.0:1746066791.218101:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976902400 00000100:00100000:3.0:1746066791.218108:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976902656 00000100:00100000:3.0:1746066791.218110:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976902656 00000100:00100000:2.0:1746066791.218124:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6544 00000100:00100000:2.0:1746066791.219362:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882976902144:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:2.0:1746066791.219399:0:1992:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b2e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.219412:0:1992:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.219414:0:1992:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.219419:0:1992:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b2e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.219432:0:1992:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b2e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.221367:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6545 00000100:00100000:1.0:1746066791.221455:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6546 00000100:00100000:1.0:1746066791.221469:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882976902656:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:1.0:1746066791.221500:0:8456:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ecca000/0xfb36a14ee608b2e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.221512:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.221513:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.221518:0:8456:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecca000/0xfb36a14ee608b2e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.221529:0:8456:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecca000/0xfb36a14ee608b2e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.222046:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882976902400:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:3.0:1746066791.222065:0:21551:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6400/0xfb36a14ee608b2ef lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.222072:0:21551:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.222073:0:21551:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.222076:0:21551:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6400/0xfb36a14ee608b2ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.222082:0:21551:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6400/0xfb36a14ee608b2ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.225794:0:21550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b2be lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.225810:0:21550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b2be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.225817:0:21550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b2be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.225823:0:21550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009288b800 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066791.225826:0:21550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b2be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.225834:0:21550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b2be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.225848:0:21550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b2be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.225853:0:21550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b2be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.228587:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882976900864:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 25439us (25914us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066791.228598:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6539 00010000:00010000:2.0:1746066791.234039:0:21552:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092d08a00/0xfb36a14ee608b2c5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.234054:0:21552:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092d08a00/0xfb36a14ee608b2c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.234062:0:21552:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092d08a00/0xfb36a14ee608b2c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.234067:0:21552:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d08a00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066791.234072:0:21552:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d08a00/0xfb36a14ee608b2c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.234078:0:21552:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d08a00/0xfb36a14ee608b2c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.234094:0:21552:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092d08a00/0xfb36a14ee608b2c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.234100:0:21552:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d08a00/0xfb36a14ee608b2c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.235464:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882976901248:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 29353us (29551us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066791.235475:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6540 00010000:00010000:3.0:1746066791.239191:0:25585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b2d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.239207:0:25585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b2d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.239215:0:25585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b2d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.239220:0:25585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009288b200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066791.239224:0:25585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b2d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.239230:0:25585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b2d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.239249:0:25585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b2d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.239254:0:25585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b2d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.239325:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882976901760:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 32001us (33350us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066791.239333:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6542 00010000:00010000:2.0:1746066791.247458:0:1993:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092d09600/0xfb36a14ee608b2cc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.247473:0:1993:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092d09600/0xfb36a14ee608b2cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.247480:0:1993:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092d09600/0xfb36a14ee608b2cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.247487:0:1993:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d09600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066791.247490:0:1993:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d09600/0xfb36a14ee608b2cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.247496:0:1993:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d09600/0xfb36a14ee608b2cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.247511:0:1993:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092d09600/0xfb36a14ee608b2cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.247517:0:1993:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d09600/0xfb36a14ee608b2cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.247591:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882976901376:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 40481us (41640us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066791.247600:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6541 00010000:00010000:1.0:1746066791.267604:0:11692:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608b2da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.267632:0:11692:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608b2da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.267640:0:11692:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608b2da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.267651:0:11692:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecca600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066791.267654:0:11692:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608b2da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.267661:0:11692:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608b2da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.267698:0:11692:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608b2da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.267704:0:11692:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608b2da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.267800:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976901632:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 59914us (61798us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066791.267810:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6543 00010000:00010000:2.0:1746066791.268188:0:1992:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b2e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.268195:0:1992:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b2e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.268204:0:1992:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b2e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.268209:0:1992:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008de12600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066791.268212:0:1992:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b2e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.268217:0:1992:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b2e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.268227:0:1992:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b2e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.268232:0:1992:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b2e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.268266:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976902144:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 50135us (50304us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066791.268272:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6544 00010000:00010000:1.0:1746066791.275094:0:8456:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ecca000/0xfb36a14ee608b2e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.275110:0:8456:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecca000/0xfb36a14ee608b2e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.275118:0:8456:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ecca000/0xfb36a14ee608b2e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.275124:0:8456:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecca000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066791.275128:0:8456:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ecca000/0xfb36a14ee608b2e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.275135:0:8456:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ecca000/0xfb36a14ee608b2e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.275151:0:8456:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ecca000/0xfb36a14ee608b2e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.275158:0:8456:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecca000/0xfb36a14ee608b2e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.277057:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976902656:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 55586us (59020us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066791.277068:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6546 00010000:00010000:2.0:1746066791.289156:0:21551:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6400/0xfb36a14ee608b2ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.289169:0:21551:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6400/0xfb36a14ee608b2ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.289176:0:21551:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6400/0xfb36a14ee608b2ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.289187:0:21551:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a67e6400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066791.289190:0:21551:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6400/0xfb36a14ee608b2ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.289196:0:21551:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6400/0xfb36a14ee608b2ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.289210:0:21551:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6400/0xfb36a14ee608b2ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.289215:0:21551:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6400/0xfb36a14ee608b2ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.289295:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976902400:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 67249us (71291us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066791.289304:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6545 00000100:00100000:0.0:1746066791.293536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.293630:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976902912 00000100:00100000:1.0:1746066791.293638:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976902912 00000100:00100000:1.0:1746066791.293702:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9963 00000100:00100000:1.0:1746066791.293710:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31577:x1830882976902912:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:1.0:1746066791.293751:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.293774:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccb000/0xfb36a14ee608b28d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3b0 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.293805:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066791.293809:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066791.293838:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092000/0xfb36a14ee608b2f6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.293848:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092000/0xfb36a14ee608b2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.293868:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092000/0xfb36a14ee608b2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00010000:1.0:1746066791.294003:0:14548:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ed0b100 reply state ffff88009f613000 transno 8589944013 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092000/0xfb36a14ee608b2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746066791.294009:0:14548:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746066791.294065:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31577:x1830882976902912:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 356us (537us total) trans 8589944013 rc 0/0 00000100:00100000:1.0:1746066791.294071:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9963 00000100:00100000:1.0:1746066791.296222:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066791.296312:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092000/0xfb36a14ee608b2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.296322:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092000/0xfb36a14ee608b2f6 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.296327:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092000/0xfb36a14ee608b2f6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.296331:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b092000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066791.296335:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092000/0xfb36a14ee608b2f6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.296343:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092000/0xfb36a14ee608b2f6 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.296356:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:2.0:1746066791.296358:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066791.296362:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092000/0xfb36a14ee608b2f6 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.296366:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b092000/0xfb36a14ee608b2f6 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746066791.296585:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976903040 00000100:00100000:3.0:1746066791.296593:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976903040 00000100:00100000:3.0:1746066791.296643:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14451 00000100:00100000:3.0:1746066791.296650:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31577:x1830882976903040:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066791.296663:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.296697:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6600/0xfb36a14ee608b2fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e3e1 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.296718:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b2a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3b7 expref: 9 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.296725:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.296727:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.296730:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6600/0xfb36a14ee608b2fd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e1 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.296754:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b2a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3b7 expref: 9 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.296765:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b2a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3b7 expref: 9 pid: 21973 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746066791.296775:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976828032:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.296849:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3c72a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.298464:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976828032:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.298484:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6600/0xfb36a14ee608b2fd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e1 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.298496:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a67e6600, rc 0) 00000100:00100000:3.0:1746066791.298534:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31577:x1830882976903040:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1884us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.298542:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14451 00000100:00100000:0.0:1746066791.298700:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.298848:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976903168 00000100:00100000:1.0:1746066791.298852:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976903168 00010000:00010000:1.0:1746066791.298871:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b2a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3b7 expref: 10 pid: 21973 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746066791.299605:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7417 00000100:00100000:1.0:1746066791.299611:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5408c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976903168:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.299633:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.299651:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b2a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3b7 expref: 10 pid: 21973 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.299662:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b2a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3b7 expref: 10 pid: 21973 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.299694:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b2a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3b7 expref: 10 pid: 21973 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.299709:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.299711:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.299717:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6600/0xfb36a14ee608b2fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e1 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.299724:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6600/0xfb36a14ee608b2fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e1 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.299746:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6600/0xfb36a14ee608b2fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e1 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.299755:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092044380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976828160:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066791.300287:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.304291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.304396:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976903296 00000100:00100000:3.0:1746066791.304403:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976903296 00000100:00100000:1.0:1746066791.304413:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092044380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976828160:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066791.304427:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066791.304447:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14452 00000100:00100000:3.0:1746066791.304454:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31577:x1830882976903296:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066791.304469:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066791.304471:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5408c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976903168:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4860us (5772us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.304478:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7417 00010000:00010000:3.0:1746066791.304579:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009288be00/0xfb36a14ee608b304 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e3e8 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.304604:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009354c800/0xfb36a14ee608b294 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3be expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.304627:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.304629:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.304633:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009288be00/0xfb36a14ee608b304 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e8 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.304657:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009354c800/0xfb36a14ee608b294 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3be expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.304666:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009354c800/0xfb36a14ee608b294 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3be expref: 9 pid: 4614 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746066791.305276:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976828288:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.305580:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3c72a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.309131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.309324:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976903424 00000100:00100000:1.0:1746066791.309332:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976903424 00010000:00010000:1.0:1746066791.309360:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009354c800/0xfb36a14ee608b294 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3be expref: 10 pid: 4614 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746066791.309392:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7418 00000100:00100000:1.0:1746066791.309399:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976903424:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.309416:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066791.309426:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976828288:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.309435:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009354c800/0xfb36a14ee608b294 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3be expref: 10 pid: 4614 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.309445:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009354c800/0xfb36a14ee608b294 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3be expref: 10 pid: 4614 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746066791.309455:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009288be00/0xfb36a14ee608b304 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e8 expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.309465:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009354c800/0xfb36a14ee608b294 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3be expref: 10 pid: 4614 timeout: 852 lvb_type: 1 00010000:00010000:3.0:1746066791.309467:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.309469:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.309474:0:4614:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009288be00/0xfb36a14ee608b304 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e8 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.309481:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009288be00/0xfb36a14ee608b304 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e8 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.309492:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066791.309505:0:4614:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009288be00/0xfb36a14ee608b304 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e8 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.309521:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976828416:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066791.309537:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976903424:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 138us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.309544:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7418 00000100:00100000:3.0:1746066791.309563:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3c72a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.311166:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976828416:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066791.311176:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009288be00, rc 0) 00000100:00100000:3.0:1746066791.311205:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31577:x1830882976903296:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 6752us (6923us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.311212:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14452 00000100:00100000:0.0:1746066791.312114:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.312165:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976903552 00000100:00100000:3.0:1746066791.312168:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976903552 00000100:00100000:3.0:1746066791.312326:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14453 00000100:00100000:3.0:1746066791.312331:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31577:x1830882976903552:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066791.312341:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.312351:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009288b200/0xfb36a14ee608b30b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e3ef expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.312367:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecca400/0xfb36a14ee608b2b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3c5 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.312371:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.312372:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.312374:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009288b200/0xfb36a14ee608b30b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3ef expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.312388:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecca400/0xfb36a14ee608b2b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3c5 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.312397:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ecca400/0xfb36a14ee608b2b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3c5 expref: 9 pid: 8451 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746066791.312403:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976828544:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.312461:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3c72a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.313903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.313985:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976828544:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.313999:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009288b200/0xfb36a14ee608b30b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3ef expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.314009:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009288b200, rc 0) 00000100:00100000:3.0:1746066791.314045:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31577:x1830882976903552:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1713us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.314050:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14453 00000100:00100000:1.0:1746066791.314114:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976903680 00000100:00100000:1.0:1746066791.314118:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976903680 00010000:00010000:1.0:1746066791.314135:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecca400/0xfb36a14ee608b2b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3c5 expref: 9 pid: 8451 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746066791.314171:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7419 00000100:00100000:1.0:1746066791.314178:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976903680:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.314187:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.314206:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ecca400/0xfb36a14ee608b2b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3c5 expref: 9 pid: 8451 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.314216:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ecca400/0xfb36a14ee608b2b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3c5 expref: 9 pid: 8451 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.314232:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecca400/0xfb36a14ee608b2b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3c5 expref: 9 pid: 8451 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.314258:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.314259:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.314265:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009288b200/0xfb36a14ee608b30b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3ef expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.314272:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009288b200/0xfb36a14ee608b30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3ef expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.314293:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009288b200/0xfb36a14ee608b30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3ef expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.314301:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092044380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976828672:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066791.314352:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.316445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.316524:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092044380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976828672:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066791.316535:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066791.316560:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976903680:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2382us (2660us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.316567:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7419 00000100:00100000:3.0:1746066791.316760:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976903808 00000100:00100000:3.0:1746066791.316765:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976903808 00000100:00100000:3.0:1746066791.316793:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14454 00000100:00100000:3.0:1746066791.316798:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31577:x1830882976903808:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066791.316810:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.316822:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b312 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e3f6 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.316840:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608b29b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3cc expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.316850:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.316852:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.316854:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b312 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3f6 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.316871:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608b29b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3cc expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.316879:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608b29b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3cc expref: 9 pid: 4614 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746066791.316887:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976828800:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.317256:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3c72a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.318234:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976828800:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.318248:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b312 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3f6 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.318258:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009288b800, rc 0) 00000100:00100000:3.0:1746066791.318279:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31577:x1830882976903808:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1481us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.318284:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14454 00000100:00100000:0.0:1746066791.318770:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.319179:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976903936 00000100:00100000:1.0:1746066791.319184:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976903936 00010000:00010000:1.0:1746066791.319203:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608b29b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3cc expref: 9 pid: 4614 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746066791.319238:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7420 00000100:00100000:1.0:1746066791.319248:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976903936:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.319257:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.319274:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608b29b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3cc expref: 9 pid: 4614 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.319284:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608b29b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3cc expref: 9 pid: 4614 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.319300:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608b29b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3cc expref: 9 pid: 4614 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.319310:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.319312:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.319317:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3f6 expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.319324:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b312 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3f6 expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.319342:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b312 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3f6 expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.319350:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092044380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976828928:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066791.319472:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.320763:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.320777:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092044380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976828928:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066791.320788:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066791.320807:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976903936:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1563us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.320815:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7420 00000100:00100000:3.0:1746066791.320817:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976904064 00000100:00100000:3.0:1746066791.320821:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976904064 00000100:00100000:3.0:1746066791.320844:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14455 00000100:00100000:3.0:1746066791.320849:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31577:x1830882976904064:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066791.320862:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.320871:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b319 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e3fd expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.320891:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009288ae00/0xfb36a14ee608b2b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3d3 expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.320899:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.320900:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.320903:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b319 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3fd expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.320919:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009288ae00/0xfb36a14ee608b2b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3d3 expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.320929:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009288ae00/0xfb36a14ee608b2b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3d3 expref: 9 pid: 4614 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746066791.320937:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976829056:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.320996:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3c72a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.322373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.322410:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976904192 00000100:00100000:1.0:1746066791.322414:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976904192 00010000:00010000:1.0:1746066791.322431:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009288ae00/0xfb36a14ee608b2b7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3d3 expref: 10 pid: 4614 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746066791.322459:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7421 00000100:00100000:1.0:1746066791.322465:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976904192:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.322472:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.322487:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009288ae00/0xfb36a14ee608b2b7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3d3 expref: 10 pid: 4614 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.322497:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009288ae00/0xfb36a14ee608b2b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3d3 expref: 10 pid: 4614 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.322513:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.322514:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.322517:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3fd expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.322522:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3fd expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.322538:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3fd expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.322544:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092044380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976829184:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066791.322592:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473000 going to sleep for 11 seconds 00010000:00010000:3.0:1746066791.323513:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009288ae00/0xfb36a14ee608b2b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3d3 expref: 10 pid: 4614 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746066791.323547:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976829056:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.323571:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3fd expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.323587:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009288b000, rc 0) 00000100:00100000:3.0:1746066791.323650:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31577:x1830882976904064:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2800us (2888us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.323658:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14455 00000100:00100000:1.0:1746066791.323772:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092044380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976829184:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066791.323783:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066791.323799:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976904192:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1335us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.323806:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7421 00000100:00100000:0.0:1746066791.324921:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.324998:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976904320 00000100:00100000:3.0:1746066791.325002:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976904320 00000100:00100000:3.0:1746066791.325118:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14456 00000100:00100000:3.0:1746066791.325125:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31577:x1830882976904320:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066791.325138:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.325151:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e404 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.325170:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800990f5c00/0xfb36a14ee608b2a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3da expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.325177:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.325178:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.325181:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e404 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.325200:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800990f5c00/0xfb36a14ee608b2a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3da expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.325209:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800990f5c00/0xfb36a14ee608b2a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3da expref: 9 pid: 4614 timeout: 852 lvb_type: 1 00000100:00100000:3.0:1746066791.325224:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976829312:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.325524:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3c72a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.326934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.327009:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976829312:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.327027:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e404 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.327039:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009288ba00, rc 0) 00000100:00100000:3.0:1746066791.327076:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31577:x1830882976904320:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1952us (2157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.327083:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14456 00000100:00100000:1.0:1746066791.327154:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976904448 00000100:00100000:1.0:1746066791.327158:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976904448 00010000:00010000:1.0:1746066791.327177:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800990f5c00/0xfb36a14ee608b2a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3da expref: 9 pid: 4614 timeout: 852 lvb_type: 1 00000100:00100000:1.0:1746066791.327207:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7422 00000100:00100000:1.0:1746066791.327213:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976904448:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.327222:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.327237:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800990f5c00/0xfb36a14ee608b2a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3da expref: 9 pid: 4614 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.327248:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800990f5c00/0xfb36a14ee608b2a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3da expref: 9 pid: 4614 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.327269:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800990f5c00/0xfb36a14ee608b2a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3da expref: 9 pid: 4614 timeout: 852 lvb_type: 1 00010000:00010000:1.0:1746066791.327282:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.327284:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.327288:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e404 expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.327295:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e404 expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.327315:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e404 expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.327323:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092044380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976829440:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066791.327372:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093473000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.329723:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092044380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976829440:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066791.329734:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066791.329962:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976904448:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2747us (3029us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066791.329966:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.329970:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7422 00000100:00100000:3.0:1746066791.330029:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976904576 00000100:00100000:3.0:1746066791.330034:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976904576 00000100:00100000:2.0:1746066791.330122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.330220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.330242:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976904832 00000100:00100000:3.0:1746066791.330245:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976904832 00000100:00100000:3.0:1746066791.330265:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14457 00000100:00100000:3.0:1746066791.330270:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976904576:12345-192.168.202.57@tcp:2:lfs.0 00000100:00100000:0.0:1746066791.330321:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976905088 00000100:00100000:0.0:1746066791.330325:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976905088 00000100:00100000:1.0:1746066791.330342:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14458 00000100:00100000:1.0:1746066791.330347:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976904832:12345-192.168.202.57@tcp:2:lfs.0 00000100:00100000:0.0:1746066791.330350:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14459 00000100:00100000:0.0:1746066791.330354:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976905088:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:1.0:1746066791.330471:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066791.330471:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:1.0:1746066791.330474:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:0.0:1746066791.330474:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066789 -> 1746066790 00002000:00010000:1.0:1746066791.330476:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066788 -> 1746066790 00002000:00010000:0.0:1746066791.330476:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066789 -> 1746066790 00002000:00010000:1.0:1746066791.330478:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066790 -> 1746066791 00002000:00010000:0.0:1746066791.330478:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066789 -> 1746066791 00002000:00010000:1.0:1746066791.330480:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:0.0:1746066791.330480:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5921 -> 5921 00000100:00100000:0.0:1746066791.330499:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976905088:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 144us (279us total) trans 17179873569 rc 0/0 00000100:00100000:0.0:1746066791.330504:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14459 00002000:00010000:3.0:1746066791.330561:0:4614:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746066791.330563:0:4614:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066789 -> 1746066790 00002000:00010000:3.0:1746066791.330565:0:4614:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066789 -> 1746066790 00002000:00010000:3.0:1746066791.330567:0:4614:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066789 -> 1746066791 00002000:00010000:3.0:1746066791.330568:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2017 -> 2017 00000100:00100000:1.0:1746066791.330835:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976904832:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 487us (713us total) trans 21474840892 rc 0/0 00000100:00100000:1.0:1746066791.330841:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14458 00000100:00100000:0.0:1746066791.331483:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.331492:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976904576:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 1221us (1525us total) trans 17179873570 rc 0/0 00000100:00100000:3.0:1746066791.331497:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14457 00000100:00100000:3.0:1746066791.331507:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976904704 00000100:00100000:3.0:1746066791.331509:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976904704 00000100:00100000:0.0:1746066791.331511:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.331526:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976904960 00000100:00100000:3.0:1746066791.331527:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976904960 00000100:00100000:0.0:1746066791.331530:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.331641:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976905216 00000100:00100000:3.0:1746066791.331646:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976905216 00000100:00100000:0.0:1746066791.331667:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14460 00000100:00100000:0.0:1746066791.331688:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976904704:12345-192.168.202.57@tcp:2:lfs.0 00000100:00100000:3.0:1746066791.331708:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14461 00000100:00100000:3.0:1746066791.331713:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976904960:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:3.0:1746066791.331779:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066791.331783:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066789 -> 1746066790 00002000:00010000:3.0:1746066791.331784:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066788 -> 1746066790 00002000:00010000:3.0:1746066791.331786:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066788 -> 1746066791 00002000:00010000:3.0:1746066791.331788:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:0.0:1746066791.331793:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066791.331795:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:0.0:1746066791.331797:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066790 -> 1746066790 00002000:00010000:0.0:1746066791.331799:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066790 -> 1746066791 00002000:00010000:0.0:1746066791.331800:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746066791.331803:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882976904960:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 90us (291us total) trans 17179873571 rc 0/0 00000100:00100000:3.0:1746066791.331808:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14461 00000100:00100000:0.0:1746066791.331810:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882976904704:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 138us (328us total) trans 21474840893 rc 0/0 00000100:00100000:0.0:1746066791.331815:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14460 00000100:00100000:3.0:1746066791.331830:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14462 00000100:00100000:3.0:1746066791.331834:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976905216:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:3.0:1746066791.332805:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066791.332809:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:3.0:1746066791.332811:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066790 -> 1746066790 00002000:00010000:3.0:1746066791.332813:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066790 -> 1746066791 00002000:00010000:3.0:1746066791.332814:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746066791.332837:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882976905216:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 1003us (1306us total) trans 21474840894 rc 0/0 00000100:00100000:3.0:1746066791.332842:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14462 00000100:00100000:0.0:1746066791.334303:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.334544:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976905472 00000100:00100000:2.0:1746066791.334550:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976905472 00000100:00100000:2.0:1746066791.334606:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4150 00000100:00100000:2.0:1746066791.334612:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31577:x1830882976905472:12345-192.168.202.57@tcp:35:lfs.0 00000004:00010000:2.0:1746066791.334663:0:14552:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x318:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b240 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3a2 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.334753:0:14552:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14552 initiator: MDT0 00010000:00010000:2.0:1746066791.334763:0:14552:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b27f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3a9 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.334769:0:14552:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14552 initiator: MDT0 00010000:00010000:2.0:1746066791.334792:0:14552:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b27f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3a9 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.334801:0:14552:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b27f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3a9 expref: 9 pid: 809 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.334812:0:14552:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c529180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14552:1830882976829568:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066791.334875:0:14552:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d1d180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066791.335971:0:14552:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c529180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14552:1830882976829568:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066791.335988:0:14552:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14552 initiator: MDT0 00000100:00100000:0.0:1746066791.336367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.336410:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976905600 00000100:00100000:1.0:1746066791.336414:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976905600 00010000:00010000:1.0:1746066791.336431:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b27f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3a9 expref: 10 pid: 809 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.336460:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7423 00000100:00100000:1.0:1746066791.336466:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976905600:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.336476:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.336481:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b27f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3a9 expref: 10 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.336490:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b27f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3a9 expref: 10 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.336504:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d4e00/0xfb36a14ee608b27f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3a9 expref: 10 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.336531:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:1.0:1746066791.336536:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14552 initiator: MDT0 00010000:00010000:1.0:1746066791.336545:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14552 initiator: MDT0 00010000:00010000:1.0:1746066791.336550:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14552 initiator: MDT0 00010000:00010000:1.0:1746066791.336581:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066791.336614:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976905600:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 147us (246us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066791.336645:0:14552:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14552 initiator: MDT0 00000100:00100000:1.0:1746066791.336650:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7423 00010000:00010000:2.0:1746066791.336653:0:14552:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14552 initiator: MDT0 00000040:00080000:2.0:1746066791.337240:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3079, 88 off260200 00000004:00080000:2.0:1746066791.337245:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752514568705ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066791.337270:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3097, 88 off261696 00000004:00080000:2.0:1746066791.337272:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752514596528ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066791.337282:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3098, 88 off261784 00000004:00080000:2.0:1746066791.337285:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752514608815ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066791.337292:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3080, 88 off260288 00000004:00080000:2.0:1746066791.337294:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752514617975ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066791.337300:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3081, 88 off260376 00000004:00080000:2.0:1746066791.337302:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752514626168ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066791.337308:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3099, 88 off261872 00000004:00080000:2.0:1746066791.337310:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752514634538ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066791.337318:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3100, 88 off261960 00000004:00080000:2.0:1746066791.337319:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752514643578ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066791.337325:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3101, 88 off262048 00000004:00080000:2.0:1746066791.337327:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752514651583ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066791.337333:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3082, 88 off260464 00000004:00080000:2.0:1746066791.337335:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752514659100ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066791.337359:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3103, 88 off262232 00000004:00080000:2.0:1746066791.337362:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752514685853ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066791.337368:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3083, 88 off260552 00000004:00080000:2.0:1746066791.337371:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752514694943ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066791.337376:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3104, 88 off262320 00000004:00080000:2.0:1746066791.337378:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752514702368ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066791.337384:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3084, 88 off260640 00000004:00080000:2.0:1746066791.337386:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752514710153ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066791.337392:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3085, 88 off260728 00000004:00080000:2.0:1746066791.337394:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752514717845ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066791.337399:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3086, 88 off260816 00000004:00080000:2.0:1746066791.337401:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752514724996ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066791.337406:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3087, 88 off260904 00000004:00080000:2.0:1746066791.337408:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752514732115ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066791.337413:0:14552:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3105, 88 off262408 00000004:00080000:2.0:1746066791.337415:0:14552:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752514739158ns, next at 749511475809ns, rc = 0 00000004:00010000:0.0:1746066791.386832:0:14552:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ed0bb80 reply state ffff880099176000 transno 8589944014 ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14552 initiator: MDT0 00000100:00100000:0.0:1746066791.386845:0:14552:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746066791.386853:0:14552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:0.0:1746066791.386856:0:14552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066791.386864:0:14552:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b240 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3a2 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746066791.386904:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944013 is committed 00000001:00080000:3.0:1746066791.386917:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944014 is committed 00000004:00080000:3.0:1746066791.386923:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2379 committed 00000004:00080000:3.0:1746066791.386930:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2361 committed 00000004:00080000:3.0:1746066791.386935:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2360 committed 00000004:00080000:3.0:1746066791.386937:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2359 committed 00000004:00080000:3.0:1746066791.386938:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2358 committed 00000004:00080000:3.0:1746066791.386939:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2378 committed 00000004:00080000:3.0:1746066791.386941:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2357 committed 00000004:00080000:3.0:1746066791.386942:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2377 committed 00000004:00080000:3.0:1746066791.386944:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2356 committed 00000004:00080000:3.0:1746066791.386945:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2376 committed 00000004:00080000:3.0:1746066791.386947:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2375 committed 00000004:00080000:3.0:1746066791.386948:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2374 committed 00000004:00080000:3.0:1746066791.386949:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2355 committed 00000004:00080000:3.0:1746066791.386951:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2354 committed 00000004:00080000:3.0:1746066791.386952:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2373 committed 00010000:00080000:0.0:1746066791.386953:0:14552:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000004:00080000:3.0:1746066791.386954:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2372 committed 00000004:00080000:3.0:1746066791.386955:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2353 committed 00000100:00100000:0.0:1746066791.386962:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31577:x1830882976905472:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 52350us (52662us total) trans 8589944014 rc 0/0 00000100:00100000:0.0:1746066791.386971:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4150 00000100:00100000:3.0:1746066791.387041:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976829696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.387086:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.387120:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976830208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.387134:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.387154:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746066791.387156:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976829696 00000100:00100000:3.0:1746066791.387158:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976829824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066791.387161:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976829696 00000100:00100000:3.0:1746066791.387172:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.387181:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976830336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.387192:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066791.387197:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976830208 00000100:00100000:0.0:1746066791.387199:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976830208 00000100:00100000:3.0:1746066791.387206:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976829952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066791.387208:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976829824 00000100:00100000:0.0:1746066791.387209:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976829824 00000100:00100000:1.0:1746066791.387210:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976830336 00000100:00100000:1.0:1746066791.387214:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976830336 00000100:00100000:3.0:1746066791.387218:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066791.387220:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14463 00000100:00100000:0.0:1746066791.387225:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3293:x1830882976829696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.387228:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976830464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.387230:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976829952 00000100:00100000:1.0:1746066791.387232:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976829952 00000100:00100000:3.0:1746066791.387239:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066791.387243:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976830464 00000100:00100000:1.0:1746066791.387245:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976830464 00000100:00100000:3.0:1746066791.387248:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746066791.387251:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976830080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.387252:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14464 00000100:00100000:1.0:1746066791.387257:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3293:x1830882976830208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.387264:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.387270:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976830592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.387281:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.387296:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976830080 00000100:00100000:3.0:1746066791.387299:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976830080 00000100:00100000:1.0:1746066791.387301:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976830592 00000100:00100000:1.0:1746066791.387303:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976830592 00000100:00100000:3.0:1746066791.387313:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14465 00000100:00100000:3.0:1746066791.387317:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882976829824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.387320:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14466 00000100:00100000:1.0:1746066791.387324:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882976830336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.387353:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14467 00000100:00100000:1.0:1746066791.387357:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3295:x1830882976829952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.387366:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14468 00000100:00100000:1.0:1746066791.387370:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3295:x1830882976830464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066791.387382:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066791.387384:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:0.0:1746066791.387385:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066790 -> 1746066790 00002000:00010000:0.0:1746066791.387387:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066791 -> 1746066791 00002000:00010000:0.0:1746066791.387388:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2017 -> 2017 00002000:00010000:3.0:1746066791.387402:0:4614:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066791.387404:0:4614:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:3.0:1746066791.387406:0:4614:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066790 -> 1746066790 00000100:00100000:0.0:1746066791.387406:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3293:x1830882976829696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (320us total) trans 17179873572 rc 0/0 00002000:00010000:3.0:1746066791.387408:0:4614:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066791 -> 1746066791 00002000:00010000:3.0:1746066791.387410:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746066791.387410:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14463 00000100:00100000:0.0:1746066791.387419:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14469 00000100:00100000:0.0:1746066791.387422:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3295:x1830882976830080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066791.387428:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3293:x1830882976829824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (255us total) trans 17179873573 rc 0/0 00002000:00010000:1.0:1746066791.387430:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1746066791.387433:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14465 00002000:00010000:1.0:1746066791.387433:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746066791.387435:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066791.387437:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746066791.387438:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746066791.387444:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14470 00000100:00100000:3.0:1746066791.387448:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3295:x1830882976830592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.387462:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3295:x1830882976830464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (221us total) trans 17179873574 rc 0/0 00000100:00100000:1.0:1746066791.387467:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14468 00000100:00100000:0.0:1746066791.387479:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3295:x1830882976830080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (214us total) trans 17179873575 rc 0/0 00000100:00100000:0.0:1746066791.387484:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14469 00000004:00080000:0.0:1746066791.387536:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c7b80/2, rc 0, transno 17179873573 00000100:00100000:0.0:1746066791.387543:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976829824:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066791.387551:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c7480/2, rc 0, transno 17179873572 00000100:00100000:0.0:1746066791.387554:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976829696:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066791.387556:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c5f80/2, rc 0, transno 17179873575 00000100:00100000:1.0:1746066791.387561:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976830080:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066791.387567:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c7800/2, rc 0, transno 17179873574 00000100:00100000:1.0:1746066791.387570:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976830464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.387893:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976830976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066791.387914:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746066791.387931:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14552 initiator: MDT0 00010000:00010000:2.0:1746066791.387939:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14552 initiator: MDT0 00000100:00100000:1.0:1746066791.387940:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976831488:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066791.387948:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14552 initiator: MDT0 00010000:00010000:2.0:1746066791.387953:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008de12600 already unused, calling callback (ffffffffa137d690) 00000100:00100000:1.0:1746066791.387954:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746066791.387957:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14552 initiator: MDT0 00010000:00010000:2.0:1746066791.387963:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14552 initiator: MDT0 00000100:00100000:1.0:1746066791.387966:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746066791.387970:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976831104:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066791.387973:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009d6bd900) 00010000:00010000:2.0:1746066791.387975:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066791.387978:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14552 initiator: MDT0 00010000:00010000:2.0:1746066791.387982:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008de12600/0xfb36a14ee608b327 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14552 initiator: MDT0 00000100:00100000:1.0:1746066791.387982:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066791.387992:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976831616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066791.388002:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066791.388005:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976830848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066791.388025:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066791.388037:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976831360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066791.388047:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066791.388056:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746066791.388059:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976830720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066791.388070:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066791.388075:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976831232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066791.388084:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066791.388095:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976830976 00000100:00100000:2.0:1746066791.388097:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976830976 00000100:00100000:2.0:1746066791.388108:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976831488 00000100:00100000:2.0:1746066791.388110:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976831488 00000100:00100000:2.0:1746066791.388115:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976831104 00000100:00100000:2.0:1746066791.388116:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976831104 00000100:00100000:2.0:1746066791.388120:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976831616 00000100:00100000:2.0:1746066791.388122:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976831616 00000100:00100000:2.0:1746066791.388126:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976830848 00000100:00100000:2.0:1746066791.388127:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976830848 00000100:00100000:2.0:1746066791.388130:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976831360 00000100:00100000:2.0:1746066791.388132:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976831360 00000100:00100000:2.0:1746066791.388135:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976830720 00000100:00100000:2.0:1746066791.388137:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976830720 00000100:00100000:2.0:1746066791.388141:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976831232 00000100:00100000:2.0:1746066791.388142:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976831232 00000100:00100000:2.0:1746066791.388147:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14471 00000100:00100000:2.0:1746066791.388151:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3295:x1830882976830976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066791.388152:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14472 00000100:00100000:1.0:1746066791.388158:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3295:x1830882976831488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066791.388222:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14473 00000100:00100000:1.0:1746066791.388227:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3295:x1830882976831104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066791.388233:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746066791.388235:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:2.0:1746066791.388236:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066790 -> 1746066790 00002000:00010000:2.0:1746066791.388237:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066791 -> 1746066791 00002000:00010000:2.0:1746066791.388239:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:2.0:1746066791.388255:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3295:x1830882976830976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (340us total) trans 21474840895 rc 0/0 00000100:00100000:2.0:1746066791.388259:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14471 00000100:00100000:2.0:1746066791.388267:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14474 00000100:00100000:2.0:1746066791.388270:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3295:x1830882976831616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066791.388307:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3295:x1830882976831104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (322us total) trans 21474840897 rc 0/0 00000100:00100000:1.0:1746066791.388313:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14473 00000100:00100000:2.0:1746066791.388315:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3295:x1830882976831488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (360us total) trans 21474840896 rc 0/0 00000100:00100000:2.0:1746066791.388320:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14472 00000100:00100000:1.0:1746066791.388324:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14475 00000100:00100000:1.0:1746066791.388328:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3294:x1830882976830848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066791.388329:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14476 00000100:00100000:2.0:1746066791.388332:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3294:x1830882976831360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066791.388359:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14477 00000100:00100000:1.0:1746066791.388363:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3294:x1830882976830720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066791.388396:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3295:x1830882976831616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (393us total) trans 21474840898 rc 0/0 00000100:00100000:2.0:1746066791.388400:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14474 00000100:00100000:2.0:1746066791.388407:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14478 00000100:00100000:2.0:1746066791.388410:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3294:x1830882976831232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066791.388430:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066791.388433:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:1.0:1746066791.388435:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066790 -> 1746066790 00002000:00010000:1.0:1746066791.388436:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066791 -> 1746066791 00002000:00010000:1.0:1746066791.388438:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746066791.388457:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3294:x1830882976830720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (385us total) trans 21474840899 rc 0/0 00000100:00100000:2.0:1746066791.388463:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3294:x1830882976831360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (414us total) trans 21474840900 rc 0/0 00000100:00100000:1.0:1746066791.388463:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14477 00000100:00100000:2.0:1746066791.388468:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14476 00000004:00080000:1.0:1746066791.388483:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c529180/2, rc 0, transno 21474840899 00000100:00100000:1.0:1746066791.388487:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976830720:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066791.388494:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c528e00/2, rc 0, transno 21474840900 00000100:00100000:1.0:1746066791.388497:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976831360:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066791.388508:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c52a300/2, rc 0, transno 21474840897 00000100:00100000:1.0:1746066791.388510:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976831104:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066791.388515:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00000004:00080000:1.0:1746066791.388516:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c52ad80/2, rc 0, transno 21474840898 00000100:00100000:1.0:1746066791.388518:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976831616:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066791.388524:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c528a80/2, rc 0, transno 21474840896 00000100:00100000:1.0:1746066791.388526:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976831488:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066791.388532:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c529500/2, rc 0, transno 21474840895 00000100:00100000:1.0:1746066791.388534:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c529500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976830976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066791.388987:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746066791.388993:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976831744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.389009:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.389073:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3295:x1830882976830592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1625us (1790us total) trans 17179873576 rc 0/0 00000100:00100000:3.0:1746066791.389078:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14470 00000100:00100000:3.0:1746066791.389086:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976831744 00000100:00100000:3.0:1746066791.389089:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976831744 00000100:00100000:3.0:1746066791.389101:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14479 00000100:00100000:3.0:1746066791.389105:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3294:x1830882976831744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066791.389144:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3293:x1830882976830208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1887us (2010us total) trans 17179873577 rc 0/0 00000100:00100000:0.0:1746066791.389149:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14464 00000004:00080000:0.0:1746066791.389165:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c5500/2, rc 0, transno 17179873577 00000100:00100000:0.0:1746066791.389168:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976830208:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066791.389380:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:0.0:1746066791.389382:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:0.0:1746066791.389384:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066790 -> 1746066790 00002000:00010000:0.0:1746066791.389385:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066791 -> 1746066791 00002000:00010000:0.0:1746066791.389387:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5921 -> 5921 00000100:00100000:0.0:1746066791.389401:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3295:x1830882976829952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2043us (2181us total) trans 17179873579 rc 0/0 00000100:00100000:0.0:1746066791.389408:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14467 00000100:00100000:1.0:1746066791.389493:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3293:x1830882976830336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2169us (2300us total) trans 17179873578 rc 0/0 00000100:00100000:1.0:1746066791.389498:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14466 00000004:00080000:1.0:1746066791.389513:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c5180/2, rc 0, transno 17179873576 00000100:00100000:1.0:1746066791.389516:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976830592:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066791.389521:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c5880/2, rc 0, transno 17179873579 00000100:00100000:1.0:1746066791.389523:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976829952:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066791.389557:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c5c00/2, rc 0, transno 17179873578 00000100:00100000:0.0:1746066791.389560:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976830336:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066791.389648:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:2.0:1746066791.389650:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066790 -> 1746066790 00002000:00010000:2.0:1746066791.389651:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066791 -> 1746066791 00002000:00010000:2.0:1746066791.389653:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746066791.389693:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3294:x1830882976830848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1364us (1666us total) trans 21474840901 rc 0/0 00000100:00100000:2.0:1746066791.389700:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14475 00000100:00100000:3.0:1746066791.389725:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3294:x1830882976831744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 619us (715us total) trans 17179873580 rc 0/0 00000100:00100000:3.0:1746066791.389730:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14479 00000100:00100000:2.0:1746066791.389792:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3294:x1830882976831232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1380us (1705us total) trans 21474840902 rc 0/0 00000100:00100000:2.0:1746066791.389798:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14478 00000004:00080000:1.0:1746066791.389864:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bb2c380/2, rc 0, transno 17179873580 00000100:00100000:1.0:1746066791.389867:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976831744:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066791.389874:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c52a680/2, rc 0, transno 21474840902 00000100:00100000:1.0:1746066791.389876:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976831232:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066791.389882:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c52b100/2, rc 0, transno 21474840901 00000100:00100000:1.0:1746066791.389884:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976830848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066791.391399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.391540:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976905728 00000100:00100000:2.0:1746066791.391545:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976905728 00000100:00100000:2.0:1746066791.391585:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9964 00000100:00100000:2.0:1746066791.391591:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:31577:x1830882976905728:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066791.391606:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.391948:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608b32e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e40b expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.391987:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608b32e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e40b expref: 7 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.391995:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608b32e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e40b expref: 7 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.392005:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066791.392007:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066791.392008:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1ec00, rc 0) 00000100:00100000:3.0:1746066791.392034:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31577:x1830882976905728:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 444us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.392038:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9964 00000100:00100000:0.0:1746066791.400433:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.400516:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976905984 00000100:00100000:2.0:1746066791.400525:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976905984 00000100:00100000:2.0:1746066791.400636:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4151 00000100:00100000:2.0:1746066791.400644:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31577:x1830882976905984:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:2.0:1746066791.400932:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31577:x1830882976905984:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 288us (505us total) trans 8589944015 rc 0/0 00000100:00100000:2.0:1746066791.400938:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4151 00000100:00100000:0.0:1746066791.418895:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.418949:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.419052:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976906368 00000100:00100000:1.0:1746066791.419053:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976906496 00000100:00100000:3.0:1746066791.419058:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976906368 00000100:00100000:1.0:1746066791.419058:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976906496 00000100:00100000:1.0:1746066791.419101:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9965 00000100:00100000:3.0:1746066791.419107:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9966 00000100:00100000:1.0:1746066791.419108:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+6:31589:x1830882976906496:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066791.419112:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+250:31590:x1830882976906368:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066791.419126:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.419127:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.419141:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608b33c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e412 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.419144:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b335 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e419 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.419233:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ba00/0xfb36a14ee608b343 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.419243:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ba00/0xfb36a14ee608b343 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.419252:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ba00/0xfb36a14ee608b343 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.419261:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82600/0xfb36a14ee608b34a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066791.419262:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b351 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.419267:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.419271:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82600/0xfb36a14ee608b34a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066791.419272:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.419278:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82600/0xfb36a14ee608b34a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066791.419287:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82400/0xfb36a14ee608b358 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066791.419292:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82400/0xfb36a14ee608b358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066791.419297:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82400/0xfb36a14ee608b358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066791.419351:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b35f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.419353:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83400/0xfb36a14ee608b366 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066791.419356:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b35f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.419360:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b35f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.419361:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83400/0xfb36a14ee608b366 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00000004:00200000:1.0:1746066791.419366:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066791.419367:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83400/0xfb36a14ee608b366 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:2.0:1746066791.419376:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066791.419430:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ba00/0xfb36a14ee608b343 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.419435:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ba00/0xfb36a14ee608b343 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.419443:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ba00/0xfb36a14ee608b343 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.419444:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82600/0xfb36a14ee608b34a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066791.419450:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82600/0xfb36a14ee608b34a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066791.419454:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82600/0xfb36a14ee608b34a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066791.419454:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e80ba00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066791.419458:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e82600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066791.419458:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ba00/0xfb36a14ee608b343 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.419461:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82600/0xfb36a14ee608b34a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066791.419462:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ba00/0xfb36a14ee608b343 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.419465:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82600/0xfb36a14ee608b34a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066791.419472:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066791.419474:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066791.419477:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ba00/0xfb36a14ee608b343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.419479:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066791.419481:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066791.419482:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ba00/0xfb36a14ee608b343 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.419484:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82600/0xfb36a14ee608b34a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066791.419488:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82600/0xfb36a14ee608b34a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066791.419500:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82400/0xfb36a14ee608b358 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066791.419504:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82400/0xfb36a14ee608b358 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066791.419508:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82400/0xfb36a14ee608b358 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066791.419553:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.419558:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b351 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.419562:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b351 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.419566:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e80b800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066791.419568:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b351 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.419572:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b351 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.419581:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebebe00) 00010000:00010000:1.0:1746066791.419582:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066791.419584:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b351 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.419588:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b351 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.419627:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b335 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e419 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.419638:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b35f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e419 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.419643:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:1.0:1746066791.419645:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066791.419647:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e80b400, rc 0) 00000100:00100000:1.0:1746066791.419832:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+8:31589:x1830882976906496:12345-192.168.202.57@tcp:101:cat.0 Request processed in 724us (882us total) trans 8589944016 rc 0/0 00000100:00100000:1.0:1746066791.419838:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9965 00010000:00010000:2.0:1746066791.419890:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e82400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066791.419893:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82400/0xfb36a14ee608b358 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066791.419899:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82400/0xfb36a14ee608b358 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066791.419906:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebebe00) 00010000:00010000:2.0:1746066791.419908:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066791.419910:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82400/0xfb36a14ee608b358 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066791.419914:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e82400/0xfb36a14ee608b358 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066791.419939:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608b33c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e412 expref: 253 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.419949:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83400/0xfb36a14ee608b366 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e412 expref: 252 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.419954:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066791.419956:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066791.419958:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e83400, rc 0) 00000100:00100000:2.0:1746066791.419995:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31590:x1830882976906368:12345-192.168.202.57@tcp:101:cat.0 Request processed in 882us (1106us total) trans 8589944017 rc 0/0 00000100:00100000:2.0:1746066791.420000:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9966 00000100:00100000:0.0:1746066791.423669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.425022:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976906624 00000100:00100000:2.0:1746066791.425031:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976906624 00000100:00100000:1.0:1746066791.425041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.425389:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.425412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.425472:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976907264 00000100:00100000:2.0:1746066791.425476:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976907264 00000100:00100000:3.0:1746066791.425482:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14480 00000100:00100000:3.0:1746066791.425491:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:31589:x1830882976906624:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:2.0:1746066791.425494:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14481 00000100:00100000:2.0:1746066791.425500:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31590:x1830882976907264:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066791.425504:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.425507:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.425517:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608b37b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e420 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.425517:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e82e00/0xfb36a14ee608b382 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e435 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.425538:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6600/0xfb36a14ee608b2fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e1 expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.425545:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066791.425546:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066791.425549:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608b37b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e420 expref: 21 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.425555:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066791.425559:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e82e00/0xfb36a14ee608b382 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e435 expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066791.425595:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976906880 00000100:00100000:0.0:1746066791.425598:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976906880 00000100:00100000:0.0:1746066791.425628:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976907136 00000100:00100000:0.0:1746066791.425631:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976907136 00000100:00100000:0.0:1746066791.425645:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9967 00000100:00100000:0.0:1746066791.425650:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+8:31584:x1830882976906880:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066791.425662:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066791.425671:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0400/0xfb36a14ee608b389 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e427 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.425754:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.425765:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b35f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e419 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.425771:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83400/0xfb36a14ee608b366 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e412 expref: 252 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.425776:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.425798:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83400/0xfb36a14ee608b366 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e412 expref: 252 pid: 809 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.425800:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9968 00000100:00100000:1.0:1746066791.425806:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31585:x1830882976907136:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066791.425807:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83400/0xfb36a14ee608b366 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e412 expref: 252 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.425814:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066791.425817:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976831872:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.425821:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80a800/0xfb36a14ee608b397 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e42e expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.425855:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066791.425861:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066791.425866:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066791.425877:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b35f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e419 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.425884:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b35f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e419 expref: 9 pid: 14548 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.426023:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6600/0xfb36a14ee608b2fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e1 expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.426032:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6600/0xfb36a14ee608b2fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e1 expref: 10 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.426040:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976832128:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066791.426046:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e82e00/0xfb36a14ee608b382 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e435 expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.426055:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e82e00, rc 0) 00000100:00100000:3.0:1746066791.426061:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e18f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066791.426076:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31590:x1830882976907264:12345-192.168.202.57@tcp:101:cat.0 Request processed in 576us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.426081:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14481 00000100:00100000:0.0:1746066791.426141:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976832000:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066791.426161:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.427759:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.427773:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976832128:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.427789:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608b37b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e420 expref: 21 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.427803:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1f400, rc 0) 00000100:00100000:3.0:1746066791.427823:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:31589:x1830882976906624:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2334us (4161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.427828:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14480 00000100:00100000:1.0:1746066791.427847:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976831872:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066791.427855:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976832000:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.427872:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746066791.427925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.427949:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.427997:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976907520 00000100:00100000:2.0:1746066791.428001:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976907520 00000100:00100000:3.0:1746066791.428013:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976907392 00000100:00100000:3.0:1746066791.428015:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976907392 00010000:00010000:2.0:1746066791.428018:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83400/0xfb36a14ee608b366 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e412 expref: 254 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.428024:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6600/0xfb36a14ee608b2fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e1 expref: 11 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.428033:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976907648 00000100:00100000:2.0:1746066791.428035:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976907648 00000100:00100000:3.0:1746066791.428037:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7424 00000100:00100000:3.0:1746066791.428041:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5408850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:1963:x1830882976907520:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.428042:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b35f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e419 expref: 10 pid: 14548 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.428049:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066791.428053:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83400/0xfb36a14ee608b366 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e412 expref: 254 pid: 809 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.428057:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7425 00010000:00010000:3.0:1746066791.428061:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83400/0xfb36a14ee608b366 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e412 expref: 254 pid: 809 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.428061:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882976907392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.428065:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066791.428076:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83400/0xfb36a14ee608b366 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e412 expref: 254 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.428080:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6600/0xfb36a14ee608b2fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e1 expref: 11 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.428086:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6600/0xfb36a14ee608b2fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e1 expref: 11 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.428087:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066791.428091:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.428096:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.428098:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a67e6600/0xfb36a14ee608b2fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e1 expref: 11 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.428101:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066791.428105:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.428106:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.428111:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608b37b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e420 expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.428116:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5408850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:1963:x1830882976907520:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 75us (360us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066791.428117:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608b37b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e420 expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.428121:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7424 00010000:00010000:2.0:1746066791.428124:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.428125:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.428127:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e82e00/0xfb36a14ee608b382 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e435 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.428133:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e82e00/0xfb36a14ee608b382 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e435 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.428148:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7426 00010000:00010000:2.0:1746066791.428150:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130e82e00/0xfb36a14ee608b382 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e435 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.428152:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+10:1963:x1830882976907648:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066791.428157:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066791.428160:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b35f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e419 expref: 10 pid: 14548 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.428167:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b35f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e419 expref: 10 pid: 14548 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.428176:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b35f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e419 expref: 10 pid: 14548 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.428184:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066791.428187:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.428192:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.428196:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.428202:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.428210:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.428214:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.428226:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066791.428233:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066791.428240:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066791.428240:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746066791.428241:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+9:1963:x1830882976907648:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 88us (291us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066791.428245:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746066791.428246:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7426 00000004:00200000:1.0:1746066791.428251:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:0.0:1746066791.428254:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000100:00100000:2.0:1746066791.428326:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976832256:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066791.428358:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0400/0xfb36a14ee608b389 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e427 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.428376:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608b37b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e420 expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.428377:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e427 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.428382:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00000100:00100000:2.0:1746066791.428384:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976832384:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066791.428384:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066791.428386:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af0600, rc 0) 00000100:00100000:2.0:1746066791.428401:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.428401:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:31584:x1830882976906880:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2751us (3013us total) trans 8589944018 rc 0/0 00000100:00100000:0.0:1746066791.428406:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9967 00010000:00010000:1.0:1746066791.428515:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80a800/0xfb36a14ee608b397 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e42e expref: 254 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.428525:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e42e expref: 253 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.428531:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:1.0:1746066791.428533:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066791.428535:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e80bc00, rc 0) 00000100:00100000:1.0:1746066791.428561:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31585:x1830882976907136:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2756us (3149us total) trans 8589944019 rc 0/0 00000100:00100000:1.0:1746066791.428567:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9968 00000100:00100000:2.0:1746066791.429833:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976832256:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066791.429986:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976832384:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066791.429999:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.430035:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976907392:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1972us (2109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.430042:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7425 00000100:00100000:0.0:1746066791.430382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.430413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.430439:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976907776 00000100:00100000:1.0:1746066791.430445:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976907776 00000100:00100000:1.0:1746066791.430475:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976907904 00000100:00100000:1.0:1746066791.430478:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976907904 00000100:00100000:1.0:1746066791.430491:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9969 00000100:00100000:1.0:1746066791.430496:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31585:x1830882976907776:12345-192.168.202.57@tcp:101:multiop.0 00000100:00100000:2.0:1746066791.430500:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9970 00000100:00100000:2.0:1746066791.430507:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:31589:x1830882976907904:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066791.430511:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.430517:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.430521:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ba00/0xfb36a14ee608b3b3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e43c expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.430524:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b3ba lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e443 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.430612:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ba00/0xfb36a14ee608b3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e43c expref: 254 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.430638:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b3ba lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e443 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.430664:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b3ba lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e443 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.430665:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ba00/0xfb36a14ee608b3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e43c expref: 254 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.430704:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:1.0:1746066791.430708:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066791.430710:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e80ba00, rc 0) 00000100:00100000:1.0:1746066791.430730:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:31585:x1830882976907776:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 234us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.430744:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9969 00010000:00010000:2.0:1746066791.430862:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066791.430865:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066791.430867:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d5400, rc 0) 00000100:00100000:2.0:1746066791.430893:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+10:31589:x1830882976907904:12345-192.168.202.57@tcp:101:cat.0 Request processed in 387us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.430898:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9970 00000100:00100000:0.0:1746066791.433741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.433910:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976908160 00000100:00100000:3.0:1746066791.433917:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976908160 00000100:00100000:3.0:1746066791.434187:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9971 00000100:00100000:3.0:1746066791.434193:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:31585:x1830882976908160:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066791.434217:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.434220:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066791.434238:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ba00/0xfb36a14ee608b3b3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e43c expref: 254 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.434250:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066791.434253:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066791.434262:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608b3c1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e44a expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.434296:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.434306:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608b32e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e40b expref: 7 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.434315:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b3ba lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e443 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.434321:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.434344:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b3ba lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e443 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.434354:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b3ba lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e443 expref: 9 pid: 14548 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.434363:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976832512:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.434762:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608b32e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e40b expref: 7 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.434769:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608b32e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e40b expref: 7 pid: 809 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.434775:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976832640:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.434796:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e186c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.440667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.440727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.441026:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976908416 00000100:00100000:1.0:1746066791.441034:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976908416 00000100:00100000:1.0:1746066791.441909:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9972 00000100:00100000:1.0:1746066791.441918:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31590:x1830882976908416:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066791.441934:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.441950:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e451 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.441992:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.441999:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 4/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e451 expref: 256 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.442013:0:14549:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.442023:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e451 expref: 256 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.442032:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:1.0:1746066791.442035:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066791.442037:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066791.442043:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e80b200, rc 0) 00000100:00100000:1.0:1746066791.442079:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:31590:x1830882976908416:12345-192.168.202.57@tcp:101:cat.0 Request processed in 163us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.442085:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9972 00000100:00100000:0.0:1746066791.442382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.442521:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976908544 00000100:00100000:2.0:1746066791.442526:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976908544 00002000:00100000:2.0:1746066791.442550:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff8800a5bb3480 x1830882976908544/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.442559:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb3480 with x1830882976908544 ext(0->1048575) 00002000:00010000:2.0:1746066791.442563:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb3480 00000100:00100000:2.0:1746066791.442574:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6547 00000100:00100000:2.0:1746066791.442579:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882976908544:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066791.442632:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976832512:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.442643:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976832640:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.442660:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746066791.442852:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.442912:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976908800 00000100:00100000:2.0:1746066791.442915:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976908800 00010000:00010000:2.0:1746066791.442928:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608b32e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e40b expref: 8 pid: 809 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.442952:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976908672 00000100:00100000:2.0:1746066791.442954:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976908672 00010000:00010000:2.0:1746066791.442962:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b3ba lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e443 expref: 10 pid: 14548 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.442979:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7427 00000100:00100000:2.0:1746066791.442984:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976908800:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.442991:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066791.442995:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608b32e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e40b expref: 8 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.443003:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608b32e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e40b expref: 8 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.443017:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608b32e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e40b expref: 8 pid: 809 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.443028:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066791.443031:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.443036:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.443040:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.443069:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976908800:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 85us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.443075:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7427 00000100:00100000:2.0:1746066791.443085:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7428 00000100:00100000:2.0:1746066791.443089:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882976908672:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.443097:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066791.443101:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b3ba lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e443 expref: 10 pid: 14548 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.443109:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b3ba lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e443 expref: 10 pid: 14548 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.443118:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2d5400/0xfb36a14ee608b3ba lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e443 expref: 10 pid: 14548 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.443125:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066791.443128:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.443134:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.443140:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.443146:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e451 expref: 255 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.443158:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.443170:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:1964:x1830882976908672:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 80us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.443175:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7428 00010000:00010000:3.0:1746066791.444186:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.444193:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00000040:00080000:3.0:1746066791.446217:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3088, 88 off260992 00000004:00080000:3.0:1746066791.446226:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752623549068ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.446275:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3106, 88 off262496 00000004:00080000:3.0:1746066791.446280:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752623603694ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066791.446313:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3107, 88 off262584 00000004:00080000:3.0:1746066791.446318:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752623641955ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066791.446329:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3089, 88 off261080 00000004:00080000:3.0:1746066791.446333:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752623656969ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.446342:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3090, 88 off261168 00000004:00080000:3.0:1746066791.446346:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752623669600ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.446354:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3108, 88 off262672 00000004:00080000:3.0:1746066791.446357:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752623681075ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066791.446365:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3109, 88 off262760 00000004:00080000:3.0:1746066791.446368:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752623691738ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066791.446376:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3110, 88 off262848 00000004:00080000:3.0:1746066791.446379:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752623703223ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066791.446387:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3091, 88 off261256 00000004:00080000:3.0:1746066791.446390:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752623713921ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.446398:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3111, 88 off262936 00000004:00080000:3.0:1746066791.446402:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752623725576ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066791.446410:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3092, 88 off261344 00000004:00080000:3.0:1746066791.446413:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752623737204ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.446422:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3112, 88 off263024 00000004:00080000:3.0:1746066791.446424:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752623748428ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066791.446432:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3093, 88 off261432 00000004:00080000:3.0:1746066791.446434:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752623758244ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.446441:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3094, 88 off261520 00000004:00080000:3.0:1746066791.446444:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752623768394ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.446451:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3095, 88 off261608 00000004:00080000:3.0:1746066791.446454:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752623778011ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.446461:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3096, 88 off261696 00000004:00080000:3.0:1746066791.446464:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 752623787534ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066791.446471:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3113, 88 off263112 00000004:00080000:3.0:1746066791.446474:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 752623797616ns, next at 749511475809ns, rc = 0 00000100:00100000:2.0:1746066791.456343:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882976908544:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13757us (15609us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066791.456353:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6547 00002000:00100000:2.0:1746066791.456362:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff8800a5bb3480 x1830882976908544/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.456372:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb3480 with x1830882976908544 ext(0->1048575) 00002000:00010000:2.0:1746066791.456377:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb3480 00000100:00100000:1.0:1746066791.466409:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.466484:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976909056 00010000:00010000:3.0:1746066791.466505:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e44a expref: 257 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.466516:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066791.466519:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746066791.466522:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e451 expref: 257 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.466530:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e451 expref: 257 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.466537:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e451 expref: 257 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.466572:0:14548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e451 expref: 257 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.466584:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976832768:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066791.466693:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea9c0 going to sleep for 11 seconds 00000001:00080000:3.0:1746066791.466706:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944018 is committed 00000001:00080000:3.0:1746066791.466713:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944019 is committed 00000001:00080000:3.0:1746066791.466726:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944015 is committed 00000001:00080000:3.0:1746066791.466730:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944020 is committed 00000004:00080000:3.0:1746066791.466733:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2387 committed 00000004:00080000:3.0:1746066791.466739:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2370 committed 00000004:00080000:3.0:1746066791.466744:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2369 committed 00000004:00080000:3.0:1746066791.466746:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2368 committed 00000004:00080000:3.0:1746066791.466747:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2367 committed 00000004:00080000:3.0:1746066791.466748:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2386 committed 00000004:00080000:3.0:1746066791.466750:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2366 committed 00000004:00080000:3.0:1746066791.466751:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2385 committed 00000004:00080000:3.0:1746066791.466753:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2365 committed 00000004:00080000:3.0:1746066791.466754:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2384 committed 00000004:00080000:3.0:1746066791.466756:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2383 committed 00000004:00080000:3.0:1746066791.466757:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2382 committed 00000004:00080000:3.0:1746066791.466759:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2364 committed 00000004:00080000:3.0:1746066791.466760:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2363 committed 00000004:00080000:3.0:1746066791.466762:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2381 committed 00000004:00080000:3.0:1746066791.466763:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2380 committed 00000004:00080000:3.0:1746066791.466765:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2362 committed 00000100:00100000:3.0:1746066791.466836:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976833024:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.466865:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.466883:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976833536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.466894:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.466909:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746066791.466913:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976833152:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.466924:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.466933:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976833664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066791.466944:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066791.466965:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976833024 00000100:00100000:3.0:1746066791.466969:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976833024 00000100:00100000:3.0:1746066791.466994:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976833536 00000100:00100000:3.0:1746066791.466996:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976833536 00000100:00100000:3.0:1746066791.467005:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976833152 00000100:00100000:3.0:1746066791.467006:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976833152 00000100:00100000:3.0:1746066791.467014:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976833664 00000100:00100000:3.0:1746066791.467015:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976833664 00000100:00100000:3.0:1746066791.467028:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14482 00000100:00100000:3.0:1746066791.467033:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3295:x1830882976833024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066791.467086:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976833280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066791.467106:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066791.467118:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976833792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066791.467128:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066791.467138:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746066791.467141:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976832896:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066791.467158:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976909056 00002000:00010000:3.0:1746066791.467173:0:8452:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066791.467176:0:8452:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:3.0:1746066791.467178:0:8452:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066790 -> 1746066790 00002000:00010000:3.0:1746066791.467179:0:8452:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066791 -> 1746066791 00002000:00010000:3.0:1746066791.467181:0:8452:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746066791.467191:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9973 00000100:00100000:2.0:1746066791.467196:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+7:31584:x1830882976909056:12345-192.168.202.57@tcp:101:multiop.0 00000100:00100000:3.0:1746066791.467205:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3295:x1830882976833024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 172us (339us total) trans 21474840903 rc 0/0 00010000:00010000:2.0:1746066791.467206:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066791.467211:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14482 00010000:00010000:2.0:1746066791.467215:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b3d6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e45f expref: -99 pid: 809 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.467223:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976833280 00000100:00100000:3.0:1746066791.467225:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976833280 00000100:00100000:3.0:1746066791.467233:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976833792 00000100:00100000:3.0:1746066791.467235:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976833792 00000100:00100000:3.0:1746066791.467242:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14483 00000100:00100000:3.0:1746066791.467245:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3295:x1830882976833536:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066791.467248:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b3d6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e45f expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.467257:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b3d6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e45f expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.467270:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066791.467272:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066791.467274:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e80b400, rc 0) 00000100:00100000:2.0:1746066791.467296:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+8:31584:x1830882976909056:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 99us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.467301:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9973 00000100:00100000:3.0:1746066791.467321:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3295:x1830882976833536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (424us total) trans 21474840904 rc 0/0 00000100:00100000:3.0:1746066791.467326:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14483 00000100:00100000:3.0:1746066791.467334:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14484 00000100:00100000:3.0:1746066791.467338:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3295:x1830882976833152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066791.467380:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066791.467395:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976833408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066791.467412:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066791.467427:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976832896 00000100:00100000:0.0:1746066791.467429:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976832896 00000100:00100000:0.0:1746066791.467441:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976833408 00000100:00100000:0.0:1746066791.467443:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976833408 00000100:00100000:0.0:1746066791.467450:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14485 00000100:00100000:0.0:1746066791.467454:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3295:x1830882976833664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066791.467458:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976833920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.467479:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066791.467489:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976834432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.467500:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066791.467507:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746066791.467511:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976834304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.467525:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066791.467528:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3295:x1830882976833664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (583us total) trans 21474840905 rc 0/0 00000100:00100000:1.0:1746066791.467531:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976834816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066791.467534:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14485 00000100:00100000:1.0:1746066791.467541:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066791.467542:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976833920 00000100:00100000:0.0:1746066791.467544:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976833920 00000100:00100000:1.0:1746066791.467553:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976834432 00000100:00100000:0.0:1746066791.467553:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976834304 00000100:00100000:1.0:1746066791.467555:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976834432 00000100:00100000:0.0:1746066791.467555:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976834304 00000100:00100000:0.0:1746066791.467560:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976834816 00000100:00100000:0.0:1746066791.467561:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976834816 00000100:00100000:1.0:1746066791.467564:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14486 00000100:00100000:1.0:1746066791.467569:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3293:x1830882976833280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066791.467569:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14487 00000100:00100000:0.0:1746066791.467572:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3293:x1830882976833792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066791.467635:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14488 00000100:00100000:1.0:1746066791.467639:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3293:x1830882976832896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066791.467656:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3293:x1830882976833792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (526us total) trans 21474840906 rc 0/0 00000100:00100000:0.0:1746066791.467660:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14487 00000100:00100000:0.0:1746066791.467668:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14489 00000100:00100000:0.0:1746066791.467673:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3293:x1830882976833408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066791.467728:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066791.467730:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:1.0:1746066791.467732:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066790 -> 1746066790 00002000:00010000:1.0:1746066791.467734:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066791 -> 1746066791 00002000:00010000:1.0:1746066791.467735:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746066791.467749:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3293:x1830882976832896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (369us total) trans 21474840908 rc 0/0 00000100:00100000:0.0:1746066791.467749:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3293:x1830882976833408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (336us total) trans 21474840909 rc 0/0 00000100:00100000:0.0:1746066791.467754:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14489 00000100:00100000:1.0:1746066791.467821:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14488 00000100:00100000:1.0:1746066791.467833:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14490 00000100:00100000:1.0:1746066791.467837:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3294:x1830882976833920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066791.467924:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066791.467927:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:1.0:1746066791.467929:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066790 -> 1746066790 00002000:00010000:1.0:1746066791.467931:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066791 -> 1746066791 00002000:00010000:1.0:1746066791.467933:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2017 -> 2017 00000100:00100000:0.0:1746066791.467945:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14491 00000100:00100000:1.0:1746066791.467952:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3294:x1830882976833920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (474us total) trans 17179873581 rc 0/0 00000100:00100000:0.0:1746066791.467952:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3294:x1830882976834304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.467957:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14490 00000100:00100000:1.0:1746066791.467965:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14492 00000100:00100000:1.0:1746066791.467969:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3294:x1830882976834432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.468022:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3294:x1830882976834432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (520us total) trans 17179873583 rc 0/0 00000100:00100000:0.0:1746066791.468022:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3294:x1830882976834304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (495us total) trans 17179873582 rc 0/0 00000100:00100000:1.0:1746066791.468027:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14492 00000100:00100000:0.0:1746066791.468038:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14491 00000100:00100000:1.0:1746066791.468040:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14493 00000100:00100000:1.0:1746066791.468045:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3294:x1830882976834816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.468110:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3294:x1830882976834816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (567us total) trans 17179873584 rc 0/0 00000100:00100000:1.0:1746066791.468115:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14493 00000100:00100000:1.0:1746066791.468126:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976834176:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066791.468130:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bb2ea00/2, rc 0, transno 21474840908 00000100:00100000:0.0:1746066791.468134:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976832896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066791.468141:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bb2d500/2, rc 0, transno 21474840909 00000100:00100000:1.0:1746066791.468142:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066791.468143:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976833408:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066791.468149:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed08000/2, rc 0, transno 21474840906 00000100:00100000:0.0:1746066791.468151:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976833792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066791.468152:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976834688:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.468163:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066791.468173:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746066791.468176:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976834048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066791.468179:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976834176 00000100:00100000:0.0:1746066791.468181:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976834176 00000100:00100000:1.0:1746066791.468187:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066791.468194:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14494 00000100:00100000:1.0:1746066791.468195:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976834560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066791.468198:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3296:x1830882976834176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.468206:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066791.468245:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3293:x1830882976833280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 675us (1138us total) trans 21474840907 rc 0/0 00000100:00100000:1.0:1746066791.468250:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14486 00000100:00100000:1.0:1746066791.468257:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976834688 00000100:00100000:1.0:1746066791.468259:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976834688 00002000:00010000:0.0:1746066791.468261:0:9776:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:0.0:1746066791.468263:0:9776:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:0.0:1746066791.468265:0:9776:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066790 -> 1746066790 00000100:00100000:1.0:1746066791.468266:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976834048 00002000:00010000:0.0:1746066791.468266:0:9776:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066791 -> 1746066791 00000100:00100000:1.0:1746066791.468267:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976834048 00002000:00010000:0.0:1746066791.468268:0:9776:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5921 -> 5921 00000100:00100000:1.0:1746066791.468272:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976834560 00000100:00100000:1.0:1746066791.468274:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976834560 00000100:00100000:1.0:1746066791.468280:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14495 00000100:00100000:1.0:1746066791.468284:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3296:x1830882976834688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066791.468286:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3296:x1830882976834176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (144us total) trans 17179873585 rc 0/0 00000100:00100000:0.0:1746066791.468290:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14494 00000100:00100000:0.0:1746066791.468298:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14496 00000100:00100000:0.0:1746066791.468303:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3296:x1830882976834048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066791.468338:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746066791.468340:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746066791.468341:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066791.468343:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746066791.468344:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746066791.468360:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3296:x1830882976834688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (195us total) trans 17179873586 rc 0/0 00000100:00100000:1.0:1746066791.468364:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14495 00000100:00100000:1.0:1746066791.468372:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14497 00000100:00100000:1.0:1746066791.468375:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3296:x1830882976834560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066791.468437:0:9776:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066791.468439:0:9776:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:0.0:1746066791.468441:0:9776:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066790 -> 1746066790 00002000:00010000:0.0:1746066791.468443:0:9776:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066791 -> 1746066791 00000100:00100000:1.0:1746066791.468444:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3296:x1830882976834560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (237us total) trans 17179873587 rc 0/0 00002000:00010000:0.0:1746066791.468444:0:9776:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746066791.468448:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14497 00000100:00100000:0.0:1746066791.468457:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3296:x1830882976834048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (269us total) trans 17179873588 rc 0/0 00000100:00100000:0.0:1746066791.468461:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14496 00000004:00080000:1.0:1746066791.468466:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092046d80/2, rc 0, transno 17179873582 00000100:00100000:1.0:1746066791.468472:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976834304:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066791.468478:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800996d9180/2, rc 0, transno 17179873584 00000100:00100000:1.0:1746066791.468481:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976834816:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066791.468486:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092044000/2, rc 0, transno 17179873581 00000100:00100000:1.0:1746066791.468489:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976833920:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066791.468494:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800996d9500/2, rc 0, transno 17179873583 00000100:00100000:1.0:1746066791.468496:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976834432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.468503:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976834944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.468515:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066791.468526:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976834944 00000100:00100000:0.0:1746066791.468529:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976834944 00000004:00080000:1.0:1746066791.468532:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092044700/2, rc 0, transno 17179873588 00000100:00100000:1.0:1746066791.468534:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976834048:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066791.468539:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800996d8700/2, rc 0, transno 17179873587 00000100:00100000:0.0:1746066791.468541:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14498 00000100:00100000:1.0:1746066791.468542:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976834560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066791.468545:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3294:x1830882976834944:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066791.468547:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092044a80/2, rc 0, transno 17179873585 00000100:00100000:1.0:1746066791.468549:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976834176:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066791.468554:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800996d8380/2, rc 0, transno 17179873586 00000100:00100000:1.0:1746066791.468556:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976834688:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066791.468605:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.468613:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3294:x1830882976834944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (96us total) trans 17179873589 rc 0/0 00000100:00100000:0.0:1746066791.468631:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14498 00000004:00080000:1.0:1746066791.468635:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16e300/2, rc 0, transno 17179873589 00000100:00100000:1.0:1746066791.468638:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976834944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066791.468639:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976908928 00000100:00100000:0.0:1746066791.468641:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976908928 00000004:00080000:1.0:1746066791.468651:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bb2c000/2, rc 0, transno 21474840907 00000100:00100000:0.0:1746066791.468653:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14499 00000100:00100000:1.0:1746066791.468654:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976833280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066791.468657:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+25:31589:x1830882976908928:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066791.468664:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066791.468671:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e458 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066791.468734:0:8452:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066791.468736:0:8452:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066790 -> 1746066790 00002000:00010000:3.0:1746066791.468738:0:8452:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066790 -> 1746066790 00002000:00010000:3.0:1746066791.468740:0:8452:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066791 -> 1746066791 00002000:00010000:3.0:1746066791.468741:0:8452:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746066791.468758:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3295:x1830882976833152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1420us (1833us total) trans 21474840910 rc 0/0 00000100:00100000:3.0:1746066791.468762:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14484 00000004:00080000:3.0:1746066791.468861:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bb2e680/2, rc 0, transno 21474840910 00000100:00100000:3.0:1746066791.468865:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976833152:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066791.468871:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed09880/2, rc 0, transno 21474840905 00000100:00100000:3.0:1746066791.468873:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976833664:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066791.468879:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bb2ed80/2, rc 0, transno 21474840903 00000100:00100000:3.0:1746066791.468881:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976833024:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066791.468886:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bb2d880/2, rc 0, transno 21474840904 00000100:00100000:3.0:1746066791.468887:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976833536:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746066791.469149:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009288be00/0xfb36a14ee608b304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e8 expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.469155:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066791.469157:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066791.469160:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.469182:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009288be00/0xfb36a14ee608b304 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e8 expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.469193:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009288be00/0xfb36a14ee608b304 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e8 expref: 10 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746066791.469201:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976835072:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066791.469253:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f5cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.469890:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976832768:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066791.469911:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608b3c1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e44a expref: 254 pid: 14548 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746066791.469923:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e44a expref: 253 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.469942:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1fa00, rc 0) 00000100:00100000:3.0:1746066791.469999:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31585:x1830882976908160:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 35805us (36263us total) trans 8589944020 rc 0/0 00000100:00100000:3.0:1746066791.470004:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9971 00000100:00100000:0.0:1746066791.470403:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.470566:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976909184 00000100:00100000:1.0:1746066791.470566:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976835072:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066791.470570:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976909184 00010000:00010000:1.0:1746066791.470581:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.470588:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eccb400, rc 0) 00000100:00100000:2.0:1746066791.470603:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4152 00000100:00100000:1.0:1746066791.470603:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+26:31589:x1830882976908928:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1946us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.470608:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14499 00000100:00100000:2.0:1746066791.470609:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31590:x1830882976909184:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:2.0:1746066791.471035:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31590:x1830882976909184:12345-192.168.202.57@tcp:49:cat.0 Request processed in 425us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.471041:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4152 00000100:00100000:0.0:1746066791.471444:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.471493:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976909312 00000100:00100000:2.0:1746066791.471497:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976909312 00010000:00010000:2.0:1746066791.471512:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009288be00/0xfb36a14ee608b304 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e8 expref: 11 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.471528:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7429 00000100:00100000:2.0:1746066791.471533:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976909312:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.471540:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066791.471553:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009288be00/0xfb36a14ee608b304 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e8 expref: 11 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.471563:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009288be00/0xfb36a14ee608b304 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e8 expref: 11 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.471578:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009288be00/0xfb36a14ee608b304 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3e8 expref: 11 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.471586:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.471588:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.471593:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.471599:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.471638:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.471646:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976835200:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066791.471712:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066791.473552:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976835200:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066791.473567:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.473703:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976909312:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2168us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.473712:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7429 00000100:00100000:0.0:1746066791.479753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.479857:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976909568 00000100:00100000:2.0:1746066791.479869:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976909568 00002000:00100000:2.0:1746066791.479927:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009f16ea00 x1830882976909568/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.479937:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16ea00 with x1830882976909568 ext(0->1048575) 00002000:00010000:2.0:1746066791.479942:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16ea00 00000100:00100000:2.0:1746066791.479977:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6548 00000100:00100000:2.0:1746066791.479982:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882976909568:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066791.481301:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.481872:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976909696 00000100:00100000:1.0:1746066791.481882:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976909696 00000100:00100000:1.0:1746066791.481926:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14500 00000100:00100000:1.0:1746066791.481932:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+26:31584:x1830882976909696:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066791.481947:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.481961:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e466 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.481984:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 27 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.481990:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.481991:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.481994:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [2076672->2097151] (req 2076672->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 27 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.482018:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 27 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.482027:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 27 pid: 8451 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.482038:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976835328:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066791.482254:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.483603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.483666:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976909952 00000100:00100000:1.0:1746066791.483672:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976909952 00002000:00100000:1.0:1746066791.483728:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009f16c000 x1830882976909952/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.483736:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16c000 with x1830882976909952 ext(1048576->2097151) 00010000:00010000:1.0:1746066791.483743:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 28 pid: 8451 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.483752:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 28 pid: 8451 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746066791.483758:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f16c000 00000100:00100000:1.0:1746066791.484010:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2133 00000100:00100000:1.0:1746066791.484017:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882976909952:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066791.486062:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976835328:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.486085:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [2076672->2097151] (req 2076672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 29 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.486098:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f318400, rc 0) 00000100:00100000:1.0:1746066791.486123:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+29:31584:x1830882976909696:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4191us (4831us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.486133:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14500 00000100:00100000:3.0:1746066791.487777:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882976909568:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 7788us (8032us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066791.487787:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6548 00002000:00100000:3.0:1746066791.487795:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009f16ea00 x1830882976909568/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.487804:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16ea00 with x1830882976909568 ext(0->1048575) 00002000:00010000:3.0:1746066791.487808:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16ea00 00000100:00100000:1.0:1746066791.490380:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882976909952:12345-192.168.202.57@tcp:3:cat.0 Request processed in 6356us (6774us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066791.490391:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2133 00002000:00100000:1.0:1746066791.490399:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009f16c000 x1830882976909952/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.490407:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16c000 with x1830882976909952 ext(1048576->2097151) 00010000:00010000:1.0:1746066791.490416:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 27 pid: 8451 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.490428:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 27 pid: 8451 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746066791.490434:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f16c000 00000100:00100000:0.0:1746066791.495089:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.495133:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.495180:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976910080 00000100:00100000:1.0:1746066791.495188:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976910080 00000100:00100000:2.0:1746066791.495218:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976910208 00000100:00100000:2.0:1746066791.495221:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976910208 00000100:00100000:1.0:1746066791.495237:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14501 00010000:00010000:2.0:1746066791.495239:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 28 pid: 8451 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.495244:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+28:31589:x1830882976910080:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:2.0:1746066791.495256:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7430 00000100:00100000:2.0:1746066791.495260:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882976910208:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.495262:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.495268:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.495273:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f319e00/0xfb36a14ee608b3eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e46d expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.495281:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 28 pid: 8451 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.495289:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 29 pid: 8451 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.495294:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009288b200/0xfb36a14ee608b30b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3ef expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.495301:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eccb400/0xfb36a14ee608b3dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e458 expref: 29 pid: 8451 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.495323:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.495325:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.495329:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 28 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.495333:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 28 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.495354:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 28 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.495362:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976835456:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066791.495386:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066791.495387:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066791.495391:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f319e00/0xfb36a14ee608b3eb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e46d expref: 28 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.495409:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009288b200/0xfb36a14ee608b30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3ef expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.495414:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746066791.495418:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009288b200/0xfb36a14ee608b30b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3ef expref: 9 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.495426:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976835584:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066791.495447:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.496863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.496895:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.496953:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.496984:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976835584:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.497001:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f319e00/0xfb36a14ee608b3eb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e46d expref: 28 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066791.497007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066791.497011:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f319e00, rc 0) 00000100:00100000:1.0:1746066791.497036:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+28:31589:x1830882976910080:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1792us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.497042:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14501 00000100:00100000:1.0:1746066791.497056:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976910336 00000100:00100000:1.0:1746066791.497059:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976910336 00000100:00100000:1.0:1746066791.497072:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976910464 00000100:00100000:1.0:1746066791.497074:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976910464 00000100:00100000:1.0:1746066791.497085:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14502 00000100:00100000:1.0:1746066791.497090:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:31590:x1830882976910336:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066791.497098:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.497106:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f319200/0xfb36a14ee608b3f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e474 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.497111:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14503 00000100:00100000:3.0:1746066791.497119:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31585:x1830882976910464:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066791.497120:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 27 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.497125:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066791.497126:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.497126:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066791.497129:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f319200/0xfb36a14ee608b3f2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e474 expref: 32 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.497136:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e47b expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.497144:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 27 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.497150:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608b37b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e420 expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.497151:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 27 pid: 8451 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.497157:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e82e00/0xfb36a14ee608b382 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e435 expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.497159:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976835712:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.497163:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.497164:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.497167:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [188416->229375] (req 188416->229375) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.497182:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e82e00/0xfb36a14ee608b382 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e435 expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.497187:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb840 going to sleep for 11 seconds 00010000:00010000:3.0:1746066791.497189:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e82e00/0xfb36a14ee608b382 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e435 expref: 27 pid: 10402 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.497197:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976835840:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066791.497200:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976910848 00000100:00100000:1.0:1746066791.497202:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976910848 00000100:00100000:2.0:1746066791.497212:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976835456:192.168.202.57@tcp:105: 00002000:00100000:1.0:1746066791.497220:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (2076672->2080767) req@ffff88009f16d180 x1830882976910848/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746066791.497221:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066791.497224:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608b37b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e420 expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746066791.497228:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16d180 with x1830882976910848 ext(2076672->2080767) 00010000:00010000:3.0:1746066791.497231:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608b37b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e420 expref: 20 pid: 8452 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.497233:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 28 pid: 8451 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.497238:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976835968:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066791.497238:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882976910208:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1977us (2104us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066791.497241:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 28 pid: 8451 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.497244:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7430 00002000:00010000:1.0:1746066791.497246:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f16d180 00000100:00100000:3.0:1746066791.497254:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066791.497256:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976910592 00000100:00100000:1.0:1746066791.497257:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2134 00000100:00100000:2.0:1746066791.497258:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976910592 00000100:00100000:1.0:1746066791.497261:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882976910848:12345-192.168.202.57@tcp:3:multiop.0 00010000:00010000:2.0:1746066791.497267:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009288b200/0xfb36a14ee608b30b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3ef expref: 10 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.497280:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7431 00000100:00100000:2.0:1746066791.497284:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5408450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976910592:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.497291:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066791.497301:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009288b200/0xfb36a14ee608b30b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3ef expref: 10 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.497309:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009288b200/0xfb36a14ee608b30b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3ef expref: 10 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.497321:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009288b200/0xfb36a14ee608b30b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3ef expref: 10 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.497329:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.497330:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.497334:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f319e00/0xfb36a14ee608b3eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e46d expref: 27 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.497342:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f319e00/0xfb36a14ee608b3eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e46d expref: 27 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.497360:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f319e00/0xfb36a14ee608b3eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e46d expref: 27 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.497369:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882976910848:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 107us (362us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066791.497370:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976836096:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066791.497375:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2134 00002000:00100000:1.0:1746066791.497380:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (2076672->2080767) req@ffff88009f16d180 x1830882976910848/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/4536 e 0 to 0 dl 1746066802 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.497386:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16d180 with x1830882976910848 ext(2076672->2080767) 00000100:00100000:2.0:1746066791.497387:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746066791.497389:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 27 pid: 8451 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.497396:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 27 pid: 8451 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746066791.497401:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f16d180 00000100:00100000:1.0:1746066791.499104:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976835712:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.499122:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f319200/0xfb36a14ee608b3f2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e474 expref: 32 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.499141:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f319200, rc 0) 00000100:00100000:1.0:1746066791.499166:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:31590:x1830882976910336:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2076us (2308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.499172:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14502 00000100:00100000:3.0:1746066791.499186:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976835840:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066791.499191:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976836096:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066791.499194:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976835968:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066791.499200:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066791.499212:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [188416->229375] (req 188416->229375) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.499218:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5408450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976910592:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1933us (2265us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066791.499225:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b46ba00, rc 0) 00000100:00100000:2.0:1746066791.499225:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7431 00000100:00100000:3.0:1746066791.499242:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:31585:x1830882976910464:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2125us (2347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.499247:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14503 00000100:00100000:0.0:1746066791.500727:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.500751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.500784:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976911360 00000100:00100000:2.0:1746066791.500791:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976911360 00000100:00100000:1.0:1746066791.500805:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976911104 00000100:00100000:0.0:1746066791.500807:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.500809:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976911104 00010000:00010000:2.0:1746066791.500812:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e82e00/0xfb36a14ee608b382 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e435 expref: 27 pid: 10402 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.500831:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976911232 00002000:00100000:1.0:1746066791.500831:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (2076672->2097151) req@ffff88009f16f480 x1830882976911104/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746066791.500834:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976911232 00002000:00100000:1.0:1746066791.500839:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16f480 with x1830882976911104 ext(2076672->2097151) 00010000:00010000:2.0:1746066791.500842:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608b37b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e420 expref: 21 pid: 8452 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.500844:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 27 pid: 8451 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.500854:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7432 00010000:00010000:1.0:1746066791.500854:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 27 pid: 8451 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.500860:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882976911360:12345-192.168.202.57@tcp:103:ldlm_bl.0 00002000:00010000:1.0:1746066791.500860:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f16f480 00010000:00010000:2.0:1746066791.500868:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066791.500873:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2135 00000100:00100000:3.0:1746066791.500878:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7433 00000100:00100000:1.0:1746066791.500878:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882976911104:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066791.500885:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:1966:x1830882976911232:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066791.500892:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066791.500902:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608b37b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e420 expref: 21 pid: 8452 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.500910:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608b37b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e420 expref: 21 pid: 8452 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.500967:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608b37b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e420 expref: 21 pid: 8452 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.500982:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066791.501000:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882976911232:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 116us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.501004:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7433 00010000:00010000:2.0:1746066791.501253:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e82e00/0xfb36a14ee608b382 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e435 expref: 27 pid: 10402 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.501266:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e82e00/0xfb36a14ee608b382 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e435 expref: 27 pid: 10402 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.501277:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e82e00/0xfb36a14ee608b382 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e435 expref: 27 pid: 10402 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.501285:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.501287:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.501292:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->229375) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.501298:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->229375) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.501321:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->229375) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.501331:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976836224:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066791.501494:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.501509:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976911616 00000100:00100000:0.0:1746066791.501512:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976911616 00002000:00100000:0.0:1746066791.501530:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009f16e680 x1830882976911616/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066791.501537:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16e680 with x1830882976911616 ext(1048576->2097151) 00002000:00010000:0.0:1746066791.501540:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16e680 00000100:00100000:0.0:1746066791.501563:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6549 00000100:00100000:0.0:1746066791.501569:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882976911616:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066791.501712:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.504518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.504534:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976911872 00000100:00100000:3.0:1746066791.504538:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976911872 00000100:00100000:2.0:1746066791.504545:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976836224:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066791.504559:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746066791.504560:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x38e:0x0] (188416->192511) req@ffff88009ed08a80 x1830882976911872/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.504573:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed08a80 with x1830882976911872 ext(188416->192511) 00002000:00010000:3.0:1746066791.504577:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed08a80 00000100:00100000:2.0:1746066791.504588:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882976911360:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3727us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.504592:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6550 00000100:00100000:2.0:1746066791.504595:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7432 00000100:00100000:3.0:1746066791.504599:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882976911872:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066791.504766:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882976911872:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 167us (252us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066791.504772:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6550 00002000:00100000:3.0:1746066791.504777:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x38e:0x0] (188416->192511) req@ffff88009ed08a80 x1830882976911872/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/4536 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.504784:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed08a80 with x1830882976911872 ext(188416->192511) 00002000:00010000:3.0:1746066791.504786:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed08a80 00000100:00100000:1.0:1746066791.505200:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+31:1964:x1830882976911104:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 4320us (4474us total) trans 21474840911 rc 0/0 00000100:00100000:1.0:1746066791.505207:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2135 00002000:00100000:1.0:1746066791.505212:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (2076672->2097151) req@ffff88009f16f480 x1830882976911104/t21474840911(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/448 e 0 to 0 dl 1746066802 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.505224:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16f480 with x1830882976911104 ext(2076672->2097151) 00010000:00010000:1.0:1746066791.505230:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 31 pid: 8451 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.505241:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 31 pid: 8451 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746066791.505247:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f16f480 00000100:00100000:0.0:1746066791.509114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.510149:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.510210:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882976911616:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 8638us (8713us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066791.510220:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6549 00002000:00100000:2.0:1746066791.510230:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009f16e680 x1830882976911616/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.510238:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16e680 with x1830882976911616 ext(1048576->2097151) 00002000:00010000:2.0:1746066791.510243:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16e680 00000100:00100000:2.0:1746066791.510263:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976912256 00000100:00100000:2.0:1746066791.510268:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976912256 00002000:00100000:2.0:1746066791.510294:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x38e:0x0] (225280->229375) req@ffff88009244ca80 x1830882976912256/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.510301:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244ca80 with x1830882976912256 ext(225280->229375) 00002000:00010000:2.0:1746066791.510304:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244ca80 00000100:00100000:2.0:1746066791.510322:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6551 00000100:00100000:2.0:1746066791.510328:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1966:x1830882976912256:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066791.510438:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1966:x1830882976912256:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 110us (291us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066791.510443:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6551 00002000:00100000:2.0:1746066791.510448:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x38e:0x0] (225280->229375) req@ffff88009244ca80 x1830882976912256/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/4536 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.510454:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244ca80 with x1830882976912256 ext(225280->229375) 00002000:00010000:2.0:1746066791.510457:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244ca80 00000100:00100000:3.0:1746066791.510610:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976912000 00000100:00100000:3.0:1746066791.510626:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976912000 00010000:00010000:3.0:1746066791.510646:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 29 pid: 8451 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.510665:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7434 00000100:00100000:3.0:1746066791.510670:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882976912000:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066791.510699:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066791.510711:0:21351:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066790 -> 1746066791 00010000:00010000:3.0:1746066791.510717:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 29 pid: 8451 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.510732:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 29 pid: 8451 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.510750:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608b3e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e466 expref: 29 pid: 8451 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.510765:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.510766:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.510772:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f319200/0xfb36a14ee608b3f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e474 expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.510778:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f319200/0xfb36a14ee608b3f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e474 expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.510857:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f319200/0xfb36a14ee608b3f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e474 expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.510868:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976836352:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066791.511156:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.516440:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976836352:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066791.516456:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066791.516503:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882976912000:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5832us (7397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.516511:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7434 00000100:00100000:0.0:1746066791.516934:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.516974:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976912512 00000100:00100000:0.0:1746066791.516974:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.516980:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976912512 00000100:00100000:3.0:1746066791.517087:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976912640 00000100:00100000:3.0:1746066791.517090:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976912640 00000100:00100000:0.0:1746066791.517099:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14504 00000100:00100000:0.0:1746066791.517110:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:31589:x1830882976912512:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066791.517119:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14505 00010000:00010000:0.0:1746066791.517123:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066791.517124:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:31584:x1830882976912640:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066791.517132:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066791.517136:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608b400 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e482 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.517140:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e489 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.517157:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f319e00/0xfb36a14ee608b3eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e46d expref: 29 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.517157:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3f6 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.517164:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066791.517164:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066791.517165:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066791.517165:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066791.517169:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->1535999] (req 1048576->1535999) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 29 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.517169:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608b400 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e482 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.517188:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f319e00/0xfb36a14ee608b3eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e46d expref: 29 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.517189:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b312 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3f6 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.517198:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b312 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3f6 expref: 9 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.517199:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f319e00/0xfb36a14ee608b3eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e46d expref: 29 pid: 8451 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.517208:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976836608:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066791.517208:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976836480:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.517252:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.518991:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f5c540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.519043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.519177:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976912768 00000100:00100000:2.0:1746066791.519181:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976912768 00002000:00100000:2.0:1746066791.519208:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8801361fb480 x1830882976912768/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.519223:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fb480 with x1830882976912768 ext(1048576->2097151) 00002000:00010000:2.0:1746066791.519226:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361fb480 00000100:00100000:2.0:1746066791.519361:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6552 00000100:00100000:2.0:1746066791.519368:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882976912768:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066791.521507:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976836480:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.521535:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608b400 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e482 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.521549:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1e000, rc 0) 00000100:00100000:1.0:1746066791.521585:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+21:31589:x1830882976912512:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4478us (5179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.521592:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14504 00000100:00100000:3.0:1746066791.521724:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976836608:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.521739:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->1535999] (req 1048576->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 29 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.521749:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b46b400, rc 0) 00000100:00100000:3.0:1746066791.521775:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+29:31584:x1830882976912640:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4651us (4801us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.521781:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14505 00000100:00100000:0.0:1746066791.525357:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.525652:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976912896 00000100:00100000:3.0:1746066791.525660:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976912896 00010000:00010000:3.0:1746066791.525715:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b312 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3f6 expref: 10 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.525755:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7435 00000100:00100000:3.0:1746066791.525763:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976912896:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066791.525774:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066791.525793:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b312 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3f6 expref: 10 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.525803:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b312 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3f6 expref: 10 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.525822:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009288b800/0xfb36a14ee608b312 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3f6 expref: 10 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.525839:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.525841:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.525847:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608b400 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e482 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.525859:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608b400 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e482 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.525899:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608b400 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e482 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.525910:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976836736:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066791.525984:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.526058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.526124:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976913024 00000100:00100000:2.0:1746066791.526128:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976913024 00010000:00010000:2.0:1746066791.526143:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f319e00/0xfb36a14ee608b3eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e46d expref: 29 pid: 8451 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.526158:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7436 00000100:00100000:2.0:1746066791.526162:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882976913024:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.526170:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066791.526181:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f319e00/0xfb36a14ee608b3eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e46d expref: 29 pid: 8451 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.526189:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f319e00/0xfb36a14ee608b3eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e46d expref: 29 pid: 8451 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.526201:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f319e00/0xfb36a14ee608b3eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e46d expref: 29 pid: 8451 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.526214:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.526215:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.526219:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.526230:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.526247:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.526256:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976836864:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066791.526280:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066791.527348:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882976912768:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 7978us (8305us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066791.527357:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6552 00002000:00100000:2.0:1746066791.527365:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8801361fb480 x1830882976912768/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.527373:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fb480 with x1830882976912768 ext(1048576->2097151) 00002000:00010000:2.0:1746066791.527377:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361fb480 00000100:00100000:2.0:1746066791.528252:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976836864:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066791.528264:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976836736:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066791.528266:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066791.528276:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066791.528320:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976912896:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2558us (2970us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.528327:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7435 00000100:00100000:2.0:1746066791.528464:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882976913024:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2135us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.528470:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7436 00000100:00100000:0.0:1746066791.534235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.534568:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976913280 00000100:00100000:2.0:1746066791.534576:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976913280 00002000:00100000:2.0:1746066791.534630:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1531904->1535999) req@ffff8801361fbb80 x1830882976913280/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.534644:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fbb80 with x1830882976913280 ext(1531904->1535999) 00002000:00010000:2.0:1746066791.534652:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361fbb80 00000100:00100000:2.0:1746066791.534708:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6553 00000100:00100000:2.0:1746066791.534716:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882976913280:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066791.534862:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882976913280:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 146us (634us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066791.534868:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6553 00002000:00100000:2.0:1746066791.534873:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1531904->1535999) req@ffff8801361fbb80 x1830882976913280/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/4536 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.534880:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fbb80 with x1830882976913280 ext(1531904->1535999) 00002000:00010000:2.0:1746066791.534883:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361fbb80 00000100:00100000:1.0:1746066791.537644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.538548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.538780:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976913664 00000100:00100000:2.0:1746066791.538791:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976913664 00002000:00100000:2.0:1746066791.538828:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009244fb80 x1830882976913664/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.538837:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244fb80 with x1830882976913664 ext(1048576->2097151) 00002000:00010000:2.0:1746066791.538845:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244fb80 00000100:00100000:2.0:1746066791.538872:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6554 00000100:00100000:2.0:1746066791.538878:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882976913664:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066791.539704:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976913536 00000100:00100000:3.0:1746066791.539709:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976913536 00000100:00100000:3.0:1746066791.539741:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14506 00000100:00100000:3.0:1746066791.539747:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:31590:x1830882976913536:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066791.539755:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.539768:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b46ae00/0xfb36a14ee608b40e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e490 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.539788:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.539799:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066791.539803:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066791.539807:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b46ae00/0xfb36a14ee608b40e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e490 expref: 33 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.539837:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.539847:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 27 pid: 10402 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.539857:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976836992:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.539922:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.547891:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.547961:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976913792 00000100:00100000:1.0:1746066791.547969:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976913792 00002000:00100000:1.0:1746066791.548007:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1535999) req@ffff8801361f8e00 x1830882976913792/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.548016:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8e00 with x1830882976913792 ext(1048576->1535999) 00010000:00010000:1.0:1746066791.548025:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 28 pid: 10402 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.548037:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 28 pid: 10402 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746066791.548043:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801361f8e00 00000100:00100000:1.0:1746066791.548072:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2136 00000100:00100000:1.0:1746066791.548078:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882976913792:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066791.549469:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976836992:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.549494:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b46ae00/0xfb36a14ee608b40e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e490 expref: 33 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.549507:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b46ae00, rc 0) 00000100:00100000:3.0:1746066791.549535:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:31590:x1830882976913536:12345-192.168.202.57@tcp:101:cat.0 Request processed in 9788us (11926us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.549541:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14506 00000100:00100000:3.0:1746066791.554895:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882976913664:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 16007us (16339us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066791.554906:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6554 00002000:00100000:3.0:1746066791.554916:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009244fb80 x1830882976913664/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.554925:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244fb80 with x1830882976913664 ext(1048576->2097151) 00002000:00010000:3.0:1746066791.554931:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244fb80 00000100:00100000:1.0:1746066791.557128:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+30:1964:x1830882976913792:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 9045us (9240us total) trans 21474840912 rc 0/0 00000100:00100000:1.0:1746066791.557137:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2136 00002000:00100000:1.0:1746066791.557145:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1535999) req@ffff8801361f8e00 x1830882976913792/t21474840912(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/448 e 0 to 0 dl 1746066802 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.557153:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8e00 with x1830882976913792 ext(1048576->1535999) 00010000:00010000:1.0:1746066791.557160:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 30 pid: 10402 timeout: 852 lvb_type: 0 00010000:00010000:1.0:1746066791.557172:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 30 pid: 10402 timeout: 852 lvb_type: 0 00002000:00010000:1.0:1746066791.557177:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801361f8e00 00000100:00100000:0.0:1746066791.558976:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.559458:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976913920 00000100:00100000:2.0:1746066791.559465:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976913920 00010000:00010000:2.0:1746066791.559492:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 30 pid: 10402 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.559530:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7437 00000100:00100000:2.0:1746066791.559536:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+30:1966:x1830882976913920:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.559547:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066791.559561:0:7107:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066790 -> 1746066791 00010000:00010000:2.0:1746066791.559567:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 30 pid: 10402 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.559576:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 30 pid: 10402 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.559596:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b407 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1535999) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e489 expref: 30 pid: 10402 timeout: 852 lvb_type: 0 00010000:00010000:2.0:1746066791.559631:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.559633:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.559642:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b46ae00/0xfb36a14ee608b40e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e490 expref: 32 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.559649:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b46ae00/0xfb36a14ee608b40e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e490 expref: 32 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.559702:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b46ae00/0xfb36a14ee608b40e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e490 expref: 32 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.559712:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976837120:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066791.559776:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.561648:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.561802:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976837120:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066791.561818:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.561861:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1966:x1830882976913920:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2324us (2889us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066791.561930:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.561950:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976914048 00000100:00100000:1.0:1746066791.561955:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976914048 00000100:00100000:1.0:1746066791.561983:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976914304 00000100:00100000:1.0:1746066791.561985:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976914304 00000100:00100000:1.0:1746066791.561999:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14507 00000100:00100000:1.0:1746066791.562004:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882976914048:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:0.0:1746066791.562007:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066791.562018:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066791.562021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066791.562031:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee2b000/0xfb36a14ee608b415 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e497 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066791.562044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.562064:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976837248:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066791.562107:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.562119:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976914560 00000100:00100000:1.0:1746066791.562122:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976914560 00000100:00100000:1.0:1746066791.562135:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976914176 00000100:00100000:1.0:1746066791.562136:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976914176 00000100:00100000:1.0:1746066791.562144:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976914432 00000100:00100000:1.0:1746066791.562145:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976914432 00000100:00100000:1.0:1746066791.562157:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14508 00000100:00100000:1.0:1746066791.562161:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+32:1964:x1830882976914304:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066791.562167:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.562174:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3fee00/0xfb36a14ee608b41c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e4a5 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.562184:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.562185:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.562191:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3fee00/0xfb36a14ee608b41c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4a5 expref: 33 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.562202:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3fee00/0xfb36a14ee608b41c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4a5 expref: 33 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.562210:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3fee00, rc 0) 00000100:00100000:1.0:1746066791.562224:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+33:1964:x1830882976914304:12345-192.168.202.57@tcp:101:cat.0 Request processed in 63us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.562230:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14508 00000100:00100000:0.0:1746066791.562242:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14509 00000100:00100000:2.0:1746066791.562248:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7437 00000100:00100000:0.0:1746066791.562253:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+32:1964:x1830882976914560:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:1.0:1746066791.562258:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14510 00010000:00010000:0.0:1746066791.562260:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066791.562263:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+31:1964:x1830882976914176:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066791.562267:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b423 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e4b3 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.562269:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.562274:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d3fe600/0xfb36a14ee608b42a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e49e expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.562275:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14511 00000100:00100000:2.0:1746066791.562281:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882976914432:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066791.562283:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.562284:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.562288:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.562288:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3fe600/0xfb36a14ee608b42a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e49e expref: 33 pid: 21973 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066791.562288:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976837376:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066791.562294:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009288b400/0xfb36a14ee608b431 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e4ac expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.562299:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d3fe600/0xfb36a14ee608b42a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e49e expref: 33 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.562306:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3fe600, rc 0) 00000100:00100000:2.0:1746066791.562315:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976837504:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066791.562318:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f5c540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.562321:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+33:1964:x1830882976914176:12345-192.168.202.57@tcp:101:cat.0 Request processed in 58us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.562325:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14510 00000100:00100000:2.0:1746066791.562336:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.563079:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.563311:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976914816 00000100:00100000:1.0:1746066791.563315:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976914816 00002000:00100000:1.0:1746066791.563341:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8801361f8a80 x1830882976914816/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.563350:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8a80 with x1830882976914816 ext(1048576->2097151) 00002000:00010000:1.0:1746066791.563353:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361f8a80 00000100:00100000:1.0:1746066791.563377:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6555 00000100:00100000:1.0:1746066791.563383:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1966:x1830882976914816:12345-192.168.202.57@tcp:3:multiop.0 00010000:00010000:0.0:1746066791.564138:0:20532:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e404 expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066791.564162:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976837376:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066791.564183:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b423 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4b3 expref: 32 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066791.564192:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b423 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4b3 expref: 32 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066791.564211:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e80b800, rc 0) 00000100:00100000:0.0:1746066791.564236:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+31:1964:x1830882976914560:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1988us (2228us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066791.564241:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14509 00010000:00010000:3.0:1746066791.564358:0:4614:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3fd expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.564375:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976837504:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066791.564390:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009288b400/0xfb36a14ee608b431 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4ac expref: 24 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.564398:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009288b400/0xfb36a14ee608b431 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4ac expref: 24 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.564409:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009288b400, rc 0) 00000100:00100000:3.0:1746066791.564425:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882976914432:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2145us (2380us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066791.564430:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14511 00002000:00010000:2.0:1746066791.564520:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime: 1746066790 -> 1746066791 00002000:00010000:2.0:1746066791.564523:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime: 1746066790 -> 1746066791 00000100:00100000:2.0:1746066791.564533:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976837248:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066791.564550:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee2b000/0xfb36a14ee608b415 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e497 expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066791.564558:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee2b000/0xfb36a14ee608b415 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e497 expref: 22 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066791.564574:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee2b000, rc 0) 00000100:00100000:2.0:1746066791.564592:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882976914048:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2588us (2950us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066791.564598:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14507 00000100:00100000:1.0:1746066791.569467:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1966:x1830882976914816:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 6075us (6380us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066791.569477:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6555 00002000:00100000:1.0:1746066791.569487:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8801361f8a80 x1830882976914816/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.569498:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8a80 with x1830882976914816 ext(1048576->2097151) 00002000:00010000:1.0:1746066791.569502:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361f8a80 00000100:00100000:0.0:1746066791.569975:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.570081:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976914944 00000100:00100000:2.0:1746066791.570087:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976914944 00000100:00100000:2.0:1746066791.570113:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14512 00000100:00100000:2.0:1746066791.570119:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+21:31589:x1830882976914944:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066791.570131:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.570145:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b438 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e4ba expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.570166:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3fd expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.570173:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066791.570174:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066791.570177:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b438 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4ba expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.570201:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3fd expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.570211:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3fd expref: 8 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.570220:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976837632:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066791.570276:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.573311:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.573579:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976837632:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066791.573603:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b438 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4ba expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.573634:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009288b200, rc 0) 00000100:00100000:2.0:1746066791.573691:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:31589:x1830882976914944:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3554us (3699us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.573699:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14512 00000100:00100000:2.0:1746066791.573720:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976915072 00000100:00100000:2.0:1746066791.573724:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976915072 00000100:00100000:2.0:1746066791.574061:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14513 00000100:00100000:2.0:1746066791.574068:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31590:x1830882976915072:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066791.574079:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.574089:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009288be00/0xfb36a14ee608b43f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e4c1 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.574105:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.574106:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.574111:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009288be00/0xfb36a14ee608b43f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c1 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.574121:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009288be00/0xfb36a14ee608b43f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c1 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.574127:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009288be00, rc 0) 00000100:00100000:1.0:1746066791.574494:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.574501:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:31590:x1830882976915072:12345-192.168.202.57@tcp:101:cat.0 Request processed in 433us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.574507:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14513 00000100:00100000:3.0:1746066791.574655:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976915200 00000100:00100000:3.0:1746066791.574659:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976915200 00010000:00010000:3.0:1746066791.574693:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3fd expref: 9 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.574902:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7438 00000100:00100000:3.0:1746066791.574908:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5408050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976915200:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066791.574917:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066791.574933:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3fd expref: 9 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.574947:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3fd expref: 9 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.574961:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009288b000/0xfb36a14ee608b319 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e3fd expref: 9 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.574974:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.574976:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.574980:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b438 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4ba expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.574986:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b438 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4ba expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.575400:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b438 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4ba expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.575411:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976837760:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066791.575496:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.580603:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.580637:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976837760:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066791.580654:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066791.580708:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5408050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976915200:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5800us (6213us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.580717:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7438 00000100:00100000:1.0:1746066791.580754:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976915456 00000100:00100000:1.0:1746066791.580761:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976915456 00002000:00100000:1.0:1746066791.580794:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009b7fad80 x1830882976915456/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.580802:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fad80 with x1830882976915456 ext(1048576->2097151) 00002000:00010000:1.0:1746066791.580806:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7fad80 00000100:00100000:1.0:1746066791.580831:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6556 00000100:00100000:1.0:1746066791.580837:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882976915456:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066791.582910:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.583345:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976915712 00000100:00100000:3.0:1746066791.583352:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976915712 00002000:00100000:3.0:1746066791.583380:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009b7fbb80 x1830882976915712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.583389:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fbb80 with x1830882976915712 ext(2097152->3145727) 00002000:00010000:3.0:1746066791.583393:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7fbb80 00000100:00100000:3.0:1746066791.583416:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6557 00000100:00100000:3.0:1746066791.583422:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882976915712:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066791.588302:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882976915456:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 7446us (7687us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066791.588313:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6556 00002000:00100000:1.0:1746066791.588323:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009b7fad80 x1830882976915456/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.588331:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fad80 with x1830882976915456 ext(1048576->2097151) 00002000:00010000:1.0:1746066791.588337:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7fad80 00000100:00100000:3.0:1746066791.592916:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882976915712:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9485us (10002us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066791.592926:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6557 00002000:00100000:3.0:1746066791.592935:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009b7fbb80 x1830882976915712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.592943:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fbb80 with x1830882976915712 ext(2097152->3145727) 00002000:00010000:3.0:1746066791.592948:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7fbb80 00000100:00100000:0.0:1746066791.605888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.606289:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976915840 00000100:00100000:2.0:1746066791.606297:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976915840 00000100:00100000:2.0:1746066791.606771:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14514 00000100:00100000:2.0:1746066791.606780:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+31:31589:x1830882976915840:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066791.606796:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.606827:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b446 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e4c8 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.606850:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e404 expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.606857:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066791.606858:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066791.606861:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b446 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c8 expref: 32 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.606884:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e404 expref: 8 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.606894:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e404 expref: 8 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:2.0:1746066791.606903:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976837888:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066791.607933:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.612029:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.612063:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.612152:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976915968 00000100:00100000:2.0:1746066791.612158:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976915968 00000100:00100000:2.0:1746066791.612191:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976916096 00000100:00100000:2.0:1746066791.612193:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976916096 00000100:00100000:2.0:1746066791.612208:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14515 00000100:00100000:2.0:1746066791.612214:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1966:x1830882976915968:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066791.612227:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.612240:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e80ba00/0xfb36a14ee608b44d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e4cf expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.612258:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.612260:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.612266:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e80ba00/0xfb36a14ee608b44d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4cf expref: 28 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066791.612278:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e80ba00/0xfb36a14ee608b44d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4cf expref: 28 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066791.612286:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e80ba00, rc 0) 00000100:00100000:2.0:1746066791.612318:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882976915968:12345-192.168.202.57@tcp:101:cat.0 Request processed in 105us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.612323:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14515 00000100:00100000:2.0:1746066791.612334:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14516 00000100:00100000:2.0:1746066791.612338:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1966:x1830882976916096:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066791.612343:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.612350:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e80b600/0xfb36a14ee608b454 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e4d6 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.612377:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976838016:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066791.612543:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.612747:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976837888:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.612764:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b446 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c8 expref: 32 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.612773:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e80ae00, rc 0) 00000100:00100000:3.0:1746066791.612791:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+32:31589:x1830882976915840:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6014us (6910us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.612796:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14514 00000100:00100000:3.0:1746066791.613039:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976916224 00000100:00100000:3.0:1746066791.613042:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976916224 00010000:00010000:3.0:1746066791.613057:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e404 expref: 9 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:3.0:1746066791.613073:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7439 00000100:00100000:3.0:1746066791.613078:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976916224:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066791.613085:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066791.613101:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e404 expref: 9 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.613110:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e404 expref: 9 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:3.0:1746066791.613124:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.613125:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.613130:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b446 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c8 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.613136:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b446 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c8 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.613152:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b446 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c8 expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.613160:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976838144:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066791.613191:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066791.614108:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.620114:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976838144:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066791.620133:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066791.620182:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976916224:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7102us (7638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.620190:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7439 00000100:00100000:0.0:1746066791.621317:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.621349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.621369:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976916480 00000100:00100000:0.0:1746066791.621371:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.621375:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976916480 00002000:00100000:3.0:1746066791.621404:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009b7f9c00 x1830882976916480/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.621413:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f9c00 with x1830882976916480 ext(2097152->3145727) 00000100:00100000:2.0:1746066791.621416:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976916736 00002000:00010000:3.0:1746066791.621417:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7f9c00 00000100:00100000:2.0:1746066791.621420:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976916736 00000100:00100000:3.0:1746066791.621434:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976916992 00002000:00100000:2.0:1746066791.621434:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009b7fb480 x1830882976916736/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066791.621436:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976916992 00002000:00100000:2.0:1746066791.621439:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fb480 with x1830882976916736 ext(3145728->4194303) 00002000:00010000:2.0:1746066791.621441:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7fb480 00000100:00100000:2.0:1746066791.621448:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6558 00002000:00100000:3.0:1746066791.621449:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009b7f8700 x1830882976916992/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746066791.621452:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+33:1964:x1830882976916480:12345-192.168.202.57@tcp:3:cat.0 00002000:00100000:3.0:1746066791.621455:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f8700 with x1830882976916992 ext(3145728->4194303) 00000100:00100000:1.0:1746066791.621455:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6559 00002000:00010000:3.0:1746066791.621458:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7f8700 00000100:00100000:1.0:1746066791.621462:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+33:1964:x1830882976916736:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066791.621468:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6560 00000100:00100000:3.0:1746066791.621472:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976916992:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:0.0:1746066791.621930:0:20532:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.57@tcp) returned -22 from glimpse AST (req@ffff8800a590ca80 x1830882976838016) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e404 expref: 8 pid: 4614 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746066791.621955:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009288ba00/0xfb36a14ee608b320 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e404 expref: 8 pid: 4614 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746066791.621969:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976838016:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066791.621990:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e80b600/0xfb36a14ee608b454 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4d6 expref: 34 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066791.621999:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e80b600/0xfb36a14ee608b454 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4d6 expref: 34 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066791.622005:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e80b600, rc 0) 00000100:00100000:0.0:1746066791.622029:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1966:x1830882976916096:12345-192.168.202.57@tcp:101:cat.0 Request processed in 9690us (9966us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066791.622035:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14516 00000100:00100000:0.0:1746066791.628228:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.628294:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976917248 00000100:00100000:3.0:1746066791.628302:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976917248 00002000:00100000:3.0:1746066791.628337:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009b7f8a80 x1830882976917248/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.628347:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f8a80 with x1830882976917248 ext(2097152->3145727) 00002000:00010000:3.0:1746066791.628352:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7f8a80 00000100:00100000:3.0:1746066791.628380:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6561 00000100:00100000:3.0:1746066791.628387:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882976917248:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066791.628548:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+34:1964:x1830882976916480:12345-192.168.202.57@tcp:3:cat.0 Request processed in 7093us (7232us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066791.628555:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6558 00002000:00100000:2.0:1746066791.628560:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009b7f9c00 x1830882976916480/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.628568:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f9c00 with x1830882976916480 ext(2097152->3145727) 00002000:00010000:2.0:1746066791.628571:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7f9c00 00000100:00100000:3.0:1746066791.633370:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976916992:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11887us (11988us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066791.633380:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6560 00002000:00100000:3.0:1746066791.633390:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009b7f8700 x1830882976916992/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.633399:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f8700 with x1830882976916992 ext(3145728->4194303) 00002000:00010000:3.0:1746066791.633404:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7f8700 00000100:00100000:0.0:1746066791.641031:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.641449:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+32:1964:x1830882976916736:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19986us (20098us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066791.641459:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6559 00002000:00100000:1.0:1746066791.641467:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009b7fb480 x1830882976916736/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.641476:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fb480 with x1830882976916736 ext(3145728->4194303) 00002000:00010000:1.0:1746066791.641480:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7fb480 00000100:00100000:3.0:1746066791.642919:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976917504 00000100:00100000:3.0:1746066791.642927:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976917504 00000100:00100000:3.0:1746066791.642972:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9974 00000100:00100000:3.0:1746066791.642977:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31594:x1830882976917504:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066791.642993:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.643009:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46ac00/0xfb36a14ee608b45b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e4dd expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.643087:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b462 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643098:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643108:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643119:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b469 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643124:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643128:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643209:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b470 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643216:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b470 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643221:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b470 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746066791.643230:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066791.643335:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643341:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b462 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643345:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b462 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643350:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b46a200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066791.643353:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b462 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643358:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b462 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643368:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066791.643370:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066791.643374:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b462 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643382:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643415:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643420:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b469 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643424:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b469 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643428:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b46b000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066791.643430:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b469 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643434:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b469 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643440:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800901e3800) 00010000:00010000:3.0:1746066791.643441:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066791.643443:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b469 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643447:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b469 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066791.643481:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46ac00/0xfb36a14ee608b45b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4dd expref: 256 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.643492:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b470 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4dd expref: 255 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.643502:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066791.643504:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066791.643506:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b46b400, rc 0) 00000100:00100000:3.0:1746066791.643556:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31594:x1830882976917504:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 578us (2532us total) trans 8589944021 rc 0/0 00000100:00100000:3.0:1746066791.643562:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9974 00000100:00100000:0.0:1746066791.651308:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.651517:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976917760 00000100:00100000:2.0:1746066791.651524:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976917760 00000100:00100000:2.0:1746066791.651562:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4153 00000100:00100000:2.0:1746066791.651569:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f5acc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31594:x1830882976917760:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066791.651787:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f5acc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:31594:x1830882976917760:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 218us (485us total) trans 8589944022 rc 0/0 00000100:00100000:2.0:1746066791.651793:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4153 00000100:00100000:3.0:1746066791.652163:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882976917248:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23776us (23940us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066791.652170:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6561 00002000:00100000:3.0:1746066791.652178:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009b7f8a80 x1830882976917248/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.652187:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f8a80 with x1830882976917248 ext(2097152->3145727) 00002000:00010000:3.0:1746066791.652191:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7f8a80 00000100:00100000:0.0:1746066791.660251:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.661598:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976917888 00000100:00100000:2.0:1746066791.661607:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976917888 00000100:00100000:2.0:1746066791.661656:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14517 00000100:00100000:2.0:1746066791.661662:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976917888:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066791.661688:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.661703:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e80ac00/0xfb36a14ee608b47e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e4e4 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.661747:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976838272:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066791.661829:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.679009:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.679047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.679160:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976838272:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066791.679187:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e80ac00/0xfb36a14ee608b47e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4e4 expref: 23 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066791.679208:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e80ac00/0xfb36a14ee608b47e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4e4 expref: 23 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066791.679231:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e80ac00, rc 0) 00000100:00100000:0.0:1746066791.679266:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976917888:12345-192.168.202.57@tcp:101:cat.0 Request processed in 17604us (19024us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066791.679274:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14517 00000100:00100000:0.0:1746066791.679294:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976918272 00000100:00100000:0.0:1746066791.679300:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976918272 00000100:00100000:3.0:1746066791.679309:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976918144 00000100:00100000:3.0:1746066791.679312:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976918144 00000100:00100000:0.0:1746066791.679330:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14518 00000100:00100000:3.0:1746066791.679331:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9975 00000100:00100000:3.0:1746066791.679336:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+8:31596:x1830882976918144:12345-192.168.202.57@tcp:101:multiop.0 00000100:00100000:0.0:1746066791.679336:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:31590:x1830882976918272:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066791.679346:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066791.679346:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066791.679357:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b485 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e4f2 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.679358:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b48c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e4eb expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.679371:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066791.679373:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066791.679378:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b485 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4f2 expref: 34 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.679388:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b485 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4f2 expref: 34 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.679395:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d5000, rc 0) 00000100:00100000:0.0:1746066791.679408:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:31590:x1830882976918272:12345-192.168.202.57@tcp:101:cat.0 Request processed in 74us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066791.679415:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14518 00010000:00010000:3.0:1746066791.679431:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a800/0xfb36a14ee608b493 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679440:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a800/0xfb36a14ee608b493 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679447:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a800/0xfb36a14ee608b493 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679458:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46ac00/0xfb36a14ee608b49a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679463:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46ac00/0xfb36a14ee608b49a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679468:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46ac00/0xfb36a14ee608b49a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679551:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b4a1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679559:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679565:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066791.679573:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066791.679653:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a800/0xfb36a14ee608b493 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679659:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a800/0xfb36a14ee608b493 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679664:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a800/0xfb36a14ee608b493 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679669:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b46a800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066791.679672:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a800/0xfb36a14ee608b493 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679704:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a800/0xfb36a14ee608b493 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679712:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066791.679715:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066791.679718:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a800/0xfb36a14ee608b493 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679722:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a800/0xfb36a14ee608b493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679733:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46ac00/0xfb36a14ee608b49a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679738:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46ac00/0xfb36a14ee608b49a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679742:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46ac00/0xfb36a14ee608b49a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679746:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b46ac00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066791.679748:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46ac00/0xfb36a14ee608b49a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679752:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46ac00/0xfb36a14ee608b49a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679757:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800901e3b00) 00010000:00010000:3.0:1746066791.679759:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066791.679761:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46ac00/0xfb36a14ee608b49a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679765:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46ac00/0xfb36a14ee608b49a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.679974:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b48c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4eb expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.679984:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4eb expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.679989:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066791.679990:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066791.679992:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b46b000, rc 0) 00000100:00100000:3.0:1746066791.680019:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:31596:x1830882976918144:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 683us (1018us total) trans 8589944023 rc 0/0 00000100:00100000:3.0:1746066791.680024:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9975 00000100:00100000:2.0:1746066791.685548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.685756:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976918528 00000100:00100000:0.0:1746066791.685763:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976918528 00000100:00100000:0.0:1746066791.685813:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4154 00000100:00100000:0.0:1746066791.685820:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:31596:x1830882976918528:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:0.0:1746066791.686001:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+11:31596:x1830882976918528:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 181us (459us total) trans 8589944024 rc 0/0 00000100:00100000:0.0:1746066791.686007:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4154 00000100:00100000:2.0:1746066791.686693:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.686815:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976918784 00000100:00100000:3.0:1746066791.686819:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976918784 00002000:00100000:3.0:1746066791.686843:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a590f800 x1830882976918784/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.686852:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590f800 with x1830882976918784 ext(4194304->5091327) 00002000:00010000:3.0:1746066791.686857:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590f800 00000100:00100000:3.0:1746066791.686871:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6562 00000100:00100000:3.0:1746066791.686877:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976918784:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066791.695007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.695064:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.695115:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.695257:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976919040 00000100:00100000:2.0:1746066791.695266:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976919040 00002000:00100000:2.0:1746066791.695307:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88008efb6680 x1830882976919040/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.695316:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb6680 with x1830882976919040 ext(2097152->3145727) 00002000:00010000:2.0:1746066791.695320:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb6680 00000100:00100000:2.0:1746066791.695341:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976919296 00000100:00100000:2.0:1746066791.695345:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976919296 00002000:00100000:2.0:1746066791.695361:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88008efb7480 x1830882976919296/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.695367:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb7480 with x1830882976919296 ext(3145728->4194303) 00002000:00010000:2.0:1746066791.695370:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb7480 00000100:00100000:2.0:1746066791.695384:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976919552 00000100:00100000:2.0:1746066791.695388:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976919552 00002000:00100000:2.0:1746066791.695405:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88008efb6d80 x1830882976919552/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.695411:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb6d80 with x1830882976919552 ext(3145728->4194303) 00002000:00010000:2.0:1746066791.695414:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb6d80 00000100:00100000:2.0:1746066791.695433:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6563 00000100:00100000:2.0:1746066791.695441:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1965:x1830882976919040:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066791.695911:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6564 00000100:00100000:1.0:1746066791.695918:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1965:x1830882976919296:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066791.696459:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6565 00000100:00100000:2.0:1746066791.696464:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882976919552:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066791.697823:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976918784:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10941us (11126us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066791.697831:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6562 00002000:00100000:2.0:1746066791.697841:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a590f800 x1830882976918784/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.697849:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590f800 with x1830882976918784 ext(4194304->5091327) 00002000:00010000:2.0:1746066791.697853:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590f800 00000100:00100000:2.0:1746066791.706424:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1965:x1830882976919040:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10977us (11419us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066791.706434:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6563 00002000:00100000:2.0:1746066791.706443:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88008efb6680 x1830882976919040/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.706451:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb6680 with x1830882976919040 ext(2097152->3145727) 00002000:00010000:2.0:1746066791.706456:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb6680 00000100:00100000:0.0:1746066791.709349:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.709479:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976919680 00000100:00100000:1.0:1746066791.709488:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976919680 00000100:00100000:1.0:1746066791.710402:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14519 00000100:00100000:1.0:1746066791.710411:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882976919680:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066791.710426:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.710440:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d36b400/0xfb36a14ee608b4af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e4f9 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.710480:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976838400:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066791.713065:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.713908:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882976919296:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17988us (18842us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066791.713921:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6564 00002000:00100000:1.0:1746066791.713934:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88008efb7480 x1830882976919296/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.713943:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb7480 with x1830882976919296 ext(3145728->4194303) 00002000:00010000:1.0:1746066791.713947:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb7480 00000100:00100000:1.0:1746066791.720196:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976838400:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066791.720224:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d36b400/0xfb36a14ee608b4af lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4f9 expref: 23 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.720236:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d36b400/0xfb36a14ee608b4af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4f9 expref: 23 pid: 9776 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066791.720407:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882976919552:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23941us (25292us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066791.720416:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6565 00002000:00100000:2.0:1746066791.720423:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88008efb6d80 x1830882976919552/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.720436:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb6d80 with x1830882976919552 ext(3145728->4194303) 00002000:00010000:2.0:1746066791.720440:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb6d80 00010000:00010000:1.0:1746066791.720816:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d36b400, rc 0) 00000100:00100000:1.0:1746066791.720895:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882976919680:12345-192.168.202.57@tcp:101:cat.0 Request processed in 10485us (11552us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066791.720900:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14519 00000100:00100000:0.0:1746066791.731312:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.732474:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976919808 00000100:00100000:1.0:1746066791.732483:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976919808 00000100:00100000:1.0:1746066791.732524:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14520 00000100:00100000:1.0:1746066791.732531:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976919808:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066791.732544:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.732559:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e500 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.732599:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976838528:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066791.733640:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.734108:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.735964:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976920064 00000100:00100000:2.0:1746066791.735974:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976920064 00002000:00100000:2.0:1746066791.736013:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880135f81180 x1830882976920064/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.736022:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f81180 with x1830882976920064 ext(4194304->5091327) 00002000:00010000:2.0:1746066791.736026:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135f81180 00000100:00100000:2.0:1746066791.736056:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6566 00000100:00100000:2.0:1746066791.736062:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882976920064:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066791.740590:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976838528:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066791.740652:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e500 expref: 23 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.740664:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e500 expref: 23 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.741036:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d36b200, rc 0) 00000100:00100000:1.0:1746066791.741075:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882976919808:12345-192.168.202.57@tcp:101:cat.0 Request processed in 8543us (9768us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066791.741083:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14520 00000100:00100000:3.0:1746066791.742847:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882976920064:12345-192.168.202.57@tcp:3:cat.0 Request processed in 6780us (8735us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066791.742856:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6566 00002000:00100000:3.0:1746066791.742864:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880135f81180 x1830882976920064/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.742876:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f81180 with x1830882976920064 ext(4194304->5091327) 00002000:00010000:3.0:1746066791.742881:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135f81180 00000100:00100000:0.0:1746066791.757281:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.758787:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976920320 00000100:00100000:3.0:1746066791.758795:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976920320 00000100:00100000:3.0:1746066791.758837:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4155 00000100:00100000:3.0:1746066791.758843:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:31589:x1830882976920320:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:3.0:1746066791.759005:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:31589:x1830882976920320:12345-192.168.202.57@tcp:35:cat.0 Request processed in 162us (1731us total) trans 8589944025 rc 0/0 00000100:00100000:3.0:1746066791.759011:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4155 00000100:00100000:2.0:1746066791.759422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.759582:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976920576 00000100:00100000:0.0:1746066791.759585:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976920576 00000100:00100000:0.0:1746066791.759625:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4156 00000100:00100000:0.0:1746066791.759632:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:31590:x1830882976920576:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:0.0:1746066791.759744:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:31590:x1830882976920576:12345-192.168.202.57@tcp:35:cat.0 Request processed in 113us (323us total) trans 8589944026 rc 0/0 00000100:00100000:0.0:1746066791.759750:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4156 00000100:00100000:0.0:1746066791.798587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.798706:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976920704 00000100:00100000:1.0:1746066791.798713:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976920704 00000100:00100000:1.0:1746066791.798748:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14521 00000100:00100000:1.0:1746066791.798754:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+32:31596:x1830882976920704:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066791.798769:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.798785:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e507 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.798808:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b446 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c8 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.798815:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b485 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4f2 expref: 33 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.798826:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.798827:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.798830:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [4149248->4194303] (req 4149248->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 33 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.798853:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b485 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4f2 expref: 33 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.798862:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b485 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4f2 expref: 33 pid: 20532 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.798871:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976838656:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.801199:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b446 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c8 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.801212:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b446 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c8 expref: 33 pid: 8450 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.801223:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976838784:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066791.802593:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.808511:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.808549:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.808569:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976920832 00000100:00100000:0.0:1746066791.808575:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976920832 00010000:00010000:0.0:1746066791.808605:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b446 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c8 expref: 34 pid: 8450 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746066791.808774:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976920960 00000100:00100000:0.0:1746066791.808777:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976920960 00010000:00010000:0.0:1746066791.808788:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b485 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4f2 expref: 34 pid: 20532 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746066791.808802:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7440 00000100:00100000:0.0:1746066791.808808:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+34:1965:x1830882976920832:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066791.808820:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066791.808840:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b446 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c8 expref: 34 pid: 8450 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746066791.808849:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b446 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c8 expref: 34 pid: 8450 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746066791.808871:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066791.808902:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+34:1965:x1830882976920832:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 94us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066791.808908:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7440 00000100:00100000:0.0:1746066791.808922:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7441 00000100:00100000:0.0:1746066791.808927:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882976920960:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066791.808933:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066791.808939:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b485 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4f2 expref: 34 pid: 20532 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746066791.808948:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b485 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4f2 expref: 34 pid: 20532 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746066791.808957:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066791.808959:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066791.808964:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 33 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.808971:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 33 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.808997:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 33 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066791.809007:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c22df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976838912:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066791.809054:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f5c540 going to sleep for 11 seconds 00010000:00010000:1.0:1746066791.809586:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b485 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4f2 expref: 34 pid: 20532 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.809601:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976838656:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.809623:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b446 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c8 expref: 33 pid: 8450 timeout: 852 lvb_type: 0 00000100:00100000:1.0:1746066791.809631:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976838784:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.809656:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 32 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.809664:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d36a800, rc 0) 00000100:00100000:1.0:1746066791.809702:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+32:31596:x1830882976920704:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 10949us (11123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.809708:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14521 00000100:00100000:2.0:1746066791.815243:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c22df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976838912:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066791.815268:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.815297:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1965:x1830882976920960:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6370us (6747us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.815306:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7441 00000100:00100000:0.0:1746066791.823471:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.823549:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976921216 00000100:00100000:3.0:1746066791.823557:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976921216 00002000:00100000:3.0:1746066791.823595:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (4149248->4153343) req@ffff88012c22f480 x1830882976921216/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.823605:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22f480 with x1830882976921216 ext(4149248->4153343) 00002000:00010000:3.0:1746066791.823610:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c22f480 00000100:00100000:3.0:1746066791.823651:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6567 00000100:00100000:3.0:1746066791.823659:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+32:1963:x1830882976921216:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066791.823828:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+32:1963:x1830882976921216:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 169us (363us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066791.823834:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6567 00002000:00100000:3.0:1746066791.823839:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (4149248->4153343) req@ffff88012c22f480 x1830882976921216/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/4536 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.823846:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22f480 with x1830882976921216 ext(4149248->4153343) 00002000:00010000:3.0:1746066791.823849:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c22f480 00000100:00100000:0.0:1746066791.827986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.828070:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976921344 00000100:00100000:3.0:1746066791.828077:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976921344 00000100:00100000:3.0:1746066791.828114:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9976 00000100:00100000:3.0:1746066791.828120:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:31599:x1830882976921344:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066791.828139:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.828153:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46ac00/0xfb36a14ee608b4c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e50e expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.828199:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b800/0xfb36a14ee608b4cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.828209:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b800/0xfb36a14ee608b4cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.828218:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b800/0xfb36a14ee608b4cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.828229:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b4d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.828233:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.828238:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.828325:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.828333:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e427 expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.828343:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e42e expref: 256 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.828348:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.828374:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e42e expref: 256 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.828384:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e42e expref: 256 pid: 14549 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066791.828394:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976839040:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.828721:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e427 expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.828728:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e427 expref: 11 pid: 14548 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066791.828735:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976839168:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066791.835041:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.835119:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976921472 00000100:00100000:1.0:1746066791.835126:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976921472 00000100:00100000:1.0:1746066791.835163:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14522 00000100:00100000:1.0:1746066791.835169:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+22:31596:x1830882976921472:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066791.835184:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.835197:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e515 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.835219:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b438 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4ba expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.835226:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e80ba00/0xfb36a14ee608b44d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4cf expref: 27 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.835232:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.835234:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.835238:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->4812799] (req 4194304->4812799) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 23 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.835259:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e80ba00/0xfb36a14ee608b44d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4cf expref: 27 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.835268:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e80ba00/0xfb36a14ee608b44d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4cf expref: 27 pid: 20532 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746066791.835278:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976839296:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.835462:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929eacc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066791.835736:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b438 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4ba expref: 23 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.835744:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b438 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4ba expref: 23 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066791.835751:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976839424:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066791.835777:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.842423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.842552:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976839040:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066791.842672:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976921600 00000100:00100000:2.0:1746066791.842691:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976921600 00010000:00010000:2.0:1746066791.842729:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e42e expref: 257 pid: 14549 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066791.843334:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7442 00000100:00100000:2.0:1746066791.843340:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:1964:x1830882976921600:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.843351:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066791.843357:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e42e expref: 257 pid: 14549 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.843367:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e42e expref: 257 pid: 14549 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.843384:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80bc00/0xfb36a14ee608b39e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e42e expref: 257 pid: 14549 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.843400:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066791.843404:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.843410:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.843414:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.843418:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.843467:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:1964:x1830882976921600:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 126us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.843472:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7442 00000100:00100000:3.0:1746066791.843857:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976839168:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.843877:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746066791.843886:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.843907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.843921:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976921728 00000100:00100000:3.0:1746066791.843923:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976921728 00000100:00100000:1.0:1746066791.843930:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066791.843934:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e427 expref: 12 pid: 14548 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066791.843946:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976921984 00000100:00100000:3.0:1746066791.843948:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976921984 00000100:00100000:1.0:1746066791.843950:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976921856 00000100:00100000:1.0:1746066791.843951:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976921856 00010000:00010000:3.0:1746066791.843958:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b438 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4ba expref: 24 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066791.843961:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e80ba00/0xfb36a14ee608b44d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4cf expref: 28 pid: 20532 timeout: 853 lvb_type: 1 00000100:00100000:3.0:1746066791.843969:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7443 00000100:00100000:3.0:1746066791.843974:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882976921728:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066791.843978:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7444 00010000:00010000:3.0:1746066791.843980:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066791.843982:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882976921984:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066791.843983:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e427 expref: 12 pid: 14548 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066791.843988:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066791.843989:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e427 expref: 12 pid: 14548 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066791.843999:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608b390 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e427 expref: 12 pid: 14548 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066791.844003:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b438 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4ba expref: 24 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066791.844009:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:1.0:1746066791.844010:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b438 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4ba expref: 24 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066791.844012:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844018:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066791.844024:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066791.844026:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844038:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066791.844038:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882976921984:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 56us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.844043:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7444 00000100:00100000:3.0:1746066791.844048:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882976921728:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 75us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.844052:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7445 00000100:00100000:3.0:1746066791.844054:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7443 00000100:00100000:1.0:1746066791.844055:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882976921856:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.844060:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.844066:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e80ba00/0xfb36a14ee608b44d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4cf expref: 28 pid: 20532 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746066791.844070:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066791.844073:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e80ba00/0xfb36a14ee608b44d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4cf expref: 28 pid: 20532 timeout: 853 lvb_type: 1 00010000:00010000:3.0:1746066791.844074:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066791.844082:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.844083:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.844088:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 23 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.844094:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 23 pid: 9776 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1746066791.844104:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066791.844107:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1746066791.844113:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 23 pid: 9776 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1746066791.844119:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746066791.844122:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976839552:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066791.844126:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844132:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b800/0xfb36a14ee608b4cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844137:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b800/0xfb36a14ee608b4cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844141:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b800/0xfb36a14ee608b4cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844146:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b46b800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066791.844149:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b800/0xfb36a14ee608b4cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844156:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b800/0xfb36a14ee608b4cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844163:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00000100:00100000:1.0:1746066791.844163:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb840 going to sleep for 11 seconds 00010000:00010000:3.0:1746066791.844165:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066791.844168:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b800/0xfb36a14ee608b4cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844172:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b800/0xfb36a14ee608b4cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844179:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844183:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b4d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844188:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844191:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b46a200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066791.844194:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844198:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b4d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844203:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800901e3600) 00010000:00010000:3.0:1746066791.844205:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066791.844207:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b4d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844210:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46a200/0xfb36a14ee608b4d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.844236:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46ac00/0xfb36a14ee608b4c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e50e expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.844245:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e50e expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.844289:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e80ba00/0xfb36a14ee608b44d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4cf expref: 28 pid: 20532 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746066791.844301:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976839296:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066791.844309:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009288b200/0xfb36a14ee608b438 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4ba expref: 23 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746066791.844320:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976839424:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066791.844339:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 22 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.844346:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d36b200, rc 0) 00000100:00100000:0.0:1746066791.844366:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+22:31596:x1830882976921472:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 9197us (9333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066791.844372:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14522 00010000:00010000:3.0:1746066791.844494:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066791.844497:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066791.844499:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5831800, rc 0) 00000100:00100000:3.0:1746066791.844529:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31599:x1830882976921344:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 16408us (16550us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.844535:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9976 00000100:00100000:1.0:1746066791.846154:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976839552:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066791.846168:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066791.846190:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882976921856:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2133us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.846198:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7445 00000100:00100000:0.0:1746066791.848332:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.848360:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.848384:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976922240 00000100:00100000:0.0:1746066791.848386:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.848391:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976922240 00000100:00100000:0.0:1746066791.848400:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976922496 00000100:00100000:0.0:1746066791.848402:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976922496 00000100:00100000:2.0:1746066791.848418:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976922752 00000100:00100000:2.0:1746066791.848420:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976922752 00000100:00100000:0.0:1746066791.848479:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14523 00000100:00100000:0.0:1746066791.848487:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976922240:12345-192.168.202.57@tcp:101:mirror_io.0 00000100:00100000:2.0:1746066791.848488:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14524 00000100:00100000:2.0:1746066791.848492:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976922496:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066791.848501:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066791.848501:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.848513:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e80a800/0xfb36a14ee608b4e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e531 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.848513:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb08000/0xfb36a14ee608b4ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e523 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.848530:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066791.848530:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.848532:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066791.848532:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.848538:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e80a800/0xfb36a14ee608b4e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e531 expref: 9 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066791.848538:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb08000/0xfb36a14ee608b4ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e523 expref: 10 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066791.848550:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e80a800/0xfb36a14ee608b4e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e531 expref: 9 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066791.848550:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eb08000/0xfb36a14ee608b4ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e523 expref: 10 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066791.848559:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e80a800, rc 0) 00010000:00010000:0.0:1746066791.848559:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb08000, rc 0) 00000100:00100000:2.0:1746066791.848590:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976922496:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 93us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.848595:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14524 00000100:00100000:1.0:1746066791.848599:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14525 00000100:00100000:1.0:1746066791.848605:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976922752:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066791.848622:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.848629:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1e00/0xfb36a14ee608b4f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e53f expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.848659:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976839680:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066791.848723:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882976922240:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 237us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066791.848729:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14523 00000100:00100000:2.0:1746066791.848833:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.848849:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.848861:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.848881:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.848952:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976922112 00000100:00100000:3.0:1746066791.848956:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976922112 00000100:00100000:3.0:1746066791.848971:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976922368 00000100:00100000:3.0:1746066791.848972:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976922368 00000100:00100000:3.0:1746066791.848982:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976922624 00000100:00100000:3.0:1746066791.848983:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976922624 00000100:00100000:3.0:1746066791.848990:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976922880 00000100:00100000:3.0:1746066791.848992:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976922880 00000100:00100000:1.0:1746066791.848994:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.849002:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14526 00000100:00100000:3.0:1746066791.849006:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976922112:12345-192.168.202.57@tcp:101:mirror_io.0 00000100:00100000:1.0:1746066791.849008:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14527 00010000:00010000:3.0:1746066791.849012:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066791.849012:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882976922368:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066791.849018:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25a00/0xfb36a14ee608b4fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e51c expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.849018:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.849022:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b503 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e52a expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.849029:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.849030:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.849034:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e52a expref: 12 pid: 21973 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066791.849038:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976839808:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066791.849043:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e52a expref: 12 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.849048:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a0200, rc 0) 00000100:00100000:3.0:1746066791.849059:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.849059:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882976922368:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 47us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.849063:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14527 00000100:00100000:3.0:1746066791.849071:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14528 00000100:00100000:1.0:1746066791.849074:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14529 00000100:00100000:3.0:1746066791.849075:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882976922624:12345-192.168.202.57@tcp:101:mirror_io.0 00000100:00100000:1.0:1746066791.849077:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:31594:x1830882976922880:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066791.849080:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.849081:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.849085:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25800/0xfb36a14ee608b50a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e538 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.849086:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e546 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.849097:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b46ae00/0xfb36a14ee608b40e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e490 expref: 34 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066791.849102:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976839936:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066791.849104:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b503 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e52a expref: 11 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.849114:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3fee00/0xfb36a14ee608b41c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4a5 expref: 31 pid: 21973 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066791.849117:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea900 going to sleep for 11 seconds 00010000:00010000:1.0:1746066791.849119:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.849121:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.849123:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [2043904->2097151] (req 2043904->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 34 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.849137:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3fee00/0xfb36a14ee608b41c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4a5 expref: 31 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.849146:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3fee00/0xfb36a14ee608b41c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4a5 expref: 31 pid: 21973 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746066791.849154:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976840064:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.849176:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e52a expref: 11 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.849183:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b503 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e52a expref: 11 pid: 21973 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746066791.849196:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976840192:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.849219:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b46ae00/0xfb36a14ee608b40e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e490 expref: 34 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.849230:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b46ae00/0xfb36a14ee608b40e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e490 expref: 34 pid: 10402 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066791.849237:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976840320:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066791.849249:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.852814:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976840064:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.852864:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976839808:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066791.852891:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25a00/0xfb36a14ee608b4fc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e51c expref: 12 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.852903:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25a00/0xfb36a14ee608b4fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e51c expref: 12 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.852915:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f25a00, rc 0) 00000100:00100000:3.0:1746066791.852952:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882976922112:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 3944us (4118us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066791.852960:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14526 00002000:00010000:2.0:1746066791.853059:0:10402:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime: 1746066790 -> 1746066791 00002000:00010000:2.0:1746066791.853063:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime: 1746066790 -> 1746066791 00000100:00100000:2.0:1746066791.853071:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976839936:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066791.853085:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25800/0xfb36a14ee608b50a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e538 expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066791.853093:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25800/0xfb36a14ee608b50a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e538 expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066791.853108:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f25800, rc 0) 00000100:00100000:2.0:1746066791.853124:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976922624:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 4048us (4262us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066791.853129:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14528 00000100:00100000:1.0:1746066791.853325:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976840192:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066791.853333:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976840320:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.853395:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [2043904->2097151] (req 2043904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 34 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.853407:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a1400, rc 0) 00000100:00100000:1.0:1746066791.853435:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:31594:x1830882976922880:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4356us (4552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.853440:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14529 00002000:00010000:1.0:1746066791.853466:0:8451:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime: 1746066790 -> 1746066791 00002000:00010000:1.0:1746066791.853468:0:8451:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime: 1746066790 -> 1746066791 00000100:00100000:1.0:1746066791.853478:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976839680:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066791.853490:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1e00/0xfb36a14ee608b4f5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e53f expref: 11 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.853498:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1e00/0xfb36a14ee608b4f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e53f expref: 11 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.853520:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a1e00, rc 0) 00000100:00100000:1.0:1746066791.853535:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976922752:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 4931us (5148us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066791.853540:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14525 00000100:00100000:0.0:1746066791.853655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.853706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.853788:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976923136 00000100:00100000:2.0:1746066791.853793:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976923136 00010000:00010000:2.0:1746066791.853811:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b503 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e52a expref: 10 pid: 21973 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746066791.853827:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976923008 00000100:00100000:2.0:1746066791.853829:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976923008 00010000:00010000:2.0:1746066791.853835:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3fee00/0xfb36a14ee608b41c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4a5 expref: 32 pid: 21973 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746066791.853845:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7446 00000100:00100000:2.0:1746066791.853850:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976923136:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.853859:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066791.853867:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b503 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e52a expref: 10 pid: 21973 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746066791.853874:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b503 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e52a expref: 10 pid: 21973 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746066791.853887:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b503 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e52a expref: 10 pid: 21973 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746066791.853898:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.853913:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976923136:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 64us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.853918:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7446 00000100:00100000:2.0:1746066791.853926:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7447 00000100:00100000:2.0:1746066791.853929:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+32:1965:x1830882976923008:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.853934:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066791.853939:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3fee00/0xfb36a14ee608b41c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4a5 expref: 32 pid: 21973 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746066791.853946:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3fee00/0xfb36a14ee608b41c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4a5 expref: 32 pid: 21973 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746066791.853955:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3fee00/0xfb36a14ee608b41c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4a5 expref: 32 pid: 21973 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746066791.853963:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.853974:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+31:1965:x1830882976923008:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 44us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.853979:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7447 00000100:00100000:0.0:1746066791.856190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.856703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.856773:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976923264 00000100:00100000:1.0:1746066791.856781:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976923264 00010000:00010000:1.0:1746066791.856806:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b46ae00/0xfb36a14ee608b40e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e490 expref: 34 pid: 10402 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066791.856841:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7448 00000100:00100000:1.0:1746066791.856848:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882976923264:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066791.856859:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066791.856874:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b46ae00/0xfb36a14ee608b40e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e490 expref: 34 pid: 10402 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066791.856884:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b46ae00/0xfb36a14ee608b40e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e490 expref: 34 pid: 10402 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066791.856902:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b46ae00/0xfb36a14ee608b40e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e490 expref: 34 pid: 10402 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066791.856912:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.856913:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.856919:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.856931:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.856959:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.856969:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976840448:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066791.857025:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066791.857074:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976923520 00000100:00100000:2.0:1746066791.857077:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976923520 00002000:00100000:2.0:1746066791.857103:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (4808704->4812799) req@ffff88009244ed80 x1830882976923520/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.857110:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244ed80 with x1830882976923520 ext(4808704->4812799) 00002000:00010000:2.0:1746066791.857114:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244ed80 00000100:00100000:2.0:1746066791.857125:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6568 00000100:00100000:2.0:1746066791.857130:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882976923520:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066791.857239:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882976923520:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 107us (537us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066791.857244:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6568 00002000:00100000:2.0:1746066791.857248:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (4808704->4812799) req@ffff88009244ed80 x1830882976923520/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/4536 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.857255:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244ed80 with x1830882976923520 ext(4808704->4812799) 00002000:00010000:2.0:1746066791.857257:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244ed80 00000100:00100000:0.0:1746066791.859581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.859725:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976923776 00000100:00100000:3.0:1746066791.859732:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976923776 00000100:00100000:3.0:1746066791.859767:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9977 00000100:00100000:3.0:1746066791.859773:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31599:x1830882976923776:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066791.859786:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.859799:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25000/0xfb36a14ee608b518 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e54d expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.859863:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25200/0xfb36a14ee608b51f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.859874:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e50e expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.859879:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25200/0xfb36a14ee608b51f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066791.859901:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e50e expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.859910:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e50e expref: 8 pid: 14549 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066791.859919:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976840576:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.859968:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.860571:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.860640:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976840448:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066791.860654:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.860699:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1966:x1830882976923264:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3851us (4516us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.860706:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7448 00000100:00100000:3.0:1746066791.860915:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976924032 00000100:00100000:3.0:1746066791.860918:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976924032 00000100:00100000:1.0:1746066791.860926:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.860938:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4157 00000100:00100000:3.0:1746066791.860942:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:31596:x1830882976924032:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:0.0:1746066791.861021:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976924288 00000100:00100000:0.0:1746066791.861024:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976924288 00002000:00100000:0.0:1746066791.861047:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (2043904->2047999) req@ffff88009f16d880 x1830882976924288/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066791.861055:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16d880 with x1830882976924288 ext(2043904->2047999) 00002000:00010000:0.0:1746066791.861058:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16d880 00000100:00100000:0.0:1746066791.861079:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6569 00000100:00100000:0.0:1746066791.861085:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882976924288:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066791.861154:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:31596:x1830882976924032:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 211us (582us total) trans 8589944027 rc 0/0 00000100:00100000:3.0:1746066791.861159:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4157 00000100:00100000:0.0:1746066791.861348:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882976924288:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 262us (420us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066791.861353:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6569 00002000:00100000:0.0:1746066791.861358:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (2043904->2047999) req@ffff88009f16d880 x1830882976924288/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/4536 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066791.861365:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16d880 with x1830882976924288 ext(2043904->2047999) 00002000:00010000:0.0:1746066791.861368:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16d880 00000100:00100000:3.0:1746066791.862293:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976840576:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.862305:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25200/0xfb36a14ee608b51f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066791.862667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.862835:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976924416 00000100:00100000:2.0:1746066791.862840:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976924416 00010000:00010000:2.0:1746066791.862858:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e50e expref: 9 pid: 14549 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066791.862886:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7449 00000100:00100000:2.0:1746066791.862891:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b472d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976924416:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.862899:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066791.862903:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e50e expref: 9 pid: 14549 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.862916:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e50e expref: 9 pid: 14549 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.862931:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831800/0xfb36a14ee608b4d9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e50e expref: 9 pid: 14549 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.862940:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066791.862944:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25200/0xfb36a14ee608b51f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.862950:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25200/0xfb36a14ee608b51f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.862956:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25200/0xfb36a14ee608b51f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.862969:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.862990:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b472d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976924416:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 99us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.862995:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7449 00010000:00010000:2.0:1746066791.863431:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25200/0xfb36a14ee608b51f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.863437:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25200/0xfb36a14ee608b51f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746066791.863449:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066791.863544:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25000/0xfb36a14ee608b518 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e54d expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.863558:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25200/0xfb36a14ee608b51f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e54d expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.863563:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066791.863566:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066791.863568:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f25200, rc 0) 00000100:00100000:2.0:1746066791.863732:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31599:x1830882976923776:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 3957us (4155us total) trans 8589944028 rc 0/0 00000100:00100000:2.0:1746066791.863737:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9977 00000100:00100000:0.0:1746066791.865236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.865299:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976924672 00000100:00100000:2.0:1746066791.865305:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976924672 00000100:00100000:2.0:1746066791.865389:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9978 00000100:00100000:2.0:1746066791.865396:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31599:x1830882976924672:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066791.865411:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.865413:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746066791.865426:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25200/0xfb36a14ee608b51f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e54d expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.865436:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066791.865439:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066791.865447:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b52d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e554 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.865500:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b534 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.865508:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b534 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.865516:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b534 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.865524:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b534 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.865529:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b534 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.865534:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b534 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.865539:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e80ae00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066791.865543:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b534 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.865548:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b534 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.865555:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066791.865557:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066791.865559:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b534 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.865563:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80ae00/0xfb36a14ee608b534 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066791.865588:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b52d lrc: 1/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e554 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.865594:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b800/0xfb36a14ee608b52d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e554 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.865605:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e80b800, rc 0) 00000100:00100000:2.0:1746066791.865650:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31599:x1830882976924672:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 254us (416us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066791.865656:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9978 00000100:00100000:0.0:1746066791.866096:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.866266:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976924800 00000100:00100000:1.0:1746066791.866270:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976924800 00000100:00100000:1.0:1746066791.866291:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14530 00000100:00100000:1.0:1746066791.866296:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:31594:x1830882976924800:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066791.866303:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.866313:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e55b expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.866330:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608b400 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e482 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.866337:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e80a800/0xfb36a14ee608b4e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e531 expref: 8 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.866344:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009288be00/0xfb36a14ee608b43f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c1 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.866350:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.866351:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066791.866354:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 6/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1048576->2007039] (req 1048576->2007039) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 28 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.866373:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009288be00/0xfb36a14ee608b43f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c1 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.866382:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009288be00/0xfb36a14ee608b43f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c1 expref: 28 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066791.866390:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976840704:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.866550:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e80a800/0xfb36a14ee608b4e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e531 expref: 8 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.866557:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e80a800/0xfb36a14ee608b4e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e531 expref: 8 pid: 9776 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746066791.866564:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976840832:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.866583:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608b400 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e482 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.866589:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608b400 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e482 expref: 21 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066791.866600:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976840960:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066791.866609:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.869766:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.869867:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976840704:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066791.869878:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976840832:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066791.869885:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976840960:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.869912:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1048576->2007039] (req 1048576->2007039) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 28 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.869925:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a0200, rc 0) 00000100:00100000:1.0:1746066791.869968:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31594:x1830882976924800:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3671us (3873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.869975:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14530 00000100:00100000:3.0:1746066791.870030:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976925312 00000100:00100000:3.0:1746066791.870035:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976925312 00000100:00100000:3.0:1746066791.870063:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4158 00000100:00100000:3.0:1746066791.870068:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31599:x1830882976925312:12345-192.168.202.57@tcp:35:mirror_io.0 00000100:00100000:3.0:1746066791.870205:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31599:x1830882976925312:12345-192.168.202.57@tcp:35:mirror_io.0 Request processed in 136us (445us total) trans 8589944029 rc 0/0 00000100:00100000:3.0:1746066791.870211:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4158 00000100:00100000:0.0:1746066791.871165:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.871200:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.871261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.871336:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976924928 00000100:00100000:2.0:1746066791.871341:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976924928 00010000:00010000:2.0:1746066791.871360:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009288be00/0xfb36a14ee608b43f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c1 expref: 28 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066791.871379:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976925440 00000100:00100000:2.0:1746066791.871381:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976925440 00010000:00010000:2.0:1746066791.871389:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608b400 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e482 expref: 22 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066791.871399:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976925056 00000100:00100000:2.0:1746066791.871401:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976925056 00010000:00010000:2.0:1746066791.871408:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e80a800/0xfb36a14ee608b4e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e531 expref: 9 pid: 9776 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746066791.871420:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7450 00000100:00100000:2.0:1746066791.871425:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882976924928:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.871434:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066791.871450:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009288be00/0xfb36a14ee608b43f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c1 expref: 28 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.871459:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009288be00/0xfb36a14ee608b43f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c1 expref: 28 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.871478:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009288be00/0xfb36a14ee608b43f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4c1 expref: 28 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.871488:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.871506:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882976924928:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 81us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.871511:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7450 00000100:00100000:2.0:1746066791.871521:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7451 00000100:00100000:2.0:1746066791.871526:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882976925440:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.871532:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066791.871538:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608b400 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e482 expref: 22 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.871544:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608b400 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e482 expref: 22 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.871554:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608b400 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e482 expref: 22 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.871562:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.871574:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882976925440:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 48us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.871578:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7451 00000100:00100000:2.0:1746066791.871587:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7452 00000100:00100000:2.0:1746066791.871592:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976925056:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.871598:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066791.871603:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e80a800/0xfb36a14ee608b4e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e531 expref: 9 pid: 9776 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746066791.871621:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e80a800/0xfb36a14ee608b4e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e531 expref: 9 pid: 9776 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746066791.871632:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e80a800/0xfb36a14ee608b4e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e531 expref: 9 pid: 9776 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746066791.871640:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.871641:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.871647:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2007039) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.871654:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2007039) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.871693:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2007039) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.871703:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976841088:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066791.871736:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.878127:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976841088:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066791.878147:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066791.878382:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976925056:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6786us (7118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066791.878392:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7452 00000100:00100000:1.0:1746066791.878510:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.878628:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976925696 00000100:00100000:0.0:1746066791.878633:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976925696 00000100:00100000:0.0:1746066791.878699:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9979 00000100:00100000:0.0:1746066791.878707:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:31603:x1830882976925696:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066791.878726:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066791.878741:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09e00/0xfb36a14ee608b542 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e562 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.878827:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08400/0xfb36a14ee608b549 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.878837:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08400/0xfb36a14ee608b549 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.878845:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08400/0xfb36a14ee608b549 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.878863:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b550 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.878867:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.878871:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.878944:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09800/0xfb36a14ee608b557 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.878950:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09800/0xfb36a14ee608b557 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.878954:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09800/0xfb36a14ee608b557 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:0.0:1746066791.878960:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066791.879016:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08400/0xfb36a14ee608b549 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.879021:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08400/0xfb36a14ee608b549 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.879025:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08400/0xfb36a14ee608b549 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.879029:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eb08400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066791.879032:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08400/0xfb36a14ee608b549 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.879037:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08400/0xfb36a14ee608b549 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.879045:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066791.879047:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066791.879050:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08400/0xfb36a14ee608b549 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.879054:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08400/0xfb36a14ee608b549 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.879064:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b550 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.879068:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b550 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.879072:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b550 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.879075:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eb09200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066791.879077:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b550 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.879080:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b550 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.879084:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012dc13200) 00010000:00010000:0.0:1746066791.879086:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066791.879087:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b550 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.879091:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b550 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066791.879114:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09e00/0xfb36a14ee608b542 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e562 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.879124:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09800/0xfb36a14ee608b557 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e562 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066791.879130:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:0.0:1746066791.879132:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066791.879134:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb09800, rc 0) 00000100:00100000:0.0:1746066791.879326:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+14:31603:x1830882976925696:12345-192.168.202.57@tcp:101:cat.0 Request processed in 618us (814us total) trans 8589944030 rc 0/0 00000100:00100000:0.0:1746066791.879331:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9979 00000100:00100000:0.0:1746066791.880645:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.880711:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976925952 00000100:00100000:2.0:1746066791.880716:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976925952 00002000:00100000:2.0:1746066791.880741:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (2002944->2007039) req@ffff88009b472d80 x1830882976925952/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.880755:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b472d80 with x1830882976925952 ext(2002944->2007039) 00002000:00010000:2.0:1746066791.880759:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b472d80 00000100:00100000:2.0:1746066791.880773:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6570 00000100:00100000:2.0:1746066791.880778:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882976925952:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066791.880904:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882976925952:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 126us (261us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066791.880909:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6570 00002000:00100000:2.0:1746066791.880913:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (2002944->2007039) req@ffff88009b472d80 x1830882976925952/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/4536 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.880919:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b472d80 with x1830882976925952 ext(2002944->2007039) 00002000:00010000:2.0:1746066791.880921:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b472d80 00000100:00100000:0.0:1746066791.882774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.882840:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976926080 00000100:00100000:1.0:1746066791.882844:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976926080 00000100:00100000:1.0:1746066791.882878:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14531 00000100:00100000:1.0:1746066791.882884:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882976926080:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066791.882895:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.882907:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0000/0xfb36a14ee608b565 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e569 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.882947:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976841216:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066791.883006:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.883924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.883957:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.883975:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976926208 00000100:00100000:2.0:1746066791.883978:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976926208 00000100:00100000:2.0:1746066791.884009:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976926336 00000100:00100000:2.0:1746066791.884011:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976926336 00000100:00100000:2.0:1746066791.884034:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14532 00000100:00100000:2.0:1746066791.884039:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+31:1964:x1830882976926208:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066791.884050:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.884059:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e80b600/0xfb36a14ee608b56c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e570 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066791.884066:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14533 00000100:00100000:0.0:1746066791.884075:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882976926336:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066791.884080:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066791.884084:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976841344:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066791.884087:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb08200/0xfb36a14ee608b573 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e577 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066791.884104:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b470000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976841472:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066791.884128:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.884129:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066791.886163:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.886206:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976926592 00000100:00100000:2.0:1746066791.886212:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976926592 00000100:00100000:2.0:1746066791.886252:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4159 00000100:00100000:2.0:1746066791.886258:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f5ac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:31594:x1830882976926592:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066791.886413:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f5ac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:31594:x1830882976926592:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 155us (254us total) trans 8589944031 rc 0/0 00000100:00100000:2.0:1746066791.886419:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4159 00000100:00100000:1.0:1746066791.886636:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976841216:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066791.886660:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0000/0xfb36a14ee608b565 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e569 expref: 24 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.886670:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0000/0xfb36a14ee608b565 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e569 expref: 24 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.886708:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a0000, rc 0) 00000100:00100000:1.0:1746066791.886726:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882976926080:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3842us (3955us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066791.886732:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14531 00002000:00010000:3.0:1746066791.887252:0:21973:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime: 1746066790 -> 1746066791 00000100:00100000:3.0:1746066791.887266:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976841344:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066791.887281:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e80b600/0xfb36a14ee608b56c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e570 expref: 32 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.887289:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e80b600/0xfb36a14ee608b56c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e570 expref: 32 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.887306:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e80b600, rc 0) 00002000:00010000:1.0:1746066791.888038:0:4614:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime: 1746066790 -> 1746066791 00002000:00010000:1.0:1746066791.888041:0:4614:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime: 1746066790 -> 1746066791 00000100:00100000:1.0:1746066791.888050:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b470000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976841472:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066791.888067:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb08200/0xfb36a14ee608b573 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e577 expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.888074:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb08200/0xfb36a14ee608b573 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e577 expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066791.888081:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb08200, rc 0) 00000100:00100000:3.0:1746066791.888142:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+31:1964:x1830882976926208:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4101us (4218us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066791.888148:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14532 00000100:00100000:1.0:1746066791.888553:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882976926336:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4481us (4594us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066791.888558:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14533 00000100:00100000:0.0:1746066791.891054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.891276:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976926720 00000100:00100000:1.0:1746066791.891282:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976926720 00000100:00100000:1.0:1746066791.891360:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14534 00000100:00100000:1.0:1746066791.891367:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:31603:x1830882976926720:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066791.891382:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.891396:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b57a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e57e expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.891416:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->229375) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.891423:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066791.891424:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066791.891427:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b57a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e57e expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.891452:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->229375) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.891461:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->229375) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 26 pid: 10402 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066791.891471:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976841600:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066791.892158:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.892719:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976841600:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.892738:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b57a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e57e expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.892899:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a1a00, rc 0) 00000100:00100000:1.0:1746066791.892936:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:31603:x1830882976926720:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1569us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.892942:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14534 00000100:00100000:0.0:1746066791.893125:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.893303:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976926848 00000100:00100000:2.0:1746066791.893307:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976926848 00002000:00100000:2.0:1746066791.893335:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (188416->229375) req@ffff88009b470a80 x1830882976926848/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.893343:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470a80 with x1830882976926848 ext(188416->229375) 00010000:00010000:2.0:1746066791.893348:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->229375) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 27 pid: 10402 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.893358:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->229375) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 27 pid: 10402 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066791.893363:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b470a80 00000100:00100000:2.0:1746066791.893377:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2137 00000100:00100000:2.0:1746066791.893382:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882976926848:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:2.0:1746066791.895480:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882976926848:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 2092us (2349us total) trans 17179873590 rc 0/0 00000100:00100000:2.0:1746066791.895490:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2137 00002000:00100000:2.0:1746066791.895497:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (188416->229375) req@ffff88009b470a80 x1830882976926848/t17179873590(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/448 e 0 to 0 dl 1746066802 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.895510:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470a80 with x1830882976926848 ext(188416->229375) 00010000:00010000:2.0:1746066791.895516:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->229375) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 29 pid: 10402 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.895529:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->229375) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 29 pid: 10402 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066791.895536:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b470a80 00000100:00100000:0.0:1746066791.896959:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.897053:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976926976 00000100:00100000:2.0:1746066791.897060:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976926976 00010000:00010000:2.0:1746066791.897082:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 188416->229375) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 29 pid: 10402 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066791.897411:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7453 00000100:00100000:2.0:1746066791.897419:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1966:x1830882976926976:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.897430:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066791.897444:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 188416->229375) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 29 pid: 10402 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.897454:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 188416->229375) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 29 pid: 10402 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.897472:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b46ba00/0xfb36a14ee608b3f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 188416->229375) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e47b expref: 29 pid: 10402 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.897497:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.897499:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.897505:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b57a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e57e expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.897512:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e57e expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.897538:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e57e expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.897548:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976841728:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066791.897665:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066791.899232:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976841728:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066791.899248:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.899273:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882976926976:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1855us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.899281:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7453 00000100:00100000:0.0:1746066791.902394:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066791.902427:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.902498:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976927360 00000100:00100000:2.0:1746066791.902505:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976927360 00002000:00100000:2.0:1746066791.902539:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009b471880 x1830882976927360/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066791.902541:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976927488 00000100:00100000:1.0:1746066791.902545:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976927488 00002000:00100000:2.0:1746066791.902547:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b471880 with x1830882976927360 ext(1048576->2097151) 00002000:00010000:2.0:1746066791.902552:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b471880 00002000:00100000:1.0:1746066791.902558:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009244f800 x1830882976927488/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.902563:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244f800 with x1830882976927488 ext(0->1048575) 00002000:00010000:1.0:1746066791.902566:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244f800 00000100:00100000:2.0:1746066791.902577:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6571 00000100:00100000:2.0:1746066791.902582:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+31:1964:x1830882976927360:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066791.902584:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6572 00000100:00100000:1.0:1746066791.902589:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882976927488:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066791.912359:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+31:1964:x1830882976927360:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9768us (9962us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066791.912369:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6571 00002000:00100000:3.0:1746066791.912379:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009b471880 x1830882976927360/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066791.912393:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b471880 with x1830882976927360 ext(1048576->2097151) 00002000:00010000:3.0:1746066791.912398:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b471880 00000100:00100000:1.0:1746066791.918136:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882976927488:12345-192.168.202.57@tcp:3:cat.0 Request processed in 15538us (15699us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066791.918146:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6572 00002000:00100000:1.0:1746066791.918156:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009244f800 x1830882976927488/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.918164:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244f800 with x1830882976927488 ext(0->1048575) 00002000:00010000:1.0:1746066791.918169:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244f800 00000100:00100000:0.0:1746066791.935797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.936035:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976927616 00000100:00100000:1.0:1746066791.936043:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976927616 00000100:00100000:1.0:1746066791.936087:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14535 00000100:00100000:1.0:1746066791.936092:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+31:31603:x1830882976927616:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066791.936105:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.936117:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b581 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e585 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.936139:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 32 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.936143:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066791.936144:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066791.936146:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b581 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e585 expref: 32 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.936166:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 32 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.936173:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 32 pid: 21973 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066791.936180:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976841856:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066791.936832:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.938932:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976841856:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066791.938956:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b581 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e585 expref: 32 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066791.938969:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a1600, rc 0) 00000100:00100000:1.0:1746066791.939014:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+32:31603:x1830882976927616:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2920us (3223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066791.939021:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14535 00000100:00100000:0.0:1746066791.939531:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.939590:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976927744 00000100:00100000:1.0:1746066791.939595:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976927744 00002000:00100000:1.0:1746066791.939634:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (2043904->2097151) req@ffff88009244c700 x1830882976927744/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.939642:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244c700 with x1830882976927744 ext(2043904->2097151) 00010000:00010000:1.0:1746066791.939648:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 33 pid: 21973 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066791.939658:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 33 pid: 21973 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746066791.939664:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009244c700 00000100:00100000:1.0:1746066791.940559:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2138 00000100:00100000:1.0:1746066791.940567:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882976927744:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:1.0:1746066791.943850:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1963:x1830882976927744:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 3278us (4313us total) trans 21474840913 rc 0/0 00000100:00100000:1.0:1746066791.943860:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2138 00002000:00100000:1.0:1746066791.943868:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (2043904->2097151) req@ffff88009244c700 x1830882976927744/t21474840913(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/448 e 0 to 0 dl 1746066802 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.943877:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244c700 with x1830882976927744 ext(2043904->2097151) 00010000:00010000:1.0:1746066791.943884:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 35 pid: 21973 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066791.943897:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 35 pid: 21973 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746066791.943908:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009244c700 00000100:00100000:0.0:1746066791.946751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.946960:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976927872 00000100:00100000:2.0:1746066791.946970:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976927872 00010000:00010000:2.0:1746066791.947006:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 35 pid: 21973 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066791.947578:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7454 00000100:00100000:2.0:1746066791.947586:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1963:x1830882976927872:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066791.947597:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066791.947626:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 35 pid: 21973 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.947637:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 35 pid: 21973 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.947654:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1400/0xfb36a14ee608b511 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2043904->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e546 expref: 35 pid: 21973 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.948054:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.948056:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066791.948064:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b581 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e585 expref: 31 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.948072:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b581 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e585 expref: 31 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.948102:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b581 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e585 expref: 31 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066791.948113:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976841984:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066791.949698:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066791.951193:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976841984:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066791.951211:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066791.951241:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882976927872:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3656us (4503us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066791.951250:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7454 00000100:00100000:0.0:1746066791.954503:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.955452:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976928128 00000100:00100000:1.0:1746066791.955460:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976928128 00002000:00100000:1.0:1746066791.955494:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880135430700 x1830882976928128/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.955502:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135430700 with x1830882976928128 ext(1048576->2097151) 00002000:00010000:1.0:1746066791.955506:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135430700 00000100:00100000:1.0:1746066791.955964:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6573 00000100:00100000:1.0:1746066791.955972:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+32:1963:x1830882976928128:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066791.962936:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+32:1963:x1830882976928128:12345-192.168.202.57@tcp:3:cat.0 Request processed in 6956us (8432us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066791.962947:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6573 00002000:00100000:1.0:1746066791.962957:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880135430700 x1830882976928128/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:197/0 lens 488/440 e 0 to 0 dl 1746066802 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066791.962965:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135430700 with x1830882976928128 ext(1048576->2097151) 00002000:00010000:1.0:1746066791.962970:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135430700 00000100:00100000:0.0:1746066791.966482:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066791.966578:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976928256 00000100:00100000:1.0:1746066791.966586:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976928256 00000100:00100000:3.0:1746066791.966936:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14536 00000100:00100000:3.0:1746066791.966945:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+22:31603:x1830882976928256:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066791.966960:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.966974:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608b588 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e58c expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.966996:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2007039) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 27 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.967002:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066791.967004:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066791.967007:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608b588 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e58c expref: 23 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.967032:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2007039) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 27 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.967042:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2007039) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 27 pid: 8451 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066791.967051:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976842112:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066791.967124:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.970917:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976842112:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066791.970945:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608b588 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e58c expref: 23 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.970960:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f24e00, rc 0) 00000100:00100000:3.0:1746066791.971262:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+23:31603:x1830882976928256:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4089us (4558us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.971272:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14536 00000100:00100000:0.0:1746066791.971367:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.971551:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976928384 00000100:00100000:2.0:1746066791.971557:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976928384 00002000:00100000:2.0:1746066791.971589:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2007039) req@ffff880135433800 x1830882976928384/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/0 e 0 to 0 dl 1746066802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.971597:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135433800 with x1830882976928384 ext(1048576->2007039) 00010000:00010000:2.0:1746066791.971603:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 28 pid: 8451 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.971626:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 28 pid: 8451 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066791.971632:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135433800 00000100:00100000:2.0:1746066791.971656:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2139 00000100:00100000:2.0:1746066791.971662:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882976928384:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066791.976633:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066791.976723:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976928640 00000100:00100000:2.0:1746066791.976731:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976928640 00000100:00100000:2.0:1746066791.977327:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9980 00000100:00100000:2.0:1746066791.977335:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:31608:x1830882976928640:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066791.977352:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066791.977487:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80be00/0xfb36a14ee608b58f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e593 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.977582:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130770800/0xfb36a14ee608b596 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977594:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130770800/0xfb36a14ee608b596 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977603:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130770800/0xfb36a14ee608b596 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977629:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608b59d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977635:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608b59d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977640:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608b59d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977769:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608b5a4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977778:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608b5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977784:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608b5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746066791.977792:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066791.977873:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130770800/0xfb36a14ee608b596 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977880:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130770800/0xfb36a14ee608b596 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977886:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130770800/0xfb36a14ee608b596 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977890:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130770800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066791.977893:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130770800/0xfb36a14ee608b596 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977899:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130770800/0xfb36a14ee608b596 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977908:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066791.977910:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066791.977914:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130770800/0xfb36a14ee608b596 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977917:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130770800/0xfb36a14ee608b596 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977938:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608b59d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977943:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608b59d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977948:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608b59d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977951:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092489800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066791.977952:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608b59d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977956:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608b59d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977965:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec74500) 00010000:00010000:2.0:1746066791.977967:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066791.977969:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608b59d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.977972:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608b59d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066791.978001:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80be00/0xfb36a14ee608b58f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e593 expref: 260 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.978011:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608b5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e593 expref: 259 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.978016:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066791.978018:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066791.978020:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092489e00, rc 0) 00000100:00100000:2.0:1746066791.978649:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:31608:x1830882976928640:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1312us (2020us total) trans 8589944032 rc 0/0 00000100:00100000:2.0:1746066791.978656:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9980 00000100:00100000:0.0:1746066791.984525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.984604:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976928768 00000100:00100000:3.0:1746066791.984619:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976928768 00000100:00100000:3.0:1746066791.984663:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14537 00000100:00100000:3.0:1746066791.984669:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882976928768:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066791.984699:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.984712:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25200/0xfb36a14ee608b5b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e59a expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.984729:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.984731:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.984738:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25200/0xfb36a14ee608b5b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e59a expref: 31 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.984750:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25200/0xfb36a14ee608b5b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e59a expref: 31 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066791.984759:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f25200, rc 0) 00000100:00100000:3.0:1746066791.984805:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882976928768:12345-192.168.202.57@tcp:101:cat.0 Request processed in 135us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.984810:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14537 00000100:00100000:2.0:1746066791.988449:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882976928384:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 16780us (17075us total) trans 17179873591 rc 0/0 00000100:00100000:2.0:1746066791.988460:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2139 00002000:00100000:2.0:1746066791.988469:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2007039) req@ffff880135433800 x1830882976928384/t17179873591(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:197/0 lens 488/448 e 0 to 0 dl 1746066802 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066791.988478:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135433800 with x1830882976928384 ext(1048576->2007039) 00010000:00010000:2.0:1746066791.988486:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 31 pid: 8451 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066791.988500:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 31 pid: 8451 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066791.988506:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135433800 00000100:00100000:0.0:1746066791.993804:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.994163:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976928896 00000100:00100000:0.0:1746066791.994163:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.994171:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976928896 00000100:00100000:0.0:1746066791.994194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.994202:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976929024 00000100:00100000:3.0:1746066791.994204:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976929024 00000100:00100000:0.0:1746066791.994218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066791.994279:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976929152 00000100:00100000:3.0:1746066791.994281:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976929152 00000100:00100000:0.0:1746066791.994289:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976929280 00000100:00100000:0.0:1746066791.994292:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976929280 00000100:00100000:3.0:1746066791.994297:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14538 00000100:00100000:3.0:1746066791.994304:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882976928896:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:0.0:1746066791.994316:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14539 00010000:00010000:3.0:1746066791.994320:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066791.994322:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14540 00000100:00100000:0.0:1746066791.994322:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882976929024:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:2.0:1746066791.994329:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882976929152:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066791.994329:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066791.994334:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608b5b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e5a1 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.994336:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066791.994338:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec01c00/0xfb36a14ee608b5c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e5a8 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066791.994344:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e80be00/0xfb36a14ee608b5c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e5af expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066791.994352:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.994354:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066791.994360:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608b5b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5a1 expref: 36 pid: 21973 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066791.994373:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976842240:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066791.994374:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608b5b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5a1 expref: 36 pid: 21973 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066791.994376:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976842368:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066791.994382:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f25600, rc 0) 00000100:00100000:2.0:1746066791.994424:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066791.994430:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14541 00000100:00100000:1.0:1746066791.994437:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882976929280:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066791.994444:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066791.994451:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b5ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e5b6 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066791.994475:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976842496:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066791.994562:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540d900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066791.994566:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1964:x1830882976928896:12345-192.168.202.57@tcp:101:cat.0 Request processed in 261us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066791.994572:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14538 00000100:00100000:1.0:1746066791.994720:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066792.000040:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976842496:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066792.000069:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b5ce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5b6 expref: 36 pid: 20532 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066792.000072:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976842240:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066792.000080:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b5ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5b6 expref: 36 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066792.000092:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e80be00/0xfb36a14ee608b5c7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5af expref: 34 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.000095:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a1200, rc 0) 00010000:00010000:3.0:1746066792.000105:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e80be00/0xfb36a14ee608b5c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5af expref: 34 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066792.000126:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e80be00, rc 0) 00000100:00100000:2.0:1746066792.000172:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976842368:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066792.000189:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec01c00/0xfb36a14ee608b5c0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5a8 expref: 33 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.000202:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec01c00/0xfb36a14ee608b5c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5a8 expref: 33 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.000215:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec01c00, rc 0) 00000100:00100000:3.0:1746066792.000223:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882976929152:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5893us (6027us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066792.000223:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882976929280:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5785us (6003us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066792.000230:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14540 00000100:00100000:2.0:1746066792.000232:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882976929024:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5911us (6070us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066792.000235:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14541 00000100:00100000:2.0:1746066792.000237:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14539 00000100:00100000:0.0:1746066792.003097:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.003200:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976929408 00000100:00100000:2.0:1746066792.003207:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976929408 00010000:00010000:2.0:1746066792.003235:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 31 pid: 8451 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.003269:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7455 00000100:00100000:2.0:1746066792.003275:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882976929408:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066792.003285:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066792.003706:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 31 pid: 8451 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.003717:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2007039) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 31 pid: 8451 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.003735:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0200/0xfb36a14ee608b53b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2007039) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e55b expref: 31 pid: 8451 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.003747:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.003749:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.003754:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608b588 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e58c expref: 22 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.003761:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608b588 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e58c expref: 22 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.003797:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608b588 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e58c expref: 22 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066792.003806:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976842624:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066792.003873:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.009123:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.009419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.009963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.010050:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976929536 00000100:00100000:1.0:1746066792.010058:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976929536 00000100:00100000:0.0:1746066792.011098:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.011165:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976930048 00000100:00100000:3.0:1746066792.011170:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976930048 00000100:00100000:3.0:1746066792.011202:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9981 00000100:00100000:3.0:1746066792.011208:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+14:31610:x1830882976930048:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066792.011231:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.011247:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608b5d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e5d2 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.011325:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066792.011337:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09800/0xfb36a14ee608b557 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e562 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.011344:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608b5a4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e593 expref: 258 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.011349:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 5/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066792.011379:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608b5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e593 expref: 258 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.011390:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608b5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e593 expref: 258 pid: 14548 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.011400:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976842752:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066792.011463:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09800/0xfb36a14ee608b557 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e562 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.011470:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09800/0xfb36a14ee608b557 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e562 expref: 15 pid: 14548 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.011477:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976842880:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066792.011494:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066792.012301:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976929792 00000100:00100000:1.0:1746066792.012306:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976929792 00000100:00100000:1.0:1746066792.012329:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976929664 00000100:00100000:1.0:1746066792.012331:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976929664 00000100:00100000:1.0:1746066792.012346:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14542 00000100:00100000:1.0:1746066792.012351:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882976929536:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.012361:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.012371:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0000/0xfb36a14ee608b5e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e5bd expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.012398:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.012403:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.012409:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0000/0xfb36a14ee608b5e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5bd expref: 33 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.012424:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0000/0xfb36a14ee608b5e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5bd expref: 33 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.012433:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a0000, rc 0) 00000100:00100000:1.0:1746066792.012470:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882976929536:12345-192.168.202.57@tcp:101:cat.0 Request processed in 118us (3356us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066792.012475:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14542 00000100:00100000:1.0:1746066792.012496:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14543 00000100:00100000:1.0:1746066792.012504:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882976929792:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.012510:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.012519:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0400/0xfb36a14ee608b5ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e5cb expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066792.012543:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976843008:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066792.012585:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066792.012604:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14544 00000100:00100000:1.0:1746066792.012620:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882976929664:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.012626:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.012633:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093630000/0xfb36a14ee608b5f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e5c4 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066792.013399:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976843136:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066792.013443:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066792.013640:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976842624:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066792.013653:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.013695:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882976929408:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 10419us (10603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.013702:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7455 00000100:00100000:0.0:1746066792.017972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.018099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.018282:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976930304 00000100:00100000:2.0:1746066792.018288:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976930304 00002000:00100000:2.0:1746066792.018322:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009e842d80 x1830882976930304/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.018331:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e842d80 with x1830882976930304 ext(1048576->2097151) 00002000:00010000:2.0:1746066792.018336:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e842d80 00000100:00100000:2.0:1746066792.018360:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6574 00000100:00100000:2.0:1746066792.018366:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882976930304:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066792.018693:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976842752:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066792.018704:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976842880:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066792.018726:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746066792.018746:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976930560 00000100:00100000:3.0:1746066792.018749:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976930560 00010000:00010000:3.0:1746066792.018767:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608b5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e593 expref: 259 pid: 14548 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.018784:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7456 00000100:00100000:3.0:1746066792.018789:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:1965:x1830882976930560:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.018797:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.018802:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608b5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e593 expref: 259 pid: 14548 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.018810:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608b5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e593 expref: 259 pid: 14548 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.018826:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608b5a4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e593 expref: 259 pid: 14548 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.018847:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066792.018850:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066792.018857:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066792.018861:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.018896:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+258:1965:x1830882976930560:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 107us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.018902:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7456 00000100:00100000:0.0:1746066792.019483:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.019784:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976843136:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066792.019803:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093630000/0xfb36a14ee608b5f1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5c4 expref: 32 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.019812:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093630000/0xfb36a14ee608b5f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5c4 expref: 32 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066792.020763:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976843008:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066792.020782:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0400/0xfb36a14ee608b5ea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5cb expref: 36 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.020791:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0400/0xfb36a14ee608b5ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5cb expref: 36 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.020804:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a0400, rc 0) 00000100:00100000:0.0:1746066792.020832:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882976929792:12345-192.168.202.57@tcp:101:cat.0 Request processed in 8331us (11413us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066792.020839:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14543 00010000:00010000:1.0:1746066792.022647:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093630000, rc 0) 00000100:00100000:3.0:1746066792.023247:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976930432 00000100:00100000:3.0:1746066792.023253:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976930432 00010000:00010000:3.0:1746066792.023280:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09800/0xfb36a14ee608b557 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e562 expref: 16 pid: 14548 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.023303:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7457 00000100:00100000:3.0:1746066792.023309:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882976930432:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.023318:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.023323:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09800/0xfb36a14ee608b557 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e562 expref: 16 pid: 14548 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.023333:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09800/0xfb36a14ee608b557 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e562 expref: 16 pid: 14548 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.023349:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09800/0xfb36a14ee608b557 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e562 expref: 16 pid: 14548 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.023359:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066792.023364:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066792.023372:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066792.023377:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066792.023391:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066792.023467:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882976929664:12345-192.168.202.57@tcp:101:cat.0 Request processed in 10855us (12368us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066792.023474:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14544 00010000:00010000:2.0:1746066792.023772:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.023780:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746066792.023796:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066792.023913:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608b5d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5d2 expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.023929:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5d2 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.023934:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066792.023936:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066792.023938:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f25c00, rc 0) 00000100:00100000:2.0:1746066792.023956:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+16:31610:x1830882976930048:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 12748us (13994us total) trans 8589944033 rc 0/0 00000100:00100000:2.0:1746066792.023963:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9981 00000100:00100000:3.0:1746066792.024572:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882976930432:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1261us (5087us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.024581:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7457 00000100:00100000:2.0:1746066792.031298:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882976930304:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12925us (13326us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066792.031308:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6574 00002000:00100000:2.0:1746066792.031318:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009e842d80 x1830882976930304/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.031326:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e842d80 with x1830882976930304 ext(1048576->2097151) 00002000:00010000:2.0:1746066792.031331:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e842d80 00000100:00100000:0.0:1746066792.044765:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.044849:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976930816 00000100:00100000:2.0:1746066792.044856:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976930816 00002000:00100000:2.0:1746066792.044889:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e843480 x1830882976930816/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.044898:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e843480 with x1830882976930816 ext(0->1048575) 00002000:00010000:2.0:1746066792.044903:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e843480 00000100:00100000:2.0:1746066792.044929:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6575 00000100:00100000:2.0:1746066792.044936:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1965:x1830882976930816:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066792.047987:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.048582:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.048769:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.048794:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976931328 00000100:00100000:0.0:1746066792.048800:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976931328 00002000:00100000:0.0:1746066792.048836:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009ef59500 x1830882976931328/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.048844:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef59500 with x1830882976931328 ext(1048576->2097151) 00002000:00010000:0.0:1746066792.048849:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef59500 00000100:00100000:2.0:1746066792.050579:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976931072 00000100:00100000:2.0:1746066792.050587:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976931072 00000100:00100000:3.0:1746066792.051097:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976931584 00000100:00100000:3.0:1746066792.051101:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976931584 00000100:00100000:2.0:1746066792.051102:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9982 00000100:00100000:2.0:1746066792.051108:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+258:31613:x1830882976931072:12345-192.168.202.57@tcp:101:multiop.0 00002000:00100000:3.0:1746066792.051122:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009ef5b800 x1830882976931584/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746066792.051124:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746066792.051129:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5b800 with x1830882976931584 ext(1048576->2097151) 00002000:00010000:3.0:1746066792.051133:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef5b800 00010000:00010000:2.0:1746066792.051138:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b5ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e5d9 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066792.051144:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6576 00000100:00100000:3.0:1746066792.051148:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1966:x1830882976931328:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:2.0:1746066792.051212:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b606 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051221:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b606 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051229:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b606 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051238:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80be00/0xfb36a14ee608b60d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051242:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80be00/0xfb36a14ee608b60d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051247:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80be00/0xfb36a14ee608b60d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051331:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e70000/0xfb36a14ee608b614 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051337:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e70000/0xfb36a14ee608b614 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051341:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e70000/0xfb36a14ee608b614 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746066792.051347:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066792.051405:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b606 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051410:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b606 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051414:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b606 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051422:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3a0200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066792.051425:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b606 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051429:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b606 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051437:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066792.051440:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066792.051442:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b606 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051446:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b606 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051458:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80be00/0xfb36a14ee608b60d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051462:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80be00/0xfb36a14ee608b60d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051465:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80be00/0xfb36a14ee608b60d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051468:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e80be00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066792.051470:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80be00/0xfb36a14ee608b60d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051473:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80be00/0xfb36a14ee608b60d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051477:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec74e00) 00010000:00010000:2.0:1746066792.051479:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066792.051480:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80be00/0xfb36a14ee608b60d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051484:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80be00/0xfb36a14ee608b60d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066792.051508:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3a1200/0xfb36a14ee608b5ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5d9 expref: 261 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.051954:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e70000/0xfb36a14ee608b614 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5d9 expref: 260 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.051962:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066792.051963:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066792.051966:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e70000, rc 0) 00000100:00100000:2.0:1746066792.052010:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:31613:x1830882976931072:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 902us (3241us total) trans 8589944034 rc 0/0 00000100:00100000:2.0:1746066792.052016:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9982 00000100:00100000:3.0:1746066792.052078:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6577 00000100:00100000:3.0:1746066792.052083:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1966:x1830882976931584:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066792.054139:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.054169:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.054193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.054222:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976931840 00000100:00100000:2.0:1746066792.054222:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976932096 00000100:00100000:3.0:1746066792.054228:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976931840 00000100:00100000:2.0:1746066792.054228:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976932096 00002000:00100000:3.0:1746066792.054257:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880135f82d80 x1830882976931840/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.054257:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135f82a00 x1830882976932096/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.054266:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f82d80 with x1830882976931840 ext(2097152->3145727) 00002000:00100000:2.0:1746066792.054266:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f82a00 with x1830882976932096 ext(3145728->4194303) 00002000:00010000:3.0:1746066792.054271:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135f82d80 00002000:00010000:2.0:1746066792.054271:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135f82a00 00000100:00100000:2.0:1746066792.054281:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976932352 00000100:00100000:2.0:1746066792.054283:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976932352 00002000:00100000:2.0:1746066792.054293:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a590d500 x1830882976932352/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066792.054294:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6578 00002000:00100000:2.0:1746066792.054300:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590d500 with x1830882976932352 ext(2097152->3145727) 00000100:00100000:3.0:1746066792.054301:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882976932096:12345-192.168.202.57@tcp:3:cat.0 00002000:00010000:2.0:1746066792.054303:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590d500 00000100:00100000:2.0:1746066792.054313:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6579 00000100:00100000:2.0:1746066792.054318:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882976931840:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066792.054351:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6580 00000100:00100000:2.0:1746066792.054356:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+32:1964:x1830882976932352:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066792.054506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.055060:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976932608 00000100:00100000:0.0:1746066792.055066:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976932608 00002000:00100000:0.0:1746066792.055095:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4149247) req@ffff88009f16fb80 x1830882976932608/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.055103:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16fb80 with x1830882976932608 ext(3145728->4149247) 00002000:00010000:0.0:1746066792.055106:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16fb80 00000100:00100000:0.0:1746066792.055146:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6581 00000100:00100000:0.0:1746066792.055154:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+34:1964:x1830882976932608:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066792.061507:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1965:x1830882976930816:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16563us (16740us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066792.061517:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6575 00002000:00100000:2.0:1746066792.061527:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e843480 x1830882976930816/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.061535:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e843480 with x1830882976930816 ext(0->1048575) 00002000:00010000:2.0:1746066792.061540:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e843480 00000100:00100000:0.0:1746066792.066104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.066593:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976932736 00000100:00100000:3.0:1746066792.066603:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976932736 00000100:00100000:3.0:1746066792.067198:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 702 00000100:00100000:3.0:1746066792.067209:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:1965:x1830882976932736:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.067228:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.067253:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e70000/0xfb36a14ee608b614 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5d9 expref: 260 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.067277:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066792.067282:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.068380:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:1965:x1830882976932736:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1172us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.068387:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 702 00000100:00100000:3.0:1746066792.072852:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1966:x1830882976931328:12345-192.168.202.57@tcp:3:cat.0 Request processed in 21697us (24866us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066792.072861:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6576 00002000:00100000:3.0:1746066792.072870:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009ef59500 x1830882976931328/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.072876:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef59500 with x1830882976931328 ext(1048576->2097151) 00002000:00010000:3.0:1746066792.072880:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef59500 00000100:00100000:3.0:1746066792.082662:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882976931584:12345-192.168.202.57@tcp:3:cat.0 Request processed in 30565us (34066us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066792.082711:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6577 00002000:00100000:3.0:1746066792.082727:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009ef5b800 x1830882976931584/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.082736:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5b800 with x1830882976931584 ext(1048576->2097151) 00002000:00010000:3.0:1746066792.082742:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef5b800 00000100:00100000:2.0:1746066792.088401:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+34:1964:x1830882976932352:12345-192.168.202.57@tcp:3:cat.0 Request processed in 34036us (34199us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066792.088411:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6580 00002000:00100000:2.0:1746066792.088421:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a590d500 x1830882976932352/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.088430:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590d500 with x1830882976932352 ext(2097152->3145727) 00002000:00010000:2.0:1746066792.088435:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590d500 00000100:00100000:3.0:1746066792.091849:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882976932096:12345-192.168.202.57@tcp:3:cat.0 Request processed in 37540us (37670us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066792.091860:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6578 00002000:00100000:3.0:1746066792.091870:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135f82a00 x1830882976932096/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.091878:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f82a00 with x1830882976932096 ext(3145728->4194303) 00002000:00010000:3.0:1746066792.091884:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135f82a00 00000100:00100000:0.0:1746066792.099188:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.099281:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.099303:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976932864 00000100:00100000:0.0:1746066792.099310:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976932864 00000100:00100000:3.0:1746066792.099589:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882976931840:12345-192.168.202.57@tcp:3:cat.0 Request processed in 45269us (45456us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066792.099598:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6579 00002000:00100000:3.0:1746066792.099608:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880135f82d80 x1830882976931840/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.099635:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f82d80 with x1830882976931840 ext(2097152->3145727) 00002000:00010000:3.0:1746066792.099639:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135f82d80 00000100:00100000:0.0:1746066792.100349:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976932992 00000100:00100000:0.0:1746066792.100353:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976932992 00000100:00100000:1.0:1746066792.100418:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14545 00000100:00100000:1.0:1746066792.100427:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882976932864:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.100438:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.100452:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e85bc00/0xfb36a14ee608b622 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e5e0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066792.100493:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976843264:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066792.100552:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.100811:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14546 00000100:00100000:0.0:1746066792.100819:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1966:x1830882976932992:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066792.100826:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066792.100835:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f737a00/0xfb36a14ee608b629 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e5e7 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066792.100858:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976843392:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066792.101577:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540d900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.116208:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+32:1964:x1830882976932608:12345-192.168.202.57@tcp:3:cat.0 Request processed in 61047us (61693us total) trans 0 rc 1003520/1003520 00000100:00100000:2.0:1746066792.116219:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6581 00002000:00100000:2.0:1746066792.116229:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4149247) req@ffff88009f16fb80 x1830882976932608/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1003520/1003520 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.116238:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16fb80 with x1830882976932608 ext(3145728->4149247) 00002000:00010000:2.0:1746066792.116243:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16fb80 00000100:00100000:2.0:1746066792.117744:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976843392:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066792.117773:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f737a00/0xfb36a14ee608b629 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5e7 expref: 36 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.117784:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f737a00/0xfb36a14ee608b629 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5e7 expref: 36 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.117806:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f737a00, rc 0) 00000100:00100000:2.0:1746066792.117830:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1966:x1830882976932992:12345-192.168.202.57@tcp:101:cat.0 Request processed in 17012us (18548us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066792.117835:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14546 00000100:00100000:1.0:1746066792.117905:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976843264:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066792.117921:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e85bc00/0xfb36a14ee608b622 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5e0 expref: 32 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.117929:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e85bc00/0xfb36a14ee608b622 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5e0 expref: 32 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.117939:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e85bc00, rc 0) 00000100:00100000:1.0:1746066792.117952:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882976932864:12345-192.168.202.57@tcp:101:cat.0 Request processed in 17529us (18773us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066792.117956:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14545 00000100:00100000:0.0:1746066792.126711:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.126786:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976933120 00000100:00100000:1.0:1746066792.126794:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976933120 00000100:00100000:1.0:1746066792.126841:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14547 00000100:00100000:1.0:1746066792.126848:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:31608:x1830882976933120:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.126866:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.126880:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e85ba00/0xfb36a14ee608b630 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e5ee expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.126905:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 22 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.126911:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066792.126913:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066792.126916:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e85ba00/0xfb36a14ee608b630 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5ee expref: 32 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.126941:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 22 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.126952:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 22 pid: 9776 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066792.126963:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976843520:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066792.128763:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.132114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.132197:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976933376 00000100:00100000:2.0:1746066792.132205:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976933376 00002000:00100000:2.0:1746066792.132242:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (4812800->5091327) req@ffff88009e840e00 x1830882976933376/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.132251:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e840e00 with x1830882976933376 ext(4812800->5091327) 00010000:00010000:2.0:1746066792.132259:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 23 pid: 9776 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.132277:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 23 pid: 9776 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066792.132283:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e840e00 00000100:00100000:2.0:1746066792.132805:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2140 00000100:00100000:2.0:1746066792.132814:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882976933376:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066792.134414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.134479:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976933504 00000100:00100000:3.0:1746066792.134485:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976933504 00002000:00100000:3.0:1746066792.134512:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4812799) req@ffff880135df9880 x1830882976933504/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.134521:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9880 with x1830882976933504 ext(4194304->4812799) 00010000:00010000:3.0:1746066792.134528:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 25 pid: 9776 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.134540:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 25 pid: 9776 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746066792.134546:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135df9880 00000100:00100000:3.0:1746066792.134563:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2141 00000100:00100000:3.0:1746066792.134568:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882976933504:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066792.135161:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976843520:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066792.135182:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e85ba00/0xfb36a14ee608b630 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5ee expref: 32 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.135194:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e85ba00, rc 0) 00000100:00100000:1.0:1746066792.135228:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:31608:x1830882976933120:12345-192.168.202.57@tcp:101:cat.0 Request processed in 8380us (8557us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066792.135234:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14547 00000100:00100000:3.0:1746066792.141944:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882976933376:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9123us (9827us total) trans 0 rc 278528/278528 00000100:00100000:3.0:1746066792.141955:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2140 00002000:00100000:3.0:1746066792.141965:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (4812800->5091327) req@ffff88009e840e00 x1830882976933376/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 278528/278528 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.141973:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e840e00 with x1830882976933376 ext(4812800->5091327) 00010000:00010000:3.0:1746066792.141981:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 25 pid: 9776 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.141994:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 25 pid: 9776 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746066792.142000:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e840e00 00000100:00100000:3.0:1746066792.147290:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882976933504:12345-192.168.202.57@tcp:4:cat.0 Request processed in 12712us (12871us total) trans 17179873592 rc 0/0 00000100:00100000:3.0:1746066792.147302:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2141 00002000:00100000:3.0:1746066792.147313:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4812799) req@ffff880135df9880 x1830882976933504/t17179873592(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/448 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.147322:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9880 with x1830882976933504 ext(4194304->4812799) 00010000:00010000:3.0:1746066792.147332:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 25 pid: 9776 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.147346:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 25 pid: 9776 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746066792.147353:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135df9880 00000100:00100000:0.0:1746066792.147827:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.148498:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976933632 00000100:00100000:1.0:1746066792.148504:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976933632 00000100:00100000:1.0:1746066792.148544:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14548 00000100:00100000:1.0:1746066792.148550:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882976933632:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.148563:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.148576:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e85b600/0xfb36a14ee608b637 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e5f5 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066792.148627:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976843648:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066792.148711:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.152389:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.152739:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976933760 00000100:00100000:3.0:1746066792.152747:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976933760 00010000:00010000:3.0:1746066792.152777:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 27 pid: 9776 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.152814:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7458 00000100:00100000:3.0:1746066792.152820:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882976933760:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.152832:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.152850:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 27 pid: 9776 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.152861:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 27 pid: 9776 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.152881:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.152883:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.152889:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e85ba00/0xfb36a14ee608b630 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5ee expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.152896:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e85ba00/0xfb36a14ee608b630 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5ee expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.152924:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e85ba00/0xfb36a14ee608b630 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5ee expref: 31 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066792.152941:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976843776:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066792.153000:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ea9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066792.153114:0:8450:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.57@tcp) returned -22 from glimpse AST (req@ffff88009f16c380 x1830882976843648) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 27 pid: 9776 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066792.153128:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d36b200/0xfb36a14ee608b4e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4812799) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e515 expref: 27 pid: 9776 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066792.153142:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976843648:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066792.153162:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e85b600/0xfb36a14ee608b637 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5f5 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.153170:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e85b600/0xfb36a14ee608b637 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5f5 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.153176:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e85b600, rc 0) 00000100:00100000:1.0:1746066792.153195:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882976933632:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4646us (5370us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066792.153202:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14548 00000100:00100000:3.0:1746066792.158434:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976843776:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066792.158455:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.158495:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882976933760:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5674us (6111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.158504:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7458 00000100:00100000:0.0:1746066792.159724:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.159781:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976934016 00000100:00100000:3.0:1746066792.159786:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976934016 00002000:00100000:3.0:1746066792.159814:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880135df8000 x1830882976934016/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.159823:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df8000 with x1830882976934016 ext(2097152->3145727) 00002000:00010000:3.0:1746066792.159826:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135df8000 00000100:00100000:3.0:1746066792.159839:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6582 00000100:00100000:3.0:1746066792.159843:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882976934016:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066792.160704:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.160842:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976934144 00000100:00100000:1.0:1746066792.160846:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976934144 00000100:00100000:1.0:1746066792.160925:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14549 00000100:00100000:1.0:1746066792.160931:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:31603:x1830882976934144:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.160941:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.160954:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e85b400/0xfb36a14ee608b63e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e5fc expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.160971:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.160973:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.160980:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e85b400/0xfb36a14ee608b63e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5fc expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.160992:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e85b400/0xfb36a14ee608b63e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5fc expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.161000:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e85b400, rc 0) 00000100:00100000:1.0:1746066792.161111:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:31603:x1830882976934144:12345-192.168.202.57@tcp:101:cat.0 Request processed in 179us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066792.161117:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14549 00000100:00100000:0.0:1746066792.166764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.166843:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976934400 00000100:00100000:2.0:1746066792.166850:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976934400 00002000:00100000:2.0:1746066792.166886:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (5087232->5091327) req@ffff880135dfb480 x1830882976934400/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.166896:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfb480 with x1830882976934400 ext(5087232->5091327) 00002000:00010000:2.0:1746066792.166900:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135dfb480 00000100:00100000:2.0:1746066792.166929:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6583 00000100:00100000:2.0:1746066792.166935:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882976934400:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066792.167072:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882976934400:12345-192.168.202.57@tcp:3:cat.0 Request processed in 136us (314us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066792.167078:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6583 00002000:00100000:2.0:1746066792.167083:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (5087232->5091327) req@ffff880135dfb480 x1830882976934400/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/4536 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.167089:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfb480 with x1830882976934400 ext(5087232->5091327) 00002000:00010000:2.0:1746066792.167091:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135dfb480 00000100:00100000:3.0:1746066792.171542:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882976934016:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11688us (11811us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066792.171553:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6582 00002000:00100000:3.0:1746066792.171562:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880135df8000 x1830882976934016/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.171571:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df8000 with x1830882976934016 ext(2097152->3145727) 00002000:00010000:3.0:1746066792.171576:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135df8000 00000100:00100000:0.0:1746066792.174415:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.174516:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976934656 00000100:00100000:3.0:1746066792.174523:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976934656 00000100:00100000:3.0:1746066792.174568:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4160 00000100:00100000:3.0:1746066792.174575:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:31603:x1830882976934656:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:3.0:1746066792.177525:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:31603:x1830882976934656:12345-192.168.202.57@tcp:35:cat.0 Request processed in 2943us (3110us total) trans 8589944035 rc 0/0 00000100:00100000:3.0:1746066792.177536:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4160 00000100:00100000:1.0:1746066792.177890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.178321:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976934784 00000100:00100000:0.0:1746066792.178328:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976934784 00000100:00100000:0.0:1746066792.178362:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14550 00000100:00100000:0.0:1746066792.178368:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:31608:x1830882976934784:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066792.178383:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066792.178399:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b645 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e603 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.178421:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 31 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.178428:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066792.178429:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066792.178432:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b645 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e603 expref: 36 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.178457:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 31 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.178467:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 31 pid: 9776 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746066792.178476:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976843904:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066792.178542:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540d180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.183084:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976843904:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066792.183120:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b645 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e603 expref: 36 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.183134:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008de12600, rc 0) 00000100:00100000:2.0:1746066792.183746:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:31608:x1830882976934784:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5375us (5853us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.183755:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14550 00000100:00100000:1.0:1746066792.183886:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.184974:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976934912 00000100:00100000:3.0:1746066792.184981:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976934912 00002000:00100000:3.0:1746066792.185012:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (4149248->4194303) req@ffff88009f16df80 x1830882976934912/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.185020:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16df80 with x1830882976934912 ext(4149248->4194303) 00010000:00010000:3.0:1746066792.185028:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 32 pid: 9776 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.185039:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 32 pid: 9776 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746066792.185045:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f16df80 00000100:00100000:3.0:1746066792.185072:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2142 00000100:00100000:3.0:1746066792.185078:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+32:1965:x1830882976934912:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066792.188657:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+34:1965:x1830882976934912:12345-192.168.202.57@tcp:4:cat.0 Request processed in 3570us (4763us total) trans 21474840914 rc 0/0 00000100:00100000:3.0:1746066792.188667:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2142 00002000:00100000:3.0:1746066792.188709:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (4149248->4194303) req@ffff88009f16df80 x1830882976934912/t21474840914(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/448 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.188722:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16df80 with x1830882976934912 ext(4149248->4194303) 00010000:00010000:3.0:1746066792.188731:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 34 pid: 9776 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.188742:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 34 pid: 9776 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746066792.188748:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f16df80 00000100:00100000:0.0:1746066792.194043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.194174:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976935040 00000100:00100000:3.0:1746066792.194181:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976935040 00010000:00010000:3.0:1746066792.194212:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 34 pid: 9776 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.194248:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7459 00000100:00100000:3.0:1746066792.194256:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+34:1966:x1830882976935040:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.194267:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.194284:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 34 pid: 9776 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.194294:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 34 pid: 9776 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.194313:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d36a800/0xfb36a14ee608b4bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e507 expref: 34 pid: 9776 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.194330:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.194332:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.194337:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b645 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e603 expref: 35 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.194344:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b645 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e603 expref: 35 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.194370:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b645 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e603 expref: 35 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066792.194380:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976844032:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066792.194453:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.200026:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.200201:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976844032:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066792.200221:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.200269:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+33:1966:x1830882976935040:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6014us (6233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.200278:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7459 00000100:00100000:0.0:1746066792.200420:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.200437:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976935424 00000100:00100000:0.0:1746066792.200442:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976935424 00002000:00100000:0.0:1746066792.200477:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135df9180 x1830882976935424/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.200486:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9180 with x1830882976935424 ext(3145728->4194303) 00002000:00010000:0.0:1746066792.200490:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135df9180 00000100:00100000:0.0:1746066792.200501:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976935552 00000100:00100000:0.0:1746066792.200503:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976935552 00002000:00100000:0.0:1746066792.200514:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880135dfaa00 x1830882976935552/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.200521:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfaa00 with x1830882976935552 ext(2097152->3145727) 00002000:00010000:0.0:1746066792.200523:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135dfaa00 00000100:00100000:1.0:1746066792.200592:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.201254:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976935680 00000100:00100000:0.0:1746066792.201257:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976935680 00002000:00100000:0.0:1746066792.201847:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009f16ca80 x1830882976935680/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.201854:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16ca80 with x1830882976935680 ext(3145728->4194303) 00002000:00010000:0.0:1746066792.201857:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16ca80 00000100:00100000:0.0:1746066792.201872:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6584 00000100:00100000:0.0:1746066792.201879:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1965:x1830882976935424:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066792.201881:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6585 00000100:00100000:3.0:1746066792.201887:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1965:x1830882976935552:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066792.202852:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6586 00000100:00100000:3.0:1746066792.202858:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1965:x1830882976935680:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066792.211867:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1965:x1830882976935552:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9972us (11439us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066792.211879:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6585 00002000:00100000:3.0:1746066792.211889:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880135dfaa00 x1830882976935552/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.211899:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfaa00 with x1830882976935552 ext(2097152->3145727) 00002000:00010000:3.0:1746066792.211904:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135dfaa00 00000100:00100000:2.0:1746066792.218196:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1965:x1830882976935424:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16306us (18163us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066792.218209:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6584 00002000:00100000:2.0:1746066792.218222:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135df9180 x1830882976935424/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.218231:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9180 with x1830882976935424 ext(3145728->4194303) 00002000:00010000:2.0:1746066792.218237:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135df9180 00010000:00010000:2.0:1746066792.219118:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746066792.221284:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1965:x1830882976935680:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18416us (20681us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066792.221295:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6586 00002000:00100000:3.0:1746066792.221305:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009f16ca80 x1830882976935680/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.221314:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16ca80 with x1830882976935680 ext(3145728->4194303) 00002000:00010000:3.0:1746066792.221319:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16ca80 00000100:00100000:0.0:1746066792.221762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.221831:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976935936 00000100:00100000:2.0:1746066792.221837:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976935936 00000100:00100000:2.0:1746066792.221908:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14551 00000100:00100000:2.0:1746066792.221914:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:31610:x1830882976935936:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066792.221926:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.221939:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e60a expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.221961:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b57a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e57e expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.221974:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25200/0xfb36a14ee608b5b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e59a expref: 31 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.221980:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.221982:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.221985:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [770048->1048575] (req 770048->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.222008:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25200/0xfb36a14ee608b5b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e59a expref: 31 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.222017:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25200/0xfb36a14ee608b5b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e59a expref: 31 pid: 21973 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746066792.222028:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976844160:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066792.222633:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e57e expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.222643:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b57a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e57e expref: 26 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.222653:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976844288:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066792.223429:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066792.226930:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.227083:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976936064 00000100:00100000:0.0:1746066792.227090:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976936064 00000100:00100000:0.0:1746066792.227139:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14552 00000100:00100000:0.0:1746066792.227147:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882976936064:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066792.227162:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066792.227175:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f737400/0xfb36a14ee608b653 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e611 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.227192:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.227201:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f737400/0xfb36a14ee608b653 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e611 expref: 33 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.227210:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f737400/0xfb36a14ee608b653 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e611 expref: 33 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.227222:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f737400, rc 0) 00000100:00100000:0.0:1746066792.227255:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882976936064:12345-192.168.202.57@tcp:101:cat.0 Request processed in 109us (332us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066792.227258:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976844160:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066792.227260:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14552 00000100:00100000:2.0:1746066792.227266:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976844288:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066792.227289:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [770048->1048575] (req 770048->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.227297:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5475c00, rc 0) 00000100:00100000:2.0:1746066792.227312:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+26:31610:x1830882976935936:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 5399us (5551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.227317:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14551 00000100:00100000:0.0:1746066792.227740:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.227776:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.227835:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976936192 00000100:00100000:2.0:1746066792.227838:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976936192 00010000:00010000:2.0:1746066792.227854:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25200/0xfb36a14ee608b5b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e59a expref: 32 pid: 21973 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746066792.227871:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976936320 00000100:00100000:2.0:1746066792.227872:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976936320 00010000:00010000:2.0:1746066792.227880:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b57a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e57e expref: 26 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.227892:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7460 00000100:00100000:2.0:1746066792.227896:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882976936192:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066792.227904:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066792.227921:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25200/0xfb36a14ee608b5b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e59a expref: 32 pid: 21973 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746066792.227929:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25200/0xfb36a14ee608b5b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e59a expref: 32 pid: 21973 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746066792.227942:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f25200/0xfb36a14ee608b5b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e59a expref: 32 pid: 21973 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746066792.228042:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7461 00010000:00010000:2.0:1746066792.228111:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066792.228132:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882976936192:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 235us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.228138:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7460 00000100:00100000:1.0:1746066792.228229:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882976936320:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066792.228236:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066792.228245:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b57a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e57e expref: 26 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066792.228252:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e57e expref: 26 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066792.228262:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608b57a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e57e expref: 26 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066792.228281:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.228283:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.228289:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.228295:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.228317:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066792.228326:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976844416:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066792.228384:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.230726:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.230812:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976936576 00000100:00100000:3.0:1746066792.230818:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976936576 00000100:00100000:1.0:1746066792.230881:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976844416:192.168.202.57@tcp:105: 00002000:00100000:3.0:1746066792.230894:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880135dfb100 x1830882976936576/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746066792.230899:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746066792.230902:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfb100 with x1830882976936576 ext(4194304->5091327) 00002000:00010000:3.0:1746066792.230906:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135dfb100 00000100:00100000:1.0:1746066792.230936:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882976936320:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2735us (3160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066792.230944:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7461 00000100:00100000:3.0:1746066792.231011:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6587 00000100:00100000:3.0:1746066792.231017:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882976936576:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066792.231698:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.231754:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976936832 00000100:00100000:2.0:1746066792.231758:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976936832 00002000:00100000:2.0:1746066792.231773:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (770048->774143) req@ffff880135df9f80 x1830882976936832/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.231780:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9f80 with x1830882976936832 ext(770048->774143) 00002000:00010000:2.0:1746066792.231782:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135df9f80 00000100:00100000:2.0:1746066792.231793:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6588 00000100:00100000:2.0:1746066792.231798:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882976936832:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066792.231884:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882976936832:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 85us (186us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066792.231889:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6588 00002000:00100000:2.0:1746066792.231894:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (770048->774143) req@ffff880135df9f80 x1830882976936832/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/4536 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.231900:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9f80 with x1830882976936832 ext(770048->774143) 00002000:00010000:2.0:1746066792.231902:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135df9f80 00000100:00100000:2.0:1746066792.239126:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.239488:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882976936576:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8466us (8763us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066792.239499:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6587 00002000:00100000:3.0:1746066792.239511:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880135dfb100 x1830882976936576/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.239519:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfb100 with x1830882976936576 ext(4194304->5091327) 00002000:00010000:3.0:1746066792.239525:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135dfb100 00000100:00100000:1.0:1746066792.239666:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976936960 00000100:00100000:1.0:1746066792.239697:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976936960 00000100:00100000:1.0:1746066792.239739:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14553 00000100:00100000:1.0:1746066792.239746:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+33:31610:x1830882976936960:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066792.239757:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.239771:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e618 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.239791:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f319200/0xfb36a14ee608b3f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e474 expref: 35 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.239802:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb08000/0xfb36a14ee608b4ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e523 expref: 8 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.239807:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3fe600/0xfb36a14ee608b42a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e49e expref: 34 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.239813:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.239814:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.239817:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1048576->1744895] (req 1048576->1744895) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 34 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.239840:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3fe600/0xfb36a14ee608b42a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e49e expref: 34 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.239850:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3fe600/0xfb36a14ee608b42a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e49e expref: 34 pid: 21973 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746066792.239860:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976844544:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066792.239945:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb08000/0xfb36a14ee608b4ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e523 expref: 8 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.239955:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009eb08000/0xfb36a14ee608b4ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e523 expref: 8 pid: 20532 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746066792.239963:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976844672:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066792.239997:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f319200/0xfb36a14ee608b3f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e474 expref: 35 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.240006:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f319200/0xfb36a14ee608b3f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e474 expref: 35 pid: 8451 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066792.240013:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976844800:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066792.240037:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.242367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.242449:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.242528:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937088 00000100:00100000:2.0:1746066792.242534:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937088 00010000:00010000:2.0:1746066792.242565:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb08000/0xfb36a14ee608b4ee lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e523 expref: 9 pid: 20532 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746066792.242593:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7462 00000100:00100000:2.0:1746066792.242598:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882976937088:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066792.242619:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066792.242624:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976844544:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066792.242632:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976844672:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066792.242637:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eb08000/0xfb36a14ee608b4ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e523 expref: 9 pid: 20532 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746066792.242638:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976844800:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066792.242645:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eb08000/0xfb36a14ee608b4ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e523 expref: 9 pid: 20532 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746066792.242661:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb08000/0xfb36a14ee608b4ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e523 expref: 9 pid: 20532 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746066792.242671:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 7 type: EXT [1048576->1744895] (req 1048576->1744895) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 34 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.242715:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d08400, rc 0) 00000100:00100000:1.0:1746066792.242752:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+34:31610:x1830882976936960:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3006us (3634us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066792.242758:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14553 00000100:00100000:1.0:1746066792.242772:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937216 00000100:00100000:1.0:1746066792.242775:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937216 00000100:00100000:1.0:1746066792.242790:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14554 00000100:00100000:1.0:1746066792.242795:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1965:x1830882976937216:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.242805:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.242815:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d09a00/0xfb36a14ee608b661 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e61f expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066792.242846:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976844928:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066792.242899:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066792.243064:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1966:x1830882976937088:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 465us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.243070:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7462 00000100:00100000:1.0:1746066792.243079:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.245863:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.245929:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937472 00000100:00100000:2.0:1746066792.245936:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937472 00010000:00010000:2.0:1746066792.245960:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f319200/0xfb36a14ee608b3f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e474 expref: 36 pid: 8451 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.245982:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7463 00000100:00100000:2.0:1746066792.245988:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882976937472:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066792.245998:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066792.246014:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f319200/0xfb36a14ee608b3f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e474 expref: 36 pid: 8451 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.246023:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f319200/0xfb36a14ee608b3f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e474 expref: 36 pid: 8451 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.246040:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f319200/0xfb36a14ee608b3f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e474 expref: 36 pid: 8451 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.246052:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066792.246095:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882976937472:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 107us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.246101:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7463 00000100:00100000:0.0:1746066792.246141:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.246259:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937344 00000100:00100000:2.0:1746066792.246262:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937344 00010000:00010000:2.0:1746066792.246273:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3fe600/0xfb36a14ee608b42a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e49e expref: 34 pid: 21973 timeout: 853 lvb_type: 1 00000100:00100000:2.0:1746066792.246530:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7464 00000100:00100000:2.0:1746066792.246535:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+34:1964:x1830882976937344:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066792.246537:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976844928:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066792.246541:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066792.246550:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3fe600/0xfb36a14ee608b42a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e49e expref: 34 pid: 21973 timeout: 853 lvb_type: 1 00010000:00010000:0.0:1746066792.246555:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d09a00/0xfb36a14ee608b661 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e61f expref: 32 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.246563:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d09a00/0xfb36a14ee608b661 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e61f expref: 32 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.246570:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d09a00, rc 0) 00000100:00100000:0.0:1746066792.246586:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1965:x1830882976937216:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3792us (4138us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066792.246590:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14554 00010000:00010000:2.0:1746066792.246757:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3fe600/0xfb36a14ee608b42a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e49e expref: 34 pid: 21973 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746066792.246815:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3fe600/0xfb36a14ee608b42a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e49e expref: 34 pid: 21973 timeout: 853 lvb_type: 1 00010000:00010000:2.0:1746066792.246825:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.246826:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.246832:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1744895) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.246839:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1744895) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.246862:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1744895) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066792.246872:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976845056:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066792.247281:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.248053:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.248105:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.248302:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937600 00000100:00100000:1.0:1746066792.248306:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937600 00000100:00100000:1.0:1746066792.248333:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937728 00000100:00100000:1.0:1746066792.248335:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937728 00000100:00100000:1.0:1746066792.248348:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14555 00000100:00100000:1.0:1746066792.248353:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882976937600:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.248365:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.248375:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d08200/0xfb36a14ee608b668 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e626 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066792.248402:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976845184:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066792.248438:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.248484:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14556 00000100:00100000:2.0:1746066792.248490:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1965:x1830882976937728:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066792.248496:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.248503:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5474400/0xfb36a14ee608b66f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e62d expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066792.248523:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976845312:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066792.248541:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066792.249292:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976845056:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066792.249305:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.249324:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+33:1964:x1830882976937344:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2789us (3183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.249330:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7464 00000100:00100000:1.0:1746066792.253547:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976845184:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066792.253706:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d08200/0xfb36a14ee608b668 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e626 expref: 32 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.253718:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d08200/0xfb36a14ee608b668 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e626 expref: 32 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.253741:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d08200, rc 0) 00000100:00100000:1.0:1746066792.253780:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882976937600:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5426us (5727us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066792.253787:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14555 00000100:00100000:0.0:1746066792.254199:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00010000:2.0:1746066792.254244:0:21203:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime: 1746066790 -> 1746066791 00000100:00100000:2.0:1746066792.254258:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976845312:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066792.254278:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5474400/0xfb36a14ee608b66f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e62d expref: 36 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.254288:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5474400/0xfb36a14ee608b66f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e62d expref: 36 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.254295:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5474400, rc 0) 00000100:00100000:2.0:1746066792.254317:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1965:x1830882976937728:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5827us (6212us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066792.254322:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14556 00000100:00100000:3.0:1746066792.254377:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937984 00000100:00100000:3.0:1746066792.254382:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937984 00002000:00100000:3.0:1746066792.254409:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38d:0x0] (1740800->1744895) req@ffff88009e852d80 x1830882976937984/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.254417:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e852d80 with x1830882976937984 ext(1740800->1744895) 00002000:00010000:3.0:1746066792.254420:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e852d80 00000100:00100000:3.0:1746066792.254446:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6589 00000100:00100000:3.0:1746066792.254453:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+33:1963:x1830882976937984:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066792.254568:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+33:1963:x1830882976937984:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 115us (369us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066792.254573:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6589 00002000:00100000:3.0:1746066792.254578:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38d:0x0] (1740800->1744895) req@ffff88009e852d80 x1830882976937984/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/4536 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.254584:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e852d80 with x1830882976937984 ext(1740800->1744895) 00002000:00010000:3.0:1746066792.254587:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e852d80 00000100:00100000:0.0:1746066792.259666:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.259793:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976938240 00000100:00100000:3.0:1746066792.259801:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976938240 00000100:00100000:3.0:1746066792.259837:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4161 00000100:00100000:3.0:1746066792.259843:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:31608:x1830882976938240:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:3.0:1746066792.260015:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:31608:x1830882976938240:12345-192.168.202.57@tcp:35:cat.0 Request processed in 171us (354us total) trans 8589944036 rc 0/0 00000100:00100000:3.0:1746066792.260020:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4161 00000100:00100000:0.0:1746066792.261458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.262509:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976938368 00000100:00100000:2.0:1746066792.262516:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976938368 00000100:00100000:2.0:1746066792.262562:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14557 00000100:00100000:2.0:1746066792.262569:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:31613:x1830882976938368:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066792.262583:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.262596:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e634 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.262631:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e85ba00/0xfb36a14ee608b630 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5ee expref: 32 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.262639:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e85b400/0xfb36a14ee608b63e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5fc expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.262644:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.262646:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.262649:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3465216->4194303] (req 3465216->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 32 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.262670:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e85b400/0xfb36a14ee608b63e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5fc expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.262708:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e85b400/0xfb36a14ee608b63e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5fc expref: 24 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.262718:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976845440:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066792.262797:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e85ba00/0xfb36a14ee608b630 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5ee expref: 32 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.262804:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e85ba00/0xfb36a14ee608b630 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5ee expref: 32 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.262811:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976845568:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066792.262828:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.265444:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976845440:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066792.265455:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976845568:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066792.265477:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3465216->4194303] (req 3465216->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 32 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.265491:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136764800, rc 0) 00000100:00100000:2.0:1746066792.265526:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:31613:x1830882976938368:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2957us (4069us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.265535:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14557 00000100:00100000:0.0:1746066792.267393:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.267435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.267464:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976938496 00000100:00100000:3.0:1746066792.267472:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976938496 00010000:00010000:3.0:1746066792.267499:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e85b400/0xfb36a14ee608b63e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5fc expref: 25 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.267566:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976938624 00000100:00100000:3.0:1746066792.267569:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976938624 00010000:00010000:3.0:1746066792.267580:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e85ba00/0xfb36a14ee608b630 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5ee expref: 32 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.267597:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7465 00000100:00100000:3.0:1746066792.267602:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882976938496:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.267622:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.267641:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e85b400/0xfb36a14ee608b63e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5fc expref: 25 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.267649:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e85b400/0xfb36a14ee608b63e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5fc expref: 25 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.267667:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e85b400/0xfb36a14ee608b63e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5fc expref: 25 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.267701:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.267738:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882976938496:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 135us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.267744:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7465 00000100:00100000:3.0:1746066792.267774:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7466 00000100:00100000:3.0:1746066792.267780:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882976938624:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.267786:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.267793:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e85ba00/0xfb36a14ee608b630 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5ee expref: 32 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.267801:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e85ba00/0xfb36a14ee608b630 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5ee expref: 32 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.267812:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e85ba00/0xfb36a14ee608b630 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5ee expref: 32 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.267820:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.267822:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.267827:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.267835:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.267859:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066792.267868:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976845696:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066792.267914:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.272033:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.272057:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976845696:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066792.272074:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.272121:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882976938624:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4340us (4684us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.272129:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7466 00000100:00100000:2.0:1746066792.272153:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976938880 00000100:00100000:2.0:1746066792.272159:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976938880 00002000:00100000:2.0:1746066792.272192:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (3465216->3469311) req@ffff88009e852680 x1830882976938880/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.272202:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e852680 with x1830882976938880 ext(3465216->3469311) 00002000:00010000:2.0:1746066792.272205:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e852680 00000100:00100000:2.0:1746066792.272216:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6590 00000100:00100000:2.0:1746066792.272221:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882976938880:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066792.272353:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882976938880:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 131us (327us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066792.272359:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6590 00002000:00100000:2.0:1746066792.272364:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (3465216->3469311) req@ffff88009e852680 x1830882976938880/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/4536 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.272370:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e852680 with x1830882976938880 ext(3465216->3469311) 00002000:00010000:2.0:1746066792.272373:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e852680 00000100:00100000:0.0:1746066792.278274:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.278365:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976939008 00000100:00100000:2.0:1746066792.278372:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976939008 00000100:00100000:2.0:1746066792.278421:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14558 00000100:00100000:2.0:1746066792.278429:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:31613:x1830882976939008:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066792.278444:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.278459:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e63b expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.278487:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b645 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e603 expref: 36 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.278493:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.278494:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.278497:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->3452927] (req 3145728->3452927) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 36 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.278520:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b645 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e603 expref: 36 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.278529:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b645 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e603 expref: 36 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.278538:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976845824:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066792.280329:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.280358:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976845824:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066792.280377:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->3452927] (req 3145728->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 36 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.280387:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d5000, rc 0) 00000100:00100000:2.0:1746066792.280413:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:31613:x1830882976939008:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 1986us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.280419:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14558 00000100:00100000:0.0:1746066792.282593:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.282700:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976939136 00000100:00100000:3.0:1746066792.282707:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976939136 00010000:00010000:3.0:1746066792.282733:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b645 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e603 expref: 36 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.282768:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7467 00000100:00100000:3.0:1746066792.282774:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882976939136:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.282785:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.282802:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b645 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e603 expref: 36 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.282811:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b645 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e603 expref: 36 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.282829:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008de12600/0xfb36a14ee608b645 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e603 expref: 36 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.282854:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.282855:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.282861:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 35 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.282872:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 35 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.282955:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 35 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066792.282966:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976845952:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066792.283542:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066792.285439:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976845952:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066792.285458:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.285488:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1963:x1830882976939136:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2713us (2899us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.285496:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7467 00000100:00100000:0.0:1746066792.287256:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.288156:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976939392 00000100:00100000:2.0:1746066792.288164:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976939392 00002000:00100000:2.0:1746066792.288202:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38f:0x0] (3448832->3452927) req@ffff88009baead80 x1830882976939392/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.288212:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baead80 with x1830882976939392 ext(3448832->3452927) 00002000:00010000:2.0:1746066792.288217:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baead80 00000100:00100000:2.0:1746066792.288246:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6591 00000100:00100000:2.0:1746066792.288254:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1963:x1830882976939392:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066792.288407:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1963:x1830882976939392:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 154us (1157us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066792.288413:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6591 00002000:00100000:2.0:1746066792.288418:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38f:0x0] (3448832->3452927) req@ffff88009baead80 x1830882976939392/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/4536 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.288425:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009baead80 with x1830882976939392 ext(3448832->3452927) 00002000:00010000:2.0:1746066792.288427:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009baead80 00000100:00100000:0.0:1746066792.294509:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.294624:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976939648 00000100:00100000:3.0:1746066792.294633:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976939648 00000100:00100000:3.0:1746066792.294707:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4162 00000100:00100000:3.0:1746066792.294715:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:31613:x1830882976939648:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066792.294954:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:31613:x1830882976939648:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 239us (455us total) trans 8589944037 rc 0/0 00000100:00100000:3.0:1746066792.294960:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4162 00000100:00100000:0.0:1746066792.300151:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.300316:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976939904 00000100:00100000:3.0:1746066792.300324:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976939904 00000100:00100000:3.0:1746066792.300478:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9983 00000100:00100000:3.0:1746066792.300490:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:31619:x1830882976939904:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066792.300512:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.300527:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9400/0xfb36a14ee608b684 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e642 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.300629:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9200/0xfb36a14ee608b68b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300639:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9200/0xfb36a14ee608b68b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300648:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9200/0xfb36a14ee608b68b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300659:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9000/0xfb36a14ee608b692 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300665:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9000/0xfb36a14ee608b692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300669:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9000/0xfb36a14ee608b692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300788:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8e00/0xfb36a14ee608b699 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300796:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8e00/0xfb36a14ee608b699 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300802:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8e00/0xfb36a14ee608b699 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066792.300808:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066792.300871:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9200/0xfb36a14ee608b68b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300880:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9200/0xfb36a14ee608b68b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300885:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9200/0xfb36a14ee608b68b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300889:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ac9200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066792.300891:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9200/0xfb36a14ee608b68b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300897:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9200/0xfb36a14ee608b68b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300905:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066792.300907:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066792.300910:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9200/0xfb36a14ee608b68b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300914:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9200/0xfb36a14ee608b68b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300938:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9000/0xfb36a14ee608b692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300942:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9000/0xfb36a14ee608b692 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300946:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9000/0xfb36a14ee608b692 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300949:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ac9000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066792.300951:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9000/0xfb36a14ee608b692 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300958:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9000/0xfb36a14ee608b692 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300963:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800901e3800) 00010000:00010000:3.0:1746066792.300964:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066792.300966:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9000/0xfb36a14ee608b692 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300970:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9000/0xfb36a14ee608b692 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.300999:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9400/0xfb36a14ee608b684 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e642 expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.301008:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8e00/0xfb36a14ee608b699 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e642 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.301014:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066792.301015:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066792.301017:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ac8e00, rc 0) 00000100:00100000:3.0:1746066792.301053:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:31619:x1830882976939904:12345-192.168.202.57@tcp:101:cat.0 Request processed in 565us (953us total) trans 8589944038 rc 0/0 00000100:00100000:3.0:1746066792.301058:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9983 00000100:00100000:0.0:1746066792.304751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.304913:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976940032 00000100:00100000:3.0:1746066792.304920:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976940032 00000100:00100000:3.0:1746066792.304967:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 703 00000100:00100000:3.0:1746066792.304974:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882976940032:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.304985:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.305004:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8e00/0xfb36a14ee608b699 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e642 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.305027:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066792.305031:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.305063:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882976940032:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 89us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.305068:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 703 00000100:00100000:0.0:1746066792.305243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.305326:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.305407:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976940288 00000100:00100000:1.0:1746066792.305411:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976940288 00000100:00100000:1.0:1746066792.305430:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976940160 00000100:00100000:1.0:1746066792.305432:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976940160 00000100:00100000:1.0:1746066792.305443:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14559 00000100:00100000:1.0:1746066792.305448:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+33:1963:x1830882976940288:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.305458:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.305470:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d08600/0xfb36a14ee608b6a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e650 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066792.305505:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976846080:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066792.305558:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.305744:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14560 00000100:00100000:2.0:1746066792.305755:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882976940160:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066792.305763:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.305772:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c2d4800/0xfb36a14ee608b6ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e649 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066792.305795:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976846208:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066792.305839:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746066792.307409:0:20532:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime: 1746066791 -> 1746066792 00002000:00010000:1.0:1746066792.307414:0:20532:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime: 1746066791 -> 1746066792 00000100:00100000:1.0:1746066792.307432:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976846080:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066792.307455:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d08600/0xfb36a14ee608b6a7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e650 expref: 34 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.307464:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d08600/0xfb36a14ee608b6a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e650 expref: 34 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.307475:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d08600, rc 0) 00000100:00100000:1.0:1746066792.307499:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+33:1963:x1830882976940288:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2050us (2255us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066792.307505:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14559 00002000:00010000:2.0:1746066792.308090:0:4614:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime: 1746066791 -> 1746066792 00002000:00010000:2.0:1746066792.308094:0:4614:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime: 1746066791 -> 1746066792 00000100:00100000:2.0:1746066792.308106:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976846208:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066792.308120:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c2d4800/0xfb36a14ee608b6ae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e649 expref: 25 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.308129:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c2d4800/0xfb36a14ee608b6ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e649 expref: 25 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.308149:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d4800, rc 0) 00000100:00100000:2.0:1746066792.308217:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882976940160:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2461us (2889us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066792.308222:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14560 00000100:00100000:0.0:1746066792.314203:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.314249:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.314374:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976940544 00000100:00100000:3.0:1746066792.314381:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976940544 00002000:00100000:3.0:1746066792.314419:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x38e:0x0] (0->770047) req@ffff88009bae8000 x1830882976940544/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.314428:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae8000 with x1830882976940544 ext(0->770047) 00002000:00010000:3.0:1746066792.314432:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bae8000 00000100:00100000:3.0:1746066792.314447:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976940800 00000100:00100000:3.0:1746066792.314449:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976940800 00002000:00100000:3.0:1746066792.314461:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38d:0x0] (1744896->2097151) req@ffff88009bae9880 x1830882976940800/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.314467:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae9880 with x1830882976940800 ext(1744896->2097151) 00002000:00010000:3.0:1746066792.314470:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae9880 00000100:00100000:3.0:1746066792.314483:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6592 00000100:00100000:3.0:1746066792.314489:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882976940544:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066792.314569:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6593 00000100:00100000:1.0:1746066792.314576:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+33:1965:x1830882976940800:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066792.324287:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882976940544:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9790us (10082us total) trans 0 rc 770048/770048 00000100:00100000:3.0:1746066792.324298:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6592 00002000:00100000:3.0:1746066792.324309:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x38e:0x0] (0->770047) req@ffff88009bae8000 x1830882976940544/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 770048/770048 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.324319:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae8000 with x1830882976940544 ext(0->770047) 00002000:00010000:3.0:1746066792.324324:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bae8000 00000100:00100000:0.0:1746066792.325240:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+33:1965:x1830882976940800:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10662us (10987us total) trans 0 rc 352256/352256 00000100:00100000:0.0:1746066792.325248:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6593 00002000:00100000:0.0:1746066792.325254:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38d:0x0] (1744896->2097151) req@ffff88009bae9880 x1830882976940800/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 352256/352256 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.325261:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae9880 with x1830882976940800 ext(1744896->2097151) 00002000:00010000:0.0:1746066792.325265:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae9880 00000100:00100000:0.0:1746066792.332889:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.332945:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976940928 00000100:00100000:2.0:1746066792.332953:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976940928 00000100:00100000:0.0:1746066792.332977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.334148:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976941056 00000100:00100000:2.0:1746066792.334153:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976941056 00000100:00100000:2.0:1746066792.334179:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14561 00000100:00100000:2.0:1746066792.334186:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882976940928:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066792.334201:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.334216:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c2d5400/0xfb36a14ee608b6b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e657 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066792.334260:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976846336:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066792.334313:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066792.334751:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14562 00000100:00100000:3.0:1746066792.334759:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+33:1963:x1830882976941056:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066792.334766:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.334776:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ac9800/0xfb36a14ee608b6bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e65e expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066792.334799:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976846464:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066792.334843:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.338082:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976846336:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066792.338112:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c2d5400/0xfb36a14ee608b6b5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e657 expref: 25 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.338131:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c2d5400/0xfb36a14ee608b6b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e657 expref: 25 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.338327:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2d5400, rc 0) 00000100:00100000:2.0:1746066792.338647:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882976940928:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4459us (5763us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066792.338654:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14561 00000100:00100000:3.0:1746066792.340291:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976846464:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066792.340315:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ac9800/0xfb36a14ee608b6bc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e65e expref: 34 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066792.340328:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099ac9800/0xfb36a14ee608b6bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e65e expref: 34 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066792.340347:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ac9800, rc 0) 00000100:00100000:3.0:1746066792.340381:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+33:1963:x1830882976941056:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5623us (7403us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066792.340387:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14562 00000100:00100000:3.0:1746066792.343787:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:980aefe6-2860-4e29-9b4a-3d9c65563e6f:3295:1830882976846592:0@lo:400:kworker.0 00000100:00100000:3.0:1746066792.343838:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066792.343875:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976847104:0@lo:400:kworker.0 00000100:00100000:3.0:1746066792.343896:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066792.343913:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746066792.343917:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1830882976846720:0@lo:400:kworker.0 00000100:00100000:3.0:1746066792.343936:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066792.343948:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830882976847232:0@lo:400:kworker.0 00000100:00100000:3.0:1746066792.343960:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066792.343980:0:14544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976846592 00000100:00100000:3.0:1746066792.343985:0:14544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976846592 00000100:00100000:3.0:1746066792.344011:0:14544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1746066792.344017:0:14544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980aefe6-2860-4e29-9b4a-3d9c65563e6f+18:3295:x1830882976846592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066792.344048:0:14544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980aefe6-2860-4e29-9b4a-3d9c65563e6f+18:3295:x1830882976846592:12345-0@lo:400:kworker.0 Request processed in 31us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.344052:0:14544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1746066792.344079:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:980aefe6-2860-4e29-9b4a-3d9c65563e6f:3295:1830882976846592:0@lo:400:kworker.0 00000100:00100000:3.0:1746066792.344097:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976847104 00000100:00100000:3.0:1746066792.344100:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976847104 00000100:00100000:3.0:1746066792.344116:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1746066792.344119:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3295:x1830882976847104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066792.344143:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3295:x1830882976847104:12345-0@lo:400:kworker.0 Request processed in 22us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.344147:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1746066792.344163:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976847104:0@lo:400:kworker.0 00000100:00100000:3.0:1746066792.344176:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976846720 00000100:00100000:3.0:1746066792.344177:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976846720 00000100:00100000:3.0:1746066792.344202:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976847232 00000100:00100000:3.0:1746066792.344204:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976847232 00000100:00100000:3.0:1746066792.344216:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1746066792.344220:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830882976846720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066792.344243:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830882976846720:12345-0@lo:400:kworker.0 Request processed in 23us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.344248:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1746066792.344255:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1746066792.344258:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830882976847232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066792.344273:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830882976847232:12345-0@lo:400:kworker.0 Request processed in 15us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.344277:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1746066792.344294:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1830882976846720:0@lo:400:kworker.0 00000100:00100000:3.0:1746066792.344301:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830882976847232:0@lo:400:kworker.0 00000100:00080000:0.0:1746066792.344394:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746066792.344446:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1830882976846848:0@lo:400:kworker.0 00000100:00100000:1.0:1746066792.344469:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066792.344481:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976847360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746066792.344494:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976846848 00000100:00100000:1.0:1746066792.344495:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066792.344499:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976846848 00000100:00100000:1.0:1746066792.344506:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746066792.344510:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976846976:0@lo:400:kworker.0 00000100:00100000:2.0:1746066792.344521:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1746066792.344521:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066792.344526:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1830882976846848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066792.344537:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976846976 00000100:00100000:1.0:1746066792.344540:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976846976 00000100:00100000:2.0:1746066792.344566:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1830882976846848:12345-0@lo:400:kworker.0 Request processed in 39us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.344571:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1746066792.344573:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1830882976846848:0@lo:400:kworker.0 00000100:00100000:1.0:1746066792.344587:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1746066792.344591:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3293:x1830882976846976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066792.344631:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3293:x1830882976846976:12345-0@lo:400:kworker.0 Request processed in 39us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066792.344635:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1746066792.344654:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976846976:0@lo:400:kworker.0 00000100:00100000:0.0:1746066792.345027:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976847360 00000100:00100000:0.0:1746066792.345030:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976847360 00000100:00100000:0.0:1746066792.345055:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1746066792.345060:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3293:x1830882976847360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746066792.345072:0:8453:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 598016000 pending 40894464 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746066792.345098:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3293:x1830882976847360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.345103:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:0.0:1746066792.345117:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066792.345215:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976847488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746066792.345235:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066792.345278:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976847488 00000100:00100000:2.0:1746066792.345282:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976847488 00000100:00100000:2.0:1746066792.345297:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1746066792.345300:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976847360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746066792.345301:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3294:x1830882976847488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746066792.345311:0:8454:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 521207808 pending 23855104 free 3852468224 avail 3850371072 00000100:00100000:2.0:1746066792.345339:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3294:x1830882976847488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.345343:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1746066792.345349:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.345360:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976941184 00000100:00100000:1.0:1746066792.345362:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976941184 00000100:00100000:1.0:1746066792.345386:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14563 00000100:00100000:1.0:1746066792.345390:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+24:31619:x1830882976941184:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.345398:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.345431:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d09e00/0xfb36a14ee608b6c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e665 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.345450:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.345456:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066792.345457:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066792.345460:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d09e00/0xfb36a14ee608b6c3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e665 expref: 25 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.345477:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.345485:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 30 pid: 21203 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066792.345493:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976847616:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066792.345592:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976847488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746066792.346728:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.350517:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976847616:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066792.350545:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d09e00/0xfb36a14ee608b6c3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e665 expref: 25 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.350561:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d09e00, rc 0) 00000100:00100000:2.0:1746066792.350618:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:31619:x1830882976941184:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5215us (5258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.350626:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14563 00000100:00100000:0.0:1746066792.351051:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.351087:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976941312 00000100:00100000:2.0:1746066792.351093:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976941312 00002000:00100000:2.0:1746066792.351121:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (3465216->4194303) req@ffff88009e93d880 x1830882976941312/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.351127:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93d880 with x1830882976941312 ext(3465216->4194303) 00010000:00010000:2.0:1746066792.351131:0:11692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 31 pid: 21203 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.351139:0:11692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 31 pid: 21203 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066792.351144:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e93d880 00000100:00100000:2.0:1746066792.351162:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2143 00000100:00100000:2.0:1746066792.351168:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882976941312:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:2.0:1746066792.360819:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882976941312:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 9643us (9760us total) trans 17179873593 rc 0/0 00000100:00100000:2.0:1746066792.360830:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2143 00002000:00100000:2.0:1746066792.360840:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (3465216->4194303) req@ffff88009e93d880 x1830882976941312/t17179873593(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/448 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.360853:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93d880 with x1830882976941312 ext(3465216->4194303) 00010000:00010000:2.0:1746066792.360861:0:11692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 33 pid: 21203 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.360875:0:11692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 33 pid: 21203 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066792.360881:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e93d880 00000100:00100000:0.0:1746066792.364969:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.365043:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976941440 00000100:00100000:2.0:1746066792.365050:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976941440 00010000:00010000:2.0:1746066792.365080:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3465216->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 33 pid: 21203 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.365119:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7468 00000100:00100000:2.0:1746066792.365127:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882976941440:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066792.365138:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066792.365154:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3465216->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 33 pid: 21203 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.365164:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3465216->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 33 pid: 21203 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.365183:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136764800/0xfb36a14ee608b676 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3465216->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e634 expref: 33 pid: 21203 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.365215:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.365217:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.365222:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d09e00/0xfb36a14ee608b6c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e665 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.365229:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d09e00/0xfb36a14ee608b6c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e665 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.365254:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092d09e00/0xfb36a14ee608b6c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e665 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066792.365263:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976847744:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066792.365335:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.366878:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976847744:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066792.366891:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066792.366919:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882976941440:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1792us (1956us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.366926:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7468 00000100:00100000:0.0:1746066792.369075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.369217:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976941696 00000100:00100000:2.0:1746066792.369225:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976941696 00002000:00100000:2.0:1746066792.369259:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009e93f100 x1830882976941696/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.369267:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93f100 with x1830882976941696 ext(2097152->3145727) 00002000:00010000:2.0:1746066792.369270:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93f100 00000100:00100000:2.0:1746066792.369384:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6594 00000100:00100000:2.0:1746066792.369391:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+25:1966:x1830882976941696:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066792.374639:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.375700:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976941952 00000100:00100000:3.0:1746066792.375708:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976941952 00000100:00100000:3.0:1746066792.375749:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9984 00000100:00100000:3.0:1746066792.375756:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+17:31623:x1830882976941952:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066792.375777:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.375793:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8600/0xfb36a14ee608b6ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e66c expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.375883:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608b6d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.375895:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608b6d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.375904:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608b6d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.375915:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8800/0xfb36a14ee608b6d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.375920:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8800/0xfb36a14ee608b6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.375925:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8800/0xfb36a14ee608b6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376009:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8200/0xfb36a14ee608b6df lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376017:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8200/0xfb36a14ee608b6df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376022:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8200/0xfb36a14ee608b6df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066792.376028:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066792.376095:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608b6d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376101:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608b6d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376107:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608b6d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376112:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ac8a00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066792.376115:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608b6d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376120:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608b6d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376130:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066792.376132:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066792.376136:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608b6d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376140:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608b6d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376168:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8800/0xfb36a14ee608b6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376174:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8800/0xfb36a14ee608b6d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376178:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8800/0xfb36a14ee608b6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376182:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ac8800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066792.376184:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8800/0xfb36a14ee608b6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376189:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8800/0xfb36a14ee608b6d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376194:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e5a4700) 00010000:00010000:3.0:1746066792.376196:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066792.376198:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8800/0xfb36a14ee608b6d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376202:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8800/0xfb36a14ee608b6d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066792.376232:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8600/0xfb36a14ee608b6ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e66c expref: 20 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.376243:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8200/0xfb36a14ee608b6df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e66c expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.376248:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066792.376250:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066792.376252:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ac8200, rc 0) 00000100:00100000:3.0:1746066792.376295:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:31623:x1830882976941952:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 538us (1663us total) trans 8589944039 rc 0/0 00000100:00100000:3.0:1746066792.376300:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9984 00000100:00100000:2.0:1746066792.378533:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+25:1966:x1830882976941696:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9136us (9459us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066792.378541:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6594 00002000:00100000:2.0:1746066792.378547:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009e93f100 x1830882976941696/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.378554:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93f100 with x1830882976941696 ext(2097152->3145727) 00002000:00010000:2.0:1746066792.378557:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93f100 00000100:00100000:0.0:1746066792.379143:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.379182:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976942208 00000100:00100000:2.0:1746066792.379187:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976942208 00000100:00100000:0.0:1746066792.379191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.379379:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4163 00000100:00100000:3.0:1746066792.379383:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976942336 00000100:00100000:2.0:1746066792.379385:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:31623:x1830882976942208:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066792.379388:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976942336 00000100:00100000:3.0:1746066792.379425:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 704 00000100:00100000:3.0:1746066792.379431:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1965:x1830882976942336:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.379440:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.379458:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8200/0xfb36a14ee608b6df lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e66c expref: 20 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.379470:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066792.379473:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.379495:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1965:x1830882976942336:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 65us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.379500:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 704 00000100:00100000:2.0:1746066792.379536:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:31623:x1830882976942208:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 151us (392us total) trans 8589944040 rc 0/0 00000100:00100000:2.0:1746066792.379543:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4163 00000100:00100000:0.0:1746066792.383642:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.383756:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976942464 00000100:00100000:2.0:1746066792.383765:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976942464 00000100:00100000:2.0:1746066792.383802:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14564 00000100:00100000:2.0:1746066792.383810:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+33:31619:x1830882976942464:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066792.383825:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.383839:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a627a00/0xfb36a14ee608b6ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e673 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.383865:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 34 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.383876:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066792.383877:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066792.383880:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a627a00/0xfb36a14ee608b6ed lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e673 expref: 34 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.383905:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 34 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.383915:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 34 pid: 21203 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.383924:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976847872:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066792.384008:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.385574:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976847872:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066792.385595:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a627a00/0xfb36a14ee608b6ed lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e673 expref: 34 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.385616:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a627a00, rc 0) 00000100:00100000:2.0:1746066792.385644:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+34:31619:x1830882976942464:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1834us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.385650:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14564 00000100:00100000:0.0:1746066792.386663:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.386873:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976942592 00000100:00100000:2.0:1746066792.386879:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976942592 00002000:00100000:2.0:1746066792.386910:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3452927) req@ffff88009e93f800 x1830882976942592/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.386923:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93f800 with x1830882976942592 ext(3145728->3452927) 00010000:00010000:2.0:1746066792.386929:0:11692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 35 pid: 21203 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.386939:0:11692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 35 pid: 21203 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066792.386945:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e93f800 00000100:00100000:2.0:1746066792.386973:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2144 00000100:00100000:2.0:1746066792.386979:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882976942592:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:2.0:1746066792.390977:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1964:x1830882976942592:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 3989us (4307us total) trans 21474840915 rc 0/0 00000100:00100000:2.0:1746066792.390988:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2144 00002000:00100000:2.0:1746066792.390997:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3452927) req@ffff88009e93f800 x1830882976942592/t21474840915(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/448 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.391014:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93f800 with x1830882976942592 ext(3145728->3452927) 00010000:00010000:2.0:1746066792.391023:0:11692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 37 pid: 21203 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.391035:0:11692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 37 pid: 21203 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066792.391042:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e93f800 00000100:00100000:0.0:1746066792.392945:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.393527:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976942720 00000100:00100000:2.0:1746066792.393536:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976942720 00010000:00010000:2.0:1746066792.393567:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 37 pid: 21203 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.393899:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7469 00000100:00100000:2.0:1746066792.393907:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1963:x1830882976942720:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066792.393921:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066792.393940:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 37 pid: 21203 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.393950:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 37 pid: 21203 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.393972:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2d5000/0xfb36a14ee608b67d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3452927) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e63b expref: 37 pid: 21203 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.394140:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.394142:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.394149:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a627a00/0xfb36a14ee608b6ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e673 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.394157:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a627a00/0xfb36a14ee608b6ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e673 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.394187:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a627a00/0xfb36a14ee608b6ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e673 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066792.394197:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976848000:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066792.395768:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.399758:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976848000:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066792.399776:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.399811:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882976942720:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5904us (6870us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.399820:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7469 00000100:00100000:0.0:1746066792.402494:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.402917:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976942976 00000100:00100000:2.0:1746066792.402923:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976942976 00002000:00100000:2.0:1746066792.402955:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009e93f480 x1830882976942976/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.402961:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93f480 with x1830882976942976 ext(2097152->3145727) 00002000:00010000:2.0:1746066792.402965:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93f480 00000100:00100000:2.0:1746066792.402988:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6595 00000100:00100000:2.0:1746066792.402992:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+34:1964:x1830882976942976:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066792.403245:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.403263:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976943232 00000100:00100000:3.0:1746066792.403267:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976943232 00002000:00100000:3.0:1746066792.403285:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e93c000 x1830882976943232/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.403297:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93c000 with x1830882976943232 ext(3145728->4194303) 00002000:00010000:3.0:1746066792.403300:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93c000 00000100:00100000:3.0:1746066792.403320:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6596 00000100:00100000:3.0:1746066792.403327:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+35:1964:x1830882976943232:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066792.403599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.403632:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976943488 00000100:00100000:2.0:1746066792.403636:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976943488 00002000:00100000:2.0:1746066792.403652:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009e93fb80 x1830882976943488/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.403660:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93fb80 with x1830882976943488 ext(3145728->4194303) 00002000:00010000:2.0:1746066792.403663:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93fb80 00000100:00100000:2.0:1746066792.403704:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6597 00000100:00100000:2.0:1746066792.403709:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882976943488:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066792.410605:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882976943488:12345-192.168.202.57@tcp:3:cat.0 Request processed in 6885us (6998us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066792.410628:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6597 00002000:00100000:2.0:1746066792.410640:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009e93fb80 x1830882976943488/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.410648:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93fb80 with x1830882976943488 ext(3145728->4194303) 00002000:00010000:2.0:1746066792.410654:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93fb80 00000100:00100000:3.0:1746066792.417290:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+36:1964:x1830882976943232:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13955us (14039us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066792.417301:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6596 00002000:00100000:3.0:1746066792.417311:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e93c000 x1830882976943232/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.417319:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93c000 with x1830882976943232 ext(3145728->4194303) 00002000:00010000:3.0:1746066792.417325:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93c000 00000100:00100000:2.0:1746066792.421246:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+34:1964:x1830882976942976:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18245us (18753us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066792.421256:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6595 00002000:00100000:2.0:1746066792.421267:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009e93f480 x1830882976942976/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.421276:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93f480 with x1830882976942976 ext(2097152->3145727) 00002000:00010000:2.0:1746066792.421282:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93f480 00000100:00100000:0.0:1746066792.438324:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.438412:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976943744 00000100:00100000:2.0:1746066792.438419:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976943744 00002000:00100000:2.0:1746066792.438449:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88008c396d80 x1830882976943744/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.438456:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396d80 with x1830882976943744 ext(4194304->5091327) 00002000:00010000:2.0:1746066792.438460:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c396d80 00000100:00100000:2.0:1746066792.438481:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6598 00000100:00100000:2.0:1746066792.438486:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882976943744:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066792.444909:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882976943744:12345-192.168.202.57@tcp:3:cat.0 Request processed in 6412us (6581us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066792.444919:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6598 00002000:00100000:2.0:1746066792.444930:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88008c396d80 x1830882976943744/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.444938:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396d80 with x1830882976943744 ext(4194304->5091327) 00002000:00010000:2.0:1746066792.444943:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c396d80 00000100:00100000:0.0:1746066792.449232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.449363:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976944000 00000100:00100000:2.0:1746066792.449370:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976944000 00000100:00100000:2.0:1746066792.449414:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4164 00000100:00100000:2.0:1746066792.449422:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:31619:x1830882976944000:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066792.449602:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:31619:x1830882976944000:12345-192.168.202.57@tcp:35:cat.0 Request processed in 180us (375us total) trans 8589944041 rc 0/0 00000100:00100000:2.0:1746066792.449617:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4164 00000100:00100000:0.0:1746066792.461090:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.461210:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976944128 00000100:00100000:2.0:1746066792.461218:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976944128 00000100:00100000:2.0:1746066792.461254:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14565 00000100:00100000:2.0:1746066792.461261:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:31623:x1830882976944128:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066792.461274:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.461288:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e67a expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.461311:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d09e00/0xfb36a14ee608b6c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e665 expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.461318:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.461319:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.461322:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3112960->3145727] (req 3112960->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.461346:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d09e00/0xfb36a14ee608b6c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e665 expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.461355:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d09e00/0xfb36a14ee608b6c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e665 expref: 26 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.461369:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976848128:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066792.461839:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.463019:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976848128:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066792.463039:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3112960->3145727] (req 3112960->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.463051:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f795a00, rc 0) 00000100:00100000:2.0:1746066792.463086:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+26:31623:x1830882976944128:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 1825us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.463097:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14565 00000100:00100000:1.0:1746066792.467699:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.467771:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976944256 00000100:00100000:2.0:1746066792.467779:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976944256 00010000:00010000:2.0:1746066792.467809:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d09e00/0xfb36a14ee608b6c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e665 expref: 26 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.468408:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7470 00000100:00100000:2.0:1746066792.468416:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882976944256:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066792.468430:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066792.468448:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d09e00/0xfb36a14ee608b6c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e665 expref: 26 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.468459:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d09e00/0xfb36a14ee608b6c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e665 expref: 26 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.468482:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d09e00/0xfb36a14ee608b6c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e665 expref: 26 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.468620:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.468622:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.468628:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 25 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.468634:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 25 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.468661:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 25 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066792.468672:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976848256:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066792.469051:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066792.471165:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976848256:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066792.471185:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.471231:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882976944256:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2815us (3560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.471240:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7470 00000100:00100000:0.0:1746066792.471325:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.471460:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976944512 00000100:00100000:2.0:1746066792.471466:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976944512 00002000:00100000:2.0:1746066792.471494:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (3112960->3117055) req@ffff88008c394e00 x1830882976944512/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.471502:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394e00 with x1830882976944512 ext(3112960->3117055) 00002000:00010000:2.0:1746066792.471506:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c394e00 00000100:00100000:2.0:1746066792.471531:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6599 00000100:00100000:2.0:1746066792.471538:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882976944512:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066792.471669:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882976944512:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 132us (343us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066792.471699:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6599 00002000:00100000:2.0:1746066792.471704:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (3112960->3117055) req@ffff88008c394e00 x1830882976944512/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/4536 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.471709:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394e00 with x1830882976944512 ext(3112960->3117055) 00002000:00010000:2.0:1746066792.471712:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c394e00 00000100:00100000:0.0:1746066792.473773:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.473828:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976944640 00000100:00100000:2.0:1746066792.473834:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976944640 00000100:00100000:2.0:1746066792.473875:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14566 00000100:00100000:2.0:1746066792.473882:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+34:31623:x1830882976944640:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066792.473894:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.473910:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e681 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.473933:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a627a00/0xfb36a14ee608b6ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e673 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.473939:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.473941:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.473944:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->2813951] (req 2097152->2813951) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.473969:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a627a00/0xfb36a14ee608b6ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e673 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.473979:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a627a00/0xfb36a14ee608b6ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e673 expref: 35 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.473994:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976848384:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066792.474295:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.475197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.475234:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976944896 00000100:00100000:1.0:1746066792.475238:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976944896 00000100:00100000:1.0:1746066792.475264:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9985 00000100:00100000:1.0:1746066792.475269:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:31627:x1830882976944896:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066792.475304:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976848384:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066792.475321:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->2813951] (req 2097152->2813951) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.475334:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f795e00, rc 0) 00000100:00100000:3.0:1746066792.475357:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+35:31623:x1830882976944640:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 1476us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.475366:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14566 00010000:00010000:1.0:1746066792.475428:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.475438:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b800/0xfb36a14ee608b702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e688 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.475517:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b709 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475531:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475539:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475549:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b710 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475554:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475558:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475657:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b200/0xfb36a14ee608b717 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475665:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b200/0xfb36a14ee608b717 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475671:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b200/0xfb36a14ee608b717 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:1.0:1746066792.475707:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066792.475771:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475775:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b709 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475779:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b709 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475785:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009281b600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066792.475787:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b709 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475791:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b709 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475797:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066792.475798:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066792.475800:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475803:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475818:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475822:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b710 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475826:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475830:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009281b400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066792.475833:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475837:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b710 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475843:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebec300) 00010000:00010000:1.0:1746066792.475845:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066792.475847:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b710 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475851:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b710 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.475878:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b800/0xfb36a14ee608b702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e688 expref: 264 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.475885:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b200/0xfb36a14ee608b717 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e688 expref: 263 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.475890:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:1.0:1746066792.475892:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066792.475893:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009281b200, rc 0) 00000100:00100000:1.0:1746066792.475918:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:31627:x1830882976944896:12345-192.168.202.57@tcp:101:cat.0 Request processed in 649us (721us total) trans 8589944042 rc 0/0 00000100:00100000:1.0:1746066792.475923:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9985 00000100:00100000:0.0:1746066792.478317:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.478471:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976945024 00000100:00100000:3.0:1746066792.478479:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976945024 00010000:00010000:3.0:1746066792.478504:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a627a00/0xfb36a14ee608b6ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e673 expref: 35 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.478522:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7471 00000100:00100000:3.0:1746066792.478527:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+35:1963:x1830882976945024:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.478536:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.478551:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a627a00/0xfb36a14ee608b6ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e673 expref: 35 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.478558:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a627a00/0xfb36a14ee608b6ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e673 expref: 35 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.478573:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a627a00/0xfb36a14ee608b6ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e673 expref: 35 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.478596:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.478598:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.478604:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 34 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.478623:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 34 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.478649:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 34 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066792.478660:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976848512:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066792.478807:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.479864:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.479883:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.479910:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.479943:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976945152 00000100:00100000:0.0:1746066792.479948:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976945152 00000100:00100000:0.0:1746066792.479978:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 705 00000100:00100000:0.0:1746066792.479984:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:1964:x1830882976945152:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.479996:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066792.480010:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066792.480010:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b200/0xfb36a14ee608b717 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e688 expref: 263 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.480029:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00000100:00100000:2.0:1746066792.480030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066792.480032:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066792.480046:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976945280 00000100:00100000:2.0:1746066792.480048:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976945280 00000100:00100000:0.0:1746066792.480054:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:1964:x1830882976945152:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 71us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.480059:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 705 00000100:00100000:2.0:1746066792.480065:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976945408 00000100:00100000:2.0:1746066792.480067:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976945408 00000100:00100000:2.0:1746066792.480083:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976945536 00000100:00100000:2.0:1746066792.480085:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976945536 00000100:00100000:2.0:1746066792.480093:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976945664 00000100:00100000:2.0:1746066792.480095:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976945664 00000100:00100000:2.0:1746066792.480105:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14567 00000100:00100000:2.0:1746066792.480110:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882976945280:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:1.0:1746066792.480115:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14568 00010000:00010000:2.0:1746066792.480120:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066792.480120:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1964:x1830882976945408:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.480126:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.480130:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f795000/0xfb36a14ee608b725 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e68f expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.480132:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009281b000/0xfb36a14ee608b72c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e696 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066792.480155:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092849180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976848768:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066792.480155:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976848640:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066792.480188:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.480202:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14569 00000100:00100000:3.0:1746066792.480207:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14570 00000100:00100000:2.0:1746066792.480207:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882976945536:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066792.480212:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1963:x1830882976945664:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066792.480214:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.480216:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.480221:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099ac8800/0xfb36a14ee608b733 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e6a4 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.480229:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093304000/0xfb36a14ee608b73a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e69d expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066792.480238:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976848896:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066792.480245:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976849024:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066792.480305:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066792.480339:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d1d180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.480339:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a866ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066792.480587:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976848512:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066792.480600:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.480640:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+34:1963:x1830882976945024:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2112us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.480647:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7471 00002000:00010000:2.0:1746066792.481922:0:20532:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime: 1746066791 -> 1746066792 00002000:00010000:2.0:1746066792.481927:0:20532:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime: 1746066791 -> 1746066792 00002000:00010000:2.0:1746066792.481929:0:20532:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime: 1746066791 -> 1746066792 00000100:00100000:2.0:1746066792.481945:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092849180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976848768:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066792.481963:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f795000/0xfb36a14ee608b725 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e68f expref: 35 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.481979:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f795000/0xfb36a14ee608b725 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e68f expref: 35 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.481993:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f795000, rc 0) 00000100:00100000:2.0:1746066792.482025:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882976945280:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1914us (2140us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066792.482030:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14567 00002000:00010000:0.0:1746066792.482161:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime: 1746066791 -> 1746066792 00002000:00010000:0.0:1746066792.482165:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime: 1746066791 -> 1746066792 00002000:00010000:0.0:1746066792.482167:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime: 1746066791 -> 1746066792 00000100:00100000:0.0:1746066792.482179:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976848640:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066792.482195:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009281b000/0xfb36a14ee608b72c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e696 expref: 39 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.482205:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009281b000/0xfb36a14ee608b72c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e696 expref: 39 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.482214:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009281b000, rc 0) 00000100:00100000:0.0:1746066792.482232:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882976945408:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2112us (2322us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066792.482238:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14568 00002000:00010000:0.0:1746066792.482408:0:21203:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime: 1746066791 -> 1746066792 00000100:00100000:0.0:1746066792.482418:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976848896:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066792.482431:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099ac8800/0xfb36a14ee608b733 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6a4 expref: 37 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.482444:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099ac8800/0xfb36a14ee608b733 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6a4 expref: 37 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066792.482451:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ac8800, rc 0) 00002000:00010000:2.0:1746066792.482555:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime: 1746066791 -> 1746066792 00000100:00100000:2.0:1746066792.482564:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976849024:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066792.482579:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093304000/0xfb36a14ee608b73a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e69d expref: 33 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.482592:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093304000/0xfb36a14ee608b73a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e69d expref: 33 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.482600:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093304000, rc 0) 00000100:00100000:0.0:1746066792.482699:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882976945664:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2486us (2667us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066792.482706:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14570 00000100:00100000:2.0:1746066792.482931:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882976945536:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2723us (2918us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066792.482937:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14569 00000100:00100000:0.0:1746066792.485799:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.485859:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976945920 00000100:00100000:3.0:1746066792.485868:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976945920 00000100:00100000:0.0:1746066792.485879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:3.0:1746066792.485902:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38f:0x0] (2809856->2813951) req@ffff880099713b80 x1830882976945920/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.485911:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099713b80 with x1830882976945920 ext(2809856->2813951) 00002000:00010000:3.0:1746066792.485915:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099713b80 00000100:00100000:3.0:1746066792.485933:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6600 00000100:00100000:3.0:1746066792.485940:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+34:1963:x1830882976945920:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066792.485972:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976946048 00000100:00100000:2.0:1746066792.485976:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976946048 00000100:00100000:2.0:1746066792.485998:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14571 00000100:00100000:2.0:1746066792.486003:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:31627:x1830882976946048:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066792.486013:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.486026:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093304400/0xfb36a14ee608b741 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e6ab expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.486052:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.486060:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066792.486061:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066792.486065:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093304400/0xfb36a14ee608b741 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ab expref: 33 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066792.486077:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+34:1963:x1830882976945920:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 137us (286us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066792.486083:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6600 00002000:00100000:3.0:1746066792.486089:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38f:0x0] (2809856->2813951) req@ffff880099713b80 x1830882976945920/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/4536 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746066792.486089:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066792.486095:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099713b80 with x1830882976945920 ext(2809856->2813951) 00002000:00010000:3.0:1746066792.486098:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099713b80 00010000:00010000:2.0:1746066792.486103:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 24 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.486113:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976849152:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066792.486780:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a866ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.489793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.489981:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976946176 00000100:00100000:3.0:1746066792.489988:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976946176 00002000:00100000:3.0:1746066792.490019:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x38e:0x0] (770048->1048575) req@ffff880099712d80 x1830882976946176/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.490029:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099712d80 with x1830882976946176 ext(770048->1048575) 00010000:00010000:3.0:1746066792.490036:0:1992:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 25 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.490048:0:1992:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 25 pid: 8450 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746066792.490054:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099712d80 00000100:00100000:3.0:1746066792.490071:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2145 00000100:00100000:3.0:1746066792.490078:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882976946176:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066792.490341:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976849152:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066792.490364:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093304400/0xfb36a14ee608b741 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ab expref: 33 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.490379:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093304400, rc 0) 00000100:00100000:3.0:1746066792.490396:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:31627:x1830882976946048:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4393us (4517us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.490402:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14571 00000100:00100000:3.0:1746066792.498116:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882976946176:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 8030us (8320us total) trans 17179873594 rc 0/0 00000100:00100000:3.0:1746066792.498128:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2145 00002000:00100000:3.0:1746066792.498137:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x38e:0x0] (770048->1048575) req@ffff880099712d80 x1830882976946176/t17179873594(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/448 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.498146:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099712d80 with x1830882976946176 ext(770048->1048575) 00010000:00010000:3.0:1746066792.498154:0:1992:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 27 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.498168:0:1992:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 27 pid: 8450 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746066792.498175:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099712d80 00000100:00100000:0.0:1746066792.501854:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.501959:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976946304 00000100:00100000:3.0:1746066792.501966:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976946304 00010000:00010000:3.0:1746066792.501994:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 27 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.502015:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7472 00000100:00100000:3.0:1746066792.502021:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099712a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882976946304:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.502035:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.502050:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 27 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.502060:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 27 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.502077:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5475c00/0xfb36a14ee608b64c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e60a expref: 27 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.502100:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.502102:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.502108:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093304400/0xfb36a14ee608b741 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ab expref: 32 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.502116:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093304400/0xfb36a14ee608b741 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ab expref: 32 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.502142:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093304400/0xfb36a14ee608b741 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ab expref: 32 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066792.502151:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976849280:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066792.502202:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d1db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066792.505037:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976849280:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066792.505055:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.505087:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099712a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882976946304:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3066us (3240us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.505099:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7472 00000100:00100000:0.0:1746066792.507014:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.507469:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976946560 00000100:00100000:3.0:1746066792.507476:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976946560 00002000:00100000:3.0:1746066792.507511:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff880099713800 x1830882976946560/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.507519:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099713800 with x1830882976946560 ext(0->1048575) 00002000:00010000:3.0:1746066792.507523:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099713800 00000100:00100000:3.0:1746066792.507551:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6601 00000100:00100000:3.0:1746066792.507558:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882976946560:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066792.514262:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882976946560:12345-192.168.202.57@tcp:3:cat.0 Request processed in 6696us (7245us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066792.514272:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6601 00002000:00100000:3.0:1746066792.514284:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff880099713800 x1830882976946560/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.514293:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099713800 with x1830882976946560 ext(0->1048575) 00002000:00010000:3.0:1746066792.514297:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099713800 00000100:00100000:0.0:1746066792.520234:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.520402:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.520765:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976946816 00000100:00100000:1.0:1746066792.520774:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976946816 00000100:00100000:3.0:1746066792.520791:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976946944 00000100:00100000:3.0:1746066792.520795:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976946944 00000100:00100000:3.0:1746066792.520853:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14572 00000100:00100000:3.0:1746066792.520861:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:31627:x1830882976946944:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066792.520876:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.520892:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1eae00/0xfb36a14ee608b748 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e6b9 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.520921:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1744895) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.520927:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066792.520929:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066792.520932:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1eae00/0xfb36a14ee608b748 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b9 expref: 37 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.520956:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1744895) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.520967:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1744895) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 33 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.520977:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976849408:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066792.521354:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d1db40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066792.521445:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9986 00000100:00100000:1.0:1746066792.521453:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:31630:x1830882976946816:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066792.521466:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.521477:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a000/0xfb36a14ee608b74f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e6b2 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.521562:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a400/0xfb36a14ee608b756 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521572:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a400/0xfb36a14ee608b756 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521581:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a400/0xfb36a14ee608b756 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521591:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b75d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521597:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b75d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521602:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b75d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521723:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b200/0xfb36a14ee608b764 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521731:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b200/0xfb36a14ee608b764 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521737:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b200/0xfb36a14ee608b764 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:1.0:1746066792.521745:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066792.521816:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a400/0xfb36a14ee608b756 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521822:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a400/0xfb36a14ee608b756 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521827:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a400/0xfb36a14ee608b756 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521832:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009281a400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066792.521835:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a400/0xfb36a14ee608b756 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521841:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a400/0xfb36a14ee608b756 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521850:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066792.521853:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066792.521856:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a400/0xfb36a14ee608b756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521861:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a400/0xfb36a14ee608b756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521887:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b75d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521892:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b75d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521896:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b75d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521900:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009281b600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066792.521902:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b75d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521910:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b75d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521916:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebece00) 00010000:00010000:1.0:1746066792.521918:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066792.521920:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b75d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521924:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b600/0xfb36a14ee608b75d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.521957:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a000/0xfb36a14ee608b74f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b2 expref: 265 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.521967:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b200/0xfb36a14ee608b764 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b2 expref: 264 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.521973:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:1.0:1746066792.521974:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066792.521976:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009281b200, rc 0) 00000100:00100000:1.0:1746066792.522006:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:31630:x1830882976946816:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 554us (1604us total) trans 8589944043 rc 0/0 00000100:00100000:1.0:1746066792.522013:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9986 00000100:00100000:3.0:1746066792.526190:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976849408:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066792.526221:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1eae00/0xfb36a14ee608b748 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b9 expref: 37 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.526234:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1eae00, rc 0) 00000100:00100000:3.0:1746066792.526376:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:31627:x1830882976946944:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5514us (6152us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.526383:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14572 00000100:00100000:0.0:1746066792.526670:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.526823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.526865:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976947200 00000100:00100000:2.0:1746066792.526870:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976947200 00000100:00100000:2.0:1746066792.526900:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 706 00000100:00100000:2.0:1746066792.526906:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099713100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:1965:x1830882976947200:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066792.526916:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066792.526934:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b200/0xfb36a14ee608b764 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b2 expref: 264 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.526950:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066792.526953:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066792.526977:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099713100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:1965:x1830882976947200:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 71us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.526982:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 706 00000100:00100000:3.0:1746066792.527247:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976947072 00000100:00100000:3.0:1746066792.527251:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976947072 00002000:00100000:3.0:1746066792.527272:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->1744895) req@ffff880099710700 x1830882976947072/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.527280:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099710700 with x1830882976947072 ext(1048576->1744895) 00010000:00010000:3.0:1746066792.527285:0:1992:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 34 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.527295:0:1992:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 34 pid: 4614 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746066792.527301:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099710700 00000100:00100000:3.0:1746066792.527311:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2146 00000100:00100000:3.0:1746066792.527316:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+34:1963:x1830882976947072:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066792.534105:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+36:1963:x1830882976947072:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 6779us (7427us total) trans 21474840916 rc 0/0 00000100:00100000:3.0:1746066792.534129:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2146 00002000:00100000:3.0:1746066792.534139:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->1744895) req@ffff880099710700 x1830882976947072/t21474840916(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/448 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.534148:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099710700 with x1830882976947072 ext(1048576->1744895) 00010000:00010000:3.0:1746066792.534157:0:1992:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 36 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.534170:0:1992:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 36 pid: 4614 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746066792.534181:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099710700 00000100:00100000:0.0:1746066792.543439:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.543539:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976947328 00000100:00100000:2.0:1746066792.543546:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976947328 00010000:00010000:2.0:1746066792.543576:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 36 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:2.0:1746066792.543600:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7473 00000100:00100000:2.0:1746066792.543620:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099711c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+36:1965:x1830882976947328:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066792.543631:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066792.543649:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1744895) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 36 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.543660:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1744895) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 36 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.543700:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d08400/0xfb36a14ee608b65a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1744895) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e618 expref: 36 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.543727:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.543729:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.543734:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1eae00/0xfb36a14ee608b748 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b9 expref: 36 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.543741:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1eae00/0xfb36a14ee608b748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b9 expref: 36 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.543766:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1eae00/0xfb36a14ee608b748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b9 expref: 36 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066792.543776:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976849536:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066792.543844:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a866ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.547198:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976849536:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066792.547219:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066792.547251:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099711c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+35:1965:x1830882976947328:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3644us (3820us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.547260:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7473 00000100:00100000:0.0:1746066792.550127:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.550206:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976947584 00000100:00100000:3.0:1746066792.550213:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976947584 00002000:00100000:3.0:1746066792.550248:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880099711f80 x1830882976947584/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.550257:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099711f80 with x1830882976947584 ext(1048576->2097151) 00002000:00010000:3.0:1746066792.550261:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099711f80 00000100:00100000:3.0:1746066792.550276:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6602 00000100:00100000:3.0:1746066792.550281:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1966:x1830882976947584:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066792.564558:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1966:x1830882976947584:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14268us (14429us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066792.564569:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6602 00002000:00100000:3.0:1746066792.564579:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880099711f80 x1830882976947584/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.564588:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099711f80 with x1830882976947584 ext(1048576->2097151) 00002000:00010000:3.0:1746066792.564593:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099711f80 00000100:00100000:0.0:1746066792.572799:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.572879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.573137:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976947840 00000100:00100000:3.0:1746066792.573145:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976947840 00000100:00100000:3.0:1746066792.573181:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976947712 00000100:00100000:3.0:1746066792.573183:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976947712 00000100:00100000:3.0:1746066792.574510:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14573 00000100:00100000:3.0:1746066792.574518:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1965:x1830882976947840:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066792.574534:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.574550:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1eac00/0xfb36a14ee608b772 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e6c7 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066792.574602:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976849664:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066792.574696:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d1db40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066792.575360:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14574 00000100:00100000:1.0:1746066792.575368:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1965:x1830882976947712:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.575376:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.575386:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009281b600/0xfb36a14ee608b779 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e6c0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066792.575414:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976849792:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066792.575435:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066792.578557:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976849792:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066792.578583:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009281b600/0xfb36a14ee608b779 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6c0 expref: 34 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.578595:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009281b600/0xfb36a14ee608b779 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6c0 expref: 34 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066792.578616:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009281b600, rc 0) 00000100:00100000:1.0:1746066792.578645:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1965:x1830882976947712:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3278us (5765us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066792.578651:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14574 00000100:00100000:3.0:1746066792.578799:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976849664:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066792.578813:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1eac00/0xfb36a14ee608b772 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6c7 expref: 38 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066792.578820:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1eac00/0xfb36a14ee608b772 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6c7 expref: 38 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066792.580849:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1eac00, rc 0) 00000100:00100000:3.0:1746066792.580899:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1965:x1830882976947840:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6379us (8104us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066792.580907:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14573 00000100:00100000:0.0:1746066792.581118:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.581392:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976948096 00000100:00100000:1.0:1746066792.581398:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976948096 00000100:00100000:1.0:1746066792.581436:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9987 00000100:00100000:1.0:1746066792.581443:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:31633:x1830882976948096:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.581460:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.581473:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a200/0xfb36a14ee608b780 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e6ce expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.581989:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b800/0xfb36a14ee608b787 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.581999:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b800/0xfb36a14ee608b787 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582009:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b800/0xfb36a14ee608b787 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582018:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b78e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582023:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b78e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582028:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b78e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582111:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a600/0xfb36a14ee608b795 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582119:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a600/0xfb36a14ee608b795 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582124:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a600/0xfb36a14ee608b795 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:1.0:1746066792.582132:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066792.582195:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b800/0xfb36a14ee608b787 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582201:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b800/0xfb36a14ee608b787 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582207:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b800/0xfb36a14ee608b787 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582212:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009281b800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066792.582215:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b800/0xfb36a14ee608b787 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582221:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b800/0xfb36a14ee608b787 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582229:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066792.582231:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066792.582235:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b800/0xfb36a14ee608b787 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582239:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b800/0xfb36a14ee608b787 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582248:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b78e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582252:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b78e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582257:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b78e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582261:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009281b400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066792.582263:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b78e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582267:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b78e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582272:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebece00) 00010000:00010000:1.0:1746066792.582273:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066792.582275:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b78e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582279:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009281b400/0xfb36a14ee608b78e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066792.582307:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a200/0xfb36a14ee608b780 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ce expref: 23 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.582317:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a600/0xfb36a14ee608b795 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ce expref: 22 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.582322:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:1.0:1746066792.582324:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066792.582326:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009281a600, rc 0) 00000100:00100000:1.0:1746066792.582356:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+22:31633:x1830882976948096:12345-192.168.202.57@tcp:101:cat.0 Request processed in 913us (1239us total) trans 8589944044 rc 0/0 00000100:00100000:1.0:1746066792.582362:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9987 00000100:00100000:0.0:1746066792.584451:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.584470:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.584495:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.585282:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976948224 00000100:00100000:3.0:1746066792.585290:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976948224 00000100:00100000:3.0:1746066792.585324:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976948352 00000100:00100000:3.0:1746066792.585326:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976948352 00000100:00100000:3.0:1746066792.585342:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976948480 00000100:00100000:3.0:1746066792.585344:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976948480 00000100:00100000:3.0:1746066792.585357:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14575 00000100:00100000:3.0:1746066792.585363:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:31627:x1830882976948224:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066792.585376:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.585389:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d0c600/0xfb36a14ee608b7a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e6d5 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.585414:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.585421:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066792.585422:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066792.585425:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d0c600/0xfb36a14ee608b7a3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6d5 expref: 34 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.585449:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.585458:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 26 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.585468:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976849920:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066792.585518:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d1db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066792.585533:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14576 00000100:00100000:3.0:1746066792.585539:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+26:1965:x1830882976948352:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066792.585545:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.585550:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d0cc00/0xfb36a14ee608b7aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e6dc expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.585560:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.585562:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.585567:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d0cc00/0xfb36a14ee608b7aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6dc expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066792.585581:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d0cc00/0xfb36a14ee608b7aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6dc expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066792.585589:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d0cc00, rc 0) 00000100:00100000:3.0:1746066792.585617:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882976948352:12345-192.168.202.57@tcp:101:cat.0 Request processed in 68us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.585623:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14576 00000100:00100000:3.0:1746066792.585635:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14577 00000100:00100000:3.0:1746066792.585639:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+35:1965:x1830882976948480:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066792.585645:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.585652:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d0c200/0xfb36a14ee608b7b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e6e3 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.585662:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.585663:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.585667:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d0c200/0xfb36a14ee608b7b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6e3 expref: 36 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066792.585690:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d0c200/0xfb36a14ee608b7b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6e3 expref: 36 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066792.585697:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d0c200, rc 0) 00000100:00100000:3.0:1746066792.585711:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+36:1965:x1830882976948480:12345-192.168.202.57@tcp:101:cat.0 Request processed in 72us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.585716:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14577 00000100:00100000:0.0:1746066792.585780:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.586161:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976948608 00000100:00100000:3.0:1746066792.586165:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976948608 00000100:00100000:3.0:1746066792.586200:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 707 00000100:00100000:3.0:1746066792.586206:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:1966:x1830882976948608:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.586214:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.586228:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009281a600/0xfb36a14ee608b795 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ce expref: 22 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.586240:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066792.586243:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.586889:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:1966:x1830882976948608:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 682us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.586895:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 707 00000100:00100000:0.0:1746066792.589378:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.589440:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976948736 00000100:00100000:2.0:1746066792.589446:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976948736 00002000:00100000:2.0:1746066792.589477:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (3112960->3145727) req@ffff88012c0ff100 x1830882976948736/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.589486:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0ff100 with x1830882976948736 ext(3112960->3145727) 00010000:00010000:2.0:1746066792.589493:0:1992:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 27 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.589504:0:1992:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 27 pid: 4614 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066792.589510:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c0ff100 00000100:00100000:2.0:1746066792.589523:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2147 00000100:00100000:2.0:1746066792.589529:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882976948736:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066792.589946:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976849920:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066792.589965:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d0c600/0xfb36a14ee608b7a3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6d5 expref: 34 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.589977:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d0c600, rc 0) 00000100:00100000:3.0:1746066792.589999:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:31627:x1830882976948224:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4636us (5553us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.590005:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14575 00000100:00100000:2.0:1746066792.592377:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882976948736:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 2842us (2999us total) trans 17179873595 rc 0/0 00000100:00100000:2.0:1746066792.592387:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2147 00002000:00100000:2.0:1746066792.592396:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (3112960->3145727) req@ffff88012c0ff100 x1830882976948736/t17179873595(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/448 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.592405:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0ff100 with x1830882976948736 ext(3112960->3145727) 00010000:00010000:2.0:1746066792.592413:0:1992:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 29 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.592430:0:1992:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 29 pid: 4614 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066792.592437:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c0ff100 00000100:00100000:0.0:1746066792.595362:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.595573:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976948864 00000100:00100000:3.0:1746066792.595580:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976948864 00010000:00010000:3.0:1746066792.595617:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 29 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.595642:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7474 00000100:00100000:3.0:1746066792.595650:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882976948864:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.595661:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.595697:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 29 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.595707:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 29 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.595727:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f795a00/0xfb36a14ee608b6f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e67a expref: 29 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.595738:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.595740:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.595745:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d0c600/0xfb36a14ee608b7a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6d5 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.595752:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d0c600/0xfb36a14ee608b7a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6d5 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.595778:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d0c600/0xfb36a14ee608b7a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6d5 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066792.595789:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976850048:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066792.595863:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d1db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.598231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.598319:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976850048:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066792.598333:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.598371:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882976948864:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2722us (3015us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.598380:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7474 00000100:00100000:2.0:1746066792.598479:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976949120 00000100:00100000:2.0:1746066792.598484:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976949120 00002000:00100000:2.0:1746066792.598510:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88012c0ff800 x1830882976949120/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.598519:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0ff800 with x1830882976949120 ext(0->1048575) 00002000:00010000:2.0:1746066792.598523:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0ff800 00000100:00100000:2.0:1746066792.598545:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6603 00000100:00100000:2.0:1746066792.598551:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882976949120:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066792.607061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.607118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.607193:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976949376 00000100:00100000:0.0:1746066792.607201:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976949376 00002000:00100000:0.0:1746066792.607239:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009284ad80 x1830882976949376/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.607248:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284ad80 with x1830882976949376 ext(1048576->2097151) 00002000:00010000:0.0:1746066792.607253:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284ad80 00000100:00100000:0.0:1746066792.607267:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976949632 00000100:00100000:0.0:1746066792.607274:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976949632 00002000:00100000:0.0:1746066792.607286:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009a5c2d80 x1830882976949632/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.607292:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5c2d80 with x1830882976949632 ext(2097152->3145727) 00002000:00010000:0.0:1746066792.607294:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a5c2d80 00000100:00100000:0.0:1746066792.607302:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6604 00000100:00100000:0.0:1746066792.607308:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+36:1966:x1830882976949376:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066792.607314:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6605 00000100:00100000:1.0:1746066792.607322:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882976949632:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066792.617219:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882976949120:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18659us (18983us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066792.617230:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6603 00002000:00100000:2.0:1746066792.617240:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88012c0ff800 x1830882976949120/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.617249:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0ff800 with x1830882976949120 ext(0->1048575) 00002000:00010000:2.0:1746066792.617255:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0ff800 00000100:00100000:2.0:1746066792.618254:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882976949632:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10931us (11132us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066792.618264:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6605 00002000:00100000:2.0:1746066792.618270:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009a5c2d80 x1830882976949632/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.618278:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5c2d80 with x1830882976949632 ext(2097152->3145727) 00002000:00010000:2.0:1746066792.618281:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a5c2d80 00000100:00100000:2.0:1746066792.621773:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+36:1966:x1830882976949376:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14457us (14711us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066792.621783:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6604 00002000:00100000:2.0:1746066792.621792:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009284ad80 x1830882976949376/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.621800:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284ad80 with x1830882976949376 ext(1048576->2097151) 00002000:00010000:2.0:1746066792.621805:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284ad80 00000100:00100000:0.0:1746066792.621864:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.621921:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976949760 00000100:00100000:3.0:1746066792.621927:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976949760 00000100:00100000:3.0:1746066792.621958:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14578 00000100:00100000:3.0:1746066792.621965:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:31627:x1830882976949760:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066792.621976:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.621994:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e6ea expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.622015:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.622022:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066792.622023:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066792.622026:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ea expref: 38 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.622051:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.622061:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 35 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.622071:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976850176:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066792.622182:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d1d180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066792.626526:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976850176:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066792.626551:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ea expref: 38 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.626565:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d0c800, rc 0) 00000100:00100000:3.0:1746066792.626601:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:31627:x1830882976949760:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4637us (4737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.626619:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14578 00000100:00100000:0.0:1746066792.629397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.629457:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976949888 00000100:00100000:2.0:1746066792.629464:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976949888 00002000:00100000:2.0:1746066792.629498:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->2813951) req@ffff88012c0ff480 x1830882976949888/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.629507:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0ff480 with x1830882976949888 ext(2097152->2813951) 00010000:00010000:2.0:1746066792.629515:0:11692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 36 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.629526:0:11692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 36 pid: 4614 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066792.629532:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c0ff480 00000100:00100000:2.0:1746066792.629561:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2148 00000100:00100000:2.0:1746066792.629568:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+36:1963:x1830882976949888:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066792.634902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.634986:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976950016 00000100:00100000:3.0:1746066792.634994:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976950016 00000100:00100000:3.0:1746066792.635028:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14579 00000100:00100000:3.0:1746066792.635034:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+28:31633:x1830882976950016:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066792.635048:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.635062:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d0ca00/0xfb36a14ee608b7bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e6f1 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.635081:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.635082:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.635088:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d0ca00/0xfb36a14ee608b7bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f1 expref: 29 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.635099:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d0ca00/0xfb36a14ee608b7bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f1 expref: 29 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.635107:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d0ca00, rc 0) 00000100:00100000:3.0:1746066792.635140:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+29:31633:x1830882976950016:12345-192.168.202.57@tcp:101:cat.0 Request processed in 107us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.635148:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14579 00000100:00100000:2.0:1746066792.638432:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+38:1963:x1830882976949888:12345-192.168.202.57@tcp:4:cat.0 Request processed in 8855us (9032us total) trans 21474840917 rc 0/0 00000100:00100000:2.0:1746066792.638442:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2148 00002000:00100000:2.0:1746066792.638451:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->2813951) req@ffff88012c0ff480 x1830882976949888/t21474840917(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/448 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.638459:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0ff480 with x1830882976949888 ext(2097152->2813951) 00010000:00010000:2.0:1746066792.638467:0:11692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 38 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.638479:0:11692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 38 pid: 4614 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066792.638485:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c0ff480 00000100:00100000:0.0:1746066792.647149:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.647198:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.647279:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976950272 00000100:00100000:2.0:1746066792.647287:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976950272 00002000:00100000:2.0:1746066792.647322:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88012c0fc700 x1830882976950272/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.647331:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fc700 with x1830882976950272 ext(2097152->3145727) 00002000:00010000:2.0:1746066792.647336:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fc700 00000100:00100000:2.0:1746066792.647352:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6606 00000100:00100000:2.0:1746066792.647358:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+29:1965:x1830882976950272:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066792.648713:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976950400 00000100:00100000:3.0:1746066792.648719:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976950400 00010000:00010000:3.0:1746066792.648738:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 38 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.648758:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7475 00000100:00100000:3.0:1746066792.648764:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+38:1964:x1830882976950400:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.648773:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.648788:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 38 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.648797:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 38 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.648816:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f795e00/0xfb36a14ee608b6fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2813951) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e681 expref: 38 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.648832:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.648834:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.648839:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ea expref: 37 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.648846:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ea expref: 37 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.648871:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ea expref: 37 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066792.648883:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976850304:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066792.648928:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d1d180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066792.654667:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976850304:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066792.654714:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.654760:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+37:1964:x1830882976950400:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5994us (7560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.654769:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7475 00000100:00100000:2.0:1746066792.655905:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+29:1965:x1830882976950272:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8544us (8759us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066792.655912:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6606 00002000:00100000:2.0:1746066792.655919:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88012c0fc700 x1830882976950272/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.655925:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fc700 with x1830882976950272 ext(2097152->3145727) 00002000:00010000:2.0:1746066792.655929:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fc700 00000100:00100000:0.0:1746066792.662045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.662086:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.662117:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.662143:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976950912 00000100:00100000:2.0:1746066792.662151:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976950912 00000100:00100000:0.0:1746066792.662158:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.662183:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976950784 00000100:00100000:2.0:1746066792.662184:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976950784 00000100:00100000:1.0:1746066792.662186:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976950656 00000100:00100000:1.0:1746066792.662190:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976950656 00000100:00100000:2.0:1746066792.662194:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 356 00000100:00100000:2.0:1746066792.662199:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976950912:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1746066792.662201:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 357 00000100:00100000:1.0:1746066792.662214:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 213 00000100:00100000:0.0:1746066792.662214:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976950784:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1746066792.662219:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976950656:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1746066792.662251:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976950912:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 52us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.662257:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 356 00000100:00100000:3.0:1746066792.662300:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976950528 00000100:00100000:3.0:1746066792.662307:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976950528 00000100:00100000:3.0:1746066792.662330:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 219 00000100:00100000:3.0:1746066792.662335:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69ee3f12-76db-44fe-a8c9-a42ead582d61+15:1964:x1830882976950528:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1746066792.662501:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976950784:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 293us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.662506:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 357 00000100:00100000:1.0:1746066792.662574:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976950656:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 354us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066792.662579:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 213 00000100:00100000:3.0:1746066792.662581:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69ee3f12-76db-44fe-a8c9-a42ead582d61+15:1964:x1830882976950528:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 245us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.662585:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.662587:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 219 00000100:00100000:2.0:1746066792.662601:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976951168 00000100:00100000:2.0:1746066792.662615:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976951168 00000100:00100000:1.0:1746066792.662624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:2.0:1746066792.662636:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009a5c1880 x1830882976951168/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.662642:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5c1880 with x1830882976951168 ext(2097152->3145727) 00002000:00010000:2.0:1746066792.662647:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a5c1880 00000100:00100000:1.0:1746066792.662647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.662673:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976951424 00000100:00100000:2.0:1746066792.662673:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976951680 00000100:00100000:2.0:1746066792.662691:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976951680 00000100:00100000:3.0:1746066792.662693:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976951424 00002000:00100000:2.0:1746066792.662699:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009b7fa680 x1830882976951680/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.662707:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fa680 with x1830882976951680 ext(3145728->4194303) 00002000:00010000:2.0:1746066792.662709:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7fa680 00002000:00100000:3.0:1746066792.662710:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009b7f9500 x1830882976951424/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.662717:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f9500 with x1830882976951424 ext(3145728->4194303) 00000100:00100000:2.0:1746066792.662719:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6607 00002000:00010000:3.0:1746066792.662720:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7f9500 00000100:00100000:2.0:1746066792.662722:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1965:x1830882976951168:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066792.662731:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6608 00000100:00100000:3.0:1746066792.662736:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882976951680:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066792.663815:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6609 00000100:00100000:1.0:1746066792.664082:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1965:x1830882976951424:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066792.665181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.665537:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976951808 00000100:00100000:3.0:1746066792.665543:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976951808 00000100:00100000:3.0:1746066792.667005:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14580 00000100:00100000:3.0:1746066792.667017:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+37:31633:x1830882976951808:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066792.667033:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.667047:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d0d200/0xfb36a14ee608b7c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e6f8 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.667078:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.667080:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066792.667087:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d0d200/0xfb36a14ee608b7c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f8 expref: 38 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.667100:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d0d200/0xfb36a14ee608b7c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f8 expref: 38 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.667110:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d0d200, rc 0) 00000100:00100000:3.0:1746066792.667154:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+38:31633:x1830882976951808:12345-192.168.202.57@tcp:101:cat.0 Request processed in 140us (1975us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.667160:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14580 00000100:00100000:2.0:1746066792.672138:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1965:x1830882976951168:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 9403us (9541us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066792.672150:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6607 00002000:00100000:2.0:1746066792.672162:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009a5c1880 x1830882976951168/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.672171:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5c1880 with x1830882976951168 ext(2097152->3145727) 00002000:00010000:2.0:1746066792.672177:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a5c1880 00000100:00100000:3.0:1746066792.679166:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882976951680:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 16421us (16509us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066792.679175:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6608 00002000:00100000:3.0:1746066792.679185:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009b7fa680 x1830882976951680/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.679194:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fa680 with x1830882976951680 ext(3145728->4194303) 00002000:00010000:3.0:1746066792.679199:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7fa680 00000100:00100000:0.0:1746066792.680232:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.680266:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.680345:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.680403:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976952192 00000100:00100000:3.0:1746066792.680410:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976952192 00002000:00100000:3.0:1746066792.680437:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009b470380 x1830882976952192/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.680445:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470380 with x1830882976952192 ext(3145728->4194303) 00000100:00100000:2.0:1746066792.680447:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976952320 00002000:00010000:3.0:1746066792.680448:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b470380 00000100:00100000:2.0:1746066792.680451:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976952320 00000100:00100000:3.0:1746066792.680460:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976952448 00000100:00100000:3.0:1746066792.680462:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976952448 00002000:00100000:2.0:1746066792.680468:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009b471500 x1830882976952320/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.680470:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009b473800 x1830882976952448/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.680476:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b471500 with x1830882976952320 ext(2097152->3145727) 00002000:00100000:3.0:1746066792.680477:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b473800 with x1830882976952448 ext(3145728->4194303) 00002000:00010000:3.0:1746066792.680479:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b473800 00002000:00010000:2.0:1746066792.680479:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b471500 00000100:00100000:2.0:1746066792.680490:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6610 00000100:00100000:2.0:1746066792.680495:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882976952192:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066792.680498:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6611 00000100:00100000:3.0:1746066792.680503:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+39:1964:x1830882976952320:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066792.680974:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.680989:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976952704 00000100:00100000:0.0:1746066792.680992:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976952704 00000100:00100000:0.0:1746066792.681014:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14581 00000100:00100000:0.0:1746066792.681018:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:31630:x1830882976952704:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066792.681026:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066792.681039:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e6ff expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.681059:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ea expref: 41 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.681065:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d0d200/0xfb36a14ee608b7c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f8 expref: 39 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.681071:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.681072:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.681075:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3682304->4194303] (req 3682304->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 41 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.681109:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d0d200/0xfb36a14ee608b7c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f8 expref: 39 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.681119:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d0d200/0xfb36a14ee608b7c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f8 expref: 39 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746066792.681128:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976850432:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066792.681186:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ea expref: 41 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.681193:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ea expref: 41 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746066792.681200:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976850560:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066792.681217:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540d180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.681482:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2149 00000100:00100000:2.0:1746066792.681488:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+39:1964:x1830882976952448:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066792.683105:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1965:x1830882976951424:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 19277us (20474us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066792.683114:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6609 00002000:00100000:1.0:1746066792.683122:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009b7f9500 x1830882976951424/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066792.683136:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f9500 with x1830882976951424 ext(3145728->4194303) 00010000:00010000:1.0:1746066792.683144:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ea expref: 40 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066792.683154:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ea expref: 40 pid: 4614 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746066792.683160:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b7f9500 00000100:00100000:2.0:1746066792.691668:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976850432:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066792.691709:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976850560:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066792.691734:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3682304->4194303] (req 3682304->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 39 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.691750:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b95400, rc 0) 00000100:00100000:2.0:1746066792.691790:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:31630:x1830882976952704:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 10770us (10815us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.691798:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14581 00000100:00100000:3.0:1746066792.692111:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882976952192:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11613us (11880us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066792.692119:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6610 00002000:00100000:3.0:1746066792.692127:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009b470380 x1830882976952192/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.692136:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470380 with x1830882976952192 ext(3145728->4194303) 00002000:00010000:3.0:1746066792.692140:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b470380 00000100:00100000:0.0:1746066792.698852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.699255:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976952832 00000100:00100000:2.0:1746066792.699263:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976952832 00000100:00100000:2.0:1746066792.699300:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14582 00000100:00100000:2.0:1746066792.699307:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1964:x1830882976952832:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066792.699322:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.699337:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f795400/0xfb36a14ee608b7d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e706 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.699356:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.699365:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f795400/0xfb36a14ee608b7d4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e706 expref: 40 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.699374:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f795400/0xfb36a14ee608b7d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e706 expref: 40 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.699403:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f795400, rc 0) 00000100:00100000:2.0:1746066792.699452:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1964:x1830882976952832:12345-192.168.202.57@tcp:101:cat.0 Request processed in 145us (608us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066792.699460:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14582 00000100:00100000:3.0:1746066792.700036:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+40:1964:x1830882976952448:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18547us (19689us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066792.700044:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2149 00002000:00100000:3.0:1746066792.700052:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009b473800 x1830882976952448/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.700066:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b473800 with x1830882976952448 ext(3145728->4194303) 00010000:00010000:3.0:1746066792.700072:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d0d200/0xfb36a14ee608b7c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f8 expref: 40 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.700081:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d0d200/0xfb36a14ee608b7c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f8 expref: 40 pid: 4614 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746066792.700087:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b473800 00000100:00100000:1.0:1746066792.704345:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.704613:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+38:1964:x1830882976952320:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24097us (24335us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066792.704623:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6611 00002000:00100000:2.0:1746066792.704637:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009b471500 x1830882976952320/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.704645:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b471500 with x1830882976952320 ext(2097152->3145727) 00010000:00010000:2.0:1746066792.704656:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d0d200/0xfb36a14ee608b7c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f8 expref: 38 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.704666:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d0d200/0xfb36a14ee608b7c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f8 expref: 38 pid: 4614 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066792.704700:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b471500 00000100:00100000:3.0:1746066792.704764:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976952960 00000100:00100000:3.0:1746066792.704771:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976952960 00010000:00010000:3.0:1746066792.704794:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ea expref: 39 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:3.0:1746066792.712158:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7476 00000100:00100000:3.0:1746066792.712178:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1963:x1830882976952960:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066792.712196:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066792.712221:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ea expref: 39 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.712235:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ea expref: 39 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.712254:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d0c800/0xfb36a14ee608b7b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ea expref: 39 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.712289:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.712348:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1963:x1830882976952960:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 179us (8009us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.712354:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7476 00000100:00100000:2.0:1746066792.714232:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.714269:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.714315:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976953344 00000100:00100000:1.0:1746066792.714323:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976953344 00000100:00100000:2.0:1746066792.714342:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.714353:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14583 00000100:00100000:1.0:1746066792.714359:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+38:31633:x1830882976953344:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066792.714374:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.714386:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e70d expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.714406:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.714412:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3682304->4194303] (req 3682304->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 37 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.714422:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066792.714425:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 39 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066792.714433:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976953216 00000100:00100000:0.0:1746066792.714436:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976953216 00010000:00010000:1.0:1746066792.714454:0:4614:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3682304->4194303] (req 3682304->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 37 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.714464:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 39 pid: 4614 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746066792.714464:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009a5c0000 x1830882976953216/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746066792.714472:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb09200, rc 0) 00002000:00100000:0.0:1746066792.714472:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5c0000 with x1830882976953216 ext(4194304->5091327) 00002000:00010000:0.0:1746066792.714476:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a5c0000 00000100:00100000:0.0:1746066792.714487:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6613 00000100:00100000:0.0:1746066792.714492:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882976953216:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066792.714500:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+39:31633:x1830882976953344:12345-192.168.202.57@tcp:101:cat.0 Request processed in 141us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066792.714505:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14583 00000100:00100000:0.0:1746066792.715756:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976953472 00000100:00100000:0.0:1746066792.715762:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976953472 00010000:00010000:0.0:1746066792.715782:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d0d200/0xfb36a14ee608b7c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f8 expref: 39 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746066792.715801:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7477 00000100:00100000:0.0:1746066792.715806:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+39:1966:x1830882976953472:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.715815:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.715831:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d0d200/0xfb36a14ee608b7c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f8 expref: 39 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746066792.715840:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d0d200/0xfb36a14ee608b7c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f8 expref: 39 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746066792.715855:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d0d200/0xfb36a14ee608b7c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f8 expref: 39 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746066792.715866:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.715868:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.715873:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 37 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.715879:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 37 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.715907:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 37 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.715919:0:21351:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 37 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746066792.715928:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976850816:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066792.715983:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540df00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.718428:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.718485:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976953728 00000100:00100000:1.0:1746066792.718491:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976953728 00000100:00100000:1.0:1746066792.718539:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9988 00000100:00100000:1.0:1746066792.718546:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:31635:x1830882976953728:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066792.718567:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.718581:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08600/0xfb36a14ee608b7e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e714 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.718716:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08200/0xfb36a14ee608b7e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718727:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08200/0xfb36a14ee608b7e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718736:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08200/0xfb36a14ee608b7e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718747:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08c00/0xfb36a14ee608b7f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718752:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08c00/0xfb36a14ee608b7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718756:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08c00/0xfb36a14ee608b7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718840:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09c00/0xfb36a14ee608b7f7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718849:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09c00/0xfb36a14ee608b7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718854:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09c00/0xfb36a14ee608b7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746066792.718860:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066792.718931:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08200/0xfb36a14ee608b7e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718937:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08200/0xfb36a14ee608b7e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718942:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08200/0xfb36a14ee608b7e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718946:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eb08200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066792.718950:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08200/0xfb36a14ee608b7e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718956:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08200/0xfb36a14ee608b7e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718965:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066792.718968:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066792.718971:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08200/0xfb36a14ee608b7e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718975:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08200/0xfb36a14ee608b7e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718991:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08c00/0xfb36a14ee608b7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.718996:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08c00/0xfb36a14ee608b7f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.719000:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08c00/0xfb36a14ee608b7f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.719004:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eb08c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066792.719006:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08c00/0xfb36a14ee608b7f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.719010:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08c00/0xfb36a14ee608b7f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.719016:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebecb00) 00010000:00010000:1.0:1746066792.719017:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066792.719019:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08c00/0xfb36a14ee608b7f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.719023:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08c00/0xfb36a14ee608b7f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066792.719054:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb08600/0xfb36a14ee608b7e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e714 expref: 24 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.719065:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09c00/0xfb36a14ee608b7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e714 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.719070:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:1.0:1746066792.719072:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066792.719073:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb09c00, rc 0) 00000100:00100000:1.0:1746066792.719108:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:31635:x1830882976953728:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 562us (686us total) trans 8589944045 rc 0/0 00000100:00100000:1.0:1746066792.719113:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9988 00000100:00100000:0.0:1746066792.723390:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976850816:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066792.723413:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.723444:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+38:1966:x1830882976953472:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7637us (9100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.723452:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7477 00000100:00100000:2.0:1746066792.724119:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882976953216:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9625us (9890us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066792.724127:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6613 00002000:00100000:2.0:1746066792.724135:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009a5c0000 x1830882976953216/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.724144:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a5c0000 with x1830882976953216 ext(4194304->5091327) 00002000:00010000:2.0:1746066792.724148:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a5c0000 00000100:00100000:0.0:1746066792.724332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.724656:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.724781:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976953984 00000100:00100000:2.0:1746066792.724787:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976953984 00002000:00100000:2.0:1746066792.724813:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3682304->3686399) req@ffff88009244d180 x1830882976953984/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.724821:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244d180 with x1830882976953984 ext(3682304->3686399) 00010000:00010000:2.0:1746066792.724827:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 38 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:2.0:1746066792.724839:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 38 pid: 8450 timeout: 853 lvb_type: 0 00002000:00010000:2.0:1746066792.724845:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009244d180 00000100:00100000:0.0:1746066792.725461:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.725514:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976954112 00000100:00100000:1.0:1746066792.725518:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976954112 00000100:00100000:1.0:1746066792.726130:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 708 00000100:00100000:1.0:1746066792.726138:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882976954112:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066792.726150:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066792.726171:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb09c00/0xfb36a14ee608b7f7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e714 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.726184:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:1.0:1746066792.726188:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066792.726217:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1966:x1830882976954112:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 80us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066792.726223:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 708 00000100:00100000:3.0:1746066792.726293:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2150 00000100:00100000:3.0:1746066792.726300:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882976953984:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066792.726407:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882976953984:12345-192.168.202.57@tcp:3:cat.0 Request processed in 108us (2075us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066792.726412:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2150 00002000:00100000:3.0:1746066792.726417:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3682304->3686399) req@ffff88009244d180 x1830882976953984/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/4536 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.726424:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244d180 with x1830882976953984 ext(3682304->3686399) 00010000:00010000:3.0:1746066792.726429:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 38 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.726438:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 38 pid: 8450 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746066792.726443:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009244d180 00000100:00100000:2.0:1746066792.726508:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976954368 00000100:00100000:2.0:1746066792.726511:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976954368 00000100:00100000:3.0:1746066792.727864:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4165 00000100:00100000:3.0:1746066792.727872:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f5adc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:31635:x1830882976954368:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066792.728021:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f5adc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:31635:x1830882976954368:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 150us (2561us total) trans 8589944046 rc 0/0 00000100:00100000:3.0:1746066792.728026:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4165 00000100:00100000:1.0:1746066792.732729:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.733239:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.734780:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976954624 00000100:00100000:3.0:1746066792.734793:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976954624 00000100:00100000:3.0:1746066792.734835:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4166 00000100:00100000:3.0:1746066792.734843:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:31627:x1830882976954624:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:3.0:1746066792.735012:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:31627:x1830882976954624:12345-192.168.202.57@tcp:35:cat.0 Request processed in 170us (2290us total) trans 8589944047 rc 0/0 00000100:00100000:3.0:1746066792.735019:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4166 00000100:00100000:1.0:1746066792.735702:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976954752 00000100:00100000:1.0:1746066792.735706:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976954752 00000100:00100000:1.0:1746066792.735731:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14584 00000100:00100000:1.0:1746066792.735737:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+29:31635:x1830882976954752:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066792.735747:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.735761:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e71b expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.735781:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d0c600/0xfb36a14ee608b7a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6d5 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.735788:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d0ca00/0xfb36a14ee608b7bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f1 expref: 30 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.735792:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.735794:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.735796:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4030464->4194303] (req 4030464->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 30 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.735820:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d0ca00/0xfb36a14ee608b7bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f1 expref: 30 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.735829:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d0ca00/0xfb36a14ee608b7bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f1 expref: 30 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066792.735839:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976850944:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066792.735891:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d0c600/0xfb36a14ee608b7a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6d5 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.735900:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d0c600/0xfb36a14ee608b7a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6d5 expref: 33 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066792.735906:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976851072:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066792.735922:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcb600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066792.737307:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.737359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.737376:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976955008 00000100:00100000:1.0:1746066792.737380:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976955008 00000100:00100000:1.0:1746066792.737402:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14585 00000100:00100000:1.0:1746066792.737407:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:31630:x1830882976955008:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066792.737417:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066792.737425:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e722 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.737439:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.737441:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.737444:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->4534271] (req 4194304->4534271) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 35 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.737453:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->4534271] (req 4194304->4534271) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 35 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.737462:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb09e00, rc 0) 00000100:00100000:1.0:1746066792.737484:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:31630:x1830882976955008:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 77us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066792.737490:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14585 00000100:00100000:3.0:1746066792.739259:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976955136 00000100:00100000:3.0:1746066792.739264:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976955136 00002000:00100000:3.0:1746066792.739294:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3682304->4194303) req@ffff8800929cc700 x1830882976955136/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.739302:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cc700 with x1830882976955136 ext(3682304->4194303) 00010000:00010000:3.0:1746066792.739309:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 38 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.739319:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 38 pid: 8450 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746066792.739325:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929cc700 00000100:00100000:3.0:1746066792.739342:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2151 00000100:00100000:3.0:1746066792.739347:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882976955136:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066792.743245:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976850944:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066792.743256:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976851072:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066792.743282:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4030464->4194303] (req 4030464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 30 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.743295:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb09000, rc 0) 00000100:00100000:0.0:1746066792.743337:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+30:31635:x1830882976954752:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 7600us (10098us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.743348:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14584 00000100:00100000:0.0:1746066792.748659:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.749956:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.749976:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976955264 00000100:00100000:0.0:1746066792.749982:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976955264 00010000:00010000:0.0:1746066792.750008:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d0ca00/0xfb36a14ee608b7bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f1 expref: 30 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746066792.750027:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7478 00000100:00100000:0.0:1746066792.750033:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+30:1963:x1830882976955264:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.750043:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.750061:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d0ca00/0xfb36a14ee608b7bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f1 expref: 30 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746066792.750071:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d0ca00/0xfb36a14ee608b7bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f1 expref: 30 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746066792.750090:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d0ca00/0xfb36a14ee608b7bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6f1 expref: 30 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746066792.751108:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.751135:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976955392 00000100:00100000:0.0:1746066792.751139:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976955392 00010000:00010000:0.0:1746066792.751156:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d0c600/0xfb36a14ee608b7a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6d5 expref: 35 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746066792.751173:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7479 00000100:00100000:0.0:1746066792.751178:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1966:x1830882976955392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.751184:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.751194:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d0c600/0xfb36a14ee608b7a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6d5 expref: 35 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746066792.751201:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d0c600/0xfb36a14ee608b7a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6d5 expref: 35 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746066792.751216:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d0c600/0xfb36a14ee608b7a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6d5 expref: 35 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746066792.751223:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.752132:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.752141:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 4030464->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 29 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.752147:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 4030464->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 29 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.752154:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.752155:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.752158:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4534271) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 34 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.752163:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4534271) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 34 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.752189:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4534271) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 34 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066792.752199:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976851200:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066792.752279:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 4030464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 29 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066792.752286:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976851328:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066792.752299:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.752415:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882976955264:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2379us (3757us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.752422:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7478 00000100:00100000:0.0:1746066792.763615:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.763643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.766086:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976955776 00000100:00100000:3.0:1746066792.766095:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976955776 00002000:00100000:3.0:1746066792.766129:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (4030464->4034559) req@ffff88009244d880 x1830882976955776/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.766137:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244d880 with x1830882976955776 ext(4030464->4034559) 00002000:00010000:3.0:1746066792.766142:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244d880 00000100:00100000:3.0:1746066792.766154:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976955904 00000100:00100000:3.0:1746066792.766156:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976955904 00002000:00100000:3.0:1746066792.766164:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (4530176->4534271) req@ffff88009244c000 x1830882976955904/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.766170:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244c000 with x1830882976955904 ext(4530176->4534271) 00002000:00010000:3.0:1746066792.766172:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244c000 00000100:00100000:3.0:1746066792.766180:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6614 00000100:00100000:3.0:1746066792.766185:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882976955776:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066792.766294:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882976955776:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 109us (2697us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066792.766300:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6614 00002000:00100000:3.0:1746066792.766304:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (4030464->4034559) req@ffff88009244d880 x1830882976955776/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/4536 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.766310:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244d880 with x1830882976955776 ext(4030464->4034559) 00002000:00010000:3.0:1746066792.766313:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244d880 00000100:00100000:3.0:1746066792.766324:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6615 00000100:00100000:3.0:1746066792.766327:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882976955904:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066792.766365:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882976955904:12345-192.168.202.57@tcp:3:cat.0 Request processed in 38us (2723us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066792.766370:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6615 00002000:00100000:3.0:1746066792.766373:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (4530176->4534271) req@ffff88009244c000 x1830882976955904/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/4536 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.766378:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244c000 with x1830882976955904 ext(4530176->4534271) 00002000:00010000:3.0:1746066792.766380:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244c000 00000100:00100000:0.0:1746066792.785391:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976851200:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066792.785437:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976851328:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066792.785453:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066792.793228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.793333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.793356:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976956160 00000100:00100000:3.0:1746066792.793364:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976956160 00000100:00100000:3.0:1746066792.793398:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4167 00000100:00100000:3.0:1746066792.793404:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:31630:x1830882976956160:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066792.793554:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:31630:x1830882976956160:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 149us (331us total) trans 8589944048 rc 0/0 00000100:00100000:3.0:1746066792.793560:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4167 00000100:00100000:3.0:1746066792.793576:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976956288 00000100:00100000:3.0:1746066792.793578:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976956288 00000100:00100000:3.0:1746066792.793617:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14586 00000100:00100000:3.0:1746066792.793622:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+38:31635:x1830882976956288:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066792.793631:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.793644:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e729 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.793661:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066792.793665:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 39 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.793671:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746066792.793687:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->3153919] (req 3145728->3153919) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 39 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.793714:0:4614:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 39 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.793728:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->3153919] (req 3145728->3153919) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 39 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.793736:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092f60800, rc 0) 00000100:00100000:3.0:1746066792.793750:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+39:31635:x1830882976956288:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 128us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066792.793755:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14586 00000100:00100000:3.0:1746066792.795267:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1964:x1830882976955136:12345-192.168.202.57@tcp:4:cat.0 Request processed in 55914us (57902us total) trans 21474840918 rc 0/0 00000100:00100000:3.0:1746066792.795274:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2151 00002000:00100000:3.0:1746066792.795281:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3682304->4194303) req@ffff8800929cc700 x1830882976955136/t21474840918(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/448 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.795289:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cc700 with x1830882976955136 ext(3682304->4194303) 00010000:00010000:3.0:1746066792.795294:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 40 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.795304:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 40 pid: 8450 timeout: 853 lvb_type: 0 00002000:00010000:3.0:1746066792.795309:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929cc700 00000100:00100000:0.0:1746066792.795716:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882976955392:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 44534us (45759us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.795725:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7479 00000100:00100000:3.0:1746066792.805672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066792.805792:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976956416 00000100:00100000:1.0:1746066792.805800:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976956416 00010000:00010000:1.0:1746066792.805838:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 40 pid: 8450 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066792.805860:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7480 00000100:00100000:1.0:1746066792.805868:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1965:x1830882976956416:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066792.805878:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066792.805896:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 40 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066792.805906:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 40 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066792.805924:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b95400/0xfb36a14ee608b7cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ff expref: 40 pid: 8450 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746066792.805935:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.805937:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066792.805942:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 38 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.805949:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 38 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.805976:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 38 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066792.805986:0:21351:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 38 pid: 4614 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746066792.805996:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976851584:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066792.808495:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008edcbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066792.810992:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976851584:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066792.811014:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.811414:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1965:x1830882976956416:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5544us (5746us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.811424:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7480 00000100:00100000:1.0:1746066792.819459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.826360:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976956672 00000100:00100000:3.0:1746066792.826371:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976956672 00002000:00100000:3.0:1746066792.827305:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800929cca80 x1830882976956672/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.827319:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cca80 with x1830882976956672 ext(3145728->4194303) 00010000:00010000:3.0:1746066792.827326:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 39 pid: 4614 timeout: 853 lvb_type: 0 00010000:00010000:3.0:1746066792.827339:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 39 pid: 4614 timeout: 854 lvb_type: 0 00002000:00010000:3.0:1746066792.827345:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929cca80 00000100:00100000:3.0:1746066792.827363:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2152 00000100:00100000:3.0:1746066792.827370:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+39:1963:x1830882976956672:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066792.844238:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+39:1963:x1830882976956672:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 16863us (24780us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066792.844248:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2152 00002000:00100000:3.0:1746066792.844258:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800929cca80 x1830882976956672/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.844266:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cca80 with x1830882976956672 ext(3145728->4194303) 00010000:00010000:3.0:1746066792.844274:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 39 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066792.844287:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 39 pid: 4614 timeout: 854 lvb_type: 0 00002000:00010000:3.0:1746066792.844293:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929cca80 00000100:00100000:0.0:1746066792.851258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.851298:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976956800 00000100:00100000:0.0:1746066792.851298:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.851306:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976956800 00000100:00100000:2.0:1746066792.851340:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976956928 00000100:00100000:2.0:1746066792.851342:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976956928 00000100:00100000:2.0:1746066792.851355:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14587 00000100:00100000:2.0:1746066792.851361:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+29:1965:x1830882976956800:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066792.851375:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.851391:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d0d000/0xfb36a14ee608b81a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e730 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066792.851435:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976851712:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066792.851494:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.851508:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14588 00000100:00100000:2.0:1746066792.851514:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+39:1966:x1830882976956928:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066792.851521:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.851530:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d0ce00/0xfb36a14ee608b821 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e737 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.851540:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066792.851548:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d0ce00/0xfb36a14ee608b821 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e737 expref: 40 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.851556:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d0ce00/0xfb36a14ee608b821 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e737 expref: 40 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.851564:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d0ce00, rc 0) 00000100:00100000:2.0:1746066792.851584:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+39:1966:x1830882976956928:12345-192.168.202.57@tcp:101:cat.0 Request processed in 71us (287us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066792.851589:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14588 00000100:00100000:0.0:1746066792.852540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.852558:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976957056 00000100:00100000:0.0:1746066792.852561:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976957056 00010000:00010000:0.0:1746066792.852578:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 39 pid: 4614 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746066792.852596:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7481 00000100:00100000:0.0:1746066792.852601:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+39:1964:x1830882976957056:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.852635:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.852654:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 39 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066792.852663:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 39 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066792.852693:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb09200/0xfb36a14ee608b7db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e70d expref: 39 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066792.852703:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.852705:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.852711:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 38 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.852718:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 38 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.853075:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 38 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066792.853087:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976851840:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066792.853459:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba7300 going to sleep for 11 seconds 00002000:00010000:2.0:1746066792.854819:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5921 -> 5923 00000100:00100000:2.0:1746066792.854828:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976851712:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066792.854847:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d0d000/0xfb36a14ee608b81a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e730 expref: 30 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.854858:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d0d000/0xfb36a14ee608b81a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e730 expref: 30 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.854866:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d0d000, rc 0) 00000100:00100000:2.0:1746066792.854893:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+29:1965:x1830882976956800:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3531us (3640us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066792.854903:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14587 00000100:00100000:1.0:1746066792.858692:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.858718:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976957440 00000100:00100000:2.0:1746066792.858725:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976957440 00000100:00100000:1.0:1746066792.858752:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:2.0:1746066792.858762:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3149824->3153919) req@ffff8800929cdf80 x1830882976957440/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.858772:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cdf80 with x1830882976957440 ext(3149824->3153919) 00002000:00010000:2.0:1746066792.858777:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929cdf80 00000100:00100000:0.0:1746066792.858993:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976851840:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066792.859010:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.859138:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+39:1964:x1830882976957056:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6534us (6598us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.859146:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7481 00000100:00100000:2.0:1746066792.859252:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6616 00000100:00100000:2.0:1746066792.859259:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+38:1963:x1830882976957440:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066792.859382:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+38:1963:x1830882976957440:12345-192.168.202.57@tcp:3:cat.0 Request processed in 123us (709us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066792.859387:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6616 00002000:00100000:2.0:1746066792.859392:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3149824->3153919) req@ffff8800929cdf80 x1830882976957440/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/4536 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.859399:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cdf80 with x1830882976957440 ext(3149824->3153919) 00002000:00010000:2.0:1746066792.859402:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929cdf80 00000100:00100000:2.0:1746066792.859418:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976957312 00000100:00100000:2.0:1746066792.859421:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976957312 00000100:00100000:2.0:1746066792.859440:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14589 00000100:00100000:2.0:1746066792.859444:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+29:31633:x1830882976957312:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066792.859453:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.859467:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d0de00/0xfb36a14ee608b828 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e73e expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.859491:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4534271) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.859498:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066792.859499:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066792.859503:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d0de00/0xfb36a14ee608b828 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->5091327] (req 4194304->5091327) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e73e expref: 30 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.859525:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4534271) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.859535:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4534271) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 33 pid: 8450 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066792.859545:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976851968:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066792.859596:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066792.861926:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976851968:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066792.861946:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d0de00/0xfb36a14ee608b828 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->5091327] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e73e expref: 30 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.861958:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d0de00, rc 0) 00000100:00100000:2.0:1746066792.861986:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+30:31633:x1830882976957312:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2540us (3232us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.861993:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14589 00000100:00100000:1.0:1746066792.862953:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.863700:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976957568 00000100:00100000:2.0:1746066792.863707:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976957568 00002000:00100000:2.0:1746066792.863807:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4534271) req@ffff88009ed72d80 x1830882976957568/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066792.863815:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed72d80 with x1830882976957568 ext(4194304->4534271) 00010000:00010000:2.0:1746066792.863821:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4534271) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 34 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066792.863832:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4534271) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 34 pid: 8450 timeout: 854 lvb_type: 0 00002000:00010000:2.0:1746066792.863838:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed72d80 00000100:00100000:2.0:1746066792.863853:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2153 00000100:00100000:2.0:1746066792.863858:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882976957568:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066792.874500:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882976957568:12345-192.168.202.57@tcp:4:cat.0 Request processed in 10633us (11540us total) trans 17179873596 rc 0/0 00000100:00100000:3.0:1746066792.874511:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2153 00002000:00100000:3.0:1746066792.874521:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4534271) req@ffff88009ed72d80 x1830882976957568/t17179873596(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:198/0 lens 488/448 e 0 to 0 dl 1746066803 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.874530:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed72d80 with x1830882976957568 ext(4194304->4534271) 00010000:00010000:3.0:1746066792.874538:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4534271) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 36 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066792.874552:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4534271) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 36 pid: 8450 timeout: 854 lvb_type: 0 00002000:00010000:3.0:1746066792.874558:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed72d80 00000100:00100000:3.0:1746066792.878320:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.878427:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976957696 00000100:00100000:0.0:1746066792.878434:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976957696 00010000:00010000:0.0:1746066792.878461:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4534271) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 36 pid: 8450 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746066792.878506:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7482 00000100:00100000:0.0:1746066792.878512:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882976957696:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.878527:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.878545:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4534271) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 36 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066792.878560:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4534271) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 36 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066792.878579:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb09e00/0xfb36a14ee608b80c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4534271) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e722 expref: 36 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066792.878615:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.878616:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066792.878623:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d0de00/0xfb36a14ee608b828 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e73e expref: 29 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.878630:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d0de00/0xfb36a14ee608b828 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e73e expref: 29 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.878662:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d0de00/0xfb36a14ee608b828 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e73e expref: 29 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066792.878672:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976852096:192.168.202.57@tcp:105: 00000001:00080000:3.0:1746066792.878753:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840909 is committed 00000100:00100000:0.0:1746066792.878763:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b523acc0 going to sleep for 11 seconds 00000001:00080000:3.0:1746066792.878764:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840893 is committed 00000001:00080000:3.0:1746066792.878767:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840874 is committed 00000001:00080000:3.0:1746066792.878773:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840913 is committed 00000001:00080000:3.0:1746066792.878779:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840912 is committed 00000001:00080000:3.0:1746066792.878813:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840917 is committed 00000001:00080000:3.0:1746066792.878819:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840915 is committed 00000001:00080000:3.0:1746066792.878875:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840910 is committed 00000001:00080000:3.0:1746066792.878884:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840894 is committed 00000001:00080000:1.0:1746066792.879510:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873589 is committed 00000001:00080000:1.0:1746066792.879523:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873569 is committed 00000001:00080000:1.0:1746066792.879539:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873559 is committed 00000001:00080000:1.0:1746066792.879543:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873558 is committed 00000001:00080000:1.0:1746066792.879561:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873595 is committed 00000001:00080000:1.0:1746066792.879565:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873593 is committed 00000001:00080000:1.0:1746066792.879600:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873571 is committed 00000100:00100000:0.0:1746066792.881548:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976852096:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066792.881565:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.881613:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882976957696:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3091us (3291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.881621:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7482 00000100:00100000:0.0:1746066792.883485:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.883541:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976957952 00000100:00100000:3.0:1746066792.883550:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976957952 00002000:00100000:3.0:1746066792.883582:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009244e300 x1830882976957952/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/0 e 0 to 0 dl 1746066803 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066792.883592:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244e300 with x1830882976957952 ext(4194304->5091327) 00002000:00010000:3.0:1746066792.883598:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244e300 00000100:00100000:3.0:1746066792.883881:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6617 00000100:00100000:3.0:1746066792.883888:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+10:1963:x1830882976957952:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066792.896857:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+10:1963:x1830882976957952:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12960us (13367us total) trans 0 rc 897024/897024 00000100:00100000:0.0:1746066792.896868:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6617 00002000:00100000:0.0:1746066792.896878:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009244e300 x1830882976957952/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:198/0 lens 488/440 e 0 to 0 dl 1746066803 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066792.896891:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244e300 with x1830882976957952 ext(4194304->5091327) 00002000:00010000:0.0:1746066792.896897:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244e300 00000100:00100000:0.0:1746066792.915079:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.915233:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976958080 00000100:00100000:2.0:1746066792.915242:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976958080 00000100:00100000:2.0:1746066792.915278:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14590 00000100:00100000:2.0:1746066792.915285:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882976958080:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066792.915302:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.915314:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f884c00/0xfb36a14ee608b82f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e745 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.915341:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f884c00/0xfb36a14ee608b82f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e745 expref: 11 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.915351:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f884c00/0xfb36a14ee608b82f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e745 expref: 11 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.916701:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f884c00, rc 0) 00000100:00100000:2.0:1746066792.917571:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882976958080:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2283us (2496us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066792.917578:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14590 00000100:00100000:0.0:1746066792.922428:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.922519:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976958208 00000100:00100000:2.0:1746066792.922526:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976958208 00000100:00100000:2.0:1746066792.922561:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14591 00000100:00100000:2.0:1746066792.922568:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:1966:x1830882976958208:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066792.922581:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.922594:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f884a00/0xfb36a14ee608b836 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e74c expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.922634:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f884a00/0xfb36a14ee608b836 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e74c expref: 11 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.922643:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f884a00/0xfb36a14ee608b836 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e74c expref: 11 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066792.922770:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f884a00, rc 0) 00000100:00100000:2.0:1746066792.922806:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:1966:x1830882976958208:12345-192.168.202.57@tcp:101:cat.0 Request processed in 238us (385us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066792.922812:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14591 00000100:00100000:0.0:1746066792.936737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.937271:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976958464 00000100:00100000:3.0:1746066792.937279:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976958464 00000100:00100000:3.0:1746066792.937324:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4168 00000100:00100000:3.0:1746066792.937331:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:31633:x1830882976958464:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:3.0:1746066792.937509:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:31633:x1830882976958464:12345-192.168.202.57@tcp:35:cat.0 Request processed in 178us (778us total) trans 8589944049 rc 0/0 00000100:00100000:3.0:1746066792.937515:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4168 00000100:00100000:0.0:1746066792.964183:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.964714:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976958720 00000100:00100000:2.0:1746066792.964722:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976958720 00000100:00100000:2.0:1746066792.964770:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9989 00000100:00100000:2.0:1746066792.964777:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:31640:x1830882976958720:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066792.964797:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.965007:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884800/0xfb36a14ee608b83d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e753 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.965147:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b844 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.965159:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.965170:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.965181:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b84b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.965186:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.965191:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.965356:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884a00/0xfb36a14ee608b852 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.965364:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884a00/0xfb36a14ee608b852 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.965370:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884a00/0xfb36a14ee608b852 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:2.0:1746066792.965377:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066792.965444:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.965450:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b844 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.965455:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b844 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.965460:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f884400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066792.965463:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b844 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.965469:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b844 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.965477:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066792.965479:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066792.965483:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b844 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.965487:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b844 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.969256:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.969269:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b84b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.969275:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b84b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.969280:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f884200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066792.969283:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b84b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.969292:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b84b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.969305:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13d00) 00010000:00010000:2.0:1746066792.969307:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066792.969310:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b84b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.969314:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b84b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.969367:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884800/0xfb36a14ee608b83d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e753 expref: 268 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.969376:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884a00/0xfb36a14ee608b852 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e753 expref: 267 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.969381:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066792.969383:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066792.969385:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f884a00, rc 0) 00000100:00100000:2.0:1746066792.969448:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:31640:x1830882976958720:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4670us (5272us total) trans 8589944050 rc 0/0 00000100:00100000:2.0:1746066792.969454:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9989 00000100:00100000:0.0:1746066792.979278:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.979360:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976958976 00000100:00100000:2.0:1746066792.979368:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976958976 00000100:00100000:2.0:1746066792.979420:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9990 00000100:00100000:2.0:1746066792.979427:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:31644:x1830882976958976:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066792.979446:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066792.979461:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885e00/0xfb36a14ee608b860 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e75a expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.979550:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885400/0xfb36a14ee608b867 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979559:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885400/0xfb36a14ee608b867 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979567:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885400/0xfb36a14ee608b867 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979576:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b86e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979581:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b86e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979585:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b86e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979817:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885800/0xfb36a14ee608b875 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979827:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885800/0xfb36a14ee608b875 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979833:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885800/0xfb36a14ee608b875 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:2.0:1746066792.979841:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066792.979912:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885400/0xfb36a14ee608b867 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979917:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885400/0xfb36a14ee608b867 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979924:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885400/0xfb36a14ee608b867 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979929:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f885400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066792.979931:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885400/0xfb36a14ee608b867 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979936:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885400/0xfb36a14ee608b867 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979944:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066792.979946:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066792.979949:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885400/0xfb36a14ee608b867 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979953:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885400/0xfb36a14ee608b867 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979977:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b86e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979981:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b86e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979986:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b86e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979990:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f885600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066792.979992:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b86e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.979996:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b86e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.980005:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13900) 00010000:00010000:2.0:1746066792.980006:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066792.980009:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b86e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.980012:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b86e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066792.980042:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885e00/0xfb36a14ee608b860 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e75a expref: 270 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.980051:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885800/0xfb36a14ee608b875 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e75a expref: 269 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.980057:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066792.980059:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066792.980060:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f885800, rc 0) 00000100:00100000:2.0:1746066792.982017:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+269:31644:x1830882976958976:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2584us (2739us total) trans 8589944051 rc 0/0 00000100:00100000:2.0:1746066792.982026:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9990 00000100:00100000:0.0:1746066792.983908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066792.984288:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976959104 00000100:00100000:0.0:1746066792.984295:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976959104 00000100:00100000:0.0:1746066792.984334:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 709 00000100:00100000:0.0:1746066792.984341:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+269:1966:x1830882976959104:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066792.984353:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066792.984372:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884a00/0xfb36a14ee608b852 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e753 expref: 269 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066792.984729:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:0.0:1746066792.984734:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066792.985038:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:1966:x1830882976959104:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 696us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066792.985044:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 709 00000100:00100000:0.0:1746066792.995037:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066792.997441:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976959232 00000100:00100000:2.0:1746066792.997451:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976959232 00000100:00100000:2.0:1746066792.997504:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 710 00000100:00100000:2.0:1746066792.997512:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:1965:x1830882976959232:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066792.997523:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066792.997542:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885800/0xfb36a14ee608b875 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e75a expref: 268 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066792.997576:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066792.997580:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066792.997626:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:1965:x1830882976959232:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 115us (2597us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066792.997632:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 710 00000100:00100000:0.0:1746066792.997779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066792.998147:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976959360 00000100:00100000:3.0:1746066792.998152:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976959360 00000100:00100000:3.0:1746066792.998174:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14592 00000100:00100000:3.0:1746066792.998179:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1966:x1830882976959360:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066792.998191:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066792.998202:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608b883 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e761 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066792.998220:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608b883 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e761 expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066792.998229:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608b883 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e761 expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066792.999499:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5ec00, rc 0) 00000100:00100000:3.0:1746066792.999546:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1966:x1830882976959360:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1364us (1765us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066792.999552:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14592 00000100:00100000:0.0:1746066793.007812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.007877:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976959488 00000100:00100000:3.0:1746066793.007884:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976959488 00000100:00100000:3.0:1746066793.007961:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14593 00000100:00100000:3.0:1746066793.007968:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1966:x1830882976959488:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066793.007983:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.007996:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099740a00/0xfb36a14ee608b88a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e768 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.008036:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976852224:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066793.008100:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b7653c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746066793.008248:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746066793.011252:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976852224:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066793.011278:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099740a00/0xfb36a14ee608b88a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e768 expref: 16 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.011290:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099740a00/0xfb36a14ee608b88a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e768 expref: 16 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.011314:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099740a00, rc 0) 00000100:00100000:3.0:1746066793.011360:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1966:x1830882976959488:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3390us (3551us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066793.011370:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14593 00000100:00100000:0.0:1746066793.033125:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.033174:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.034156:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976959744 00000100:00100000:1.0:1746066793.034156:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976959616 00000100:00100000:3.0:1746066793.034165:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976959744 00000100:00100000:1.0:1746066793.034165:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976959616 00000100:00080000:0.0:1746066793.034212:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066793.034413:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14594 00000100:00100000:3.0:1746066793.034421:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1965:x1830882976959744:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:1.0:1746066793.034421:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14595 00000100:00100000:1.0:1746066793.034427:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1965:x1830882976959616:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066793.034436:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.034436:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.034450:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094238000/0xfb36a14ee608b898 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e776 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.034450:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e7e5400/0xfb36a14ee608b891 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e76f expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.034472:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e7e5400/0xfb36a14ee608b891 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e76f expref: 22 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.034484:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e7e5400/0xfb36a14ee608b891 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e76f expref: 22 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.034496:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e7e5400, rc 0) 00000100:00100000:1.0:1746066793.034532:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1965:x1830882976959616:12345-192.168.202.57@tcp:101:cat.0 Request processed in 105us (1358us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066793.034537:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14595 00000100:00100000:3.0:1746066793.034555:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976852352:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066793.034617:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b7653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.038311:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976852352:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066793.038340:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094238000/0xfb36a14ee608b898 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e776 expref: 16 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.038352:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094238000/0xfb36a14ee608b898 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e776 expref: 16 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.038376:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094238000, rc 0) 00000100:00100000:3.0:1746066793.038496:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1965:x1830882976959744:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4074us (5376us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066793.038503:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14594 00000100:00100000:0.0:1746066793.039722:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.039774:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976959872 00000100:00100000:3.0:1746066793.039779:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976959872 00000100:00100000:3.0:1746066793.039811:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14596 00000100:00100000:3.0:1746066793.039816:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:31644:x1830882976959872:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066793.039828:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.039839:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094239c00/0xfb36a14ee608b89f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e77d expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.039862:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 4030464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.039867:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066793.039868:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066793.039870:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094239c00/0xfb36a14ee608b89f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e77d expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.039887:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 4030464->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.039894:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 4030464->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 9 pid: 4614 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.039901:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976852480:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.040128:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b7653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.045308:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.045341:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976852480:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.045366:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094239c00/0xfb36a14ee608b89f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e77d expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.045381:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094239c00, rc 0) 00000100:00100000:1.0:1746066793.045476:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976960000 00000100:00100000:1.0:1746066793.045482:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976960000 00002000:00100000:1.0:1746066793.045520:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4030464->4194303) req@ffff88009bb2ce00 x1830882976960000/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.045528:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ce00 with x1830882976960000 ext(4030464->4194303) 00010000:00010000:1.0:1746066793.045533:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 10 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.045543:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 10 pid: 4614 timeout: 854 lvb_type: 0 00002000:00010000:1.0:1746066793.045549:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2ce00 00000100:00100000:1.0:1746066793.045580:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2154 00000100:00100000:1.0:1746066793.045587:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+10:1965:x1830882976960000:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066793.045795:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31644:x1830882976959872:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5978us (6074us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.045802:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14596 00000100:00080000:0.0:1746066793.045826:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066793.054634:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882976960000:12345-192.168.202.57@tcp:4:cat.0 Request processed in 9038us (9324us total) trans 17179873597 rc 0/0 00000100:00100000:1.0:1746066793.054644:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2154 00002000:00100000:1.0:1746066793.054655:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4030464->4194303) req@ffff88009bb2ce00 x1830882976960000/t17179873597(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/448 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.054664:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ce00 with x1830882976960000 ext(4030464->4194303) 00010000:00010000:1.0:1746066793.054672:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 12 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.054708:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 12 pid: 4614 timeout: 854 lvb_type: 0 00002000:00010000:1.0:1746066793.054715:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2ce00 00000100:00100000:0.0:1746066793.058372:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.058671:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976960128 00000100:00100000:3.0:1746066793.058709:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976960128 00010000:00010000:3.0:1746066793.058741:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 12 pid: 4614 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.058775:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7483 00000100:00100000:3.0:1746066793.058782:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:1966:x1830882976960128:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.058793:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.058811:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 12 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.058821:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 4030464->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 12 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.058841:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb09000/0xfb36a14ee608b805 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 4030464->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e71b expref: 12 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.058861:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.058863:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.058869:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094239c00/0xfb36a14ee608b89f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e77d expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.058877:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094239c00/0xfb36a14ee608b89f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e77d expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.058903:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094239c00/0xfb36a14ee608b89f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e77d expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.058914:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976852608:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066793.058987:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b7653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.062624:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976852608:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.062641:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.062691:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+11:1966:x1830882976960128:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3908us (4323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.062699:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7483 00000100:00100000:1.0:1746066793.064111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.064430:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976960384 00000100:00100000:0.0:1746066793.064436:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976960384 00002000:00100000:0.0:1746066793.064470:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009ed73b80 x1830882976960384/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.064479:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73b80 with x1830882976960384 ext(2097152->3145727) 00002000:00010000:0.0:1746066793.064483:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed73b80 00000100:00100000:0.0:1746066793.064508:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6618 00000100:00100000:0.0:1746066793.064514:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882976960384:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066793.080890:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882976960384:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16366us (16772us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066793.080901:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6618 00002000:00100000:1.0:1746066793.080912:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009ed73b80 x1830882976960384/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.080920:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73b80 with x1830882976960384 ext(2097152->3145727) 00002000:00010000:1.0:1746066793.080924:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed73b80 00000100:00100000:0.0:1746066793.081825:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.081986:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976960640 00000100:00100000:2.0:1746066793.081993:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976960640 00000100:00100000:2.0:1746066793.082035:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9991 00000100:00100000:2.0:1746066793.082042:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+24:31649:x1830882976960640:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066793.082059:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.082072:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885a00/0xfb36a14ee608b8a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e784 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746066793.082133:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746066793.082266:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885c00/0xfb36a14ee608b8ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082276:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885c00/0xfb36a14ee608b8ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082286:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885c00/0xfb36a14ee608b8ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082297:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885000/0xfb36a14ee608b8b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082302:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885000/0xfb36a14ee608b8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082307:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885000/0xfb36a14ee608b8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082388:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b8bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082395:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b8bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082401:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b8bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:2.0:1746066793.082407:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066793.082473:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885c00/0xfb36a14ee608b8ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082478:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885c00/0xfb36a14ee608b8ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082483:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885c00/0xfb36a14ee608b8ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082487:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f885c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066793.082490:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885c00/0xfb36a14ee608b8ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082496:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885c00/0xfb36a14ee608b8ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082504:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066793.082507:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066793.082510:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885c00/0xfb36a14ee608b8ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082514:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885c00/0xfb36a14ee608b8ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082545:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885000/0xfb36a14ee608b8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082549:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885000/0xfb36a14ee608b8b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082554:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885000/0xfb36a14ee608b8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082558:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f885000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066793.082560:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885000/0xfb36a14ee608b8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082564:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885000/0xfb36a14ee608b8b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082569:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13900) 00010000:00010000:2.0:1746066793.082571:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066793.082573:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885000/0xfb36a14ee608b8b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082577:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885000/0xfb36a14ee608b8b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.082618:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885a00/0xfb36a14ee608b8a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e784 expref: 27 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.082630:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b8bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e784 expref: 26 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.082635:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066793.082638:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066793.082639:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f885600, rc 0) 00000100:00100000:2.0:1746066793.082700:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+26:31649:x1830882976960640:12345-192.168.202.57@tcp:101:cat.0 Request processed in 658us (876us total) trans 8589944052 rc 0/0 00000100:00100000:2.0:1746066793.082706:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9991 00000100:00100000:0.0:1746066793.090031:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.090032:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.090155:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.090225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.090295:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.090314:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976960768 00000100:00100000:2.0:1746066793.090321:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976960768 00000100:00100000:2.0:1746066793.090643:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976960896 00000100:00100000:2.0:1746066793.090647:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976960896 00000100:00100000:1.0:1746066793.090693:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976961408 00000100:00100000:1.0:1746066793.090695:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976961408 00000100:00100000:1.0:1746066793.090714:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14597 00000100:00100000:1.0:1746066793.090720:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:31644:x1830882976960768:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066793.090735:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.090748:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e78b expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.090775:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 7 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.090781:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066793.090782:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066793.090785:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 16 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.090806:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 7 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.090814:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 7 pid: 4614 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.090823:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976852736:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.090875:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86a1600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.090890:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14598 00000100:00100000:1.0:1746066793.090895:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:1966:x1830882976960896:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066793.090902:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.090910:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edf7600/0xfb36a14ee608b8d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e792 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.090921:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.090922:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.090928:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edf7600/0xfb36a14ee608b8d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e792 expref: 12 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.090944:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edf7600/0xfb36a14ee608b8d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e792 expref: 12 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.090952:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edf7600, rc 0) 00000100:00100000:1.0:1746066793.090971:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:1966:x1830882976960896:12345-192.168.202.57@tcp:101:cat.0 Request processed in 76us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.090977:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14598 00000100:00100000:1.0:1746066793.090989:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14599 00000100:00100000:1.0:1746066793.090993:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31640:x1830882976961408:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066793.090998:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.091003:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e7a0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.091013:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094239c00/0xfb36a14ee608b89f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e77d expref: 23 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.091019:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edf7600/0xfb36a14ee608b8d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e792 expref: 11 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.091023:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.091024:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.091026:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3092480->3145727] (req 3092480->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.091040:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edf7600/0xfb36a14ee608b8d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e792 expref: 11 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.091047:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edf7600/0xfb36a14ee608b8d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e792 expref: 11 pid: 10402 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746066793.091054:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976852864:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.091074:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094239c00/0xfb36a14ee608b89f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e77d expref: 23 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.091080:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094239c00/0xfb36a14ee608b89f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e77d expref: 23 pid: 4614 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.091086:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976852992:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.091096:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86a13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.091229:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976961024 00000100:00100000:2.0:1746066793.091232:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976961024 00000100:00100000:2.0:1746066793.091255:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 711 00000100:00100000:2.0:1746066793.091259:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882976961024:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066793.091266:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066793.091281:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885600/0xfb36a14ee608b8bb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e784 expref: 26 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.091296:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066793.091299:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066793.091317:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882976961024:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 59us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.091322:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 711 00000100:00100000:2.0:1746066793.091339:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976961280 00000100:00100000:2.0:1746066793.091341:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976961280 00000100:00100000:2.0:1746066793.091356:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9992 00000100:00100000:2.0:1746066793.091360:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+25:31648:x1830882976961280:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066793.091370:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.091377:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884800/0xfb36a14ee608b8de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e799 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.091449:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b8e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.091457:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.091464:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.091474:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b8ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.091479:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.091484:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.091569:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885e00/0xfb36a14ee608b8f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.091577:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885e00/0xfb36a14ee608b8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.091582:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885e00/0xfb36a14ee608b8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:2.0:1746066793.091589:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066793.092125:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.092132:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b8e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.092137:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b8e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.092141:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f884200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066793.092144:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b8e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.092149:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b8e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.092157:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066793.092159:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066793.092162:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b8e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.092166:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884200/0xfb36a14ee608b8e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.092172:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.092176:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b8ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.092180:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b8ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.092183:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f884400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066793.092185:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b8ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.092189:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b8ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.092193:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13400) 00010000:00010000:2.0:1746066793.092195:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066793.092197:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b8ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.092202:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884400/0xfb36a14ee608b8ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.092229:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f884800/0xfb36a14ee608b8de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e799 expref: 28 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.092238:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885e00/0xfb36a14ee608b8f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e799 expref: 27 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.092243:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066793.092244:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066793.092246:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f885e00, rc 0) 00000100:00100000:2.0:1746066793.092901:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+27:31648:x1830882976961280:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 1537us (2870us total) trans 8589944053 rc 0/0 00000100:00100000:2.0:1746066793.092907:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9992 00000100:00100000:1.0:1746066793.093414:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976852736:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.093436:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 16 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.093447:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edf6200, rc 0) 00000100:00100000:1.0:1746066793.093463:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:31644:x1830882976960768:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2744us (3439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.093469:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14597 00000100:00100000:0.0:1746066793.093475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.093491:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976852864:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.093499:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976852992:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.093512:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3092480->3145727] (req 3092480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.093521:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edf7c00, rc 0) 00000100:00100000:1.0:1746066793.093537:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:31640:x1830882976961408:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2543us (3243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.093542:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14599 00000100:00100000:2.0:1746066793.093549:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976961664 00000100:00100000:2.0:1746066793.093553:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976961664 00010000:00010000:2.0:1746066793.093567:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edf7600/0xfb36a14ee608b8d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e792 expref: 12 pid: 10402 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746066793.093579:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.093584:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7484 00000100:00100000:2.0:1746066793.093589:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882976961664:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066793.093597:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066793.093627:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edf7600/0xfb36a14ee608b8d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e792 expref: 12 pid: 10402 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746066793.093628:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976961536 00000100:00100000:1.0:1746066793.093630:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976961536 00010000:00010000:2.0:1746066793.093634:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edf7600/0xfb36a14ee608b8d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e792 expref: 12 pid: 10402 timeout: 854 lvb_type: 1 00002000:00100000:1.0:1746066793.093655:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3153919) req@ffff88009e86b100 x1830882976961536/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 8680/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.093662:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e86b100 with x1830882976961536 ext(3145728->3153919) 00010000:00010000:1.0:1746066793.093667:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 8 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.093692:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 8 pid: 4614 timeout: 854 lvb_type: 0 00002000:00010000:1.0:1746066793.093698:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e86b100 00000100:00100000:1.0:1746066793.093717:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2155 00000100:00100000:1.0:1746066793.093722:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+8:1965:x1830882976961536:12345-192.168.202.57@tcp:4:cat.0 00000100:00080000:0.0:1746066793.093751:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746066793.093796:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edf7600/0xfb36a14ee608b8d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e792 expref: 12 pid: 10402 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746066793.093805:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066793.093822:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882976961664:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 233us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.093828:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7484 00000100:00100000:0.0:1746066793.094271:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.094361:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976961792 00000100:00100000:2.0:1746066793.094364:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976961792 00010000:00010000:2.0:1746066793.094375:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094239c00/0xfb36a14ee608b89f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e77d expref: 23 pid: 4614 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.094593:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:1965:x1830882976961536:12345-192.168.202.57@tcp:4:cat.0 Request processed in 871us (1013us total) trans 21474840919 rc 0/0 00000100:00100000:1.0:1746066793.094610:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2155 00002000:00100000:1.0:1746066793.094616:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3153919) req@ffff88009e86b100 x1830882976961536/t21474840919(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 8680/448 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.094628:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e86b100 with x1830882976961536 ext(3145728->3153919) 00010000:00010000:1.0:1746066793.094633:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 10 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.094640:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 10 pid: 4614 timeout: 854 lvb_type: 0 00002000:00010000:1.0:1746066793.094645:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e86b100 00000100:00100000:2.0:1746066793.095135:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7485 00000100:00100000:2.0:1746066793.095142:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882976961792:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066793.095149:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066793.095159:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094239c00/0xfb36a14ee608b89f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e77d expref: 23 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.095171:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094239c00/0xfb36a14ee608b89f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e77d expref: 23 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.095184:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094239c00/0xfb36a14ee608b89f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e77d expref: 23 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.095192:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.095194:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.095199:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3092480->4194303] (req 3092480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 22 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.095206:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3092480->4194303] (req 3092480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 22 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.095228:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3092480->4194303] (req 3092480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 22 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.095237:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976853120:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066793.095289:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.095853:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.096100:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.096135:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976962176 00000100:00100000:1.0:1746066793.096139:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976962176 00000100:00100000:3.0:1746066793.096152:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976961920 00000100:00100000:3.0:1746066793.096155:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976961920 00000100:00100000:1.0:1746066793.096171:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4169 00000100:00100000:1.0:1746066793.096177:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+28:31648:x1830882976962176:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066793.096179:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 712 00000100:00100000:3.0:1746066793.096183:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882976961920:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.096190:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.096202:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f885e00/0xfb36a14ee608b8f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e799 expref: 28 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.096215:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066793.096218:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.096235:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882976961920:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 51us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.096240:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 712 00000100:00100000:1.0:1746066793.096299:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:31648:x1830882976962176:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 122us (199us total) trans 8589944054 rc 0/0 00000100:00100000:1.0:1746066793.096305:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4169 00000100:00100000:2.0:1746066793.096859:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976853120:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066793.096875:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066793.096903:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882976961792:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1761us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.096909:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7485 00000100:00100000:0.0:1746066793.097251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.097320:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976962432 00000100:00100000:1.0:1746066793.097323:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976962432 00002000:00100000:1.0:1746066793.097343:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3092480->3096575) req@ffff88009e637480 x1830882976962432/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.097351:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e637480 with x1830882976962432 ext(3092480->3096575) 00002000:00010000:1.0:1746066793.097355:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e637480 00000100:00100000:1.0:1746066793.097379:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6619 00000100:00100000:1.0:1746066793.097385:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882976962432:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066793.097491:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882976962432:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 106us (239us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066793.097496:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6619 00002000:00100000:1.0:1746066793.097501:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3092480->3096575) req@ffff88009e637480 x1830882976962432/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/4536 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.097507:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e637480 with x1830882976962432 ext(3092480->3096575) 00002000:00010000:1.0:1746066793.097510:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e637480 00000100:00100000:0.0:1746066793.098940:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.098998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.099703:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976962688 00000100:00100000:2.0:1746066793.099709:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976962688 00010000:00010000:2.0:1746066793.099730:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 10 pid: 4614 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.099923:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7486 00000100:00100000:2.0:1746066793.099930:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:1966:x1830882976962688:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066793.099939:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066793.099955:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 10 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.099965:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 10 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.099982:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092f60800/0xfb36a14ee608b813 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e729 expref: 10 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.099993:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.099994:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.100000:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 15 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.100007:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 15 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.100033:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 15 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.100042:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976853248:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066793.100119:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976962560 00000100:00100000:1.0:1746066793.100123:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976962560 00000100:00100000:1.0:1746066793.100144:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14600 00000100:00100000:1.0:1746066793.100149:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:31649:x1830882976962560:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066793.100158:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.100169:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a737c000/0xfb36a14ee608b901 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e7a7 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.100185:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3092480->4194303] (req 3092480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 21 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.100191:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066793.100192:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066793.100195:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a737c000/0xfb36a14ee608b901 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a7 expref: 12 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.100209:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0b240 going to sleep for 11 seconds 00010000:00010000:1.0:1746066793.100214:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3092480->4194303] (req 3092480->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 21 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.100224:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3092480->4194303] (req 3092480->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 21 pid: 10402 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746066793.100227:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.100238:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976853376:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.100268:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.100285:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976962816 00000100:00100000:1.0:1746066793.100287:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976962816 00000100:00100000:1.0:1746066793.100305:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14601 00000100:00100000:1.0:1746066793.100310:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:31640:x1830882976962816:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066793.100316:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.100322:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e7ae expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.100335:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.100340:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.100342:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.100344:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->2801663] (req 2097152->2801663) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.100358:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.100364:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 17 pid: 20532 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.100371:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976853504:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.100401:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.101724:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976853376:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.101740:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a737c000/0xfb36a14ee608b901 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a7 expref: 12 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.101749:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a737c000, rc 0) 00000100:00100000:1.0:1746066793.101772:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:31649:x1830882976962560:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1624us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.101778:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14600 00000100:00100000:2.0:1746066793.101802:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976853248:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066793.101803:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976853504:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.101811:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066793.101814:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->2801663] (req 2097152->2801663) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.101821:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edf6c00, rc 0) 00000100:00100000:2.0:1746066793.101830:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+9:1966:x1830882976962688:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1901us (2832us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.101836:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:31640:x1830882976962816:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 1526us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.101837:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7486 00000100:00100000:1.0:1746066793.101841:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14601 00000100:00100000:0.0:1746066793.105354:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.105397:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.105570:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976962944 00000100:00100000:2.0:1746066793.105578:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976962944 00002000:00100000:2.0:1746066793.105629:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3092480->3145727) req@ffff88012c528700 x1830882976962944/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.105639:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c528700 with x1830882976962944 ext(3092480->3145727) 00010000:00010000:2.0:1746066793.105647:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3092480->4194303] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 22 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.105657:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3092480->4194303] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 22 pid: 10402 timeout: 854 lvb_type: 0 00002000:00010000:2.0:1746066793.105664:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c528700 00000100:00100000:2.0:1746066793.105716:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976963200 00000100:00100000:2.0:1746066793.105718:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976963200 00002000:00100000:2.0:1746066793.105731:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88012c52bb80 x1830882976963200/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.105738:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52bb80 with x1830882976963200 ext(2097152->3145727) 00010000:00010000:2.0:1746066793.105743:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 17 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.105755:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 17 pid: 20532 timeout: 854 lvb_type: 0 00002000:00010000:2.0:1746066793.105759:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c52bb80 00000100:00100000:2.0:1746066793.105771:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2156 00000100:00100000:2.0:1746066793.105776:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882976962944:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066793.105852:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2157 00000100:00100000:3.0:1746066793.105860:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1966:x1830882976963200:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066793.115161:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1966:x1830882976962944:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 9378us (9807us total) trans 17179873598 rc 0/0 00000100:00100000:0.0:1746066793.115171:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2156 00002000:00100000:0.0:1746066793.115180:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3092480->3145727) req@ffff88012c528700 x1830882976962944/t17179873598(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/448 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.115188:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c528700 with x1830882976962944 ext(3092480->3145727) 00010000:00010000:0.0:1746066793.115198:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3092480->4194303] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 24 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066793.115208:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3092480->4194303] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 24 pid: 10402 timeout: 854 lvb_type: 0 00002000:00010000:0.0:1746066793.115214:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c528700 00000100:00100000:2.0:1746066793.116474:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1966:x1830882976963200:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 10612us (11073us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066793.116480:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2157 00002000:00100000:2.0:1746066793.116486:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88012c52bb80 x1830882976963200/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.116492:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52bb80 with x1830882976963200 ext(2097152->3145727) 00010000:00010000:2.0:1746066793.116497:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 17 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.116505:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 17 pid: 20532 timeout: 854 lvb_type: 0 00002000:00010000:2.0:1746066793.116510:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c52bb80 00000100:00100000:0.0:1746066793.120014:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.120146:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976963328 00000100:00100000:2.0:1746066793.120156:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976963328 00010000:00010000:2.0:1746066793.120189:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3092480->4194303] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 24 pid: 10402 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.120225:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7487 00000100:00100000:2.0:1746066793.120233:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1965:x1830882976963328:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066793.120249:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066793.120271:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3092480->4194303] (req 3092480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 24 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.120281:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3092480->4194303] (req 3092480->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 24 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.120301:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edf7c00/0xfb36a14ee608b8d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3092480->4194303] (req 3092480->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a0 expref: 24 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.120327:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.120329:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.120335:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a737c000/0xfb36a14ee608b901 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a7 expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.120342:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a737c000/0xfb36a14ee608b901 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a7 expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.120370:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a737c000/0xfb36a14ee608b901 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a7 expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.120379:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976853632:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066793.120430:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.128848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.128898:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.128921:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976963456 00000100:00100000:1.0:1746066793.128927:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976963456 00000100:00100000:1.0:1746066793.128963:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14602 00000100:00100000:1.0:1746066793.128969:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:31644:x1830882976963456:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066793.128983:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.128996:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ed35e00/0xfb36a14ee608b90f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e7b5 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.129008:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976963584 00000100:00100000:2.0:1746066793.129011:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976963584 00010000:00010000:1.0:1746066793.129020:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.129021:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.129027:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 17 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.129027:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed35e00/0xfb36a14ee608b90f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7b5 expref: 25 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.129039:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ed35e00/0xfb36a14ee608b90f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7b5 expref: 25 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.129043:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7488 00000100:00100000:2.0:1746066793.129047:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1965:x1830882976963584:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.129048:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed35e00, rc 0) 00010000:00010000:2.0:1746066793.129054:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066793.129071:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 17 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.129079:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 17 pid: 20532 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.129080:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31644:x1830882976963456:12345-192.168.202.57@tcp:101:cat.0 Request processed in 111us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.129085:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14602 00010000:00010000:2.0:1746066793.129093:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edf6200/0xfb36a14ee608b8c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e78b expref: 17 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.129106:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.129107:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.129111:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 16 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.129342:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 16 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.129366:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 16 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.129377:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976853632:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066793.129379:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976853760:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.129389:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.129409:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1965:x1830882976963328:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 9178us (9406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.129415:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.129417:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7487 00000100:00100000:0.0:1746066793.133098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.133205:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976963840 00000100:00100000:2.0:1746066793.133214:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976963840 00002000:00100000:2.0:1746066793.133256:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880092046a00 x1830882976963840/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.133266:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092046a00 with x1830882976963840 ext(2097152->3145727) 00002000:00010000:2.0:1746066793.133271:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092046a00 00000100:00100000:2.0:1746066793.133292:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6620 00000100:00100000:2.0:1746066793.133300:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:1966:x1830882976963840:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066793.136537:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976853760:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.136556:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.136614:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1965:x1830882976963584:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7564us (7714us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.136623:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7488 00000100:00100000:0.0:1746066793.142490:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.142514:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976964096 00000100:00100000:0.0:1746066793.142521:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976964096 00002000:00100000:0.0:1746066793.142553:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880092045500 x1830882976964096/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.142562:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092045500 with x1830882976964096 ext(3145728->4194303) 00002000:00010000:0.0:1746066793.142566:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092045500 00000100:00100000:0.0:1746066793.142595:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6621 00000100:00100000:0.0:1746066793.142612:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882976964096:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066793.142913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.142979:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.142994:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976964352 00000100:00100000:1.0:1746066793.142996:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976964352 00002000:00100000:1.0:1746066793.143011:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e86a300 x1830882976964352/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.143017:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e86a300 with x1830882976964352 ext(3145728->4194303) 00002000:00010000:1.0:1746066793.143020:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e86a300 00000100:00100000:1.0:1746066793.143290:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976964608 00000100:00100000:1.0:1746066793.143293:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976964608 00002000:00100000:1.0:1746066793.143304:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (2797568->2801663) req@ffff88009e86bb80 x1830882976964608/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.143310:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e86bb80 with x1830882976964608 ext(2797568->2801663) 00002000:00010000:1.0:1746066793.143313:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e86bb80 00000100:00100000:3.0:1746066793.143339:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6622 00000100:00100000:3.0:1746066793.143345:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1963:x1830882976964352:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066793.144413:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6623 00000100:00100000:3.0:1746066793.144419:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1965:x1830882976964608:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066793.144492:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1965:x1830882976964608:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 73us (1513us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066793.144498:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6623 00002000:00100000:3.0:1746066793.144503:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (2797568->2801663) req@ffff88009e86bb80 x1830882976964608/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/4536 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.144510:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e86bb80 with x1830882976964608 ext(2797568->2801663) 00002000:00010000:3.0:1746066793.144513:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e86bb80 00000100:00100000:2.0:1746066793.157706:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:1966:x1830882976963840:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24398us (24608us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066793.157718:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6620 00002000:00100000:2.0:1746066793.157731:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880092046a00 x1830882976963840/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.157740:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092046a00 with x1830882976963840 ext(2097152->3145727) 00002000:00010000:2.0:1746066793.157745:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092046a00 00000100:00100000:2.0:1746066793.167244:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882976964096:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 24620us (24748us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066793.167256:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6621 00002000:00100000:2.0:1746066793.167269:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880092045500 x1830882976964096/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.167284:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092045500 with x1830882976964096 ext(3145728->4194303) 00002000:00010000:2.0:1746066793.167289:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092045500 00000100:00100000:0.0:1746066793.176926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.177005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.177299:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976964736 00000100:00100000:1.0:1746066793.177307:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976964736 00000100:00100000:1.0:1746066793.177343:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14603 00000100:00100000:1.0:1746066793.177350:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+9:31649:x1830882976964736:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066793.177364:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.177378:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009edf7800/0xfb36a14ee608b916 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e7bc expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.177402:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.177409:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066793.177410:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066793.177413:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edf7800/0xfb36a14ee608b916 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7bc expref: 10 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.177440:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.177450:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 17 pid: 20532 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.177461:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976853888:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.177527:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86a1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.178112:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1963:x1830882976964352:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 34765us (35197us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066793.178120:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6622 00002000:00100000:3.0:1746066793.178127:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e86a300 x1830882976964352/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.178140:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e86a300 with x1830882976964352 ext(3145728->4194303) 00010000:00010000:3.0:1746066793.178145:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 16 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.178154:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 16 pid: 20532 timeout: 854 lvb_type: 0 00002000:00010000:3.0:1746066793.178159:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e86a300 00000100:00100000:2.0:1746066793.178165:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976964992 00000100:00100000:2.0:1746066793.178169:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976964992 00000100:00100000:2.0:1746066793.178195:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4170 00000100:00100000:2.0:1746066793.178200:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:31640:x1830882976964992:12345-192.168.202.57@tcp:35:multiop.0 00000100:00080000:0.0:1746066793.178221:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066793.178347:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:31640:x1830882976964992:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 145us (1341us total) trans 8589944055 rc 0/0 00000100:00100000:2.0:1746066793.178353:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4170 00000100:00100000:0.0:1746066793.179264:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.179352:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976965248 00000100:00100000:3.0:1746066793.179358:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976965248 00002000:00100000:3.0:1746066793.179387:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880092046680 x1830882976965248/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.179395:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092046680 with x1830882976965248 ext(4194304->5091327) 00002000:00010000:3.0:1746066793.179399:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092046680 00000100:00100000:3.0:1746066793.179441:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6624 00000100:00100000:3.0:1746066793.179449:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1966:x1830882976965248:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066793.185327:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976853888:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066793.185351:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009edf7800/0xfb36a14ee608b916 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7bc expref: 10 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.185365:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edf7800, rc 0) 00000100:00100000:0.0:1746066793.185400:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+10:31649:x1830882976964736:12345-192.168.202.57@tcp:101:cat.0 Request processed in 8050us (8482us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066793.185407:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14603 00000100:00100000:0.0:1746066793.188103:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.188232:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976965376 00000100:00100000:2.0:1746066793.188239:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976965376 00002000:00100000:2.0:1746066793.188272:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->2801663) req@ffff8800996d9c00 x1830882976965376/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.188281:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d9c00 with x1830882976965376 ext(2097152->2801663) 00010000:00010000:2.0:1746066793.188288:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 16 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.188300:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 16 pid: 20532 timeout: 854 lvb_type: 0 00002000:00010000:2.0:1746066793.188306:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800996d9c00 00000100:00100000:2.0:1746066793.188320:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2158 00000100:00100000:2.0:1746066793.188325:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1963:x1830882976965376:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066793.196247:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1966:x1830882976965248:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 16790us (16978us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066793.196257:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6624 00002000:00100000:3.0:1746066793.196267:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880092046680 x1830882976965248/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 897024/897024 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.196275:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092046680 with x1830882976965248 ext(4194304->5091327) 00002000:00010000:3.0:1746066793.196280:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092046680 00000100:00100000:0.0:1746066793.201717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.201950:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976965504 00000100:00100000:1.0:1746066793.201960:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976965504 00000100:00100000:1.0:1746066793.202008:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14604 00000100:00100000:1.0:1746066793.202019:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1965:x1830882976965504:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066793.202039:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.202057:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608b91d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e7c3 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.202110:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976854016:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066793.202197:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.208523:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976854016:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066793.208558:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608b91d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7c3 expref: 19 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.208573:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa29c00/0xfb36a14ee608b91d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7c3 expref: 19 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.208702:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa29c00, rc 0) 00000100:00100000:1.0:1746066793.209180:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1965:x1830882976965504:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7159us (7468us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066793.209189:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14604 00000100:00100000:0.0:1746066793.212803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.212859:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976965632 00000100:00100000:1.0:1746066793.212866:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976965632 00000100:00100000:1.0:1746066793.212897:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14605 00000100:00100000:1.0:1746066793.212902:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1965:x1830882976965632:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066793.212917:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.212932:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa28200/0xfb36a14ee608b924 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e7ca expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.212984:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976854144:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066793.213068:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86a13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.214417:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882976965376:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 26088us (26317us total) trans 21474840920 rc 0/0 00000100:00100000:2.0:1746066793.214426:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2158 00002000:00100000:2.0:1746066793.214435:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->2801663) req@ffff8800996d9c00 x1830882976965376/t21474840920(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/448 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.214442:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d9c00 with x1830882976965376 ext(2097152->2801663) 00010000:00010000:2.0:1746066793.214448:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 20 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.214458:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 20 pid: 20532 timeout: 854 lvb_type: 0 00002000:00010000:2.0:1746066793.214464:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800996d9c00 00000100:00100000:1.0:1746066793.216432:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976854144:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066793.216456:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa28200/0xfb36a14ee608b924 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ca expref: 19 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.216466:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa28200/0xfb36a14ee608b924 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ca expref: 19 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.216489:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa28200, rc 0) 00000100:00100000:1.0:1746066793.217134:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1965:x1830882976965632:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4226us (4333us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066793.217143:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14605 00000100:00100000:0.0:1746066793.218059:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.218553:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976965760 00000100:00100000:2.0:1746066793.218559:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976965760 00010000:00010000:2.0:1746066793.218584:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 18 pid: 20532 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.218611:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7489 00000100:00100000:2.0:1746066793.218617:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1965:x1830882976965760:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066793.218626:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066793.218640:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 18 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.218650:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 18 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.218670:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edf6c00/0xfb36a14ee608b908 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ae expref: 18 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.218697:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.218699:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.218704:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edf7800/0xfb36a14ee608b916 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7bc expref: 9 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.218711:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009edf7800/0xfb36a14ee608b916 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7bc expref: 9 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.218735:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009edf7800/0xfb36a14ee608b916 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7bc expref: 9 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.218744:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976854272:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066793.218796:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0b000 going to sleep for 11 seconds 00010000:00010000:1.0:1746066793.223179:0:9851:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066793.223371:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.223525:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976854272:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.223540:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.223570:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1965:x1830882976965760:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4953us (5516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.223579:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7489 00000100:00100000:2.0:1746066793.223650:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976966016 00000100:00100000:2.0:1746066793.223656:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976966016 00000100:00100000:2.0:1746066793.223747:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4171 00000100:00100000:2.0:1746066793.223754:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f5ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:31644:x1830882976966016:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066793.223893:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f5ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+269:31644:x1830882976966016:12345-192.168.202.57@tcp:35:cat.0 Request processed in 140us (526us total) trans 8589944056 rc 0/0 00000100:00100000:2.0:1746066793.223898:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4171 00000100:00100000:0.0:1746066793.228059:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.228102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.228509:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976966272 00000100:00100000:2.0:1746066793.228519:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976966272 00002000:00100000:2.0:1746066793.228564:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a5bb1880 x1830882976966272/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.228574:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb1880 with x1830882976966272 ext(2097152->3145727) 00002000:00010000:2.0:1746066793.228578:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb1880 00000100:00100000:2.0:1746066793.228610:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976966400 00000100:00100000:2.0:1746066793.228614:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976966400 00002000:00100000:2.0:1746066793.228630:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a5bb0700 x1830882976966400/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.228636:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb0700 with x1830882976966400 ext(3145728->4194303) 00002000:00010000:2.0:1746066793.228639:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb0700 00000100:00100000:2.0:1746066793.228661:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6625 00000100:00100000:2.0:1746066793.228669:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882976966272:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066793.229396:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6626 00000100:00100000:0.0:1746066793.229405:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882976966400:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066793.235774:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.238374:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976966784 00000100:00100000:3.0:1746066793.238384:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976966784 00002000:00100000:3.0:1746066793.238423:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009e86aa00 x1830882976966784/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.238433:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e86aa00 with x1830882976966784 ext(3145728->4194303) 00002000:00010000:3.0:1746066793.238437:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e86aa00 00000100:00100000:3.0:1746066793.238453:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6627 00000100:00100000:3.0:1746066793.238459:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882976966784:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066793.249508:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882976966400:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20096us (21397us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066793.249520:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6626 00002000:00100000:1.0:1746066793.249529:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a5bb0700 x1830882976966400/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.249926:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb0700 with x1830882976966400 ext(3145728->4194303) 00002000:00010000:1.0:1746066793.249933:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb0700 00000100:00100000:2.0:1746066793.252342:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:1963:x1830882976966272:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23666us (24284us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066793.252353:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6625 00002000:00100000:2.0:1746066793.252366:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a5bb1880 x1830882976966272/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.252375:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb1880 with x1830882976966272 ext(2097152->3145727) 00002000:00010000:2.0:1746066793.252380:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb1880 00000100:00100000:3.0:1746066793.253918:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882976966784:12345-192.168.202.57@tcp:3:cat.0 Request processed in 15454us (18146us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066793.253926:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6627 00002000:00100000:3.0:1746066793.253933:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009e86aa00 x1830882976966784/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.253940:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e86aa00 with x1830882976966784 ext(3145728->4194303) 00002000:00010000:3.0:1746066793.253944:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e86aa00 00000100:00100000:0.0:1746066793.263544:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.263583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.263711:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976967168 00000100:00100000:1.0:1746066793.263711:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976966912 00000100:00100000:2.0:1746066793.263718:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976967168 00000100:00100000:1.0:1746066793.263718:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976966912 00000100:00100000:2.0:1746066793.263753:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4172 00000100:00100000:1.0:1746066793.263753:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14606 00000100:00100000:2.0:1746066793.263760:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:31649:x1830882976967168:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:1.0:1746066793.263760:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:31648:x1830882976966912:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066793.263773:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.263785:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e7d1 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.263803:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093304400/0xfb36a14ee608b741 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ab expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.263810:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d0cc00/0xfb36a14ee608b7aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6dc expref: 13 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.263815:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.263817:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.263819:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [548864->1048575] (req 548864->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 13 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.263842:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d0cc00/0xfb36a14ee608b7aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6dc expref: 13 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.263850:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d0cc00/0xfb36a14ee608b7aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6dc expref: 13 pid: 21973 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746066793.263860:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976854400:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.263900:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+28:31649:x1830882976967168:12345-192.168.202.57@tcp:35:cat.0 Request processed in 139us (315us total) trans 8589944057 rc 0/0 00000100:00100000:2.0:1746066793.263906:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4172 00010000:00010000:1.0:1746066793.265222:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093304400/0xfb36a14ee608b741 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ab expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.265238:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093304400/0xfb36a14ee608b741 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ab expref: 23 pid: 10402 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.265247:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976854528:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.266163:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.266940:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976854400:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066793.267216:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.267533:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976967296 00000100:00100000:3.0:1746066793.267540:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976967296 00010000:00010000:3.0:1746066793.267568:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d0cc00/0xfb36a14ee608b7aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6dc expref: 14 pid: 21973 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746066793.267639:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7490 00000100:00100000:3.0:1746066793.267646:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5219c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882976967296:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.267657:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.267907:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d0cc00/0xfb36a14ee608b7aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6dc expref: 14 pid: 21973 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746066793.267917:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d0cc00/0xfb36a14ee608b7aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6dc expref: 14 pid: 21973 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746066793.267935:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d0cc00/0xfb36a14ee608b7aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6dc expref: 14 pid: 21973 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746066793.267958:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.267987:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5219c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882976967296:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 342us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.267993:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7490 00000100:00100000:1.0:1746066793.268592:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976854528:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.268624:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [548864->1048575] (req 548864->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 12 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.268632:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa29e00, rc 0) 00000100:00100000:1.0:1746066793.268650:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:31648:x1830882976966912:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4891us (5112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.268655:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14606 00000100:00100000:0.0:1746066793.270429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.270538:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976967424 00000100:00100000:3.0:1746066793.270544:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976967424 00010000:00010000:3.0:1746066793.270563:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093304400/0xfb36a14ee608b741 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ab expref: 24 pid: 10402 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.270629:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7491 00000100:00100000:3.0:1746066793.270635:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882976967424:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.270644:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.270656:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093304400/0xfb36a14ee608b741 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ab expref: 24 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.270665:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093304400/0xfb36a14ee608b741 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ab expref: 24 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.270699:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093304400/0xfb36a14ee608b741 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6ab expref: 24 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.270715:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.270716:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.270722:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 548864->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.270728:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 548864->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.270753:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 548864->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.270763:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976854656:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066793.270820:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b7653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.272467:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.272512:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976967680 00000100:00100000:2.0:1746066793.272516:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976967680 00002000:00100000:2.0:1746066793.272543:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (548864->552959) req@ffff8800a5bb3800 x1830882976967680/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.272551:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb3800 with x1830882976967680 ext(548864->552959) 00002000:00010000:2.0:1746066793.272555:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb3800 00000100:00100000:2.0:1746066793.272569:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6628 00000100:00100000:2.0:1746066793.272574:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882976967680:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066793.272726:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882976967680:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 151us (261us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066793.272733:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6628 00002000:00100000:2.0:1746066793.272737:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (548864->552959) req@ffff8800a5bb3800 x1830882976967680/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/4536 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.272744:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb3800 with x1830882976967680 ext(548864->552959) 00002000:00010000:2.0:1746066793.272747:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb3800 00000100:00100000:3.0:1746066793.272810:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976854656:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.272823:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.272984:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882976967424:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2347us (2556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.272990:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7491 00000100:00100000:0.0:1746066793.276518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.276626:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976967808 00000100:00100000:1.0:1746066793.276633:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976967808 00000100:00100000:1.0:1746066793.276670:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14607 00000100:00100000:1.0:1746066793.276696:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+10:31648:x1830882976967808:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066793.276712:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.276725:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e7d8 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.276748:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1eae00/0xfb36a14ee608b748 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b9 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.276760:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d0c200/0xfb36a14ee608b7b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6e3 expref: 11 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.276766:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.276767:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.276776:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->1470463] (req 1048576->1470463) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.276805:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d0c200/0xfb36a14ee608b7b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6e3 expref: 11 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.276814:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d0c200/0xfb36a14ee608b7b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6e3 expref: 11 pid: 21973 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746066793.276824:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976854784:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.276949:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1eae00/0xfb36a14ee608b748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b9 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.276956:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f1eae00/0xfb36a14ee608b748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b9 expref: 16 pid: 10402 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.276964:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976854912:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.276980:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.279890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.280107:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976854784:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.280118:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976854912:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.280138:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->1470463] (req 1048576->1470463) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.280151:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa29600, rc 0) 00000100:00100000:1.0:1746066793.280176:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:31648:x1830882976967808:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3501us (3665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.280183:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14607 00000100:00100000:3.0:1746066793.280245:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976967936 00000100:00100000:3.0:1746066793.280250:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976967936 00010000:00010000:3.0:1746066793.280268:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d0c200/0xfb36a14ee608b7b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6e3 expref: 11 pid: 21973 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746066793.280284:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7492 00000100:00100000:3.0:1746066793.280289:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+11:1966:x1830882976967936:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.280298:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.280313:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d0c200/0xfb36a14ee608b7b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6e3 expref: 11 pid: 21973 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746066793.280321:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d0c200/0xfb36a14ee608b7b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6e3 expref: 11 pid: 21973 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746066793.280335:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d0c200/0xfb36a14ee608b7b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6e3 expref: 11 pid: 21973 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746066793.280345:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.280358:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+10:1966:x1830882976967936:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 69us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.280362:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7492 00000100:00100000:0.0:1746066793.280468:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.280798:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976968064 00000100:00100000:3.0:1746066793.280802:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976968064 00010000:00010000:3.0:1746066793.280812:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1eae00/0xfb36a14ee608b748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b9 expref: 17 pid: 10402 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.281452:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7493 00000100:00100000:3.0:1746066793.281461:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1964:x1830882976968064:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.281470:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.281479:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f1eae00/0xfb36a14ee608b748 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b9 expref: 17 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.281487:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f1eae00/0xfb36a14ee608b748 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b9 expref: 17 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.281499:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1eae00/0xfb36a14ee608b748 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e6b9 expref: 17 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.281507:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.281509:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.281514:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 9 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.281520:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 9 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.281541:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 9 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.281881:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976855040:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066793.282258:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b7653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.283011:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976855040:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.283024:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.283058:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1964:x1830882976968064:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1598us (2589us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.283065:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7493 00000100:00100000:0.0:1746066793.285500:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.285578:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976968320 00000100:00100000:2.0:1746066793.285586:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976968320 00002000:00100000:2.0:1746066793.285633:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1466368->1470463) req@ffff88009a0d3800 x1830882976968320/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.285641:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d3800 with x1830882976968320 ext(1466368->1470463) 00002000:00010000:2.0:1746066793.285645:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a0d3800 00000100:00100000:2.0:1746066793.285661:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6629 00000100:00100000:2.0:1746066793.285668:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:1963:x1830882976968320:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066793.286051:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:1963:x1830882976968320:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 382us (555us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066793.286057:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6629 00002000:00100000:2.0:1746066793.286062:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1466368->1470463) req@ffff88009a0d3800 x1830882976968320/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/4536 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.286069:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d3800 with x1830882976968320 ext(1466368->1470463) 00002000:00010000:2.0:1746066793.286071:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a0d3800 00000100:00100000:0.0:1746066793.294334:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.294443:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976968448 00000100:00100000:2.0:1746066793.294451:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976968448 00000100:00100000:2.0:1746066793.294535:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9993 00000100:00100000:2.0:1746066793.294544:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31654:x1830882976968448:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066793.294559:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.294574:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93a00/0xfb36a14ee608b939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e7df expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746066793.294853:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746066793.294966:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93c00/0xfb36a14ee608b940 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.294974:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93c00/0xfb36a14ee608b940 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.294981:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93c00/0xfb36a14ee608b940 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.294989:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93e00/0xfb36a14ee608b947 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.294992:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93e00/0xfb36a14ee608b947 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.294998:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93e00/0xfb36a14ee608b947 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.295071:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.295077:0:20127:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5d2 expref: 27 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.295082:0:20127:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.295102:0:20127:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5d2 expref: 27 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.295109:0:20127:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5d2 expref: 27 pid: 14548 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.295116:0:20127:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976855168:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.295188:0:20127:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0b840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.296550:0:20127:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976855168:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.296562:0:20127:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000100:00100000:0.0:1746066793.296568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.296622:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976968704 00000100:00100000:3.0:1746066793.296626:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976968704 00000100:00100000:3.0:1746066793.296658:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4173 00000100:00100000:3.0:1746066793.296664:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+28:23712:x1830882976968704:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746066793.296908:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+29:23712:x1830882976968704:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 243us (338us total) trans 8589944058 rc 0/0 00000100:00100000:3.0:1746066793.296914:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4173 00000100:00100000:0.0:1746066793.298606:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.298709:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976968832 00000100:00100000:3.0:1746066793.298714:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976968832 00010000:00010000:3.0:1746066793.298732:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5d2 expref: 29 pid: 14548 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.298858:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7494 00000100:00100000:3.0:1746066793.298865:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882976968832:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.298876:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.298881:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5d2 expref: 29 pid: 14548 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.298889:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5d2 expref: 29 pid: 14548 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.298905:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25c00/0xfb36a14ee608b5dc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5d2 expref: 29 pid: 14548 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.298915:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066793.298920:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.298927:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.298932:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.298948:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066793.299020:0:20127:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299026:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:0.0:1746066793.299054:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:0.0:1746066793.299058:0:20127:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746066793.299069:0:20127:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299077:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299084:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93c00/0xfb36a14ee608b940 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299089:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93c00/0xfb36a14ee608b940 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299094:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93c00/0xfb36a14ee608b940 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299101:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef93c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066793.299104:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93c00/0xfb36a14ee608b940 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299116:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93c00/0xfb36a14ee608b940 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299123:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066793.299126:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066793.299128:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93c00/0xfb36a14ee608b940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299132:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93c00/0xfb36a14ee608b940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299152:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93e00/0xfb36a14ee608b947 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299157:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93e00/0xfb36a14ee608b947 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299161:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93e00/0xfb36a14ee608b947 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299165:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef93e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066793.299168:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93e00/0xfb36a14ee608b947 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299172:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93e00/0xfb36a14ee608b947 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299178:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13900) 00010000:00010000:0.0:1746066793.299179:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066793.299182:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93e00/0xfb36a14ee608b947 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299185:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93e00/0xfb36a14ee608b947 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.299209:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93a00/0xfb36a14ee608b939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7df expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.299218:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7df expref: 9 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.299223:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:0.0:1746066793.299225:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066793.299226:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef93800, rc 0) 00000100:00100000:3.0:1746066793.299351:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882976968832:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 486us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.299358:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7494 00000100:00100000:0.0:1746066793.299457:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31654:x1830882976968448:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 4900us (5117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066793.299462:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9993 00000100:00100000:0.0:1746066793.302818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.302855:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.302869:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.302983:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976968960 00000100:00100000:0.0:1746066793.302985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.302991:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976968960 00000100:00100000:0.0:1746066793.303001:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.303029:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976969088 00000100:00100000:2.0:1746066793.303032:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976969088 00000100:00100000:1.0:1746066793.303037:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976969216 00000100:00100000:1.0:1746066793.303039:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976969216 00000100:00100000:2.0:1746066793.303044:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976969472 00000100:00100000:2.0:1746066793.303045:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976969472 00000100:00100000:2.0:1746066793.303055:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976969344 00000100:00100000:2.0:1746066793.303057:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976969344 00000100:00100000:1.0:1746066793.303061:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14608 00000100:00100000:1.0:1746066793.303066:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976968960:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:2.0:1746066793.303073:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14609 00000100:00100000:2.0:1746066793.303077:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882976969088:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066793.303079:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.303082:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.303092:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef92800/0xfb36a14ee608b955 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e7ed expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.303092:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d0c200/0xfb36a14ee608b95c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e7e6 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.303128:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976855296:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066793.303128:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976855424:192.168.202.57@tcp:106: 00000100:00080000:0.0:1746066793.303168:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746066793.303171:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066793.303200:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14610 00000100:00100000:3.0:1746066793.303207:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976969216:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066793.303212:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.303218:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608b963 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e7f4 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.303227:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.303229:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.303235:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608b963 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7f4 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.303246:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608b963 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7f4 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.303255:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e83a00, rc 0) 00000100:00100000:2.0:1746066793.303297:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.303297:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.303310:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976969600 00000100:00100000:2.0:1746066793.303312:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976969600 00000100:00100000:2.0:1746066793.303325:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14611 00000100:00100000:2.0:1746066793.303329:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976969472:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066793.303334:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.303340:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef92000/0xfb36a14ee608b96a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e802 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.303349:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.303350:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.303354:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef92000/0xfb36a14ee608b96a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e802 expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.303363:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef92000/0xfb36a14ee608b96a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e802 expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.303369:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef92000, rc 0) 00000100:00100000:1.0:1746066793.303377:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86a13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.303383:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976969472:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 54us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.303387:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14612 00000100:00100000:1.0:1746066793.303391:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976969344:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:3.0:1746066793.303413:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976969216:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 206us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.303442:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14611 00000100:00100000:3.0:1746066793.303445:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14610 00000100:00100000:2.0:1746066793.303454:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14613 00000100:00100000:2.0:1746066793.303458:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976969600:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066793.303464:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.303469:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef92c00/0xfb36a14ee608b971 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e809 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.303478:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.303479:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.303483:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef92c00/0xfb36a14ee608b971 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e809 expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.303490:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.303491:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef92c00/0xfb36a14ee608b971 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e809 expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.303497:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef92c00, rc 0) 00010000:00010000:1.0:1746066793.303497:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608b978 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e7fb expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.303504:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.303506:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066793.303510:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976969600:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 52us (213us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066793.303510:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608b978 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7fb expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066793.303514:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14613 00010000:00010000:1.0:1746066793.303518:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608b978 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7fb expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.303524:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d00600, rc 0) 00000100:00100000:1.0:1746066793.303535:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976969344:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 143us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.303539:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14612 00002000:00010000:1.0:1746066793.305055:0:8451:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime: 1746066792 -> 1746066793 00002000:00010000:1.0:1746066793.305060:0:8451:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime: 1746066792 -> 1746066793 00000100:00100000:1.0:1746066793.305075:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976855424:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066793.305092:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d0c200/0xfb36a14ee608b95c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7e6 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.305101:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d0c200/0xfb36a14ee608b95c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7e6 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.305111:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d0c200, rc 0) 00000100:00100000:1.0:1746066793.305139:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976968960:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2073us (2328us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066793.305144:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14608 00002000:00010000:2.0:1746066793.305518:0:20532:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime: 1746066792 -> 1746066793 00002000:00010000:2.0:1746066793.305521:0:20532:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime: 1746066792 -> 1746066793 00000100:00100000:2.0:1746066793.305532:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976855296:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066793.305544:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef92800/0xfb36a14ee608b955 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ed expref: 8 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.305552:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef92800/0xfb36a14ee608b955 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7ed expref: 8 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.305574:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef92800, rc 0) 00000100:00100000:2.0:1746066793.305590:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976969088:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2513us (2735us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066793.305594:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14609 00000100:00100000:0.0:1746066793.309282:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.309474:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976969856 00000100:00100000:2.0:1746066793.309482:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976969856 00000100:00100000:2.0:1746066793.309553:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9994 00000100:00100000:2.0:1746066793.309561:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31654:x1830882976969856:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066793.309576:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.309590:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92600/0xfb36a14ee608b97f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e810 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.309672:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.309711:0:20127:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7df expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.309717:0:20127:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.309741:0:20127:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7df expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.309750:0:20127:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7df expref: 10 pid: 20127 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.309760:0:20127:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976855552:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.310036:0:20127:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0b840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.311446:0:20127:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976855552:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.311464:0:20127:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000100:00100000:0.0:1746066793.312220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.313507:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976969984 00000100:00100000:3.0:1746066793.313515:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976969984 00010000:00010000:3.0:1746066793.313540:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7df expref: 11 pid: 20127 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.313568:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7495 00000100:00100000:3.0:1746066793.313575:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976969984:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.313585:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.313590:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7df expref: 11 pid: 20127 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.313611:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7df expref: 11 pid: 20127 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.313630:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93800/0xfb36a14ee608b94e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7df expref: 11 pid: 20127 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.313713:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066793.313718:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.313726:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.313731:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.313757:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066793.313779:0:20127:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.313787:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000100:00100000:3.0:1746066793.313792:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976969984:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 217us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.313798:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7495 00000004:00200000:2.0:1746066793.313805:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066793.313928:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92600/0xfb36a14ee608b97f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e810 expref: 11 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.313953:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e810 expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.313959:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066793.313962:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066793.313964:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef92400, rc 0) 00000100:00100000:2.0:1746066793.314007:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31654:x1830882976969856:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 4447us (4731us total) trans 8589944059 rc 0/0 00000100:00100000:2.0:1746066793.314014:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9994 00000100:00100000:0.0:1746066793.316460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.316532:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976970112 00000100:00100000:2.0:1746066793.316540:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976970112 00000100:00100000:2.0:1746066793.316593:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9995 00000100:00100000:2.0:1746066793.316609:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31654:x1830882976970112:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066793.316629:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.316647:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92800/0xfb36a14ee608b994 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e817 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.316749:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93a00/0xfb36a14ee608b99b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.316761:0:20127:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e810 expref: 11 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.316767:0:20127:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93a00/0xfb36a14ee608b99b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.316792:0:20127:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e810 expref: 11 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.316802:0:20127:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e810 expref: 11 pid: 20127 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.316812:0:20127:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976855680:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.317497:0:20127:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540d900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.319977:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.320054:0:20127:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976855680:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066793.320072:0:20127:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93a00/0xfb36a14ee608b99b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000100:00100000:3.0:1746066793.320176:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976970240 00000100:00100000:3.0:1746066793.320183:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976970240 00010000:00010000:3.0:1746066793.320210:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e810 expref: 12 pid: 20127 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.320234:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7496 00000100:00100000:3.0:1746066793.320239:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882976970240:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.320252:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.320257:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e810 expref: 12 pid: 20127 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.320266:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e810 expref: 12 pid: 20127 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.320283:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92400/0xfb36a14ee608b986 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e810 expref: 12 pid: 20127 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.320763:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066793.320767:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93a00/0xfb36a14ee608b99b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.320774:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93a00/0xfb36a14ee608b99b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.320780:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93a00/0xfb36a14ee608b99b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.320798:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.320831:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882976970240:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 590us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.320837:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7496 00010000:00010000:0.0:1746066793.320897:0:20127:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93a00/0xfb36a14ee608b99b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.320903:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93a00/0xfb36a14ee608b99b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:0.0:1746066793.320936:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:0.0:1746066793.320939:0:20127:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746066793.320951:0:20127:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93a00/0xfb36a14ee608b99b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.320979:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92800/0xfb36a14ee608b994 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e817 expref: 11 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.320993:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93a00/0xfb36a14ee608b99b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e817 expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.320999:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:0.0:1746066793.321001:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066793.321003:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef93a00, rc 0) 00000100:00100000:0.0:1746066793.321025:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31654:x1830882976970112:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 4427us (4572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066793.321031:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9995 00000100:00100000:0.0:1746066793.324339:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.324385:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976970496 00000100:00100000:2.0:1746066793.324393:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976970496 00000100:00100000:2.0:1746066793.324437:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14614 00000100:00100000:0.0:1746066793.324441:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.324443:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976970496:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066793.324459:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.324473:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef93000/0xfb36a14ee608b9a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e825 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.324476:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976970368 00000100:00100000:1.0:1746066793.324480:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976970368 00000100:00100000:1.0:1746066793.324514:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14615 00000100:00100000:2.0:1746066793.324519:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976855808:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066793.324520:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976970368:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066793.324527:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.324536:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093d00400/0xfb36a14ee608b9a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e81e expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.324559:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976855936:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066793.324595:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540d900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.324614:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.326960:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976855936:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066793.326986:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093d00400/0xfb36a14ee608b9a9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e81e expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.326997:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093d00400/0xfb36a14ee608b9a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e81e expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.327011:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d00400, rc 0) 00000100:00100000:1.0:1746066793.327044:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976970368:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2523us (2606us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066793.327051:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14615 00000100:00100000:2.0:1746066793.327423:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976855808:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066793.327439:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ef93000/0xfb36a14ee608b9a2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e825 expref: 8 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.327449:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef93000/0xfb36a14ee608b9a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e825 expref: 8 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.327458:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef93000, rc 0) 00000100:00100000:2.0:1746066793.327475:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976970496:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 3033us (3145us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066793.327480:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14614 00000100:00100000:2.0:1746066793.329931:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.330005:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976970752 00000100:00100000:0.0:1746066793.330013:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976970752 00000100:00100000:0.0:1746066793.330046:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9996 00000100:00100000:0.0:1746066793.330052:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31654:x1830882976970752:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066793.330068:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066793.330081:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85bf600/0xfb36a14ee608b9b0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e82c expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.330156:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be200/0xfb36a14ee608b9b7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.330168:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be200/0xfb36a14ee608b9b7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066793.330178:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be200/0xfb36a14ee608b9b7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:0.0:1746066793.330188:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066793.330284:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85bf600/0xfb36a14ee608b9b0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e82c expref: 13 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.330312:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be200/0xfb36a14ee608b9b7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e82c expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.330319:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:0.0:1746066793.330321:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066793.330324:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85be200, rc 0) 00000100:00100000:0.0:1746066793.330365:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31654:x1830882976970752:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 313us (440us total) trans 8589944060 rc 0/0 00000100:00100000:0.0:1746066793.330370:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9996 00000100:00100000:0.0:1746066793.332260:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.332295:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.332320:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.333762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.335924:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.337086:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976970880 00000100:00100000:2.0:1746066793.337096:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976970880 00000100:00100000:2.0:1746066793.337146:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976971136 00000100:00100000:2.0:1746066793.337148:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976971136 00000100:00100000:2.0:1746066793.337160:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976971392 00000100:00100000:2.0:1746066793.337162:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976971392 00000100:00100000:2.0:1746066793.337170:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976971008 00000100:00100000:2.0:1746066793.337172:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976971008 00000100:00100000:2.0:1746066793.337187:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14616 00000100:00100000:2.0:1746066793.337193:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976970880:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066793.337230:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ef93400/0xfb36a14ee608b9c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337243:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 548864->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337254:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.337255:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.337258:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef93400/0xfb36a14ee608b9c5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337284:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 548864->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337294:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 548864->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 11 pid: 10402 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.337306:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a5c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976856064:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.337363:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540d900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.337382:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14617 00000100:00100000:2.0:1746066793.337387:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976971136:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066793.337408:0:21973:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ef92e00/0xfb36a14ee608b9cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337417:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b581 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e585 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337424:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608b963 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7f4 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.337430:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608b5b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5a1 expref: 15 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.337435:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.337437:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.337438:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef92e00/0xfb36a14ee608b9cc lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337452:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608b5b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5a1 expref: 15 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.337459:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608b5b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5a1 expref: 15 pid: 21973 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746066793.337468:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976856192:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.337492:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608b963 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7f4 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.337500:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608b963 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7f4 expref: 8 pid: 4614 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746066793.337507:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092044380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976856320:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.337529:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b581 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e585 expref: 9 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337536:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b581 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e585 expref: 9 pid: 4614 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.337548:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092047800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976856448:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.337562:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0b840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.337577:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14618 00000100:00100000:2.0:1746066793.337582:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976971392:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066793.337607:0:21203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e5e400/0xfb36a14ee608b9d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337617:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a737c000/0xfb36a14ee608b901 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a7 expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337623:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ef92000/0xfb36a14ee608b96a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e802 expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.337629:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ed35e00/0xfb36a14ee608b90f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7b5 expref: 22 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337636:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d0de00/0xfb36a14ee608b828 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e73e expref: 11 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337641:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.337642:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.337644:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e5e400/0xfb36a14ee608b9d3 lrc: 7/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337658:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d0de00/0xfb36a14ee608b828 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e73e expref: 11 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337665:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d0de00/0xfb36a14ee608b828 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e73e expref: 11 pid: 4614 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.337672:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976856576:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.337713:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ed35e00/0xfb36a14ee608b90f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7b5 expref: 22 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337719:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ed35e00/0xfb36a14ee608b90f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7b5 expref: 22 pid: 20532 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.337726:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976856704:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.337745:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ef92000/0xfb36a14ee608b96a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e802 expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.337751:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ef92000/0xfb36a14ee608b96a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e802 expref: 8 pid: 21203 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746066793.337757:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976856832:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.337776:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a737c000/0xfb36a14ee608b901 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a7 expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337782:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a737c000/0xfb36a14ee608b901 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a7 expref: 11 pid: 10402 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.337793:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976856960:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.337806:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ea6240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.337818:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14619 00000100:00100000:2.0:1746066793.337823:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976971008:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066793.337837:0:20532:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608b9da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337845:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 9 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337851:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.337852:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.337854:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608b9da lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337867:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 9 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.337874:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 9 pid: 10402 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.337881:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976857088:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.337895:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21f89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.339716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.339783:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976971264 00000100:00100000:1.0:1746066793.339791:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976971264 00000100:00100000:1.0:1746066793.339818:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976971520 00000100:00100000:1.0:1746066793.339820:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976971520 00000100:00100000:1.0:1746066793.339830:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14620 00000100:00100000:1.0:1746066793.339836:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976971264:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:1.0:1746066793.339867:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093d00c00/0xfb36a14ee608b9e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.339886:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608b588 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e58c expref: 11 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.339893:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608b978 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7fb expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.339899:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0000/0xfb36a14ee608b5e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5bd expref: 22 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.339905:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.339907:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.339909:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093d00c00/0xfb36a14ee608b9e1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.339931:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0000/0xfb36a14ee608b5e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5bd expref: 22 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.339941:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0000/0xfb36a14ee608b5e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5bd expref: 22 pid: 20532 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746066793.339951:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976857216:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.340013:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608b978 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7fb expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.340021:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608b978 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7fb expref: 9 pid: 10402 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746066793.340032:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976857344:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.340052:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608b588 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e58c expref: 11 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.340059:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608b588 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e58c expref: 11 pid: 21973 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.340065:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976857472:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.340076:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.340093:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14621 00000100:00100000:1.0:1746066793.340099:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976971520:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:1.0:1746066793.340114:0:10402:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b9e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.340123:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009edf7800/0xfb36a14ee608b916 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7bc expref: 9 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.340129:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ef92c00/0xfb36a14ee608b971 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e809 expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.340134:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.340136:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.340138:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b9e8 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.340156:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ef92c00/0xfb36a14ee608b971 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e809 expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.340164:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ef92c00/0xfb36a14ee608b971 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e809 expref: 9 pid: 21203 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746066793.340171:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f618a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976857600:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.340193:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009edf7800/0xfb36a14ee608b916 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7bc expref: 9 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.340200:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009edf7800/0xfb36a14ee608b916 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7bc expref: 9 pid: 10402 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.340207:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f619f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976857728:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.340218:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.345397:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.345467:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.345491:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976971648 00000100:00100000:0.0:1746066793.345498:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976971648 00002000:00100000:0.0:1746066793.345543:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x38e:0x0] (548864->1048575) req@ffff88009b470000 x1830882976971648/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.345553:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470000 with x1830882976971648 ext(548864->1048575) 00010000:00010000:0.0:1746066793.345561:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 548864->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 12 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066793.345572:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 548864->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 12 pid: 10402 timeout: 854 lvb_type: 0 00002000:00010000:0.0:1746066793.345579:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b470000 00000100:00100000:0.0:1746066793.345593:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976972416 00000100:00100000:0.0:1746066793.345595:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976972416 00002000:00100000:0.0:1746066793.345616:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->1470463) req@ffff88009b471c00 x1830882976972416/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.345623:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b471c00 with x1830882976972416 ext(1048576->1470463) 00010000:00010000:0.0:1746066793.345628:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 10 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066793.345635:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 10 pid: 10402 timeout: 854 lvb_type: 0 00002000:00010000:0.0:1746066793.345641:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b471c00 00000100:00100000:0.0:1746066793.345653:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2159 00000100:00100000:0.0:1746066793.345659:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882976971648:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066793.346094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.346229:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976856192:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.346239:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092044380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976856320:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.346247:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092047800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976856448:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.346271:0:21973:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ef92e00/0xfb36a14ee608b9cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.346291:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976972288 00000100:00100000:3.0:1746066793.346294:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976972288 00010000:00010000:3.0:1746066793.346312:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608b5b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5a1 expref: 16 pid: 21973 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746066793.346331:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7497 00000100:00100000:3.0:1746066793.346336:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5219850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1966:x1830882976972288:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.346344:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.346360:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608b5b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5a1 expref: 16 pid: 21973 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746066793.346368:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608b5b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5a1 expref: 16 pid: 21973 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746066793.346385:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608b5b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5a1 expref: 16 pid: 21973 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746066793.346401:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.346422:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5219850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1966:x1830882976972288:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 85us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.346428:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7497 00000100:00100000:2.0:1746066793.346859:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a5c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976856064:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.346874:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ef93400/0xfb36a14ee608b9c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.346894:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976856576:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.346901:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976856704:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.346910:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976856832:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.346917:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976856960:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.346935:0:21203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b4e5e400/0xfb36a14ee608b9d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.346951:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2160 00000100:00100000:2.0:1746066793.346957:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:1966:x1830882976972416:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:1.0:1746066793.347718:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976857088:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.347733:0:20532:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608b9da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.350345:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976857216:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.350355:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976857344:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.350361:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976857472:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.350382:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093d00c00/0xfb36a14ee608b9e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.350527:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.350571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.350572:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f618a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976857600:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.350580:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f619f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976857728:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.350587:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976972800 00010000:00010000:3.0:1746066793.350591:0:10402:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b9e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.350591:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976972800 00000100:00100000:3.0:1746066793.350616:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976972928 00000100:00100000:3.0:1746066793.350618:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976972928 00010000:00010000:2.0:1746066793.350626:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed35e00/0xfb36a14ee608b90f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7b5 expref: 23 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.350629:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef92c00/0xfb36a14ee608b971 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e809 expref: 10 pid: 21203 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746066793.350656:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7498 00000100:00100000:2.0:1746066793.350660:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7499 00000100:00100000:3.0:1746066793.350662:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882976972928:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066793.350664:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1966:x1830882976972800:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.350672:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066793.350672:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.350710:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ef92c00/0xfb36a14ee608b971 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e809 expref: 10 pid: 21203 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746066793.350710:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ed35e00/0xfb36a14ee608b90f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7b5 expref: 23 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.350720:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ef92c00/0xfb36a14ee608b971 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e809 expref: 10 pid: 21203 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746066793.350723:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ed35e00/0xfb36a14ee608b90f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7b5 expref: 23 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.350735:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef92c00/0xfb36a14ee608b971 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e809 expref: 10 pid: 21203 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746066793.350735:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ed35e00/0xfb36a14ee608b90f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7b5 expref: 23 pid: 20532 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.350746:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066793.350747:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066793.350773:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882976972800:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 108us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.350778:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7499 00000100:00100000:3.0:1746066793.350928:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882976972928:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 265us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.350933:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7498 00000100:00100000:1.0:1746066793.351931:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.351944:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.351953:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976971776 00000100:00100000:1.0:1746066793.351957:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976971776 00010000:00010000:1.0:1746066793.351972:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608b963 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7f4 expref: 9 pid: 4614 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746066793.351976:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.352044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.352392:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976972032 00000100:00100000:1.0:1746066793.352394:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976972032 00010000:00010000:1.0:1746066793.352406:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d0de00/0xfb36a14ee608b828 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e73e expref: 14 pid: 4614 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.352415:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976972544 00000100:00100000:1.0:1746066793.352416:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976972544 00010000:00010000:1.0:1746066793.352423:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0000/0xfb36a14ee608b5e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5bd expref: 22 pid: 20532 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746066793.352440:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976973056 00000100:00100000:1.0:1746066793.352442:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976973056 00010000:00010000:1.0:1746066793.352447:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a737c000/0xfb36a14ee608b901 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a7 expref: 15 pid: 10402 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.352455:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7500 00000100:00100000:1.0:1746066793.352459:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976971776:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.352467:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.352479:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608b963 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7f4 expref: 9 pid: 4614 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.352487:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608b963 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7f4 expref: 9 pid: 4614 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.352501:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e83a00/0xfb36a14ee608b963 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7f4 expref: 9 pid: 4614 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.352513:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066793.352529:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976971776:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 70us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.352533:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7500 00000100:00100000:1.0:1746066793.352541:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7501 00000100:00100000:1.0:1746066793.352545:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f619500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882976972032:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.352549:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.352557:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d0de00/0xfb36a14ee608b828 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e73e expref: 15 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.352564:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d0de00/0xfb36a14ee608b828 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e73e expref: 15 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.352572:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d0de00/0xfb36a14ee608b828 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e73e expref: 15 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.352579:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066793.352587:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f619500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882976972032:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 42us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.352594:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7501 00000100:00100000:1.0:1746066793.352610:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7502 00000100:00100000:1.0:1746066793.352614:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882976972544:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.352618:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.352625:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0000/0xfb36a14ee608b5e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5bd expref: 22 pid: 20532 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.352631:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0000/0xfb36a14ee608b5e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5bd expref: 22 pid: 20532 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.352639:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a0000/0xfb36a14ee608b5e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e5bd expref: 22 pid: 20532 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.352646:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066793.352655:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882976972544:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 41us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.352659:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7502 00000100:00100000:1.0:1746066793.352665:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7503 00000100:00100000:1.0:1746066793.352668:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882976973056:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.352673:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.352693:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a737c000/0xfb36a14ee608b901 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a7 expref: 13 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.352699:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a737c000/0xfb36a14ee608b901 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a7 expref: 13 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.352712:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a737c000/0xfb36a14ee608b901 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7a7 expref: 13 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.352719:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066793.352729:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882976973056:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 60us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.352733:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7503 00000100:00100000:1.0:1746066793.352757:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.352766:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976971904 00000100:00100000:1.0:1746066793.352768:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976971904 00010000:00010000:1.0:1746066793.352776:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b581 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e585 expref: 12 pid: 4614 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.352784:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7504 00000100:00100000:1.0:1746066793.352787:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5219450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882976971904:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.352792:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.352797:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b581 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e585 expref: 12 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.352804:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b581 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e585 expref: 12 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.352813:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1600/0xfb36a14ee608b581 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e585 expref: 12 pid: 4614 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.352824:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.352826:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.352829:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ef92e00/0xfb36a14ee608b9cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.352836:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef92e00/0xfb36a14ee608b9cc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.352850:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066793.352860:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5219450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882976971904:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 72us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.352864:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7504 00000100:00100000:1.0:1746066793.352913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.352923:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976972160 00000100:00100000:1.0:1746066793.352925:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976972160 00010000:00010000:1.0:1746066793.352934:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef92000/0xfb36a14ee608b96a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e802 expref: 10 pid: 21203 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746066793.352944:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7505 00000100:00100000:1.0:1746066793.352947:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976972160:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.352952:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.352957:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ef92000/0xfb36a14ee608b96a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e802 expref: 10 pid: 21203 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.352965:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ef92000/0xfb36a14ee608b96a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e802 expref: 10 pid: 21203 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.352980:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef92000/0xfb36a14ee608b96a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e802 expref: 10 pid: 21203 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.352987:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.352988:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.352990:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e5e400/0xfb36a14ee608b9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.352996:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e5e400/0xfb36a14ee608b9d3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.353009:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066793.353023:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976972160:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 75us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.353027:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7505 00000100:00100000:1.0:1746066793.353059:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.353067:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976972672 00000100:00100000:1.0:1746066793.353069:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976972672 00010000:00010000:1.0:1746066793.353077:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608b978 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7fb expref: 9 pid: 10402 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746066793.353087:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7506 00000100:00100000:1.0:1746066793.353090:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f619500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976972672:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.353096:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.353102:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608b978 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7fb expref: 9 pid: 10402 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.353114:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608b978 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7fb expref: 9 pid: 10402 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.353123:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093d00600/0xfb36a14ee608b978 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7fb expref: 9 pid: 10402 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.353131:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066793.353143:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f619500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976972672:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 52us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.353148:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7506 00000100:00100000:1.0:1746066793.353202:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.353214:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976973184 00000100:00100000:1.0:1746066793.353216:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976973184 00010000:00010000:1.0:1746066793.353224:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608b588 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e58c expref: 12 pid: 21973 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.353233:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7507 00000100:00100000:1.0:1746066793.353236:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882976973184:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.353241:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.353247:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608b588 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e58c expref: 12 pid: 21973 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.353255:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608b588 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e58c expref: 12 pid: 21973 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.353269:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608b588 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e58c expref: 12 pid: 21973 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.353276:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.353277:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.353279:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093d00c00/0xfb36a14ee608b9e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.353284:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093d00c00/0xfb36a14ee608b9e1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.353296:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066793.353309:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882976973184:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 72us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.353314:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7507 00010000:00010000:1.0:1746066793.353328:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093d00c00/0xfb36a14ee608b9e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.353335:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093d00c00/0xfb36a14ee608b9e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.353350:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093d00c00/0xfb36a14ee608b9e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.353356:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093d00c00/0xfb36a14ee608b9e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.353367:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093d00c00/0xfb36a14ee608b9e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.353372:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093d00c00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066793.353375:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093d00c00/0xfb36a14ee608b9e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.353382:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093d00c00/0xfb36a14ee608b9e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.353391:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093d00c00/0xfb36a14ee608b9e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.353396:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093d00c00/0xfb36a14ee608b9e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.353428:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976971264:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 13592us (17510us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.353434:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14620 00010000:00010000:2.0:1746066793.354040:0:21203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b4e5e400/0xfb36a14ee608b9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.354048:0:21203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e5e400/0xfb36a14ee608b9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.354060:0:21203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e5e400/0xfb36a14ee608b9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.354065:0:21203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e5e400/0xfb36a14ee608b9d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.354070:0:21203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b4e5e400/0xfb36a14ee608b9d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.354075:0:21203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e5e400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066793.354078:0:21203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b4e5e400/0xfb36a14ee608b9d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.354083:0:21203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b4e5e400/0xfb36a14ee608b9d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.354090:0:21203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b4e5e400/0xfb36a14ee608b9d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.354095:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e5e400/0xfb36a14ee608b9d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.354124:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882976971392:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 16542us (21804us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.354129:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14618 00000100:00100000:0.0:1746066793.354921:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:1965:x1830882976971648:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 9260us (9529us total) trans 17179873599 rc 0/0 00000100:00100000:0.0:1746066793.354928:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2159 00002000:00100000:0.0:1746066793.354936:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x38e:0x0] (548864->1048575) req@ffff88009b470000 x1830882976971648/t17179873599(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/448 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.354944:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470000 with x1830882976971648 ext(548864->1048575) 00010000:00010000:0.0:1746066793.354950:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 548864->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 11 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066793.354960:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 548864->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 11 pid: 10402 timeout: 854 lvb_type: 0 00002000:00010000:0.0:1746066793.354966:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b470000 00010000:00010000:3.0:1746066793.356275:0:21973:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ef92e00/0xfb36a14ee608b9cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.356284:0:21973:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ef92e00/0xfb36a14ee608b9cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.356303:0:21973:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ef92e00/0xfb36a14ee608b9cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.356308:0:21973:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef92e00/0xfb36a14ee608b9cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.356314:0:21973:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ef92e00/0xfb36a14ee608b9cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.356318:0:21973:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef92e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066793.356322:0:21973:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ef92e00/0xfb36a14ee608b9cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.356327:0:21973:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ef92e00/0xfb36a14ee608b9cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.356339:0:21973:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ef92e00/0xfb36a14ee608b9cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.356344:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef92e00/0xfb36a14ee608b9cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.356387:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882976971136:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 18998us (24090us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.356393:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14617 00000100:00100000:3.0:1746066793.356447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.357831:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976973312 00000100:00100000:2.0:1746066793.357839:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976973312 00010000:00010000:2.0:1746066793.357861:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009edf7800/0xfb36a14ee608b916 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7bc expref: 11 pid: 10402 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.357881:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7508 00000100:00100000:2.0:1746066793.357887:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+11:1965:x1830882976973312:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066793.357898:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066793.357910:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009edf7800/0xfb36a14ee608b916 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7bc expref: 11 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.357918:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009edf7800/0xfb36a14ee608b916 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7bc expref: 11 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.357933:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009edf7800/0xfb36a14ee608b916 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7bc expref: 11 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.357943:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.357945:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.357948:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b9e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.357956:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b9e8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.357973:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066793.357995:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+10:1965:x1830882976973312:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 109us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.358001:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7508 00010000:00010000:3.0:1746066793.358072:0:10402:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b9e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.358079:0:10402:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b9e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.358093:0:10402:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b9e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.358099:0:10402:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b9e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.358105:0:10402:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b9e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.358109:0:10402:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3a0200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066793.358112:0:10402:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b9e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.358117:0:10402:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b9e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.358125:0:10402:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b9e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.358130:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a0200/0xfb36a14ee608b9e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.358161:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882976971520:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 18062us (18452us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.358167:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14621 00000100:00100000:0.0:1746066793.360286:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.360342:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976973440 00000100:00100000:3.0:1746066793.360349:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976973440 00010000:00010000:3.0:1746066793.360373:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 548864->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 11 pid: 10402 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.360406:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7509 00000100:00100000:3.0:1746066793.360412:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b472300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+11:1966:x1830882976973440:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.360422:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.360438:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 548864->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 11 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.360446:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 548864->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 11 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.360466:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa29e00/0xfb36a14ee608b92b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 548864->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d1 expref: 11 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.360478:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.360480:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.360484:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ef93400/0xfb36a14ee608b9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.360492:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef93400/0xfb36a14ee608b9c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.360511:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.360540:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b472300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+10:1966:x1830882976973440:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 129us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.360546:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7509 00010000:00010000:3.0:1746066793.360562:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ef93400/0xfb36a14ee608b9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.360569:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef93400/0xfb36a14ee608b9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.360584:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ef93400/0xfb36a14ee608b9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.360590:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef93400/0xfb36a14ee608b9c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.360611:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ef93400/0xfb36a14ee608b9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.360616:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ef93400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066793.360619:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ef93400/0xfb36a14ee608b9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.360626:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ef93400/0xfb36a14ee608b9c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.360633:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ef93400/0xfb36a14ee608b9c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.360639:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef93400/0xfb36a14ee608b9c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.360670:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1963:x1830882976970880:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 23477us (28414us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.360690:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14616 00000100:00100000:2.0:1746066793.360981:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:1966:x1830882976972416:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 14022us (15512us total) trans 21474840921 rc 0/0 00000100:00100000:2.0:1746066793.360989:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2160 00002000:00100000:2.0:1746066793.360996:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->1470463) req@ffff88009b471c00 x1830882976972416/t21474840921(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/448 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.361003:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b471c00 with x1830882976972416 ext(1048576->1470463) 00010000:00010000:2.0:1746066793.361009:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 10 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.361017:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 10 pid: 10402 timeout: 854 lvb_type: 0 00002000:00010000:2.0:1746066793.361023:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b471c00 00000100:00100000:1.0:1746066793.363812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.363890:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976973568 00000100:00100000:0.0:1746066793.363899:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976973568 00010000:00010000:0.0:1746066793.363929:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 10 pid: 10402 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746066793.363963:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7510 00000100:00100000:0.0:1746066793.363972:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+10:1965:x1830882976973568:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066793.363987:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066793.364006:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 10 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066793.364016:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 10 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066793.364033:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa29600/0xfb36a14ee608b932 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e7d8 expref: 10 pid: 10402 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066793.364356:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066793.364359:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066793.364364:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608b9da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.364373:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608b9da lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.364409:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066793.364578:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+9:1965:x1830882976973568:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 606us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066793.364584:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7510 00010000:00010000:1.0:1746066793.364646:0:20532:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608b9da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.364654:0:20532:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608b9da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.364694:0:20532:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608b9da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.364701:0:20532:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608b9da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.364707:0:20532:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608b9da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.364712:0:20532:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008de76000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066793.364715:0:20532:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608b9da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.364721:0:20532:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608b9da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.364729:0:20532:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608b9da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.364734:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608b9da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.364772:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1963:x1830882976971008:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 26949us (31013us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.364778:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14619 00000100:00100000:0.0:1746066793.368184:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.368760:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976973824 00000100:00100000:3.0:1746066793.368768:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976973824 00000100:00100000:3.0:1746066793.368814:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9997 00000100:00100000:3.0:1746066793.368822:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31654:x1830882976973824:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:3.0:1746066793.369255:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.369276:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef93a00/0xfb36a14ee608b99b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e817 expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.369289:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066793.369293:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066793.369315:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.369324:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e44a expref: 268 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.369331:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e451 expref: 268 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.369336:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b3d6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e45f expref: 27 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.369341:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b470 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4dd expref: 268 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.369347:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b4a1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4eb expref: 27 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.369352:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 8/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.369376:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4eb expref: 27 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.369386:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b4a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4eb expref: 27 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.369401:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976857856:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.369879:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b470 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4dd expref: 268 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.369887:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b470 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4dd expref: 268 pid: 14548 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.370023:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976857984:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.370072:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b3d6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e45f expref: 27 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.370081:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b3d6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e45f expref: 27 pid: 809 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.370088:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976858112:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.370108:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e451 expref: 268 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.370115:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e451 expref: 268 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.370121:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976858240:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.370139:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e44a expref: 268 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.370149:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e44a expref: 268 pid: 14548 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.370155:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976858368:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.370170:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.372873:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976857856:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.372883:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976857984:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.372889:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976858112:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.372894:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976858240:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.372900:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976858368:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.372928:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066793.373457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.373564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.373587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.374974:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.375535:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976974080 00000100:00100000:3.0:1746066793.375544:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976974080 00010000:00010000:3.0:1746066793.375574:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b470 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4dd expref: 269 pid: 14548 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.375608:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976974336 00000100:00100000:3.0:1746066793.375611:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976974336 00010000:00010000:3.0:1746066793.375620:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e451 expref: 270 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.375633:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976973952 00000100:00100000:3.0:1746066793.375635:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976973952 00010000:00010000:3.0:1746066793.375643:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b4a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4eb expref: 28 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.375651:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976974208 00000100:00100000:3.0:1746066793.375652:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976974208 00010000:00010000:3.0:1746066793.375659:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b3d6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e45f expref: 29 pid: 809 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.375668:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7511 00000100:00100000:3.0:1746066793.375686:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5219050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+270:1964:x1830882976974080:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.375697:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.375702:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b470 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4dd expref: 270 pid: 14548 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.375711:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b470 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4dd expref: 270 pid: 14548 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.375729:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b400/0xfb36a14ee608b470 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4dd expref: 270 pid: 14548 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.375741:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066793.375745:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.375751:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.375781:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5219050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+269:1964:x1830882976974080:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 108us (2325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.375787:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7511 00000100:00100000:3.0:1746066793.375826:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7512 00000100:00100000:3.0:1746066793.375832:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:1964:x1830882976974336:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.375837:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.375841:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e451 expref: 268 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.375848:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e451 expref: 268 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.375857:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b200/0xfb36a14ee608b3cf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e451 expref: 268 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.375864:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066793.375867:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.375871:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.375883:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:1964:x1830882976974336:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 51us (2320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.375888:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7512 00000100:00100000:3.0:1746066793.375897:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7513 00000100:00100000:3.0:1746066793.375901:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882976973952:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.375906:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.375909:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b4a1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4eb expref: 29 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.375916:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4eb expref: 29 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.375930:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b46b000/0xfb36a14ee608b4a1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e4eb expref: 29 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.375937:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066793.375939:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.375944:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.375957:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882976973952:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 55us (2368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.375961:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7513 00000100:00100000:3.0:1746066793.375971:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7514 00000100:00100000:3.0:1746066793.375976:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882976974208:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.375981:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.375984:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b3d6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e45f expref: 27 pid: 809 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.375990:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b3d6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e45f expref: 27 pid: 809 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.375998:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e80b400/0xfb36a14ee608b3d6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e45f expref: 27 pid: 809 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.376005:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066793.376008:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.376015:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.376026:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882976974208:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 51us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.376030:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7514 00000100:00100000:1.0:1746066793.376090:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.376356:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976974464 00000100:00100000:0.0:1746066793.376359:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976974464 00010000:00010000:0.0:1746066793.376371:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e44a expref: 267 pid: 14548 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746066793.376385:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7515 00000100:00100000:0.0:1746066793.376388:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:1964:x1830882976974464:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066793.376393:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066793.376396:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e44a expref: 267 pid: 14548 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066793.376403:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e44a expref: 267 pid: 14548 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066793.376412:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608b3c8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e44a expref: 267 pid: 14548 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746066793.376424:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:0.0:1746066793.376427:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066793.376432:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066793.376437:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066793.376452:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066793.376468:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:1964:x1830882976974464:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 79us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066793.376475:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7515 00010000:00010000:3.0:1746066793.376857:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.376863:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000040:00080000:3.0:1746066793.377424:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3097, 88 off261784 00000004:00080000:3.0:1746066793.377431:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754554754515ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.377478:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3114, 88 off263200 00000004:00080000:3.0:1746066793.377482:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754554805603ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066793.379389:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3115, 88 off263288 00000004:00080000:3.0:1746066793.379398:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754556721781ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066793.379534:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3098, 88 off261872 00000004:00080000:3.0:1746066793.379541:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754556864454ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.379646:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3099, 88 off261960 00000004:00080000:3.0:1746066793.379651:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754556974874ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.379658:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3116, 88 off263376 00000004:00080000:3.0:1746066793.379661:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754556985076ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066793.379669:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3117, 88 off263464 00000004:00080000:3.0:1746066793.379671:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754556995434ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066793.379695:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3118, 88 off263552 00000004:00080000:3.0:1746066793.379697:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754557021256ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066793.379704:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3100, 88 off262048 00000004:00080000:3.0:1746066793.379707:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754557030888ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.379713:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3119, 88 off263640 00000004:00080000:3.0:1746066793.379715:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754557039154ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066793.379766:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3102, 88 off262232 00000004:00080000:3.0:1746066793.379769:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754557093286ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.379778:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3120, 88 off263728 00000004:00080000:3.0:1746066793.379780:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754557104149ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066793.379787:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3103, 88 off262320 00000004:00080000:3.0:1746066793.379789:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754557113226ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.379795:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3104, 88 off262408 00000004:00080000:3.0:1746066793.379797:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754557121409ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.379804:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3105, 88 off262496 00000004:00080000:3.0:1746066793.379806:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754557130121ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.379812:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3106, 88 off262584 00000004:00080000:3.0:1746066793.379814:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754557138254ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.379820:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3121, 88 off263816 00000004:00080000:3.0:1746066793.379823:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754557146694ns, next at 749511475809ns, rc = 0 00000004:00010000:3.0:1746066793.404249:0:14549:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012c0fd180 reply state ffff8800932aa800 transno 8589944061 ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746066793.404260:0:14549:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746066793.404619:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944060 is committed 00000001:00080000:0.0:1746066793.404627:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944030 is committed 00000001:00080000:0.0:1746066793.404631:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944026 is committed 00000001:00080000:0.0:1746066793.404636:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944054 is committed 00000001:00080000:0.0:1746066793.404644:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944043 is committed 00000001:00080000:0.0:1746066793.404652:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944057 is committed 00000001:00080000:0.0:1746066793.404655:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944056 is committed 00000001:00080000:0.0:1746066793.404704:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944061 is committed 00000004:00080000:0.0:1746066793.404708:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2395 committed 00000004:00080000:0.0:1746066793.404723:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2379 committed 00000004:00080000:0.0:1746066793.404728:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2378 committed 00000004:00080000:0.0:1746066793.404729:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2377 committed 00000004:00080000:0.0:1746066793.404731:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2376 committed 00000004:00080000:0.0:1746066793.404732:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2394 committed 00000004:00080000:0.0:1746066793.404734:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2375 committed 00000004:00080000:0.0:1746066793.404735:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2393 committed 00000004:00080000:0.0:1746066793.404737:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2374 committed 00000004:00080000:0.0:1746066793.404738:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2392 committed 00000004:00080000:0.0:1746066793.404740:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2391 committed 00000004:00080000:0.0:1746066793.404741:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2390 committed 00000004:00080000:0.0:1746066793.404742:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2373 committed 00000004:00080000:0.0:1746066793.404744:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2372 committed 00000004:00080000:0.0:1746066793.404746:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2389 committed 00000004:00080000:0.0:1746066793.404748:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2388 committed 00000004:00080000:0.0:1746066793.404749:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2371 committed 00000001:00080000:0.0:1746066793.404754:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944058 is committed 00010000:00080000:3.0:1746066793.404994:0:14549:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746066793.405007:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31654:x1830882976973824:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 36183us (36825us total) trans 8589944061 rc 0/0 00000100:00100000:3.0:1746066793.405015:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9997 00000100:00100000:3.0:1746066793.405042:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976858496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.405076:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.405536:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746066793.405542:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976858624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.405560:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.405571:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009270a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976859008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.405583:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066793.405607:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976858496 00000100:00100000:3.0:1746066793.405610:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976858624 00000100:00100000:3.0:1746066793.405614:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976858624 00000100:00100000:1.0:1746066793.405614:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976858496 00000100:00100000:3.0:1746066793.405649:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976859008 00000100:00100000:3.0:1746066793.405651:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976859008 00000100:00100000:3.0:1746066793.405662:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14622 00000100:00100000:3.0:1746066793.405667:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1830882976858496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.405827:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3295:x1830882976858496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (749us total) trans 17179873600 rc 0/0 00000100:00100000:3.0:1746066793.405832:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14622 00000100:00100000:3.0:1746066793.405841:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14623 00000100:00100000:3.0:1746066793.405844:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1830882976858624:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066793.406086:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.406094:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746066793.406095:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1830882976858624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 250us (534us total) trans 21474840922 rc 0/0 00010000:00010000:2.0:1746066793.406099:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746066793.406100:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14623 00010000:00010000:2.0:1746066793.406103:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e83000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066793.406106:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746066793.406109:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14624 00000100:00100000:3.0:1746066793.406112:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1830882976859008:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746066793.406112:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.406123:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066793.406126:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066793.406129:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.406134:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e83000/0xfb36a14ee608b9ef lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746066793.406182:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3295:x1830882976859008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (597us total) trans 17179873601 rc 0/0 00000100:00100000:3.0:1746066793.406186:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14624 00000100:00100000:3.0:1746066793.406203:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976859520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.406215:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.406242:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873589 gen 2 00000004:00080000:3.0:1746066793.406246:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590f480, transno 17179873560 00000004:00080000:3.0:1746066793.406249:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924d2300, transno 17179873561 00000004:00080000:3.0:1746066793.406251:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590e680, transno 17179873562 00000004:00080000:3.0:1746066793.406253:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924d2680, transno 17179873563 00000004:00080000:3.0:1746066793.406254:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924d1c00, transno 17179873564 00000004:00080000:3.0:1746066793.406256:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c4380, transno 17179873565 00000004:00080000:3.0:1746066793.406257:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c528380, transno 17179873566 00000004:00080000:3.0:1746066793.406259:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590f100, transno 17179873567 00000004:00080000:3.0:1746066793.406261:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924d3b80, transno 17179873568 00000004:00080000:3.0:1746066793.406262:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c7480, transno 17179873572 00000004:00080000:3.0:1746066793.406264:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c7b80, transno 17179873573 00000004:00080000:3.0:1746066793.406265:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c7800, transno 17179873574 00000004:00080000:3.0:1746066793.406267:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c5f80, transno 17179873575 00000004:00080000:3.0:1746066793.406269:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c5180, transno 17179873576 00000004:00080000:3.0:1746066793.406271:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c5500, transno 17179873577 00000004:00080000:3.0:1746066793.406273:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c5c00, transno 17179873578 00000004:00080000:3.0:1746066793.406274:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e8c5880, transno 17179873579 00000004:00080000:3.0:1746066793.406276:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2c380, transno 17179873580 00000004:00080000:3.0:1746066793.406278:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092044000, transno 17179873581 00000004:00080000:3.0:1746066793.406280:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092046d80, transno 17179873582 00000004:00080000:3.0:1746066793.406282:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800996d9500, transno 17179873583 00000004:00080000:3.0:1746066793.406283:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800996d9180, transno 17179873584 00000004:00080000:3.0:1746066793.406285:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092044a80, transno 17179873585 00000004:00080000:3.0:1746066793.406287:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800996d8380, transno 17179873586 00000004:00080000:3.0:1746066793.406289:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800996d8700, transno 17179873587 00000004:00080000:3.0:1746066793.406291:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092044700, transno 17179873588 00000004:00080000:3.0:1746066793.406293:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16e300, transno 17179873589 00000100:00100000:3.0:1746066793.406297:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009270a680 x1830882976859008/t17179873601(17179873601) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066809 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000100:00100000:2.0:1746066793.406299:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976859520 00000100:00100000:2.0:1746066793.406302:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976859520 00000004:00080000:3.0:1746066793.406310:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009270a680/2, rc 0, transno 17179873601 00000100:00100000:3.0:1746066793.406313:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009270a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976859008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.406319:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14625 00000100:00100000:3.0:1746066793.406322:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840910 gen 2 00000004:00080000:3.0:1746066793.406324:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef58e00, transno 21474840884 00000004:00080000:3.0:1746066793.406328:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef59880, transno 21474840885 00000100:00100000:2.0:1746066793.406328:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3295:x1830882976859520:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066793.406330:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5ad80, transno 21474840886 00000004:00080000:3.0:1746066793.406332:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5bb80, transno 21474840887 00000004:00080000:3.0:1746066793.406334:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5aa00, transno 21474840888 00000004:00080000:3.0:1746066793.406335:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef58700, transno 21474840889 00000004:00080000:3.0:1746066793.406337:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef58a80, transno 21474840890 00000004:00080000:3.0:1746066793.406339:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef58000, transno 21474840891 00000004:00080000:3.0:1746066793.406340:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c529500, transno 21474840895 00000004:00080000:3.0:1746066793.406342:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c528a80, transno 21474840896 00000004:00080000:3.0:1746066793.406344:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c52a300, transno 21474840897 00000004:00080000:3.0:1746066793.406346:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c52ad80, transno 21474840898 00000004:00080000:3.0:1746066793.406348:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c529180, transno 21474840899 00000004:00080000:3.0:1746066793.406350:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c528e00, transno 21474840900 00000004:00080000:3.0:1746066793.406351:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c52b100, transno 21474840901 00000004:00080000:3.0:1746066793.406353:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c52a680, transno 21474840902 00000004:00080000:3.0:1746066793.406355:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2ed80, transno 21474840903 00000004:00080000:3.0:1746066793.406357:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2d880, transno 21474840904 00000004:00080000:3.0:1746066793.406359:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed09880, transno 21474840905 00000004:00080000:3.0:1746066793.406361:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed08000, transno 21474840906 00000004:00080000:3.0:1746066793.406363:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2c000, transno 21474840907 00000004:00080000:3.0:1746066793.406365:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2ea00, transno 21474840908 00000004:00080000:3.0:1746066793.406366:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2d500, transno 21474840909 00000004:00080000:3.0:1746066793.406368:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2e680, transno 21474840910 00000100:00100000:3.0:1746066793.406371:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8801361fa680 x1830882976858624/t21474840922(21474840922) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066809 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746066793.406377:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801361fa680/2, rc 0, transno 21474840922 00000100:00100000:3.0:1746066793.406379:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976858624:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066793.406385:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c0fdc00/2, rc 0, transno 17179873600 00000100:00100000:3.0:1746066793.406388:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976858496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.406393:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746066793.406397:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976859136:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.406415:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066793.406420:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3295:x1830882976859520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (202us total) trans 21474840923 rc 0/0 00000100:00100000:3.0:1746066793.406425:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976859648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066793.406426:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14625 00000100:00100000:2.0:1746066793.406432:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976859136 00000100:00100000:2.0:1746066793.406434:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976859136 00000100:00100000:3.0:1746066793.406436:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066793.406443:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976859648 00000100:00100000:2.0:1746066793.406445:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976859648 00000004:00080000:3.0:1746066793.406448:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16d500/2, rc 0, transno 21474840923 00000100:00100000:3.0:1746066793.406451:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976859520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066793.406452:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14626 00000100:00100000:2.0:1746066793.406454:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3295:x1830882976859136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.406463:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14627 00000100:00100000:3.0:1746066793.406468:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3295:x1830882976859648:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066793.406503:0:14590:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 5 changes, 4 in progress, 2 in flight, 27 done 00000100:00100000:3.0:1746066793.406542:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3295:x1830882976859648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (105us total) trans 21474840924 rc 0/0 00000100:00100000:2.0:1746066793.406544:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3295:x1830882976859136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (128us total) trans 21474840925 rc 0/0 00000100:00100000:3.0:1746066793.406547:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14627 00000100:00100000:2.0:1746066793.406550:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14626 00000100:00100000:3.0:1746066793.406562:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976860032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.406575:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.406586:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009270ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976860544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.406609:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746066793.406623:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801361f9180/2, rc 0, transno 21474840925 00000100:00100000:3.0:1746066793.406626:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976859136:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066793.406632:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16ce00/2, rc 0, transno 21474840924 00000100:00100000:3.0:1746066793.406635:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976859648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.406640:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746066793.406642:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976860032 00000100:00100000:3.0:1746066793.406643:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976860160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.406644:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976860032 00000100:00100000:2.0:1746066793.406652:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976860544 00000100:00100000:2.0:1746066793.406653:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976860544 00000100:00100000:3.0:1746066793.406657:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066793.406667:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976860160 00000100:00100000:2.0:1746066793.406668:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976860160 00000100:00100000:3.0:1746066793.406690:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14628 00000100:00100000:2.0:1746066793.406694:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14629 00000100:00100000:3.0:1746066793.406696:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3295:x1830882976860032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.406697:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3295:x1830882976860544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.406721:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14630 00000100:00100000:2.0:1746066793.406724:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3295:x1830882976860160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066793.406777:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009270b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976858752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.406790:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3295:x1830882976860032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (213us total) trans 17179873602 rc 0/0 00000100:00100000:3.0:1746066793.406795:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14628 00000100:00100000:1.0:1746066793.406796:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066793.406801:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3295:x1830882976860544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (203us total) trans 17179873604 rc 0/0 00000100:00100000:3.0:1746066793.406803:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976858752 00000100:00100000:2.0:1746066793.406804:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14629 00000100:00100000:3.0:1746066793.406805:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976858752 00000100:00100000:1.0:1746066793.406806:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976859264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066793.406813:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.406817:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14631 00000100:00100000:1.0:1746066793.406819:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976859776:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.406821:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3293:x1830882976858752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.406825:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3295:x1830882976860160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (168us total) trans 17179873603 rc 0/0 00000100:00100000:1.0:1746066793.406827:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066793.406829:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14630 00000100:00100000:1.0:1746066793.406831:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009270b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976860288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.406833:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976859264 00000100:00100000:2.0:1746066793.406835:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976859264 00000100:00100000:1.0:1746066793.406837:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066793.406840:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976859776 00000100:00100000:2.0:1746066793.406841:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976859776 00000100:00100000:2.0:1746066793.406844:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976860288 00000100:00100000:2.0:1746066793.406845:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976860288 00000100:00100000:1.0:1746066793.406849:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14632 00000100:00100000:2.0:1746066793.406853:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14633 00000100:00100000:1.0:1746066793.406853:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3293:x1830882976859264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066793.406855:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3293:x1830882976859776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066793.406905:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3293:x1830882976859776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (77us total) trans 21474840926 rc 0/0 00000100:00100000:2.0:1746066793.406908:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14633 00000100:00100000:3.0:1746066793.406912:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3293:x1830882976858752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (114us total) trans 17179873605 rc 0/0 00000100:00100000:2.0:1746066793.406913:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14634 00000100:00100000:2.0:1746066793.406916:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3293:x1830882976860288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.406917:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14631 00000100:00100000:1.0:1746066793.406923:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3293:x1830882976859264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (108us total) trans 21474840927 rc 0/0 00000100:00100000:1.0:1746066793.406927:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14632 00000004:00080000:1.0:1746066793.406943:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009270b480/2, rc 0, transno 17179873605 00000100:00100000:1.0:1746066793.406945:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009270b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976858752:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066793.406949:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801361fad80/2, rc 0, transno 21474840927 00000100:00100000:1.0:1746066793.406951:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976859264:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066793.406955:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16c380/2, rc 0, transno 21474840926 00000100:00100000:1.0:1746066793.406956:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976859776:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066793.406957:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746066793.406959:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746066793.406960:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066793.406961:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00000004:00080000:3.0:1746066793.406962:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092709500/2, rc 0, transno 17179873603 00002000:00010000:2.0:1746066793.406962:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746066793.406966:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976860160:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066793.406972:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092708a80/2, rc 0, transno 17179873602 00000100:00100000:3.0:1746066793.406974:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976860032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.406975:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3293:x1830882976860288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (137us total) trans 17179873606 rc 0/0 00000100:00100000:2.0:1746066793.406978:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14634 00000004:00080000:3.0:1746066793.406980:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009270ad80/2, rc 0, transno 17179873604 00000100:00100000:3.0:1746066793.406982:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009270ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976860544:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066793.407020:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009270b100/2, rc 0, transno 17179873606 00000100:00100000:1.0:1746066793.407022:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009270b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976860288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066793.407091:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976858880:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1746066793.407118:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066793.407119:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1746066793.407120:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1746066793.407161:0:14588:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 2 in flight, 24 done 00000100:00100000:2.0:1746066793.407170:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976858880 00000100:00100000:2.0:1746066793.407172:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976858880 00000100:00100000:0.0:1746066793.407174:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976859392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066793.407190:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066793.407196:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976859392 00000100:00100000:2.0:1746066793.407198:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976859392 00000100:00100000:0.0:1746066793.407202:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976859904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066793.407208:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14635 00000100:00100000:2.0:1746066793.407212:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3294:x1830882976858880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066793.407213:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066793.407223:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976860416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066793.407234:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066793.407270:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3294:x1830882976858880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (150us total) trans 17179873607 rc 0/0 00000100:00100000:2.0:1746066793.407273:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14635 00000100:00100000:2.0:1746066793.407278:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976859904 00000100:00100000:2.0:1746066793.407280:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976859904 00000100:00100000:1.0:1746066793.407282:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976860416 00000100:00100000:1.0:1746066793.407285:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976860416 00000100:00100000:3.0:1746066793.407296:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14636 00000100:00100000:2.0:1746066793.407299:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14637 00000100:00100000:3.0:1746066793.407302:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3294:x1830882976859392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066793.407302:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3294:x1830882976859904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066793.407307:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14638 00000100:00100000:1.0:1746066793.407310:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3294:x1830882976860416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.407350:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3294:x1830882976859904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (136us total) trans 21474840928 rc 0/0 00000100:00100000:2.0:1746066793.407353:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14637 00000100:00100000:1.0:1746066793.407373:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3294:x1830882976860416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (138us total) trans 17179873608 rc 0/0 00000100:00100000:1.0:1746066793.407377:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14638 00000100:00100000:3.0:1746066793.407519:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3294:x1830882976859392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 217us (328us total) trans 21474840929 rc 0/0 00000100:00100000:3.0:1746066793.407524:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14636 00000004:00080000:0.0:1746066793.407581:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092708700/2, rc 0, transno 17179873607 00000100:00100000:0.0:1746066793.407584:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976858880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066793.407591:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16ed80/2, rc 0, transno 21474840929 00000100:00100000:0.0:1746066793.407593:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976859392:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066793.407611:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009244d500/2, rc 0, transno 21474840928 00000100:00100000:0.0:1746066793.407614:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976859904:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066793.407619:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092709880/2, rc 0, transno 17179873608 00000100:00100000:0.0:1746066793.407622:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976860416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.409205:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.409387:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976974592 00000100:00100000:3.0:1746066793.409393:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976974592 00000100:00100000:3.0:1746066793.409421:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9998 00000100:00100000:3.0:1746066793.409427:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31654:x1830882976974592:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066793.409444:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.409458:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a632a00/0xfb36a14ee608b9f6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e833 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.409499:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a632a00/0xfb36a14ee608b9f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e833 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.409510:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a632a00/0xfb36a14ee608b9f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e833 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.409524:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066793.409527:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066793.409529:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a632a00, rc 0) 00000100:00100000:3.0:1746066793.409993:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31654:x1830882976974592:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 564us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.409999:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9998 00000100:00100000:0.0:1746066793.412187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.412224:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976974720 00000100:00100000:3.0:1746066793.412230:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976974720 00000100:00100000:3.0:1746066793.412254:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 9999 00000100:00100000:3.0:1746066793.412259:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31654:x1830882976974720:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066793.412274:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.412286:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a632200/0xfb36a14ee608b9fd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e83a expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.412354:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a633a00/0xfb36a14ee608ba04 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.412362:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a633a00/0xfb36a14ee608ba04 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.412370:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a633a00/0xfb36a14ee608ba04 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066793.412391:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066793.412394:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066793.412406:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a633a00/0xfb36a14ee608ba04 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.412423:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a632200/0xfb36a14ee608b9fd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e83a expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.412556:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a633a00/0xfb36a14ee608ba04 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e83a expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.412812:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066793.412816:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066793.412819:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a633a00, rc 0) 00000100:00100000:3.0:1746066793.412850:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31654:x1830882976974720:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 590us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.412855:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 9999 00000100:00100000:0.0:1746066793.415738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.415760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.415772:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.415783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.415794:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.415801:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976974848 00000100:00100000:1.0:1746066793.415809:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976974848 00000100:00100000:1.0:1746066793.415840:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976975104 00000100:00100000:1.0:1746066793.415842:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976975104 00000100:00100000:1.0:1746066793.415851:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976975360 00000100:00100000:1.0:1746066793.415853:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976975360 00000100:00100000:0.0:1746066793.415858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.415864:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976974976 00000100:00100000:1.0:1746066793.415866:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976974976 00000100:00100000:1.0:1746066793.415874:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976975232 00000100:00100000:1.0:1746066793.415876:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976975232 00000100:00100000:1.0:1746066793.415882:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976975488 00000100:00100000:1.0:1746066793.415883:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976975488 00000100:00100000:2.0:1746066793.415892:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14639 00000100:00100000:1.0:1746066793.415898:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14640 00000100:00100000:2.0:1746066793.415900:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976974848:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:1.0:1746066793.415903:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976975104:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066793.415913:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.415914:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.415927:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa28000/0xfb36a14ee608ba12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e841 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.415928:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608ba0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e84f expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066793.415949:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd69, atime: 0x6812dd68, ctime: 0x6812dd69, blocks: 0x7dd 00002000:00010000:1.0:1746066793.415949:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd67, atime: 0x6812dd66, ctime: 0x6812dd67, blocks: 0x821 00010000:00010000:2.0:1746066793.415962:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.415962:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.415964:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.415964:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.415970:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa28000/0xfb36a14ee608ba12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e841 expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.415970:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608ba0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e84f expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.415982:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608ba0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e84f expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.415987:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa28000/0xfb36a14ee608ba12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e841 expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.415991:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e880a00, rc 0) 00010000:00010000:2.0:1746066793.415994:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa28000, rc 0) 00000100:00100000:2.0:1746066793.416025:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976974848:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 126us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.416025:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976975104:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 121us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.416029:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14640 00000100:00100000:2.0:1746066793.416032:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14639 00000100:00100000:1.0:1746066793.416042:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14641 00000100:00100000:2.0:1746066793.416046:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14642 00000100:00100000:1.0:1746066793.416047:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976975360:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:2.0:1746066793.416050:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976974976:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066793.416053:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.416056:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.416060:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ba19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e85d expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.416063:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa28400/0xfb36a14ee608ba20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e848 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066793.416069:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 5090560, mtime: 0x6812dd68, atime: 0x6812dd68, ctime: 0x6812dd68, blocks: 0x1723 00002000:00010000:2.0:1746066793.416072:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38d:0x0] initial LVB size: 2097152, mtime: 0x6812dd69, atime: 0x6812dd68, ctime: 0x6812dd69, blocks: 0x821 00010000:00010000:1.0:1746066793.416076:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.416077:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.416080:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.416081:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.416081:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ba19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e85d expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.416085:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa28400/0xfb36a14ee608ba20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e848 expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.416089:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ba19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e85d expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.416093:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa28400/0xfb36a14ee608ba20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e848 expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.416094:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e881c00, rc 0) 00010000:00010000:2.0:1746066793.416099:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa28400, rc 0) 00000100:00100000:1.0:1746066793.416107:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976975360:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 61us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.416115:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976974976:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 64us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.416115:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14641 00000100:00100000:2.0:1746066793.416119:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14642 00000100:00100000:1.0:1746066793.416123:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14643 00000100:00100000:1.0:1746066793.416127:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976975232:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:2.0:1746066793.416128:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14644 00010000:00010000:1.0:1746066793.416132:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066793.416133:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882976975488:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066793.416138:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.416138:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608ba27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e856 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.416144:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa29400/0xfb36a14ee608ba2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e864 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066793.416147:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 2097152, mtime: 0x6812dd67, atime: 0x6812dd66, ctime: 0x6812dd67, blocks: 0x821 00010000:00010000:1.0:1746066793.416153:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.416154:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1746066793.416157:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38f:0x0] initial LVB size: 4194304, mtime: 0x6812dd68, atime: 0x6812dd68, ctime: 0x6812dd68, blocks: 0x102b 00010000:00010000:1.0:1746066793.416157:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608ba27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e856 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.416164:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.416164:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608ba27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e856 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.416165:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.416168:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa29400/0xfb36a14ee608ba2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e864 expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.416170:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e881e00, rc 0) 00010000:00010000:2.0:1746066793.416176:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa29400/0xfb36a14ee608ba2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e864 expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066793.416182:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa29400, rc 0) 00000100:00100000:1.0:1746066793.416187:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976975232:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 59us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.416192:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14643 00000100:00100000:2.0:1746066793.416200:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976975488:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 62us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.416205:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14644 00000100:00100000:0.0:1746066793.425474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.425508:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.425536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.425541:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976975744 00000100:00100000:2.0:1746066793.425549:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976975744 00000100:00100000:0.0:1746066793.425559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.425611:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976976000 00000100:00100000:2.0:1746066793.425614:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976976000 00000100:00100000:2.0:1746066793.425631:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976976512 00000100:00100000:2.0:1746066793.425633:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976976512 00000100:00100000:2.0:1746066793.425644:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976976384 00000100:00100000:2.0:1746066793.425645:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976976384 00000100:00100000:2.0:1746066793.425659:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6630 00000100:00100000:2.0:1746066793.425665:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976975744:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:2.0:1746066793.425718:0:21552:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fa28c00/0xfb36a14ee608ba35 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.425730:0:21552:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.425732:0:21552:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.425736:0:21552:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa28c00/0xfb36a14ee608ba35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.425748:0:21552:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa28c00/0xfb36a14ee608ba35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066793.426044:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6631 00000100:00100000:0.0:1746066793.426051:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976976000:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:0.0:1746066793.426067:0:1993:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ba3c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.426074:0:1993:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066793.426075:0:1993:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066793.426077:0:1993:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ba3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.426085:0:1993:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ba3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.426864:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6632 00000100:00100000:1.0:1746066793.426872:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976976512:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:1.0:1746066793.426889:0:8456:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ba43 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.426900:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.426901:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.426904:0:8456:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ba43 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.426950:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6633 00000100:00100000:3.0:1746066793.426959:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976976384:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:3.0:1746066793.426975:0:25585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a632000/0xfb36a14ee608ba4a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.426982:0:25585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.426983:0:25585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.426986:0:25585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a632000/0xfb36a14ee608ba4a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.426993:0:25585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a632000/0xfb36a14ee608ba4a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.427310:0:8456:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ba43 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066793.427523:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.427544:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.427582:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976976768 00000100:00100000:1.0:1746066793.427587:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976976768 00000100:00100000:1.0:1746066793.427621:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976977024 00000100:00100000:1.0:1746066793.427623:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976977024 00000100:00100000:1.0:1746066793.427637:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6634 00000100:00100000:1.0:1746066793.427641:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976976768:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:1.0:1746066793.427651:0:31365:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e881600/0xfb36a14ee608ba51 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.427657:0:31365:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.427658:0:31365:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.427661:0:31365:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881600/0xfb36a14ee608ba51 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.427667:0:31365:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e881600/0xfb36a14ee608ba51 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.428800:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6635 00000100:00100000:1.0:1746066793.428807:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976977024:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:1.0:1746066793.428825:0:8455:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608ba58 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.428832:0:8455:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.428833:0:8455:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.428835:0:8455:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608ba58 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.428843:0:8455:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608ba58 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066793.433799:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.433856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.433883:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976977280 00000100:00100000:0.0:1746066793.433891:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976977280 00000100:00100000:0.0:1746066793.433940:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976977536 00000100:00100000:0.0:1746066793.433943:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976977536 00000100:00100000:0.0:1746066793.433962:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6636 00000100:00100000:0.0:1746066793.433969:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882976977280:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:0.0:1746066793.434002:0:8457:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099a08400/0xfb36a14ee608ba5f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.434016:0:8457:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066793.434018:0:8457:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066793.434023:0:8457:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a08400/0xfb36a14ee608ba5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.434035:0:8457:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a08400/0xfb36a14ee608ba5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.435851:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6637 00000100:00100000:3.0:1746066793.435863:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882976977536:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:3.0:1746066793.435896:0:21551:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608ba66 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.435906:0:21551:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.435908:0:21551:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.435912:0:21551:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608ba66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.435923:0:21551:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608ba66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.442089:0:31365:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009e881600/0xfb36a14ee608ba51 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.442104:0:31365:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881600/0xfb36a14ee608ba51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.442111:0:31365:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e881600/0xfb36a14ee608ba51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.442117:0:31365:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e881600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066793.442120:0:31365:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e881600/0xfb36a14ee608ba51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.442127:0:31365:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e881600/0xfb36a14ee608ba51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.442145:0:31365:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e881600/0xfb36a14ee608ba51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.442155:0:31365:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e881600/0xfb36a14ee608ba51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31365 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.442246:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882976976768:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 14598us (14717us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066793.442257:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6634 00010000:00010000:2.0:1746066793.445549:0:21552:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fa28c00/0xfb36a14ee608ba35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.445562:0:21552:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa28c00/0xfb36a14ee608ba35 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.445569:0:21552:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fa28c00/0xfb36a14ee608ba35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.445575:0:21552:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa28c00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066793.445579:0:21552:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fa28c00/0xfb36a14ee608ba35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.445585:0:21552:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fa28c00/0xfb36a14ee608ba35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.445615:0:21552:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fa28c00/0xfb36a14ee608ba35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.445621:0:21552:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa28c00/0xfb36a14ee608ba35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.445722:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882976975744:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 20053us (20252us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066793.445731:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6630 00010000:00010000:1.0:1746066793.447983:0:8455:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608ba58 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.447995:0:8455:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608ba58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.448002:0:8455:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608ba58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.448007:0:8455:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008de76000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066793.448010:0:8455:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608ba58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.448016:0:8455:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608ba58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.448028:0:8455:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608ba58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.448033:0:8455:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008de76000/0xfb36a14ee608ba58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.449282:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882976977024:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 20468us (21728us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066793.449955:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6635 00010000:00010000:3.0:1746066793.455917:0:25585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a632000/0xfb36a14ee608ba4a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.455933:0:25585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a632000/0xfb36a14ee608ba4a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.455941:0:25585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a632000/0xfb36a14ee608ba4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.455947:0:25585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a632000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066793.455950:0:25585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a632000/0xfb36a14ee608ba4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.455956:0:25585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a632000/0xfb36a14ee608ba4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.455972:0:25585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a632000/0xfb36a14ee608ba4a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.455977:0:25585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a632000/0xfb36a14ee608ba4a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.456527:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976976384:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 29564us (30960us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066793.456538:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6633 00010000:00010000:1.0:1746066793.460409:0:1993:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ba3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.460425:0:1993:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ba3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.460433:0:1993:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ba3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.460444:0:1993:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4a1fa00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066793.460448:0:1993:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ba3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.460454:0:1993:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ba3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.460472:0:1993:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ba3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.460478:0:1993:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ba3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.460557:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882976976000:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 34503us (35043us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066793.460570:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6631 00010000:00010000:3.0:1746066793.464138:0:21551:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608ba66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.464155:0:21551:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608ba66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.464163:0:21551:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608ba66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.464171:0:21551:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a632200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066793.464175:0:21551:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608ba66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.464183:0:21551:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608ba66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.464200:0:21551:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608ba66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.464206:0:21551:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608ba66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.464280:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976977536:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 28416us (30419us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066793.464289:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6637 00010000:00010000:1.0:1746066793.464853:0:8456:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ba43 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.464861:0:8456:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ba43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.464866:0:8456:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ba43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.464870:0:8456:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e881000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066793.464873:0:8456:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ba43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.464878:0:8456:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ba43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.464886:0:8456:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ba43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.464890:0:8456:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ba43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.464927:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976976512:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 38055us (39389us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066793.464933:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6632 00010000:00010000:1.0:1746066793.467990:0:8457:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099a08400/0xfb36a14ee608ba5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.468007:0:8457:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099a08400/0xfb36a14ee608ba5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.468014:0:8457:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099a08400/0xfb36a14ee608ba5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.468020:0:8457:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099a08400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066793.468024:0:8457:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a08400/0xfb36a14ee608ba5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.468030:0:8457:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a08400/0xfb36a14ee608ba5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.468049:0:8457:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099a08400/0xfb36a14ee608ba5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.468054:0:8457:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a08400/0xfb36a14ee608ba5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.469070:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976977280:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 35094us (35275us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066793.469082:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6636 00000100:00100000:0.0:1746066793.475067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.475633:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976977792 00000100:00100000:3.0:1746066793.475640:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976977792 00000100:00100000:3.0:1746066793.475709:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10000 00000100:00100000:3.0:1746066793.475716:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31654:x1830882976977792:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:3.0:1746066793.475755:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.475774:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a633a00/0xfb36a14ee608ba04 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e83a expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.475796:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066793.475799:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066793.475826:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608ba6d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.475833:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608ba6d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.475839:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608ba6d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00010000:3.0:1746066793.475953:0:14549:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093211f80 reply state ffff8800a67c5000 transno 8589944062 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608ba6d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746066793.475960:0:14549:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746066793.476023:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31654:x1830882976977792:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 307us (961us total) trans 8589944062 rc 0/0 00000100:00100000:3.0:1746066793.476031:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10000 00010000:00010000:2.0:1746066793.476817:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608ba6d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.476829:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608ba6d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.476834:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608ba6d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.476838:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eccaa00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066793.476842:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608ba6d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.476847:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608ba6d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.476855:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066793.476858:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066793.476861:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608ba6d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.476941:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608ba6d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066793.477134:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.477247:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976977920 00000100:00100000:3.0:1746066793.477251:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976977920 00000100:00100000:3.0:1746066793.477282:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14645 00000100:00100000:3.0:1746066793.477287:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31654:x1830882976977920:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066793.477297:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.477307:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0800/0xfb36a14ee608ba74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e86b expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.477324:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa28000/0xfb36a14ee608ba12 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e841 expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.477330:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.477332:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.477335:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0800/0xfb36a14ee608ba74 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e86b expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.477361:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa28000/0xfb36a14ee608ba12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e841 expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.477371:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa28000/0xfb36a14ee608ba12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e841 expref: 9 pid: 21203 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746066793.477382:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976860672:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.477449:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.480390:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976860672:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.480419:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0800/0xfb36a14ee608ba74 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e86b expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.480432:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af0800, rc 0) 00000100:00100000:3.0:1746066793.480464:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31654:x1830882976977920:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 3175us (3330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.480471:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14645 00000100:00100000:0.0:1746066793.480831:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.481171:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976978048 00000100:00100000:2.0:1746066793.481177:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976978048 00010000:00010000:2.0:1746066793.481199:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa28000/0xfb36a14ee608ba12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e841 expref: 9 pid: 21203 timeout: 854 lvb_type: 1 00000100:00100000:2.0:1746066793.481229:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7516 00000100:00100000:2.0:1746066793.481234:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976978048:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066793.481245:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066793.481262:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa28000/0xfb36a14ee608ba12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e841 expref: 9 pid: 21203 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746066793.481270:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa28000/0xfb36a14ee608ba12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e841 expref: 9 pid: 21203 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746066793.481288:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa28000/0xfb36a14ee608ba12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e841 expref: 9 pid: 21203 timeout: 854 lvb_type: 1 00010000:00010000:2.0:1746066793.481297:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.481299:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.481304:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0800/0xfb36a14ee608ba74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e86b expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.481310:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0800/0xfb36a14ee608ba74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e86b expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.481332:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0800/0xfb36a14ee608ba74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e86b expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.481341:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976860800:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066793.481405:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.482822:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976860800:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066793.482836:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066793.482891:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976978048:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1655us (2059us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066793.482898:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7516 00000100:00100000:2.0:1746066793.482935:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.483109:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976978176 00000100:00100000:3.0:1746066793.483113:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976978176 00000100:00100000:3.0:1746066793.483148:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14646 00000100:00100000:3.0:1746066793.483154:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31654:x1830882976978176:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066793.483167:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.483178:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608ba7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e872 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.483196:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa28400/0xfb36a14ee608ba20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e848 expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.483203:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.483205:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.483208:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608ba7b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e872 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.483227:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa28400/0xfb36a14ee608ba20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e848 expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.483237:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa28400/0xfb36a14ee608ba20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e848 expref: 9 pid: 21203 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746066793.483246:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976860928:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.483297:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.484489:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.484557:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976978304 00000100:00100000:1.0:1746066793.484561:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976978304 00010000:00010000:1.0:1746066793.484577:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa28400/0xfb36a14ee608ba20 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e848 expref: 10 pid: 21203 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746066793.484620:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7517 00000100:00100000:1.0:1746066793.484626:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976978304:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.484634:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.484649:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa28400/0xfb36a14ee608ba20 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e848 expref: 10 pid: 21203 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.484658:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa28400/0xfb36a14ee608ba20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e848 expref: 10 pid: 21203 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.484700:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.484702:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.484707:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608ba7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e872 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.484714:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608ba7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e872 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.484738:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608ba7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e872 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.484746:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f619f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976861056:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.484756:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa28400/0xfb36a14ee608ba20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e848 expref: 10 pid: 21203 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746066793.484769:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976860928:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.484784:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608ba7b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e872 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.484791:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fd3d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746066793.484792:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af0e00, rc 0) 00000100:00100000:3.0:1746066793.484808:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31654:x1830882976978176:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1654us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.484813:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14646 00000100:00100000:1.0:1746066793.487193:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f619f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976861056:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066793.487210:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066793.487238:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976978304:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2611us (2751us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.487247:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7517 00000100:00100000:0.0:1746066793.487530:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.487717:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976978432 00000100:00100000:3.0:1746066793.487723:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976978432 00000100:00100000:3.0:1746066793.487751:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14647 00000100:00100000:3.0:1746066793.487756:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31654:x1830882976978432:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066793.487768:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.487778:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608ba82 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e879 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.487797:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608ba0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e84f expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.487803:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.487804:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.487807:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608ba82 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e879 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.487828:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608ba0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e84f expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.487837:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608ba0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e84f expref: 9 pid: 8451 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746066793.487846:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976861184:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.488875:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.490366:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.490514:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976978560 00000100:00100000:3.0:1746066793.490516:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976861184:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.490521:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976978560 00010000:00010000:3.0:1746066793.490536:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608ba82 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e879 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.490542:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608ba0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e84f expref: 10 pid: 8451 timeout: 854 lvb_type: 1 00010000:00010000:3.0:1746066793.490552:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af1000, rc 0) 00000100:00100000:1.0:1746066793.490573:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7518 00000100:00100000:1.0:1746066793.490580:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5218c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976978560:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066793.490584:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31654:x1830882976978432:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2827us (3054us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066793.490589:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066793.490590:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14647 00010000:00010000:1.0:1746066793.490615:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608ba0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e84f expref: 9 pid: 8451 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.490624:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608ba0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e84f expref: 9 pid: 8451 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.490641:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608ba0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e84f expref: 9 pid: 8451 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.490654:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.490656:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.490661:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608ba82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e879 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.490668:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608ba82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e879 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.490712:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608ba82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e879 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.490720:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f619f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976861312:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066793.490775:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fd3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.493100:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.493115:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f619f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976861312:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066793.493128:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.493305:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976978688 00000100:00100000:3.0:1746066793.493310:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976978688 00000100:00100000:3.0:1746066793.493338:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14648 00000100:00100000:3.0:1746066793.493344:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31654:x1830882976978688:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066793.493355:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.493366:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0a00/0xfb36a14ee608ba89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e880 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.493387:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608ba27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e856 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.493393:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.493395:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.493398:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0a00/0xfb36a14ee608ba89 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e880 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.493415:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608ba27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e856 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.493423:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608ba27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e856 expref: 9 pid: 8451 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746066793.493436:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976861440:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.493486:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5218c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976978560:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2906us (3124us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.493493:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7518 00000100:00100000:3.0:1746066793.493727:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.495909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.496000:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976861440:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.496020:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0a00/0xfb36a14ee608ba89 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e880 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.496035:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af0a00, rc 0) 00000100:00100000:1.0:1746066793.496059:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976978816 00000100:00100000:1.0:1746066793.496063:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976978816 00010000:00010000:1.0:1746066793.496088:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608ba27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e856 expref: 10 pid: 8451 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746066793.496176:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31654:x1830882976978688:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2772us (3021us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.496183:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14648 00000100:00100000:1.0:1746066793.496482:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7519 00000100:00100000:1.0:1746066793.496489:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976978816:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.496499:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.496518:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608ba27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e856 expref: 9 pid: 8451 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.496527:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608ba27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e856 expref: 9 pid: 8451 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.496549:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608ba27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e856 expref: 9 pid: 8451 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.496573:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.496574:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.496580:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0a00/0xfb36a14ee608ba89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e880 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.496587:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0a00/0xfb36a14ee608ba89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e880 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.496620:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0a00/0xfb36a14ee608ba89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e880 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.496629:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976861568:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066793.496711:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fd3000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.500899:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976861568:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066793.500918:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066793.501233:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976978816:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4742us (5327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.501242:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7519 00000100:00100000:0.0:1746066793.502192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.502282:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976978944 00000100:00100000:3.0:1746066793.502289:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976978944 00000100:00100000:3.0:1746066793.502328:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14649 00000100:00100000:3.0:1746066793.502339:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31654:x1830882976978944:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066793.502354:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.502369:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1200/0xfb36a14ee608ba90 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e887 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.502392:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ba19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e85d expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.502400:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.502401:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.502404:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1200/0xfb36a14ee608ba90 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e887 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.502438:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ba19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e85d expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.502448:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ba19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e85d expref: 9 pid: 8451 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746066793.502458:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976861696:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.502514:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.503549:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976861696:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.503567:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1200/0xfb36a14ee608ba90 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e887 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.503577:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af1200, rc 0) 00000100:00100000:3.0:1746066793.503658:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31654:x1830882976978944:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1318us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.503664:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14649 00000100:00100000:0.0:1746066793.504071:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.504136:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976979072 00000100:00100000:1.0:1746066793.504140:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976979072 00010000:00010000:1.0:1746066793.504156:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ba19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e85d expref: 9 pid: 8451 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746066793.504232:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7520 00000100:00100000:1.0:1746066793.504238:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976979072:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.504247:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.504263:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ba19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e85d expref: 9 pid: 8451 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.504271:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ba19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e85d expref: 9 pid: 8451 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.504288:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608ba19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e85d expref: 9 pid: 8451 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.504307:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.504308:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.504313:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1200/0xfb36a14ee608ba90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e887 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.504320:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1200/0xfb36a14ee608ba90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e887 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.504339:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1200/0xfb36a14ee608ba90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e887 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.504348:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976861824:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066793.504551:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fd3000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.506060:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976861824:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066793.506061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066793.506074:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066793.506098:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976979072:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1860us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.506106:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7520 00000100:00100000:3.0:1746066793.506209:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976979200 00000100:00100000:3.0:1746066793.506213:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976979200 00000100:00100000:3.0:1746066793.506248:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14650 00000100:00100000:3.0:1746066793.506254:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31654:x1830882976979200:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066793.506266:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.506278:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608ba97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e88e expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.506302:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa29400/0xfb36a14ee608ba2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e864 expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.506308:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.506309:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.506311:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608ba97 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e88e expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.506330:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa29400/0xfb36a14ee608ba2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e864 expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066793.506339:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa29400/0xfb36a14ee608ba2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e864 expref: 9 pid: 21203 timeout: 854 lvb_type: 1 00000100:00100000:3.0:1746066793.506348:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976861952:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.506406:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.508252:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976861952:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.508273:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608ba97 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e88e expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.508284:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af0600, rc 0) 00000100:00100000:3.0:1746066793.508309:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31654:x1830882976979200:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2055us (2253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.508315:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14650 00000100:00100000:0.0:1746066793.509253:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.509537:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976979328 00000100:00100000:1.0:1746066793.509544:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976979328 00010000:00010000:1.0:1746066793.509568:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa29400/0xfb36a14ee608ba2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e864 expref: 9 pid: 21203 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746066793.509609:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7521 00000100:00100000:1.0:1746066793.509616:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976979328:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.509627:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.509644:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa29400/0xfb36a14ee608ba2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e864 expref: 9 pid: 21203 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.509653:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa29400/0xfb36a14ee608ba2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e864 expref: 9 pid: 21203 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.509672:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa29400/0xfb36a14ee608ba2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e864 expref: 9 pid: 21203 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746066793.509721:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.509723:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.509729:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608ba97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e88e expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.509741:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608ba97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e88e expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.509766:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608ba97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e88e expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.509775:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976862080:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066793.509836:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fd3000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.512481:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976862080:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066793.512499:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066793.512542:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976979328:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2926us (3291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.512551:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7521 00000100:00100000:0.0:1746066793.513977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.514017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.514066:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976979456 00000100:00100000:1.0:1746066793.514075:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976979456 00000100:00100000:1.0:1746066793.514115:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976979584 00000100:00100000:1.0:1746066793.514118:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976979584 00000100:00100000:1.0:1746066793.514133:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14651 00000100:00100000:1.0:1746066793.514139:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976979456:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:1.0:1746066793.514296:0:4614:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066793.514299:0:4614:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066793 -> 1746066793 00002000:00010000:1.0:1746066793.514301:0:4614:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:1.0:1746066793.514302:0:4614:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066793 -> 1746066793 00002000:00010000:1.0:1746066793.514304:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2013 -> 2013 00000100:00100000:1.0:1746066793.514340:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976979456:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 200us (368us total) trans 17179873609 rc 0/0 00000100:00100000:1.0:1746066793.514346:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14651 00000100:00100000:1.0:1746066793.514358:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14652 00000100:00100000:0.0:1746066793.514362:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.514363:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882976979584:12345-192.168.202.57@tcp:2:lfs.0 00000100:00100000:0.0:1746066793.514414:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.514428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00010000:1.0:1746066793.514440:0:4614:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066793.514442:0:4614:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066793 -> 1746066793 00002000:00010000:1.0:1746066793.514443:0:4614:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:1.0:1746066793.514445:0:4614:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066793 -> 1746066793 00000100:00100000:0.0:1746066793.514445:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00010000:1.0:1746066793.514447:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746066793.514463:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976979584:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 100us (446us total) trans 21474840930 rc 0/0 00000100:00100000:1.0:1746066793.514468:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14652 00000100:00100000:1.0:1746066793.514476:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976979712 00000100:00100000:1.0:1746066793.514478:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976979712 00000100:00100000:1.0:1746066793.514489:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976979968 00000100:00100000:1.0:1746066793.514491:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976979968 00000100:00100000:1.0:1746066793.514499:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976979840 00000100:00100000:1.0:1746066793.514500:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976979840 00000100:00100000:3.0:1746066793.514531:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976980096 00000100:00100000:3.0:1746066793.514535:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976980096 00000100:00100000:3.0:1746066793.514549:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14653 00000100:00100000:3.0:1746066793.514553:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976979712:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:3.0:1746066793.514642:0:9776:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066793.514644:0:9776:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066791 -> 1746066793 00002000:00010000:3.0:1746066793.514646:0:9776:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066790 -> 1746066792 00002000:00010000:3.0:1746066793.514647:0:9776:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066791 -> 1746066793 00002000:00010000:3.0:1746066793.514649:0:9776:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746066793.514670:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976979712:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 116us (307us total) trans 21474840931 rc 0/0 00000100:00100000:3.0:1746066793.514695:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14653 00000100:00100000:3.0:1746066793.514705:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14654 00000100:00100000:3.0:1746066793.514709:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976979968:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:3.0:1746066793.514770:0:9776:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:3.0:1746066793.514772:0:9776:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066792 -> 1746066793 00002000:00010000:3.0:1746066793.514773:0:9776:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:3.0:1746066793.514775:0:9776:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066792 -> 1746066793 00002000:00010000:3.0:1746066793.514777:0:9776:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5923 -> 5923 00000100:00100000:3.0:1746066793.514793:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976979968:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 84us (379us total) trans 17179873610 rc 0/0 00000100:00100000:3.0:1746066793.514798:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14654 00000100:00100000:3.0:1746066793.514807:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14655 00000100:00100000:3.0:1746066793.514812:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976980096:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:3.0:1746066793.514865:0:9776:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066793.514868:0:9776:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066792 -> 1746066793 00002000:00010000:3.0:1746066793.514869:0:9776:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:3.0:1746066793.514871:0:9776:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066792 -> 1746066793 00002000:00010000:3.0:1746066793.514873:0:9776:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746066793.514887:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976980096:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 75us (440us total) trans 21474840932 rc 0/0 00000100:00100000:3.0:1746066793.514892:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14655 00000100:00100000:1.0:1746066793.515041:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14656 00000100:00100000:1.0:1746066793.515046:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976979840:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:1.0:1746066793.515107:0:4614:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066793.515109:0:4614:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066791 -> 1746066793 00002000:00010000:1.0:1746066793.515111:0:4614:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066790 -> 1746066792 00002000:00010000:1.0:1746066793.515113:0:4614:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066791 -> 1746066793 00002000:00010000:1.0:1746066793.515114:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746066793.515133:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976979840:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 87us (703us total) trans 17179873611 rc 0/0 00000100:00100000:1.0:1746066793.515138:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14656 00000100:00100000:0.0:1746066793.518474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.519242:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976980352 00000100:00100000:3.0:1746066793.519250:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976980352 00000100:00100000:3.0:1746066793.519298:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4174 00000100:00100000:3.0:1746066793.519305:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31654:x1830882976980352:12345-192.168.202.57@tcp:35:lfs.0 00000004:00010000:3.0:1746066793.519354:0:16596:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x318:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be200/0xfb36a14ee608b9b7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e82c expref: 9 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.519392:0:16596:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066793.519403:0:16596:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a632a00/0xfb36a14ee608b9f6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e833 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.519409:0:16596:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 4/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066793.519433:0:16596:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a632a00/0xfb36a14ee608b9f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e833 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.519441:0:16596:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a632a00/0xfb36a14ee608b9f6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e833 expref: 9 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.519457:0:16596:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16596:1830882976862208:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.520295:0:16596:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.522825:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.523003:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976980480 00000100:00100000:1.0:1746066793.523010:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976980480 00010000:00010000:1.0:1746066793.523044:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a632a00/0xfb36a14ee608b9f6 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e833 expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.523293:0:16596:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16596:1830882976862208:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.523317:0:16596:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00000100:00100000:1.0:1746066793.523378:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7522 00000100:00100000:1.0:1746066793.523386:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976980480:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.523402:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.523409:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a632a00/0xfb36a14ee608b9f6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e833 expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.523423:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a632a00/0xfb36a14ee608b9f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e833 expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.523441:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a632a00/0xfb36a14ee608b9f6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e833 expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.523461:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:1.0:1746066793.523465:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00010000:00010000:1.0:1746066793.523472:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16596 initiator: MDT0 00010000:00010000:1.0:1746066793.523482:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16596 initiator: MDT0 00010000:00010000:1.0:1746066793.523502:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066793.523546:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976980480:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 161us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.523552:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7522 00010000:00010000:3.0:1746066793.523645:0:16596:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066793.523651:0:16596:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00000040:00080000:3.0:1746066793.524210:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3107, 88 off262672 00000004:00080000:3.0:1746066793.524216:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754701539993ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.524255:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3122, 88 off263904 00000004:00080000:3.0:1746066793.524258:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754701581963ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066793.524267:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3123, 88 off263992 00000004:00080000:3.0:1746066793.524269:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754701593263ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066793.524275:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3108, 88 off262760 00000004:00080000:3.0:1746066793.524277:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754701601226ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.524282:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3109, 88 off262848 00000004:00080000:3.0:1746066793.524284:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754701608547ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.524290:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3124, 88 off264080 00000004:00080000:3.0:1746066793.524292:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754701615901ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066793.524297:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3125, 88 off264168 00000004:00080000:3.0:1746066793.524298:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754701622421ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066793.524303:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3126, 88 off264256 00000004:00080000:3.0:1746066793.524306:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754701630101ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066793.524311:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3110, 88 off262936 00000004:00080000:3.0:1746066793.524313:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754701637248ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.524318:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3127, 88 off264344 00000004:00080000:3.0:1746066793.524320:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754701644663ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066793.524325:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3111, 88 off263024 00000004:00080000:3.0:1746066793.524327:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754701651178ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.524332:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3128, 88 off264432 00000004:00080000:3.0:1746066793.524334:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754701657673ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066793.524339:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3112, 88 off263112 00000004:00080000:3.0:1746066793.524340:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754701664517ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.524345:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3113, 88 off263200 00000004:00080000:3.0:1746066793.524347:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754701671606ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.524352:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3114, 88 off263288 00000004:00080000:3.0:1746066793.524354:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754701678197ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.524359:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3115, 88 off263376 00000004:00080000:3.0:1746066793.524360:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754701684508ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066793.524365:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3129, 88 off264520 00000004:00080000:3.0:1746066793.524367:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754701690926ns, next at 749511475809ns, rc = 0 00000004:00010000:3.0:1746066793.545094:0:16596:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800942d9f80 reply state ffff88009ee75800 transno 8589944063 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00000001:00080000:1.0:1746066793.545103:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944063 is committed 00000100:00100000:3.0:1746066793.545109:0:16596:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1746066793.545109:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2403 committed 00000004:00080000:1.0:1746066793.545117:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2388 committed 00010000:00010000:3.0:1746066793.545120:0:16596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:3.0:1746066793.545123:0:16596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:1.0:1746066793.545123:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2387 committed 00000004:00080000:1.0:1746066793.545124:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2386 committed 00000004:00080000:1.0:1746066793.545126:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2385 committed 00000004:00080000:1.0:1746066793.545127:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2402 committed 00000004:00080000:1.0:1746066793.545129:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2384 committed 00010000:00010000:3.0:1746066793.545130:0:16596:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85be200/0xfb36a14ee608b9b7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e82c expref: 8 pid: 20127 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746066793.545131:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2401 committed 00000004:00080000:1.0:1746066793.545132:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2383 committed 00000004:00080000:1.0:1746066793.545134:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2400 committed 00000004:00080000:1.0:1746066793.545135:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2399 committed 00000004:00080000:1.0:1746066793.545137:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2398 committed 00000004:00080000:1.0:1746066793.545139:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2382 committed 00000004:00080000:1.0:1746066793.545140:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2381 committed 00000004:00080000:1.0:1746066793.545141:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2397 committed 00000004:00080000:1.0:1746066793.545143:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2396 committed 00000004:00080000:1.0:1746066793.545145:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2380 committed 00010000:00080000:3.0:1746066793.545240:0:16596:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746066793.545247:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976862336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.545250:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31654:x1830882976980352:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 25945us (26782us total) trans 8589944063 rc 0/0 00000100:00100000:3.0:1746066793.545257:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4174 00000100:00100000:3.0:1746066793.545282:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976862720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066793.545287:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066793.545309:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976862848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.545310:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066793.545321:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.545322:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976863232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.545334:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066793.545338:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976862464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066793.545353:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066793.545362:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976862976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066793.545372:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066793.545381:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746066793.545385:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976862592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066793.545397:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066793.545405:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976863104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066793.545419:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066793.545441:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976862336 00000100:00100000:1.0:1746066793.545447:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976862336 00000100:00100000:1.0:1746066793.545472:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976862720 00000100:00100000:1.0:1746066793.545474:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976862720 00000100:00100000:1.0:1746066793.545482:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976862848 00000100:00100000:1.0:1746066793.545483:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976862848 00000100:00100000:1.0:1746066793.545489:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976863232 00000100:00100000:1.0:1746066793.545490:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976863232 00000100:00100000:1.0:1746066793.545495:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976862464 00000100:00100000:1.0:1746066793.545496:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976862464 00000100:00100000:1.0:1746066793.545502:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976862976 00000100:00100000:1.0:1746066793.545503:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976862976 00000100:00100000:1.0:1746066793.545509:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976862592 00000100:00100000:1.0:1746066793.545511:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976862592 00000100:00100000:1.0:1746066793.545516:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976863104 00000100:00100000:1.0:1746066793.545517:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976863104 00000100:00100000:1.0:1746066793.545524:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14657 00000100:00100000:1.0:1746066793.545528:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3296:x1830882976862336:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746066793.545763:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066793.545771:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066793.545777:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066793.545781:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4af1600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066793.545785:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066793.545791:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066793.545803:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff8800a4c34c00) 00010000:00010000:2.0:1746066793.545806:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066793.545808:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066793.545813:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608ba9e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16596 initiator: MDT0 00000100:00100000:2.0:1746066793.545837:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14658 00000100:00100000:2.0:1746066793.545843:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3295:x1830882976862720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.545954:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3295:x1830882976862720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (643us total) trans 17179873612 rc 0/0 00000100:00100000:2.0:1746066793.545959:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14658 00000100:00100000:2.0:1746066793.545970:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14659 00000100:00100000:2.0:1746066793.545974:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3296:x1830882976862848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.546032:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14660 00000100:00100000:3.0:1746066793.546039:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3295:x1830882976863232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.546053:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3296:x1830882976862848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (729us total) trans 17179873613 rc 0/0 00000100:00100000:2.0:1746066793.546057:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14659 00000100:00100000:2.0:1746066793.546067:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14661 00000100:00100000:2.0:1746066793.546071:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882976862464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.546128:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3295:x1830882976863232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (792us total) trans 17179873614 rc 0/0 00000100:00100000:3.0:1746066793.546134:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14660 00002000:00010000:2.0:1746066793.546136:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066793.546139:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066793 -> 1746066793 00002000:00010000:2.0:1746066793.546140:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:2.0:1746066793.546142:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066793 -> 1746066793 00000100:00100000:3.0:1746066793.546143:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14662 00002000:00010000:2.0:1746066793.546143:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746066793.546148:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3293:x1830882976862976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.546158:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3293:x1830882976862464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (804us total) trans 17179873615 rc 0/0 00000100:00100000:2.0:1746066793.546162:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14661 00000100:00100000:2.0:1746066793.546171:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14663 00000100:00100000:2.0:1746066793.546175:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882976862592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066793.546231:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:2.0:1746066793.546233:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066793 -> 1746066793 00002000:00010000:2.0:1746066793.546235:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:2.0:1746066793.546237:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066793 -> 1746066793 00002000:00010000:2.0:1746066793.546238:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5923 -> 5923 00000100:00100000:2.0:1746066793.546253:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3293:x1830882976862592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (856us total) trans 17179873616 rc 0/0 00000100:00100000:2.0:1746066793.546257:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14663 00000100:00100000:2.0:1746066793.546265:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14664 00000100:00100000:2.0:1746066793.546269:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882976863104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066793.546323:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746066793.546325:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746066793.546326:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066793.546327:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746066793.546330:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746066793.546346:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3293:x1830882976863104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (925us total) trans 17179873617 rc 0/0 00000100:00100000:2.0:1746066793.546351:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14664 00000100:00100000:3.0:1746066793.546388:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3293:x1830882976862976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 240us (1014us total) trans 17179873618 rc 0/0 00000100:00100000:3.0:1746066793.546394:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14662 00000100:00100000:3.0:1746066793.546422:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976863744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.546442:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.546455:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976864256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066793.546463:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976863360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.546466:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066793.546486:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746066793.546487:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c0fca80/2, rc 0, transno 17179873612 00000100:00100000:3.0:1746066793.546496:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976862720:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066793.546502:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ec2d500/2, rc 0, transno 17179873614 00000100:00100000:0.0:1746066793.546503:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976863872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.546505:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976863232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066793.546516:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.546523:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976863744 00000100:00100000:3.0:1746066793.546526:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976863744 00000004:00080000:0.0:1746066793.546530:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c0fed80/2, rc 0, transno 17179873613 00000100:00100000:0.0:1746066793.546533:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976862848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.546541:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976864256 00000100:00100000:3.0:1746066793.546542:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976864256 00000100:00100000:3.0:1746066793.546549:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976863360 00000100:00100000:3.0:1746066793.546551:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976863360 00000100:00100000:3.0:1746066793.546556:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976863872 00000100:00100000:3.0:1746066793.546557:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976863872 00000100:00100000:3.0:1746066793.546564:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14665 00000100:00100000:3.0:1746066793.546567:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3295:x1830882976863744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.546703:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3295:x1830882976863744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (259us total) trans 21474840933 rc 0/0 00000100:00100000:3.0:1746066793.546708:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14665 00000100:00100000:3.0:1746066793.546717:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14666 00000100:00100000:3.0:1746066793.546721:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3295:x1830882976864256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066793.546725:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976863616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066793.546745:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066793.546754:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976864128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066793.546765:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066793.546772:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746066793.546776:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976863488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.546789:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3295:x1830882976864256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (321us total) trans 21474840934 rc 0/0 00000100:00100000:0.0:1746066793.546790:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.546794:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14666 00000100:00100000:0.0:1746066793.546797:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976864000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.546801:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976863616 00000100:00100000:3.0:1746066793.546803:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976863616 00000100:00100000:0.0:1746066793.546808:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.546810:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14667 00000100:00100000:3.0:1746066793.546813:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3296:x1830882976863360:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066793.546827:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f618a80/2, rc 0, transno 17179873616 00000100:00100000:0.0:1746066793.546830:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976862592:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066793.546836:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed70e00/2, rc 0, transno 17179873617 00000100:00100000:0.0:1746066793.546839:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976863104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066793.546844:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f619f80/2, rc 0, transno 17179873615 00000100:00100000:0.0:1746066793.546847:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976862464:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066793.546852:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c0ffb80/2, rc 0, transno 17179873618 00000100:00100000:0.0:1746066793.546854:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976862976:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066793.546872:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066793.546874:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066793 -> 1746066793 00002000:00010000:3.0:1746066793.546877:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:3.0:1746066793.546879:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066793 -> 1746066793 00002000:00010000:3.0:1746066793.546881:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746066793.546899:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3296:x1830882976863360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (411us total) trans 21474840935 rc 0/0 00000100:00100000:3.0:1746066793.546903:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14667 00000100:00100000:3.0:1746066793.546910:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976864128 00000100:00100000:3.0:1746066793.546912:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976864128 00000100:00100000:3.0:1746066793.546918:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976863488 00000100:00100000:3.0:1746066793.546919:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976863488 00000004:00080000:0.0:1746066793.546923:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009244dc00/2, rc 0, transno 21474840935 00000100:00100000:3.0:1746066793.546924:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976864000 00000100:00100000:3.0:1746066793.546925:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976864000 00000100:00100000:0.0:1746066793.546927:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976863360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.546931:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14668 00000100:00100000:3.0:1746066793.546934:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3296:x1830882976863872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.547010:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3296:x1830882976863872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (493us total) trans 21474840936 rc 0/0 00000100:00100000:3.0:1746066793.547014:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14668 00000100:00100000:3.0:1746066793.547022:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14669 00000100:00100000:3.0:1746066793.547026:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3294:x1830882976863616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066793.547080:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066793.547082:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066793 -> 1746066793 00002000:00010000:3.0:1746066793.547084:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:3.0:1746066793.547086:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066793 -> 1746066793 00002000:00010000:3.0:1746066793.547087:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00002000:00010000:1.0:1746066793.547102:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:3.0:1746066793.547103:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3294:x1830882976863616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (358us total) trans 21474840937 rc 0/0 00002000:00010000:1.0:1746066793.547104:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066793 -> 1746066793 00002000:00010000:1.0:1746066793.547106:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00000100:00100000:3.0:1746066793.547108:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14669 00002000:00010000:1.0:1746066793.547108:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066793 -> 1746066793 00002000:00010000:1.0:1746066793.547110:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2013 -> 2013 00000100:00100000:3.0:1746066793.547116:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14670 00000100:00100000:3.0:1746066793.547119:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3294:x1830882976864128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066793.547133:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3296:x1830882976862336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1603us (1844us total) trans 17179873619 rc 0/0 00000100:00100000:1.0:1746066793.547138:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14657 00000100:00100000:3.0:1746066793.547179:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3294:x1830882976864128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (412us total) trans 21474840938 rc 0/0 00000100:00100000:3.0:1746066793.547183:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14670 00000100:00100000:3.0:1746066793.547191:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14671 00000100:00100000:3.0:1746066793.547195:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3294:x1830882976863488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066793.547238:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14672 00000100:00100000:1.0:1746066793.547244:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3294:x1830882976864000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066793.547247:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066793.547250:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066793 -> 1746066793 00002000:00010000:3.0:1746066793.547251:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:3.0:1746066793.547253:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066793 -> 1746066793 00002000:00010000:3.0:1746066793.547255:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746066793.547271:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3294:x1830882976863488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (480us total) trans 21474840939 rc 0/0 00000100:00100000:3.0:1746066793.547276:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14671 00000004:00080000:3.0:1746066793.547312:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef59880/2, rc 0, transno 21474840933 00000100:00100000:3.0:1746066793.547316:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976863744:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066793.547322:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef58700/2, rc 0, transno 21474840934 00000100:00100000:3.0:1746066793.547324:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976864256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.547329:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746066793.547333:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976864384:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.547347:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.547362:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976864384 00000100:00100000:3.0:1746066793.547364:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976864384 00000100:00100000:3.0:1746066793.547374:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14673 00000100:00100000:3.0:1746066793.547378:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3295:x1830882976864384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.547447:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3295:x1830882976864384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (98us total) trans 17179873620 rc 0/0 00000100:00100000:3.0:1746066793.547451:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14673 00000100:00100000:1.0:1746066793.547459:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3294:x1830882976864000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 215us (649us total) trans 21474840940 rc 0/0 00000100:00100000:1.0:1746066793.547464:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14672 00000004:00080000:3.0:1746066793.547468:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed08e00/2, rc 0, transno 17179873620 00000100:00100000:3.0:1746066793.547471:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976864384:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066793.548106:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009244e680/2, rc 0, transno 21474840939 00000100:00100000:1.0:1746066793.548111:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976863488:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066793.548118:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef5bb80/2, rc 0, transno 21474840940 00000100:00100000:1.0:1746066793.548121:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976864000:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066793.548126:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef58e00/2, rc 0, transno 21474840937 00000100:00100000:1.0:1746066793.548129:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976863616:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066793.548134:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef5aa00/2, rc 0, transno 21474840938 00000100:00100000:1.0:1746066793.548137:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976864128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066793.548234:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef5ad80/2, rc 0, transno 21474840936 00000100:00100000:0.0:1746066793.548237:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976863872:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066793.548245:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f61b800/2, rc 0, transno 17179873619 00000100:00100000:0.0:1746066793.548248:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976862336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066793.548501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.548541:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976980608 00000100:00100000:3.0:1746066793.548545:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976980608 00000100:00100000:3.0:1746066793.548580:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10001 00000100:00100000:3.0:1746066793.548586:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:31654:x1830882976980608:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066793.548614:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.548630:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0000/0xfb36a14ee608baa5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e895 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.548671:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0000/0xfb36a14ee608baa5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e895 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.548698:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0000/0xfb36a14ee608baa5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e895 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.548713:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066793.548715:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066793.548718:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af0000, rc 0) 00000100:00100000:3.0:1746066793.548745:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31654:x1830882976980608:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 160us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.548751:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10001 00000100:00100000:0.0:1746066793.551142:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.551209:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976980864 00000100:00100000:3.0:1746066793.551217:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976980864 00000100:00100000:3.0:1746066793.551609:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4175 00000100:00100000:3.0:1746066793.551618:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31654:x1830882976980864:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:3.0:1746066793.551966:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31654:x1830882976980864:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 349us (828us total) trans 8589944064 rc 0/0 00000100:00100000:3.0:1746066793.551973:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4175 00000100:00100000:0.0:1746066793.579363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.579503:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976981120 00000100:00100000:3.0:1746066793.579511:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976981120 00000100:00100000:3.0:1746066793.579562:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10002 00000100:00100000:3.0:1746066793.580007:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+6:31666:x1830882976981120:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066793.580031:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.580048:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca800/0xfb36a14ee608baac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e89c expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.580137:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608bab3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.580148:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608bab3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.580157:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608bab3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.580982:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608baba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.580989:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608baba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.580995:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608baba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581145:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00400/0xfb36a14ee608bac1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581151:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00400/0xfb36a14ee608bac1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581157:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00400/0xfb36a14ee608bac1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066793.581165:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066793.581230:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608bab3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581236:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608bab3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581242:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608bab3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581246:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4af1600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066793.581249:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608bab3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581254:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608bab3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581263:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066793.581265:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066793.581268:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608bab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581273:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608bab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581298:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608baba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581302:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608baba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581307:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608baba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581311:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4af1e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066793.581313:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608baba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581317:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608baba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581323:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebebe00) 00010000:00010000:3.0:1746066793.581325:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066793.581327:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608baba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581331:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af1e00/0xfb36a14ee608baba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.581364:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca800/0xfb36a14ee608baac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e89c expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.581374:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00400/0xfb36a14ee608bac1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e89c expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.581380:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066793.581382:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066793.581384:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec00400, rc 0) 00000100:00100000:3.0:1746066793.584521:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+8:31666:x1830882976981120:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4943us (5155us total) trans 8589944065 rc 0/0 00000100:00100000:3.0:1746066793.584532:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10002 00000100:00100000:0.0:1746066793.585818:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.585995:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976981376 00000100:00100000:3.0:1746066793.586002:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976981376 00000100:00100000:3.0:1746066793.586032:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10003 00000100:00100000:3.0:1746066793.586038:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+250:31665:x1830882976981376:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066793.586057:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.586073:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00000/0xfb36a14ee608bacf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e8a3 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.586156:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01c00/0xfb36a14ee608bad6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586166:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01c00/0xfb36a14ee608bad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586175:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01c00/0xfb36a14ee608bad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586184:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01200/0xfb36a14ee608badd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586188:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01200/0xfb36a14ee608badd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586193:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01200/0xfb36a14ee608badd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586268:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608bae4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586274:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608bae4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586279:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608bae4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066793.586285:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066793.586353:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01c00/0xfb36a14ee608bad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586359:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01c00/0xfb36a14ee608bad6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586364:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01c00/0xfb36a14ee608bad6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586369:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec01c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066793.586372:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01c00/0xfb36a14ee608bad6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586377:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01c00/0xfb36a14ee608bad6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586386:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066793.586389:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066793.586392:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01c00/0xfb36a14ee608bad6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586396:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01c00/0xfb36a14ee608bad6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586418:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01200/0xfb36a14ee608badd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586427:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01200/0xfb36a14ee608badd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586431:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01200/0xfb36a14ee608badd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586435:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec01200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066793.586437:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01200/0xfb36a14ee608badd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586441:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01200/0xfb36a14ee608badd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586447:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebeb100) 00010000:00010000:3.0:1746066793.586449:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066793.586451:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01200/0xfb36a14ee608badd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586455:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec01200/0xfb36a14ee608badd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.586484:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00000/0xfb36a14ee608bacf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8a3 expref: 253 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.586493:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608bae4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8a3 expref: 252 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.586498:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066793.586500:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066793.586502:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec00c00, rc 0) 00000100:00100000:3.0:1746066793.586547:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31665:x1830882976981376:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 509us (733us total) trans 8589944066 rc 0/0 00000100:00100000:3.0:1746066793.586553:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10003 00000100:00100000:0.0:1746066793.592179:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.592235:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976981504 00000100:00100000:2.0:1746066793.592244:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976981504 00000100:00100000:2.0:1746066793.592292:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14674 00000100:00100000:2.0:1746066793.592299:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+10:31666:x1830882976981504:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066793.592313:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.592327:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f161600/0xfb36a14ee608baf2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e8aa expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.592349:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0800/0xfb36a14ee608ba74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e86b expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.592355:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.592356:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.592359:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f161600/0xfb36a14ee608baf2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8aa expref: 11 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.592384:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0800/0xfb36a14ee608ba74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e86b expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.592393:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0800/0xfb36a14ee608ba74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e86b expref: 10 pid: 8450 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.592403:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976864512:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.592488:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540df00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.595429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.595472:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.596465:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976981760 00000100:00100000:2.0:1746066793.596465:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976982016 00000100:00100000:3.0:1746066793.596473:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976981760 00000100:00100000:2.0:1746066793.596473:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976982016 00000100:00100000:3.0:1746066793.596579:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10004 00000100:00100000:2.0:1746066793.596585:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10005 00000100:00100000:2.0:1746066793.596592:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31667:x1830882976982016:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066793.596594:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+8:31663:x1830882976981760:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066793.596617:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.596617:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.596630:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00a00/0xfb36a14ee608bb00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e8b1 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.596630:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb6ee00/0xfb36a14ee608baf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e8b8 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.596711:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.596711:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608bb07 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.596722:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00400/0xfb36a14ee608bac1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e89c expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.596728:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608bae4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8a3 expref: 253 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.597007:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 5/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.597555:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608bb07 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.597566:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608bb07 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:2.0:1746066793.597576:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066793.597691:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb6ee00/0xfb36a14ee608baf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b8 expref: 255 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.597985:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608bae4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8a3 expref: 254 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.597996:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608bae4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8a3 expref: 254 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.598007:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976864640:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.598083:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00400/0xfb36a14ee608bac1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e89c expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.598091:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00400/0xfb36a14ee608bac1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e89c expref: 9 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.598097:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976864768:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.598115:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066793.600751:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608bb07 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b8 expref: 254 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.600762:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066793.600765:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746066793.600768:0:20127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.600773:0:20127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.600782:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb6f200, rc 0) 00000100:00100000:2.0:1746066793.600840:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:31667:x1830882976982016:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4247us (5365us total) trans 8589944067 rc 0/0 00000100:00100000:2.0:1746066793.600847:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10005 00000100:00100000:2.0:1746066793.600899:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976864512:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.600920:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f161600/0xfb36a14ee608baf2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8aa expref: 11 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.600931:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f161600, rc 0) 00000100:00100000:2.0:1746066793.600950:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+11:31666:x1830882976981504:12345-192.168.202.57@tcp:101:cat.0 Request processed in 8652us (8779us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066793.601494:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.601662:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976982144 00000100:00100000:3.0:1746066793.601668:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976982144 00000100:00100000:2.0:1746066793.601671:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14674 00010000:00010000:3.0:1746066793.601709:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0800/0xfb36a14ee608ba74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e86b expref: 11 pid: 8450 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.601740:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7523 00000100:00100000:3.0:1746066793.601747:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882976982144:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.601759:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.601778:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0800/0xfb36a14ee608ba74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e86b expref: 11 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.601788:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0800/0xfb36a14ee608ba74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e86b expref: 11 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.601912:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0800/0xfb36a14ee608ba74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e86b expref: 11 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.601928:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.601930:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.601936:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f161600/0xfb36a14ee608baf2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8aa expref: 10 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.601943:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f161600/0xfb36a14ee608baf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8aa expref: 10 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.601967:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f161600/0xfb36a14ee608baf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8aa expref: 10 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.601977:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976864896:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066793.602014:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.605173:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.605205:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976864640:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066793.605205:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.605217:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976864768:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.605238:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746066793.606088:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976982272 00000100:00100000:1.0:1746066793.606095:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976982272 00010000:00010000:1.0:1746066793.606122:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608bae4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8a3 expref: 254 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.606898:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976982400 00000100:00100000:1.0:1746066793.606903:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976982400 00000100:00100000:2.0:1746066793.606907:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7524 00010000:00010000:1.0:1746066793.606915:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00400/0xfb36a14ee608bac1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e89c expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.606916:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:1963:x1830882976982272:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066793.606927:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066793.606931:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7525 00010000:00010000:2.0:1746066793.606932:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608bae4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8a3 expref: 254 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.606936:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5218850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+10:1963:x1830882976982400:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066793.606941:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608bae4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8a3 expref: 254 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.606942:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.606945:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00400/0xfb36a14ee608bac1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e89c expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.606957:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00c00/0xfb36a14ee608bae4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8a3 expref: 254 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.607128:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00400/0xfb36a14ee608bac1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e89c expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:2.0:1746066793.607149:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066793.607154:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.607160:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.607165:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066793.607205:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:1963:x1830882976982272:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 289us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.607211:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7524 00000100:00100000:3.0:1746066793.607269:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976864896:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.607282:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.607312:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976982144:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5565us (5819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.607318:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7523 00010000:00010000:1.0:1746066793.607592:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00400/0xfb36a14ee608bac1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e89c expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.607619:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066793.607622:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066793.607628:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066793.607633:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066793.607646:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066793.607668:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5218850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:1963:x1830882976982400:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 732us (2463us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.607673:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7525 00000100:00100000:0.0:1746066793.607702:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.607753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066793.607762:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066793.607768:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066793.607783:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000100:00100000:2.0:1746066793.607846:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976982528 00000100:00100000:2.0:1746066793.607849:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976982528 00000100:00100000:2.0:1746066793.607872:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976982656 00000100:00100000:2.0:1746066793.607874:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976982656 00000100:00100000:3.0:1746066793.607880:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10006 00000100:00100000:3.0:1746066793.607887:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:31666:x1830882976982528:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:2.0:1746066793.607891:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10007 00000100:00100000:2.0:1746066793.607896:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31667:x1830882976982656:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066793.607899:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.607905:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.607907:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00000/0xfb36a14ee608bb23 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e8bf expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.607911:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f160400/0xfb36a14ee608bb2a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e8c6 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.607934:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00000/0xfb36a14ee608bb23 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8bf expref: 11 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.607942:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00000/0xfb36a14ee608bb23 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8bf expref: 11 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.607953:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066793.607953:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.607955:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066793.607957:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec00000, rc 0) 00010000:00010000:2.0:1746066793.607959:0:20127:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 2/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066793.607964:0:20127:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.607973:0:20127:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746066793.607975:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+11:31666:x1830882976982528:12345-192.168.202.57@tcp:101:cat.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.607979:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10006 00010000:00010000:2.0:1746066793.607983:0:20127:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.608005:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00a00/0xfb36a14ee608bb00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b1 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.608016:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b1 expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.608022:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b1 expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.608026:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec00800, rc 0) 00000100:00100000:3.0:1746066793.608050:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:31663:x1830882976981760:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 11465us (12627us total) trans 8589944068 rc 0/0 00000100:00100000:3.0:1746066793.608054:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10004 00000100:00100000:0.0:1746066793.613736:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.613860:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976982784 00000100:00100000:1.0:1746066793.613869:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976982784 00010000:00010000:1.0:1746066793.613902:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b1 expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.613958:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7526 00000100:00100000:1.0:1746066793.613968:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882976982784:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066793.613984:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066793.613990:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b1 expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.614001:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b1 expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.614021:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00800/0xfb36a14ee608bb0e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b1 expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746066793.614035:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066793.614040:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066793.614048:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066793.614054:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066793.614096:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066793.614136:0:20127:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.614145:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000100:00100000:1.0:1746066793.614164:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:1964:x1830882976982784:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 195us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.614174:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7526 00000004:00200000:2.0:1746066793.614178:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:2.0:1746066793.614181:0:20127:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746066793.614193:0:20127:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.614221:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f160400/0xfb36a14ee608bb2a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8c6 expref: 255 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.614232:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8c6 expref: 254 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.614238:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066793.614240:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066793.614242:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b0c00, rc 0) 00000100:00100000:2.0:1746066793.614278:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:31667:x1830882976982656:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6381us (6523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.614284:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10007 00000100:00100000:0.0:1746066793.616770:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.617806:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976983040 00000100:00100000:1.0:1746066793.617817:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976983040 00002000:00100000:1.0:1746066793.617862:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff880135e5ed80 x1830882976983040/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.617872:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ed80 with x1830882976983040 ext(0->1048575) 00002000:00010000:1.0:1746066793.617877:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5ed80 00000100:00100000:1.0:1746066793.620824:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6638 00000100:00100000:1.0:1746066793.620842:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882976983040:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066793.622803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.624873:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976983168 00000100:00100000:2.0:1746066793.624883:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976983168 00000100:00100000:2.0:1746066793.624933:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14675 00000100:00100000:2.0:1746066793.624940:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:31667:x1830882976983168:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066793.624958:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.624973:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef93600/0xfb36a14ee608bb38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e8cd expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.624993:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.624995:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.625002:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef93600/0xfb36a14ee608bb38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8cd expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.625014:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef93600/0xfb36a14ee608bb38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8cd expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.625024:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef93600, rc 0) 00000100:00100000:2.0:1746066793.625061:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31667:x1830882976983168:12345-192.168.202.57@tcp:101:cat.0 Request processed in 121us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.625066:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14675 00000100:00100000:1.0:1746066793.635285:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882976983040:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14443us (18512us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066793.635296:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6638 00002000:00100000:1.0:1746066793.635307:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff880135e5ed80 x1830882976983040/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.635315:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ed80 with x1830882976983040 ext(0->1048575) 00002000:00010000:1.0:1746066793.635320:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5ed80 00000100:00100000:0.0:1746066793.636622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.636706:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976983424 00000100:00100000:1.0:1746066793.636712:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976983424 00002000:00100000:1.0:1746066793.636742:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff880135e5ce00 x1830882976983424/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.636750:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ce00 with x1830882976983424 ext(0->1048575) 00002000:00010000:1.0:1746066793.636754:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5ce00 00000100:00100000:2.0:1746066793.638133:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6639 00000100:00100000:2.0:1746066793.638146:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882976983424:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066793.644045:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.644181:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976983552 00000100:00100000:2.0:1746066793.644188:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976983552 00000100:00100000:2.0:1746066793.644229:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14676 00000100:00100000:2.0:1746066793.644235:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+9:31666:x1830882976983552:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066793.644250:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.644265:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f24400/0xfb36a14ee608bb3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e8d4 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.644288:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608ba7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e872 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.644295:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.644297:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.644300:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f24400/0xfb36a14ee608bb3f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8d4 expref: 10 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.644321:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608ba7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e872 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.644331:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608ba7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e872 expref: 10 pid: 8450 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.644340:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976865024:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.645048:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540df00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.679740:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976865024:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.679771:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f24400/0xfb36a14ee608bb3f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8d4 expref: 10 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.679786:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f24400, rc 0) 00000100:00100000:2.0:1746066793.679829:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+10:31666:x1830882976983552:12345-192.168.202.57@tcp:101:cat.0 Request processed in 35593us (35791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.679838:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14676 00000100:00100000:1.0:1746066793.681337:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.681475:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976983680 00000100:00100000:2.0:1746066793.681484:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976983680 00010000:00010000:2.0:1746066793.681520:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608ba7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e872 expref: 11 pid: 8450 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.682796:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7527 00000100:00100000:3.0:1746066793.682811:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976983680:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.682830:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.682855:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608ba7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e872 expref: 11 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.682866:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608ba7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e872 expref: 11 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.682887:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0e00/0xfb36a14ee608ba7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e872 expref: 11 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.682930:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.682933:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.682940:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f24400/0xfb36a14ee608bb3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8d4 expref: 9 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.682949:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f24400/0xfb36a14ee608bb3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8d4 expref: 9 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.682983:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f24400/0xfb36a14ee608bb3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8d4 expref: 9 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.682996:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976865152:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066793.683081:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.686877:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882976983424:12345-192.168.202.57@tcp:3:cat.0 Request processed in 48723us (50246us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066793.686890:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6639 00002000:00100000:2.0:1746066793.686903:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff880135e5ce00 x1830882976983424/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.686912:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ce00 with x1830882976983424 ext(0->1048575) 00002000:00010000:2.0:1746066793.686917:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5ce00 00000100:00100000:3.0:1746066793.695466:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976865152:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.695489:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.695546:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976983680:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 12738us (14210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.695557:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7527 00000100:00100000:1.0:1746066793.695817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.696357:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976983808 00000100:00100000:2.0:1746066793.696365:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976983808 00000100:00100000:2.0:1746066793.696997:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10008 00000100:00100000:2.0:1746066793.697007:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31668:x1830882976983808:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066793.697031:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.697049:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608bb46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e8db expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.697112:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608bb4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697125:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608bb4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697135:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608bb4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697149:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f24e00/0xfb36a14ee608bb54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697156:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f24e00/0xfb36a14ee608bb54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697162:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f24e00/0xfb36a14ee608bb54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697274:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25a00/0xfb36a14ee608bb5b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697284:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25a00/0xfb36a14ee608bb5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697290:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25a00/0xfb36a14ee608bb5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:2.0:1746066793.697316:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:2.0:1746066793.697322:0:20127:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746066793.697338:0:20127:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25a00/0xfb36a14ee608bb5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697347:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25a00/0xfb36a14ee608bb5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697353:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608bb4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697358:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608bb4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697363:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608bb4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697368:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f25600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066793.697371:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608bb4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697377:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608bb4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697387:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066793.697390:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066793.697393:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608bb4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697397:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25600/0xfb36a14ee608bb4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697418:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f24e00/0xfb36a14ee608bb54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697424:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f24e00/0xfb36a14ee608bb54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697428:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f24e00/0xfb36a14ee608bb54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697432:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f24e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066793.697434:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f24e00/0xfb36a14ee608bb54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697438:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f24e00/0xfb36a14ee608bb54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697444:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13d00) 00010000:00010000:2.0:1746066793.697446:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066793.697448:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f24e00/0xfb36a14ee608bb54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697452:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f24e00/0xfb36a14ee608bb54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.697480:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608bb46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8db expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.697492:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25a00/0xfb36a14ee608bb5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8db expref: 9 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.697497:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066793.697499:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066793.697501:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f25a00, rc 0) 00000100:00100000:2.0:1746066793.699984:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31668:x1830882976983808:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 2970us (4160us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.699993:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10008 00000100:00100000:0.0:1746066793.705204:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.705281:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976984064 00000100:00100000:2.0:1746066793.705293:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976984064 00002000:00100000:2.0:1746066793.705330:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880135e5ea00 x1830882976984064/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.705339:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ea00 with x1830882976984064 ext(1048576->2097151) 00002000:00010000:2.0:1746066793.705342:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5ea00 00000100:00100000:2.0:1746066793.705372:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6640 00000100:00100000:2.0:1746066793.705380:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882976984064:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066793.707291:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.709956:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976984320 00000100:00100000:2.0:1746066793.709966:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976984320 00000100:00100000:2.0:1746066793.710036:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10009 00000100:00100000:2.0:1746066793.710046:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31668:x1830882976984320:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066793.710064:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.710080:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f24000/0xfb36a14ee608bb62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e8e2 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.710175:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608bb69 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.710190:0:20127:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8c6 expref: 253 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.710197:0:20127:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25a00/0xfb36a14ee608bb5b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8db expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.710203:0:20127:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608bb69 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.710236:0:20127:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25a00/0xfb36a14ee608bb5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8db expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.710247:0:20127:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25a00/0xfb36a14ee608bb5b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8db expref: 10 pid: 20127 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.710260:0:20127:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976865280:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.712949:0:20127:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8c6 expref: 253 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.712964:0:20127:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8c6 expref: 253 pid: 20127 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.712975:0:20127:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef58000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976865408:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.713732:0:20127:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540df00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.725338:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.725469:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976984448 00000100:00100000:2.0:1746066793.725476:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976984448 00000100:00100000:2.0:1746066793.725525:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14677 00000100:00100000:2.0:1746066793.725532:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:31667:x1830882976984448:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066793.725547:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.725562:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b51b9800/0xfb36a14ee608bb70 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e8e9 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.725583:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.725585:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.725591:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b51b9800/0xfb36a14ee608bb70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8e9 expref: 16 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.725616:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b51b9800/0xfb36a14ee608bb70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8e9 expref: 16 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.725624:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b51b9800, rc 0) 00000100:00100000:2.0:1746066793.725694:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:31667:x1830882976984448:12345-192.168.202.57@tcp:101:cat.0 Request processed in 142us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.725700:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14677 00000100:00100000:3.0:1746066793.725779:0:20127:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976865280:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.726196:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882976984064:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20815us (20996us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066793.726203:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6640 00002000:00100000:2.0:1746066793.726211:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880135e5ea00 x1830882976984064/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.726219:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ea00 with x1830882976984064 ext(1048576->2097151) 00000100:00100000:3.0:1746066793.726515:0:20127:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882976865408:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.726533:0:20127:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608bb69 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00002000:00010000:2.0:1746066793.726624:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5ea00 00000100:00100000:0.0:1746066793.736549:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.736580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.736703:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976984576 00000100:00100000:3.0:1746066793.736711:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976984576 00010000:00010000:3.0:1746066793.736742:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25a00/0xfb36a14ee608bb5b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8db expref: 11 pid: 20127 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.736765:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976984704 00000100:00100000:3.0:1746066793.736767:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976984704 00010000:00010000:3.0:1746066793.736776:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8c6 expref: 254 pid: 20127 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.736795:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7528 00000100:00100000:3.0:1746066793.736801:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882976984576:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.736812:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.736816:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25a00/0xfb36a14ee608bb5b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8db expref: 11 pid: 20127 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.736828:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25a00/0xfb36a14ee608bb5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8db expref: 11 pid: 20127 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.736845:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25a00/0xfb36a14ee608bb5b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8db expref: 11 pid: 20127 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.736873:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066793.736877:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608bb69 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.736883:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608bb69 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.736888:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.736923:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976984576:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 122us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.736928:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7528 00000100:00100000:3.0:1746066793.736940:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7529 00000100:00100000:3.0:1746066793.736944:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:1963:x1830882976984704:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.736949:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.736952:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8c6 expref: 254 pid: 20127 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.736959:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8c6 expref: 254 pid: 20127 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.736968:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0c00/0xfb36a14ee608bb31 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8c6 expref: 254 pid: 20127 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.736976:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066793.736978:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608bb69 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.736984:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608bb69 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.736990:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608bb69 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.737006:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.737020:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:1963:x1830882976984704:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 75us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.737025:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7529 00010000:00010000:3.0:1746066793.737041:0:20127:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608bb69 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066793.737046:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608bb69 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:3.0:1746066793.737060:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000100:00100000:0.0:1746066793.737143:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.737156:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976984832 00000100:00100000:2.0:1746066793.737160:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976984832 00010000:00010000:3.0:1746066793.737177:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f24000/0xfb36a14ee608bb62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8e2 expref: 11 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.737188:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608bb69 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8e2 expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.737192:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14678 00010000:00010000:3.0:1746066793.737194:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066793.737196:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:2.0:1746066793.737197:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+10:31666:x1830882976984832:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066793.737198:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f25e00, rc 0) 00010000:00010000:2.0:1746066793.737206:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.737217:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608bb7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e8f0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.737219:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31668:x1830882976984320:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 27176us (29934us total) trans 8589944069 rc 0/0 00000100:00100000:3.0:1746066793.737225:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10009 00010000:00010000:2.0:1746066793.737235:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608ba82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e879 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.737242:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.737244:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.737247:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608bb7e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8f0 expref: 11 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.737267:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608ba82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e879 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.737276:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608ba82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e879 expref: 9 pid: 8450 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.737286:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976865536:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.737629:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.740152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.740235:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976985088 00000100:00100000:3.0:1746066793.740241:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976985088 00002000:00100000:3.0:1746066793.740276:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e8c7480 x1830882976985088/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.740290:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c7480 with x1830882976985088 ext(1048576->2097151) 00002000:00010000:3.0:1746066793.740294:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c7480 00000100:00100000:3.0:1746066793.740312:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6641 00000100:00100000:3.0:1746066793.740319:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1964:x1830882976985088:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066793.740923:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.741482:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976985344 00000100:00100000:2.0:1746066793.741487:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976985344 00000100:00100000:2.0:1746066793.741601:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10010 00000100:00100000:2.0:1746066793.741611:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31668:x1830882976985344:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066793.741628:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.741631:0:20127:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746066793.741796:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25e00/0xfb36a14ee608bb69 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8e2 expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.741824:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066793.741829:0:20127:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066793.741840:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bb85 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e8f7 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.741921:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a600/0xfb36a14ee608bb8c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.741933:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a600/0xfb36a14ee608bb8c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.741941:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a600/0xfb36a14ee608bb8c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.741952:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a600/0xfb36a14ee608bb8c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.741957:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a600/0xfb36a14ee608bb8c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.741961:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a600/0xfb36a14ee608bb8c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.741966:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b19a600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066793.741969:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a600/0xfb36a14ee608bb8c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.741978:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a600/0xfb36a14ee608bb8c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.741984:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066793.741986:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066793.741989:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a600/0xfb36a14ee608bb8c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.741993:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a600/0xfb36a14ee608bb8c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066793.742018:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bb85 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8f7 expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.742025:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bb85 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8f7 expref: 10 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.742032:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19ae00, rc 0) 00000100:00100000:2.0:1746066793.742080:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31668:x1830882976985344:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 470us (1155us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066793.742086:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10010 00000100:00100000:0.0:1746066793.742496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.743235:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976985472 00000100:00100000:3.0:1746066793.743239:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976985472 00010000:00010000:3.0:1746066793.743256:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608ba82 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e879 expref: 10 pid: 8450 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.743275:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7530 00000100:00100000:3.0:1746066793.743280:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976985472:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.743288:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.743302:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608ba82 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e879 expref: 10 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.743310:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608ba82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e879 expref: 10 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.743330:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.743332:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.743338:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608bb7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8f0 expref: 11 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.743345:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608bb7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8f0 expref: 11 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.743369:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608bb7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8f0 expref: 11 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.743379:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976865664:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066793.743625:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066793.745802:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1000/0xfb36a14ee608ba82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e879 expref: 10 pid: 8450 timeout: 854 lvb_type: 0 00000100:00100000:2.0:1746066793.745819:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976865536:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.745841:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608bb7e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8f0 expref: 11 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.745857:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19b200, rc 0) 00000100:00100000:2.0:1746066793.745898:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+11:31666:x1830882976984832:12345-192.168.202.57@tcp:101:cat.0 Request processed in 8699us (8753us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.745906:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14678 00000100:00100000:2.0:1746066793.745953:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976985728 00000100:00100000:2.0:1746066793.745958:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976985728 00000100:00100000:2.0:1746066793.745989:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4176 00000100:00100000:2.0:1746066793.745996:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f5ae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31668:x1830882976985728:12345-192.168.202.57@tcp:35:mirror_io.0 00000100:00100000:2.0:1746066793.746148:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f5ae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31668:x1830882976985728:12345-192.168.202.57@tcp:35:mirror_io.0 Request processed in 151us (2521us total) trans 8589944070 rc 0/0 00000100:00100000:2.0:1746066793.746154:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4176 00000100:00100000:3.0:1746066793.747263:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.755474:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976865664:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.755491:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066793.756726:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1964:x1830882976985088:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16403us (16575us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066793.756735:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6641 00000100:00100000:3.0:1746066793.756751:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976985472:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 13470us (14254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.756759:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7530 00002000:00100000:2.0:1746066793.756860:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e8c7480 x1830882976985088/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.756869:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c7480 with x1830882976985088 ext(1048576->2097151) 00002000:00010000:2.0:1746066793.756873:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c7480 00000100:00100000:3.0:1746066793.758809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.758971:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976985984 00000100:00100000:2.0:1746066793.758978:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976985984 00002000:00100000:2.0:1746066793.759007:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009ed09500 x1830882976985984/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.759014:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed09500 with x1830882976985984 ext(1048576->2097151) 00002000:00010000:2.0:1746066793.759019:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed09500 00000100:00100000:2.0:1746066793.759044:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6642 00000100:00100000:2.0:1746066793.759050:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882976985984:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066793.764184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.765302:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976986112 00000100:00100000:2.0:1746066793.765311:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976986112 00000100:00100000:2.0:1746066793.765348:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14679 00000100:00100000:2.0:1746066793.765355:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:31667:x1830882976986112:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066793.765371:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.765385:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608bb93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e8fe expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.765403:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.765405:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.765410:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608bb93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8fe expref: 17 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.765423:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608bb93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8fe expref: 17 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.765432:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19ba00, rc 0) 00000100:00100000:2.0:1746066793.765480:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:31667:x1830882976986112:12345-192.168.202.57@tcp:101:cat.0 Request processed in 124us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.765485:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14679 00000100:00100000:0.0:1746066793.769669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.770001:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976986368 00000100:00100000:1.0:1746066793.770010:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976986368 00000100:00100000:0.0:1746066793.770860:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.770878:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976986624 00000100:00100000:0.0:1746066793.770881:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976986624 00002000:00100000:0.0:1746066793.770906:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009e8c5500 x1830882976986624/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.770916:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c5500 with x1830882976986624 ext(1048576->2097151) 00002000:00010000:0.0:1746066793.770926:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c5500 00000100:00100000:0.0:1746066793.770949:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6643 00000100:00100000:0.0:1746066793.770955:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1963:x1830882976986624:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066793.770956:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10011 00000100:00100000:1.0:1746066793.770961:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:31663:x1830882976986368:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066793.770973:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.770976:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066793.770995:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec00000/0xfb36a14ee608bb23 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8bf expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.771010:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066793.771014:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066793.771021:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608bb9a lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e905 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.771053:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066793.771060:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0000/0xfb36a14ee608baa5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e895 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.771066:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608bb07 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b8 expref: 252 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.771071:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066793.771091:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608bb07 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b8 expref: 252 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.771100:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608bb07 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b8 expref: 252 pid: 20127 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.771109:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976865792:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.771170:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0000/0xfb36a14ee608baa5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e895 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.771177:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0000/0xfb36a14ee608baa5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e895 expref: 9 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.771183:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976865920:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.771197:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.771836:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882976985984:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12785us (13030us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066793.771843:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6642 00002000:00100000:3.0:1746066793.771849:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009ed09500 x1830882976985984/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.771861:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed09500 with x1830882976985984 ext(1048576->2097151) 00002000:00010000:3.0:1746066793.771864:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed09500 00000100:00100000:0.0:1746066793.779915:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.779969:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976986752 00000100:00100000:0.0:1746066793.779971:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.779976:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976986752 00010000:00010000:3.0:1746066793.780003:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608bb07 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b8 expref: 253 pid: 20127 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.780024:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976986880 00000100:00100000:3.0:1746066793.780026:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976986880 00010000:00010000:3.0:1746066793.780033:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0000/0xfb36a14ee608baa5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e895 expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.780049:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7531 00000100:00100000:3.0:1746066793.780055:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:1963:x1830882976986752:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.780064:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.780069:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608bb07 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b8 expref: 253 pid: 20127 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.780077:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608bb07 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b8 expref: 253 pid: 20127 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.780095:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066793.780098:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066793.780104:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066793.780112:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.780155:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:1963:x1830882976986752:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 100us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.780161:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7531 00000100:00100000:3.0:1746066793.780174:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7532 00000100:00100000:3.0:1746066793.780178:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5218450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976986880:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.780185:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.780188:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0000/0xfb36a14ee608baa5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e895 expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.780196:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0000/0xfb36a14ee608baa5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e895 expref: 10 pid: 14549 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.780204:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066793.780207:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066793.780212:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066793.780217:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066793.780228:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.780240:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5218450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882976986880:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 61us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.780244:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7532 00010000:00010000:1.0:1746066793.780542:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608bb07 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8b8 expref: 252 pid: 20127 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.780566:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976865792:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.780576:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4af0000/0xfb36a14ee608baa5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e895 expref: 9 pid: 14549 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746066793.780584:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976865920:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.780613:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066793.780620:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066793.780624:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000040:00080000:1.0:1746066793.781196:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3116, 88 off263464 00000004:00080000:1.0:1746066793.781202:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754958525724ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066793.781560:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3130, 88 off264608 00000004:00080000:1.0:1746066793.781565:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754958888828ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066793.781576:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3131, 88 off264696 00000004:00080000:1.0:1746066793.781579:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754958902981ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066793.781585:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3117, 88 off263552 00000004:00080000:1.0:1746066793.781587:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754958911368ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066793.781593:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3118, 88 off263640 00000004:00080000:1.0:1746066793.781617:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754958941396ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066793.781624:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3132, 88 off264784 00000004:00080000:1.0:1746066793.781626:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754958950596ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066793.781632:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3133, 88 off264872 00000004:00080000:1.0:1746066793.781634:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754958957758ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066793.781639:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3134, 88 off264960 00000004:00080000:1.0:1746066793.781641:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754958964843ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066793.781646:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3119, 88 off263728 00000004:00080000:1.0:1746066793.781648:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754958971731ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066793.781652:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3135, 88 off265048 00000004:00080000:1.0:1746066793.781654:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754958978531ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066793.781659:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3120, 88 off263816 00000004:00080000:1.0:1746066793.781661:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754958985218ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066793.781666:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3136, 88 off265136 00000004:00080000:1.0:1746066793.781668:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754958992446ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066793.781796:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3121, 88 off263904 00000004:00080000:1.0:1746066793.781799:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754959123536ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066793.781823:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3122, 88 off263992 00000004:00080000:1.0:1746066793.781826:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754959150152ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066793.781833:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3123, 88 off264080 00000004:00080000:1.0:1746066793.781835:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754959159262ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066793.781841:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3124, 88 off264168 00000004:00080000:1.0:1746066793.781844:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 754959167714ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066793.781851:0:14548:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3137, 88 off265224 00000004:00080000:1.0:1746066793.781853:0:14548:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 754959176904ns, next at 749511475809ns, rc = 0 00000100:00100000:0.0:1746066793.783867:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.783885:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976987008 00000100:00100000:0.0:1746066793.783891:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976987008 00000100:00100000:0.0:1746066793.783916:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14680 00000100:00100000:0.0:1746066793.783922:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+11:31666:x1830882976987008:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066793.783934:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066793.783945:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a09400/0xfb36a14ee608bba8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e90c expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.783964:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0a00/0xfb36a14ee608ba89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e880 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.783971:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066793.783972:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066793.783975:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a09400/0xfb36a14ee608bba8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e90c expref: 12 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.783994:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0a00/0xfb36a14ee608ba89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e880 expref: 9 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.784003:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0a00/0xfb36a14ee608ba89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e880 expref: 9 pid: 8450 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746066793.784013:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976866048:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066793.784053:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.784445:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1963:x1830882976986624:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13488us (13586us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066793.784452:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6643 00002000:00100000:0.0:1746066793.784459:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009e8c5500 x1830882976986624/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.784473:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c5500 with x1830882976986624 ext(1048576->2097151) 00002000:00010000:0.0:1746066793.784476:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c5500 00000100:00100000:0.0:1746066793.786776:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976866048:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066793.786799:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099a09400/0xfb36a14ee608bba8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e90c expref: 12 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.786815:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099a09400, rc 0) 00000100:00100000:0.0:1746066793.787401:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+12:31666:x1830882976987008:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3478us (3537us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066793.787467:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14680 00000100:00100000:0.0:1746066793.787539:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.787639:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976987136 00000100:00100000:3.0:1746066793.787644:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976987136 00010000:00010000:3.0:1746066793.787664:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0a00/0xfb36a14ee608ba89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e880 expref: 10 pid: 8450 timeout: 854 lvb_type: 0 00000100:00100000:3.0:1746066793.787703:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7533 00000100:00100000:3.0:1746066793.787709:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882976987136:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.787719:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.787737:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0a00/0xfb36a14ee608ba89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e880 expref: 10 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.787747:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0a00/0xfb36a14ee608ba89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e880 expref: 10 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.787764:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4af0a00/0xfb36a14ee608ba89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e880 expref: 10 pid: 8450 timeout: 854 lvb_type: 0 00010000:00010000:3.0:1746066793.787777:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.787779:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.787784:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099a09400/0xfb36a14ee608bba8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e90c expref: 11 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.787792:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a09400/0xfb36a14ee608bba8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e90c expref: 11 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.787815:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099a09400/0xfb36a14ee608bba8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e90c expref: 11 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.787826:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed0ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976866176:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066793.787864:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0aba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.790533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.790619:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976987264 00000100:00100000:0.0:1746066793.790624:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976987264 00000100:00100000:0.0:1746066793.790648:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14681 00000100:00100000:0.0:1746066793.790654:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31667:x1830882976987264:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066793.790926:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed0ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976866176:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.790942:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.790973:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882976987136:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3264us (3433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.790979:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7533 00010000:00010000:0.0:1746066793.791318:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066793.791332:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a08000/0xfb36a14ee608bbaf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e913 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.791355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.791564:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976987392 00000100:00100000:2.0:1746066793.791567:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976987392 00000100:00100000:2.0:1746066793.791586:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10012 00000100:00100000:2.0:1746066793.791590:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+11:31666:x1830882976987392:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066793.791608:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.791616:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e91a expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.791651:0:20127:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066793.791657:0:20127:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.791669:0:20127:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066793.791702:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.791711:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066793.791714:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066793.791717:0:20127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.791721:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19ae00, rc 0) 00000100:00100000:2.0:1746066793.791740:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+12:31666:x1830882976987392:12345-192.168.202.57@tcp:101:cat.0 Request processed in 150us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.791745:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10012 00010000:00010000:0.0:1746066793.791899:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066793.791902:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066793.791909:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a08000/0xfb36a14ee608bbaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e913 expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.791921:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099a08000/0xfb36a14ee608bbaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e913 expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.791929:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099a08000, rc 0) 00000100:00100000:0.0:1746066793.791955:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:31667:x1830882976987264:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1301us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066793.791961:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14681 00000100:00100000:1.0:1746066793.792003:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.792386:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976987520 00000100:00100000:3.0:1746066793.792389:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976987520 00000100:00100000:3.0:1746066793.792407:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10013 00000100:00100000:3.0:1746066793.792411:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31665:x1830882976987520:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066793.792418:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.792424:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac47400/0xfb36a14ee608bbbd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e921 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.792442:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac47400/0xfb36a14ee608bbbd lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e921 expref: 253 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.792448:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac47400/0xfb36a14ee608bbbd lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e921 expref: 253 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.792454:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066793.792456:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066793.792458:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 11 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.792463:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac47400, rc 0) 00000100:00100000:3.0:1746066793.792478:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31665:x1830882976987520:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 66us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.792482:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10013 00010000:00010000:1.0:1746066793.804963:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e905 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.804975:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066793.804977:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746066793.804981:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.804989:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.804995:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.805001:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac47400/0xfb36a14ee608bbbd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e921 expref: 252 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.805005:0:14548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac47400/0xfb36a14ee608bbbd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e921 expref: 252 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.805010:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac47400/0xfb36a14ee608bbbd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e921 expref: 252 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.805040:0:14548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac47400/0xfb36a14ee608bbbd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e921 expref: 252 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.805051:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976866304:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066793.805235:0:14548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.805243:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976866432:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066793.805259:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3b40 going to sleep for 11 seconds 00000001:00080000:1.0:1746066793.805272:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944071 is committed 00000004:00080000:1.0:1746066793.805277:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2411 committed 00000004:00080000:1.0:1746066793.805893:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2397 committed 00000004:00080000:1.0:1746066793.805908:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2396 committed 00000004:00080000:1.0:1746066793.805910:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2395 committed 00000004:00080000:1.0:1746066793.805911:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2394 committed 00000004:00080000:1.0:1746066793.805913:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2410 committed 00000004:00080000:1.0:1746066793.805914:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2393 committed 00000004:00080000:1.0:1746066793.805916:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2409 committed 00000004:00080000:1.0:1746066793.805917:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2392 committed 00000004:00080000:1.0:1746066793.805918:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2408 committed 00000004:00080000:1.0:1746066793.805920:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2407 committed 00000004:00080000:1.0:1746066793.805921:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2406 committed 00000004:00080000:1.0:1746066793.805922:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2391 committed 00000004:00080000:1.0:1746066793.805924:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2390 committed 00000004:00080000:1.0:1746066793.805925:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2405 committed 00000004:00080000:1.0:1746066793.805927:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2404 committed 00000004:00080000:1.0:1746066793.805928:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2389 committed 00000001:00080000:1.0:1746066793.805934:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944070 is committed 00000001:00080000:1.0:1746066793.805939:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944067 is committed 00000100:00100000:3.0:1746066793.806123:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976866816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.806152:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.806167:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976867328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.806178:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.806186:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976867840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.806199:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.806207:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976868352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.806218:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.806230:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746066793.806234:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976866944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.806245:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.806253:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976867456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.806263:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.806270:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976867968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.806280:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.806287:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976868480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.806298:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.806314:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976866816 00000100:00100000:3.0:1746066793.806318:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976866816 00000100:00100000:3.0:1746066793.806343:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976867328 00000100:00100000:3.0:1746066793.806345:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976867328 00000100:00100000:0.0:1746066793.806352:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976866560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.806353:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976867840 00000100:00100000:3.0:1746066793.806355:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976867840 00000100:00100000:3.0:1746066793.806361:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976868352 00000100:00100000:3.0:1746066793.806363:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976868352 00000100:00100000:3.0:1746066793.806368:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976866944 00000100:00100000:3.0:1746066793.806369:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976866944 00000100:00100000:0.0:1746066793.806371:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.806374:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976867456 00000100:00100000:3.0:1746066793.806376:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976867456 00000100:00100000:3.0:1746066793.806382:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976867968 00000100:00100000:0.0:1746066793.806382:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976867072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.806383:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976867968 00000100:00100000:3.0:1746066793.806388:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976868480 00000100:00100000:3.0:1746066793.806390:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976868480 00000100:00100000:0.0:1746066793.806392:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.806395:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976866560 00000100:00100000:3.0:1746066793.806397:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976866560 00000100:00100000:0.0:1746066793.806398:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976867584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.806403:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976867072 00000100:00100000:3.0:1746066793.806404:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976867072 00000100:00100000:0.0:1746066793.806409:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066793.806410:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976867584 00000100:00100000:3.0:1746066793.806411:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976867584 00000100:00100000:0.0:1746066793.806414:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976868096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.806419:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14682 00000100:00100000:3.0:1746066793.806424:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3295:x1830882976866816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066793.806424:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066793.806431:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746066793.806435:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976867712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066793.806446:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066793.806452:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976868224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066793.806462:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066793.806506:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976868096 00000100:00100000:1.0:1746066793.806509:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976868096 00000100:00100000:1.0:1746066793.806521:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976867712 00000100:00100000:1.0:1746066793.806522:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976867712 00000100:00100000:1.0:1746066793.806528:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976868224 00000100:00100000:1.0:1746066793.806530:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976868224 00000100:00100000:1.0:1746066793.806536:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14683 00000100:00100000:1.0:1746066793.806540:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3295:x1830882976867328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066793.806692:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3295:x1830882976867328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (494us total) trans 21474840941 rc 0/0 00000100:00100000:1.0:1746066793.806698:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14683 00000100:00100000:1.0:1746066793.806710:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14684 00000100:00100000:1.0:1746066793.806714:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3295:x1830882976867840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066793.806802:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:1.0:1746066793.806805:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066793 -> 1746066793 00002000:00010000:1.0:1746066793.806807:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:1.0:1746066793.806808:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066793 -> 1746066793 00002000:00010000:1.0:1746066793.806809:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5923 -> 5923 00000100:00100000:1.0:1746066793.806828:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3295:x1830882976867840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (629us total) trans 17179873621 rc 0/0 00000100:00100000:1.0:1746066793.806832:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14684 00000100:00100000:1.0:1746066793.806841:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14685 00000100:00100000:1.0:1746066793.806845:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3295:x1830882976868352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.806879:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976866688:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066793.806897:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1746066793.806899:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746066793.806899:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746066793.806901:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066793.806902:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746066793.806904:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746066793.806909:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976867200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066793.806917:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3295:x1830882976868352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (699us total) trans 17179873622 rc 0/0 00000100:00100000:2.0:1746066793.806921:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066793.806922:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14685 00000100:00100000:1.0:1746066793.806929:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976866688 00000100:00100000:1.0:1746066793.806931:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976866688 00000100:00100000:2.0:1746066793.806936:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976867200 00000100:00100000:2.0:1746066793.806939:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976867200 00000100:00100000:1.0:1746066793.806940:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14686 00000100:00100000:1.0:1746066793.806943:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3295:x1830882976866944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066793.806948:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14687 00000100:00100000:2.0:1746066793.806952:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3295:x1830882976867456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066793.807021:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3295:x1830882976866944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (774us total) trans 21474840942 rc 0/0 00000100:00100000:1.0:1746066793.807026:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14686 00000100:00100000:2.0:1746066793.807027:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3295:x1830882976867456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (763us total) trans 21474840943 rc 0/0 00000100:00100000:2.0:1746066793.807032:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14687 00000100:00100000:1.0:1746066793.807034:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14688 00000100:00100000:2.0:1746066793.807038:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14689 00000100:00100000:1.0:1746066793.807038:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3295:x1830882976867968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.807042:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3295:x1830882976868480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066793.807104:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3295:x1830882976867968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (822us total) trans 17179873623 rc 0/0 00000100:00100000:1.0:1746066793.807108:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14688 00000100:00100000:1.0:1746066793.807116:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14690 00000100:00100000:1.0:1746066793.807120:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3293:x1830882976866560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066793.807234:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066793.807237:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066793 -> 1746066793 00002000:00010000:3.0:1746066793.807239:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:3.0:1746066793.807241:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066793 -> 1746066793 00002000:00010000:3.0:1746066793.807242:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746066793.807260:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3295:x1830882976866816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 836us (1107us total) trans 21474840944 rc 0/0 00000100:00100000:3.0:1746066793.807264:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14682 00000100:00100000:3.0:1746066793.807273:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14691 00000100:00100000:3.0:1746066793.807276:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3293:x1830882976867072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.807346:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3293:x1830882976867072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (952us total) trans 21474840945 rc 0/0 00000100:00100000:3.0:1746066793.807354:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14691 00000100:00100000:3.0:1746066793.807362:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14692 00000100:00100000:3.0:1746066793.807366:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3293:x1830882976867584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066793.807429:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746066793.807432:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066793 -> 1746066793 00002000:00010000:3.0:1746066793.807434:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:3.0:1746066793.807435:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066793 -> 1746066793 00002000:00010000:3.0:1746066793.807437:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2013 -> 2013 00000100:00100000:3.0:1746066793.807452:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3293:x1830882976867584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (1042us total) trans 17179873624 rc 0/0 00000100:00100000:3.0:1746066793.807457:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14692 00000100:00100000:3.0:1746066793.807465:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14693 00000100:00100000:3.0:1746066793.807469:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3293:x1830882976868096:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066793.807646:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929cfb80/2, rc 0, transno 21474840942 00000100:00100000:0.0:1746066793.807651:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976866944:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066793.807658:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801361fb800/2, rc 0, transno 21474840943 00000100:00100000:0.0:1746066793.807661:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976867456:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066793.807667:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed08380/2, rc 0, transno 17179873623 00000100:00100000:0.0:1746066793.807691:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976867968:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066793.807700:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094128000/2, rc 0, transno 21474840944 00000100:00100000:0.0:1746066793.807702:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976866816:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066793.807708:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801361f9c00/2, rc 0, transno 21474840941 00000100:00100000:0.0:1746066793.807710:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976867328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066793.807714:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed09c00/2, rc 0, transno 17179873621 00000100:00100000:0.0:1746066793.807716:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976867840:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066793.807721:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b472300/2, rc 0, transno 17179873622 00000100:00100000:0.0:1746066793.807724:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976868352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066793.807765:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976868608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066793.807783:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066793.807795:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929cf800/2, rc 0, transno 21474840945 00000100:00100000:0.0:1746066793.807798:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976867072:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066793.807803:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed0ad80/2, rc 0, transno 17179873624 00000100:00100000:0.0:1746066793.807805:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976867584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066793.807999:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976868608 00000100:00100000:0.0:1746066793.808002:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976868608 00000100:00100000:0.0:1746066793.808016:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14694 00000100:00100000:0.0:1746066793.808020:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3293:x1830882976867712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066793.808040:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3293:x1830882976868096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 570us (1614us total) trans 17179873625 rc 0/0 00000100:00100000:3.0:1746066793.808045:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14693 00000100:00100000:3.0:1746066793.808054:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14695 00000100:00100000:3.0:1746066793.808058:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3293:x1830882976868224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066793.808089:0:8452:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066793.808092:0:8452:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066793 -> 1746066793 00002000:00010000:0.0:1746066793.808093:0:8452:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:0.0:1746066793.808095:0:8452:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066793 -> 1746066793 00002000:00010000:0.0:1746066793.808096:0:8452:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746066793.808114:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3293:x1830882976867712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (1666us total) trans 17179873626 rc 0/0 00000100:00100000:0.0:1746066793.808118:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14694 00000100:00100000:3.0:1746066793.808119:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3293:x1830882976868224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (1657us total) trans 17179873627 rc 0/0 00000100:00100000:3.0:1746066793.808124:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14695 00000100:00100000:0.0:1746066793.808126:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14696 00000100:00100000:0.0:1746066793.808130:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3294:x1830882976866688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.808131:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14697 00000100:00100000:3.0:1746066793.808134:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3294:x1830882976867200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066793.808196:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3294:x1830882976867200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (1272us total) trans 21474840946 rc 0/0 00000100:00100000:0.0:1746066793.808196:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3295:x1830882976868480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1153us (1896us total) trans 17179873628 rc 0/0 00000100:00100000:0.0:1746066793.808200:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14689 00000100:00100000:3.0:1746066793.808202:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14697 00000100:00100000:0.0:1746066793.808209:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14698 00000100:00100000:0.0:1746066793.808213:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3293:x1830882976868608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066793.808281:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066793.808283:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066793 -> 1746066793 00002000:00010000:1.0:1746066793.808285:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:1.0:1746066793.808286:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066793 -> 1746066793 00002000:00010000:1.0:1746066793.808288:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746066793.808306:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3293:x1830882976866560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1185us (1934us total) trans 21474840947 rc 0/0 00000004:00080000:2.0:1746066793.808766:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801361f9500/2, rc 0, transno 21474840946 00000100:00100000:2.0:1746066793.808771:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976867200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066793.808851:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14690 00000100:00100000:1.0:1746066793.808880:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976866304:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066793.808888:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976866432:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066793.808915:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608bb9a lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e905 expref: 9 pid: 14548 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746066793.808930:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e905 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.808950:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f208000, rc 0) 00000100:00100000:1.0:1746066793.808986:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+8:31663:x1830882976986368:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 38023us (39324us total) trans 8589944071 rc 0/0 00000100:00100000:1.0:1746066793.808991:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10011 00000100:00100000:0.0:1746066793.809350:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3293:x1830882976868608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1136us (1566us total) trans 17179873629 rc 0/0 00000100:00100000:0.0:1746066793.809356:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14698 00002000:00010000:0.0:1746066793.809424:0:8452:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066793.809427:0:8452:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066793 -> 1746066793 00002000:00010000:0.0:1746066793.809428:0:8452:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:0.0:1746066793.809430:0:8452:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066793 -> 1746066793 00002000:00010000:0.0:1746066793.809431:0:8452:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746066793.809466:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3294:x1830882976866688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1334us (2565us total) trans 21474840948 rc 0/0 00000100:00100000:0.0:1746066793.809471:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14696 00000004:00080000:0.0:1746066793.809492:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5bb1180/2, rc 0, transno 17179873628 00000100:00100000:0.0:1746066793.809495:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976868480:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066793.809509:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c529180/2, rc 0, transno 17179873629 00000100:00100000:0.0:1746066793.809511:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976868608:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066793.809590:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef58a80/2, rc 0, transno 21474840948 00000100:00100000:3.0:1746066793.809603:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976866688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066793.809714:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000004:00080000:0.0:1746066793.809799:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed0b800/2, rc 0, transno 17179873626 00000100:00100000:0.0:1746066793.809802:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976867712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066793.809808:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b7f8e00/2, rc 0, transno 17179873627 00000100:00100000:0.0:1746066793.809810:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976868224:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066793.809815:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef58000/2, rc 0, transno 21474840947 00000100:00100000:0.0:1746066793.809818:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976866560:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066793.809823:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e5fb80/2, rc 0, transno 17179873625 00000100:00100000:0.0:1746066793.809826:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976868096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066793.810025:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976987648 00000100:00100000:2.0:1746066793.810029:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976987648 00000100:00100000:2.0:1746066793.810065:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4177 00000100:00100000:2.0:1746066793.810070:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+8:31666:x1830882976987648:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:2.0:1746066793.810133:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+8:31666:x1830882976987648:12345-192.168.202.57@tcp:49:cat.0 Request processed in 62us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.810138:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4177 00000100:00100000:0.0:1746066793.810835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.810888:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.810923:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976987904 00000100:00100000:1.0:1746066793.810927:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976987904 00000100:00100000:1.0:1746066793.810947:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10014 00000100:00100000:1.0:1746066793.810952:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:31667:x1830882976987904:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066793.810960:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.810971:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbc4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e928 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.811000:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbc4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e928 expref: 252 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.811010:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbc4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e928 expref: 252 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.811038:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976987776 00000100:00100000:2.0:1746066793.811042:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976987776 00000100:00100000:2.0:1746066793.811065:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4178 00000100:00100000:2.0:1746066793.811069:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31665:x1830882976987776:12345-192.168.202.57@tcp:49:multiop.0 00000100:00100000:2.0:1746066793.811107:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31665:x1830882976987776:12345-192.168.202.57@tcp:49:multiop.0 Request processed in 37us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.811114:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4178 00010000:00010000:1.0:1746066793.811397:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066793.811400:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066793.811408:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf4c400, rc 0) 00000100:00100000:1.0:1746066793.811425:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31667:x1830882976987904:12345-192.168.202.57@tcp:101:cat.0 Request processed in 473us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.811430:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10014 00000100:00100000:3.0:1746066793.811750:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.811807:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976988032 00000100:00100000:2.0:1746066793.811810:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976988032 00000100:00100000:2.0:1746066793.811833:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4179 00000100:00100000:2.0:1746066793.811838:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:31663:x1830882976988032:12345-192.168.202.57@tcp:49:multiop.0 00000100:00100000:2.0:1746066793.812028:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:31663:x1830882976988032:12345-192.168.202.57@tcp:49:multiop.0 Request processed in 189us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.812034:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4179 00000100:00100000:0.0:1746066793.813769:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.814234:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976988160 00000100:00100000:3.0:1746066793.814239:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976988160 00000100:00100000:3.0:1746066793.814279:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 713 00000100:00100000:3.0:1746066793.814285:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:1964:x1830882976988160:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.814295:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.814312:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbc4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e928 expref: 252 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.814326:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066793.814329:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.814366:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:1964:x1830882976988160:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 81us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.814372:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 713 00000100:00100000:1.0:1746066793.821301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.821353:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976988416 00000100:00100000:0.0:1746066793.821360:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976988416 00002000:00100000:0.0:1746066793.821391:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009f61a680 x1830882976988416/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.821400:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f61a680 with x1830882976988416 ext(1048576->2097151) 00002000:00010000:0.0:1746066793.821403:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f61a680 00000100:00100000:0.0:1746066793.821427:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6644 00000100:00100000:0.0:1746066793.821433:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882976988416:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066793.822628:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.823128:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.823229:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976988800 00000100:00100000:1.0:1746066793.823234:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976988800 00000100:00100000:3.0:1746066793.823288:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976988672 00000100:00100000:3.0:1746066793.823292:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976988672 00002000:00100000:3.0:1746066793.823312:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff880092849c00 x1830882976988672/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.823320:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849c00 with x1830882976988672 ext(1048576->2097151) 00002000:00010000:3.0:1746066793.823324:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092849c00 00000100:00100000:3.0:1746066793.823337:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6645 00000100:00100000:3.0:1746066793.823343:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1966:x1830882976988672:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066793.823789:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14699 00000100:00100000:1.0:1746066793.823795:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:31665:x1830882976988800:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066793.823807:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.823820:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e92f expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.823844:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1200/0xfb36a14ee608ba90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e887 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.823851:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066793.823852:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066793.823855:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3653632->4194303] (req 3653632->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 25 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.823879:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1200/0xfb36a14ee608ba90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e887 expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.823899:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1200/0xfb36a14ee608ba90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e887 expref: 8 pid: 8450 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066793.823910:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976868736:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.823970:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.828457:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976868736:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.828482:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3653632->4194303] (req 3653632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 26 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.828495:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf4d200, rc 0) 00000100:00100000:1.0:1746066793.828522:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31665:x1830882976988800:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4727us (5394us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.828529:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14699 00000100:00100000:0.0:1746066793.832391:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.834493:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882976988416:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 13053us (13192us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066793.834503:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6644 00000100:00100000:3.0:1746066793.834506:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976988928 00002000:00100000:0.0:1746066793.834511:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009f61a680 x1830882976988416/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746066793.834513:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976988928 00002000:00100000:0.0:1746066793.834520:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f61a680 with x1830882976988416 ext(1048576->2097151) 00002000:00010000:0.0:1746066793.834524:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f61a680 00010000:00010000:3.0:1746066793.834536:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1200/0xfb36a14ee608ba90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e887 expref: 9 pid: 8450 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066793.834556:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7534 00000100:00100000:3.0:1746066793.834562:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976988928:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.834571:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.834587:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1200/0xfb36a14ee608ba90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e887 expref: 9 pid: 8450 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.834610:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1200/0xfb36a14ee608ba90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e887 expref: 9 pid: 8450 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.834629:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4af1200/0xfb36a14ee608ba90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e887 expref: 9 pid: 8450 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.834643:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.834645:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.834650:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 25 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.834658:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 25 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.834700:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 25 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.834715:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976868864:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066793.834761:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.836878:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976868864:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.836892:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.836928:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976988928:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2365us (4542us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.836936:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7534 00000100:00100000:2.0:1746066793.837790:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1966:x1830882976988672:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14446us (15163us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066793.837798:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6645 00002000:00100000:2.0:1746066793.837807:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff880092849c00 x1830882976988672/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.837814:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849c00 with x1830882976988672 ext(1048576->2097151) 00002000:00010000:2.0:1746066793.837818:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092849c00 00000100:00100000:0.0:1746066793.838124:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.838815:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976989184 00000100:00100000:2.0:1746066793.838821:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976989184 00002000:00100000:2.0:1746066793.838846:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3653632->3657727) req@ffff88012c52b800 x1830882976989184/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.838853:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52b800 with x1830882976989184 ext(3653632->3657727) 00002000:00010000:2.0:1746066793.838856:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c52b800 00000100:00100000:2.0:1746066793.838878:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6646 00000100:00100000:2.0:1746066793.838884:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882976989184:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066793.840551:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882976989184:12345-192.168.202.57@tcp:3:cat.0 Request processed in 1663us (2424us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066793.840561:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6646 00002000:00100000:2.0:1746066793.840568:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3653632->3657727) req@ffff88012c52b800 x1830882976989184/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/4536 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.840576:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52b800 with x1830882976989184 ext(3653632->3657727) 00002000:00010000:2.0:1746066793.840579:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c52b800 00000100:00100000:0.0:1746066793.845131:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.845217:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976989440 00000100:00100000:1.0:1746066793.845223:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976989440 00000100:00100000:1.0:1746066793.845268:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14700 00000100:00100000:1.0:1746066793.845276:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:31663:x1830882976989440:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066793.845291:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.845305:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e93d expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.845327:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099a09400/0xfb36a14ee608bba8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e90c expref: 13 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.845338:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099a08000/0xfb36a14ee608bbaf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e913 expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.845344:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.845345:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.845348:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1875968->2097151] (req 1875968->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 13 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.845371:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099a08000/0xfb36a14ee608bbaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e913 expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.845380:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099a08000/0xfb36a14ee608bbaf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e913 expref: 23 pid: 21203 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066793.845390:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976868992:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066793.845548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.845630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.845644:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976989312 00000100:00100000:0.0:1746066793.845647:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976989312 00000100:00100000:0.0:1746066793.845670:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14701 00000100:00100000:0.0:1746066793.845696:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882976989312:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066793.845703:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066793.845712:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b09ba00/0xfb36a14ee608bbd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e936 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066793.845738:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976869120:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066793.846206:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099a09400/0xfb36a14ee608bba8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e90c expref: 15 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.846506:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099a09400/0xfb36a14ee608bba8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e90c expref: 15 pid: 21203 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066793.846515:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f618e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976869248:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.846527:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976989696 00000100:00100000:3.0:1746066793.846530:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976989696 00002000:00100000:3.0:1746066793.846553:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800a590e680 x1830882976989696/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.846562:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590e680 with x1830882976989696 ext(2097152->3145727) 00002000:00010000:3.0:1746066793.846566:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590e680 00000100:00100000:3.0:1746066793.846588:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6647 00000100:00100000:3.0:1746066793.846602:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1966:x1830882976989696:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066793.849320:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.849472:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.850636:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00010000:0.0:1746066793.850742:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime: 1746066792 -> 1746066793 00000100:00100000:0.0:1746066793.850757:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976869120:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066793.850780:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b09ba00/0xfb36a14ee608bbd9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e936 expref: 15 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066793.850791:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b09ba00/0xfb36a14ee608bbd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e936 expref: 15 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066793.850808:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b09ba00, rc 0) 00000100:00100000:0.0:1746066793.850838:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882976989312:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5163us (5208us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066793.850845:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14701 00000100:00100000:0.0:1746066793.850862:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976989824 00000100:00100000:0.0:1746066793.850866:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976989824 00000100:00100000:0.0:1746066793.850885:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14702 00000100:00100000:0.0:1746066793.850890:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882976989824:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066793.850901:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066793.850911:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed6d400/0xfb36a14ee608bbe0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e944 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066793.850939:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976869376:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066793.850976:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.851816:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976868992:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.852779:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f618e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976869248:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066793.852800:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1875968->2097151] (req 1875968->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 13 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.852810:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac47000, rc 0) 00000100:00100000:2.0:1746066793.852849:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:31663:x1830882976989440:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 7573us (7725us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.852855:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14700 00000100:00100000:0.0:1746066793.857159:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066793.858330:0:10402:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608ba97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e88e expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.858359:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976869376:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066793.858360:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976990080 00000100:00100000:2.0:1746066793.858366:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976990080 00010000:00010000:1.0:1746066793.858381:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed6d400/0xfb36a14ee608bbe0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e944 expref: 12 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.858392:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed6d400/0xfb36a14ee608bbe0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e944 expref: 12 pid: 10402 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066793.858404:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14703 00000100:00100000:2.0:1746066793.858411:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:31665:x1830882976990080:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066793.858417:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed6d400, rc 0) 00010000:00010000:2.0:1746066793.858423:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.858433:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e94b expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.858450:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882976989824:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7559us (7818us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066793.858455:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14702 00010000:00010000:2.0:1746066793.858456:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608ba97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e88e expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.858462:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.858464:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.858468:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->3575807] (req 3145728->3575807) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.858494:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608ba97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e88e expref: 8 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.858503:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608ba97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e88e expref: 8 pid: 8450 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066793.858512:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e635500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976869504:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.858554:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acce39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.858865:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.858899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.858954:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976990208 00000100:00100000:2.0:1746066793.858957:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976990208 00010000:00010000:2.0:1746066793.858977:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099a09400/0xfb36a14ee608bba8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e90c expref: 13 pid: 21203 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066793.858996:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976989952 00000100:00100000:2.0:1746066793.858998:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976989952 00010000:00010000:2.0:1746066793.859007:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099a08000/0xfb36a14ee608bbaf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e913 expref: 26 pid: 21203 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746066793.859007:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7535 00000100:00100000:0.0:1746066793.859014:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882976990208:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066793.859018:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7536 00010000:00010000:0.0:1746066793.859022:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066793.859023:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f619500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882976989952:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066793.859029:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066793.859035:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099a09400/0xfb36a14ee608bba8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e90c expref: 13 pid: 21203 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.859036:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099a08000/0xfb36a14ee608bbaf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e913 expref: 26 pid: 21203 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.859043:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099a08000/0xfb36a14ee608bbaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e913 expref: 26 pid: 21203 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746066793.859051:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099a09400/0xfb36a14ee608bba8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e90c expref: 13 pid: 21203 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066793.859138:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1966:x1830882976989696:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12544us (13590us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066793.859145:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6647 00002000:00100000:3.0:1746066793.859151:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800a590e680 x1830882976989696/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.859159:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590e680 with x1830882976989696 ext(2097152->3145727) 00002000:00010000:3.0:1746066793.859162:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590e680 00010000:00010000:2.0:1746066793.859209:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a08000/0xfb36a14ee608bbaf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e913 expref: 24 pid: 21203 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746066793.859214:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a09400/0xfb36a14ee608bba8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e90c expref: 13 pid: 21203 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.859221:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.859223:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.859228:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 12 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.859234:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 12 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066793.859241:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066793.859256:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882976990208:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 244us (392us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066793.859257:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 12 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066793.859262:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7535 00000100:00100000:2.0:1746066793.859266:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976869632:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066793.859297:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acce3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.861436:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.861453:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.861717:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e635500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976869504:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.861740:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->3575807] (req 3145728->3575807) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.861752:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a1800, rc 0) 00000100:00100000:3.0:1746066793.861781:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:31665:x1830882976990080:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3370us (4627us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.861787:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14703 00000100:00100000:3.0:1746066793.861803:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976990464 00000100:00100000:3.0:1746066793.861806:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976990464 00000100:00100000:3.0:1746066793.861827:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14704 00000100:00100000:3.0:1746066793.861832:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:31666:x1830882976990464:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066793.861842:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.861853:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e952 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.861869:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.861875:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066793.861876:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066793.861879:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 13 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.861899:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.861913:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 23 pid: 8452 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066793.861922:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976869760:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066793.861959:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.862026:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976869632:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066793.862036:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066793.862050:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f619500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882976989952:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3027us (3151us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.862057:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7536 00000100:00100000:2.0:1746066793.862071:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976990336 00000100:00100000:2.0:1746066793.862074:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976990336 00010000:00010000:2.0:1746066793.862084:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608ba97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e88e expref: 9 pid: 8450 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066793.862098:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7537 00000100:00100000:2.0:1746066793.862103:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882976990336:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066793.862111:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066793.862125:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608ba97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e88e expref: 9 pid: 8450 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.862133:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608ba97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e88e expref: 9 pid: 8450 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.862150:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af0600/0xfb36a14ee608ba97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e88e expref: 9 pid: 8450 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.862159:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.862160:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.862165:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 17 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.862172:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 17 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.862192:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 17 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.862200:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976869888:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066793.862217:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acce3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.863995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.864027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.864094:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976869760:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.864115:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 13 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.864124:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb65c00, rc 0) 00000100:00100000:1.0:1746066793.864125:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976990720 00000100:00100000:1.0:1746066793.864128:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976990720 00000100:00100000:3.0:1746066793.864149:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:31666:x1830882976990464:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2316us (2694us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.864151:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14705 00000100:00100000:3.0:1746066793.864155:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14704 00000100:00100000:1.0:1746066793.864157:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:31667:x1830882976990720:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066793.864166:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066793.864172:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976990848 00000100:00100000:3.0:1746066793.864174:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976990848 00010000:00010000:1.0:1746066793.864176:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbf5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e959 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066793.864190:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1875968->1880063) req@ffff8800a590ca80 x1830882976990848/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746066793.864190:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066793.864198:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590ca80 with x1830882976990848 ext(1875968->1880063) 00002000:00010000:3.0:1746066793.864201:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590ca80 00010000:00010000:1.0:1746066793.864201:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066793.864202:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066793.864205:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbf5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e959 expref: 19 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.864210:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6648 00000100:00100000:3.0:1746066793.864215:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882976990848:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:1.0:1746066793.864222:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.864230:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 19 pid: 4614 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066793.864237:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976870016:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066793.864271:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.864313:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976869888:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066793.864324:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882976990848:12345-192.168.202.57@tcp:3:cat.0 Request processed in 108us (296us total) trans 0 rc 4096/4096 00010000:00010000:2.0:1746066793.864324:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.864332:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6648 00002000:00100000:3.0:1746066793.864337:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1875968->1880063) req@ffff8800a590ca80 x1830882976990848/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/4536 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746066793.864341:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882976990336:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2237us (2910us total) trans 0 rc 0/0 00002000:00100000:3.0:1746066793.864344:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590ca80 with x1830882976990848 ext(1875968->1880063) 00002000:00010000:3.0:1746066793.864346:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590ca80 00000100:00100000:2.0:1746066793.864347:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7537 00000100:00100000:0.0:1746066793.865250:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.865475:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976870016:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066793.865912:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbf5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e959 expref: 19 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.865922:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf4c400, rc 0) 00000100:00100000:1.0:1746066793.865945:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:31667:x1830882976990720:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1788us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.865950:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14705 00000100:00100000:3.0:1746066793.866399:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976990976 00000100:00100000:3.0:1746066793.866404:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976990976 00002000:00100000:3.0:1746066793.866427:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3653632->4194303) req@ffff8800a590ea00 x1830882976990976/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.866435:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590ea00 with x1830882976990976 ext(3653632->4194303) 00010000:00010000:3.0:1746066793.866441:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 23 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.866451:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 23 pid: 8452 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746066793.866457:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a590ea00 00000100:00100000:3.0:1746066793.866483:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2161 00000100:00100000:3.0:1746066793.866489:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882976990976:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066793.867622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.867693:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976991104 00000100:00100000:1.0:1746066793.867697:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976991104 00000100:00100000:1.0:1746066793.867729:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14706 00000100:00100000:1.0:1746066793.867734:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:31663:x1830882976991104:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066793.867743:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.867755:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e960 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.867771:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066793.867775:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 14 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.867781:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746066793.867784:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->2650111] (req 2097152->2650111) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 14 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.867808:0:10402:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 14 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.867818:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->2650111] (req 2097152->2650111) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 14 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.867826:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf4c000, rc 0) 00000100:00100000:1.0:1746066793.867844:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:31663:x1830882976991104:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 110us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.867849:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14706 00000100:00100000:0.0:1746066793.870366:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.870516:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976991360 00000100:00100000:1.0:1746066793.870523:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976991360 00002000:00100000:1.0:1746066793.870558:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3571712->3575807) req@ffff8800a590f480 x1830882976991360/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.870568:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590f480 with x1830882976991360 ext(3571712->3575807) 00010000:00010000:1.0:1746066793.870577:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 19 pid: 4614 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066793.870588:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 19 pid: 4614 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746066793.870604:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a590f480 00000100:00100000:1.0:1746066793.870633:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2162 00000100:00100000:1.0:1746066793.870640:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1964:x1830882976991360:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066793.870794:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1964:x1830882976991360:12345-192.168.202.57@tcp:3:cat.0 Request processed in 154us (433us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066793.870800:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2162 00002000:00100000:1.0:1746066793.870805:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3571712->3575807) req@ffff8800a590f480 x1830882976991360/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/4536 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.870812:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590f480 with x1830882976991360 ext(3571712->3575807) 00010000:00010000:1.0:1746066793.870816:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 19 pid: 4614 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066793.870824:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 19 pid: 4614 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746066793.870829:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a590f480 00000100:00100000:3.0:1746066793.874209:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882976990976:12345-192.168.202.57@tcp:4:cat.0 Request processed in 7712us (8950us total) trans 17179873630 rc 0/0 00000100:00100000:3.0:1746066793.874219:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2161 00002000:00100000:3.0:1746066793.874229:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3653632->4194303) req@ffff8800a590ea00 x1830882976990976/t17179873630(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/448 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.874243:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590ea00 with x1830882976990976 ext(3653632->4194303) 00010000:00010000:3.0:1746066793.874252:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 25 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.874262:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 25 pid: 8452 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746066793.874268:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a590ea00 00000100:00100000:0.0:1746066793.875000:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.875037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.875085:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976991872 00000100:00100000:3.0:1746066793.875090:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976991872 00002000:00100000:3.0:1746066793.875113:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3575807) req@ffff88008c395880 x1830882976991872/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.875120:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395880 with x1830882976991872 ext(3145728->3575807) 00010000:00010000:3.0:1746066793.875125:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 19 pid: 4614 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.875133:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 19 pid: 4614 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746066793.875138:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c395880 00000100:00100000:3.0:1746066793.875152:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2163 00000100:00100000:3.0:1746066793.875158:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1964:x1830882976991872:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066793.875326:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976991744 00000100:00100000:2.0:1746066793.875330:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976991744 00000100:00100000:2.0:1746066793.875361:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4180 00000100:00100000:2.0:1746066793.875366:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:31665:x1830882976991744:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066793.875580:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31665:x1830882976991744:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 212us (581us total) trans 8589944072 rc 0/0 00000100:00100000:2.0:1746066793.875585:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4180 00000100:00100000:0.0:1746066793.879938:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.880021:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976992000 00000100:00100000:2.0:1746066793.880027:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976992000 00010000:00010000:2.0:1746066793.880052:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 25 pid: 8452 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066793.880074:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7538 00000100:00100000:2.0:1746066793.880080:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5218050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882976992000:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066793.880092:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066793.880107:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 25 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.880116:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 25 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.880132:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf4d200/0xfb36a14ee608bbcb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3653632->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e92f expref: 25 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.880142:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.880143:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.880148:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 13 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.880155:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 13 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.880180:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 13 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.880190:0:9852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 13 pid: 4614 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066793.880198:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976870272:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066793.880264:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acce3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.882079:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882976991872:12345-192.168.202.57@tcp:4:cat.0 Request processed in 6915us (7034us total) trans 21474840949 rc 0/0 00000100:00100000:3.0:1746066793.882088:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2163 00002000:00100000:3.0:1746066793.882097:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3575807) req@ffff88008c395880 x1830882976991872/t21474840949(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/448 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.882105:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395880 with x1830882976991872 ext(3145728->3575807) 00010000:00010000:3.0:1746066793.882112:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 21 pid: 4614 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.882121:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 21 pid: 4614 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746066793.882127:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c395880 00000100:00100000:2.0:1746066793.883706:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976870272:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066793.883725:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066793.883767:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5218050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882976992000:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3686us (3835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066793.883776:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7538 00000100:00100000:0.0:1746066793.884518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.884607:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976992256 00000100:00100000:3.0:1746066793.884613:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976992256 00002000:00100000:3.0:1746066793.884642:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88008c394380 x1830882976992256/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.884649:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394380 with x1830882976992256 ext(2097152->3145727) 00010000:00010000:3.0:1746066793.884656:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 14 pid: 4614 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.884665:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 14 pid: 4614 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746066793.884671:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c394380 00000100:00100000:3.0:1746066793.884717:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2164 00000100:00100000:3.0:1746066793.884724:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882976992256:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066793.884835:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.884896:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976992384 00000100:00100000:2.0:1746066793.884899:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976992384 00010000:00010000:2.0:1746066793.884913:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 21 pid: 4614 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066793.884930:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7539 00000100:00100000:2.0:1746066793.884935:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1966:x1830882976992384:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066793.884943:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066793.884957:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 21 pid: 4614 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.884966:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 21 pid: 4614 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.884986:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608bbe7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3575807) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e94b expref: 21 pid: 4614 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.884996:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.884998:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066793.885005:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbf5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e959 expref: 20 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.885012:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e959 expref: 20 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.885038:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e959 expref: 20 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066793.885048:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976870400:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066793.885096:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acce3900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066793.889647:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.889697:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976870400:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.889720:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066793.889727:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976992640 00000100:00100000:0.0:1746066793.889734:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976992640 00000100:00100000:3.0:1746066793.889756:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1966:x1830882976992384:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4819us (4921us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.889764:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7539 00002000:00100000:0.0:1746066793.889789:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ed09180 x1830882976992640/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066793.889843:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed09180 with x1830882976992640 ext(2097152->3145727) 00002000:00010000:0.0:1746066793.889847:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed09180 00000100:00100000:0.0:1746066793.889891:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6649 00000100:00100000:0.0:1746066793.889897:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1965:x1830882976992640:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066793.893136:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882976992256:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8405us (8612us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066793.893146:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2164 00002000:00100000:3.0:1746066793.893155:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88008c394380 x1830882976992256/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.893164:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394380 with x1830882976992256 ext(2097152->3145727) 00010000:00010000:3.0:1746066793.893172:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 14 pid: 4614 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.893185:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 14 pid: 4614 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746066793.893191:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c394380 00000100:00100000:0.0:1746066793.906063:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.906195:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976992768 00000100:00100000:1.0:1746066793.906203:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976992768 00000100:00100000:1.0:1746066793.906249:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14707 00000100:00100000:1.0:1746066793.906256:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:31666:x1830882976992768:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066793.906271:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.906287:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13a00/0xfb36a14ee608bc03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e967 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.906306:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.906307:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066793.906313:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13a00/0xfb36a14ee608bc03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e967 expref: 12 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.906325:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13a00/0xfb36a14ee608bc03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e967 expref: 12 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066793.906334:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e13a00, rc 0) 00000100:00100000:1.0:1746066793.906372:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:31666:x1830882976992768:12345-192.168.202.57@tcp:101:cat.0 Request processed in 117us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066793.906377:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14707 00000100:00100000:2.0:1746066793.907060:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1965:x1830882976992640:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17161us (17417us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066793.907067:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6649 00002000:00100000:2.0:1746066793.907073:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ed09180 x1830882976992640/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.907080:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed09180 with x1830882976992640 ext(2097152->3145727) 00002000:00010000:2.0:1746066793.907084:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed09180 00000100:00100000:0.0:1746066793.907216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.907312:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976992896 00000100:00100000:3.0:1746066793.907315:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976992896 00010000:00010000:3.0:1746066793.907334:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 14 pid: 4614 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066793.907351:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7540 00000100:00100000:3.0:1746066793.907355:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882976992896:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.907363:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.907379:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 14 pid: 4614 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.907388:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 14 pid: 4614 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.907403:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb65c00/0xfb36a14ee608bbee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e952 expref: 14 pid: 4614 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.907427:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.907428:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.907432:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 13 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.907438:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 13 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.907459:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 13 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.907469:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976870528:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066793.907515:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.908616:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976870528:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.908633:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.910703:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882976992896:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3314us (3460us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.910713:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7540 00000100:00100000:0.0:1746066793.913925:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.914023:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976993280 00000100:00100000:2.0:1746066793.914031:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976993280 00002000:00100000:2.0:1746066793.914067:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2646016->2650111) req@ffff880099710a80 x1830882976993280/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.914075:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099710a80 with x1830882976993280 ext(2646016->2650111) 00002000:00010000:2.0:1746066793.914080:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099710a80 00000100:00100000:2.0:1746066793.914248:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6650 00000100:00100000:2.0:1746066793.914256:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+13:1965:x1830882976993280:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066793.914881:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+13:1965:x1830882976993280:12345-192.168.202.57@tcp:3:cat.0 Request processed in 624us (960us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066793.914887:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6650 00002000:00100000:2.0:1746066793.914893:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2646016->2650111) req@ffff880099710a80 x1830882976993280/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/4536 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.914900:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099710a80 with x1830882976993280 ext(2646016->2650111) 00002000:00010000:2.0:1746066793.914902:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099710a80 00000100:00100000:0.0:1746066793.916023:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.918295:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976993024 00000100:00100000:2.0:1746066793.918304:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976993024 00000100:00100000:2.0:1746066793.918357:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14708 00000100:00100000:2.0:1746066793.918368:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:31667:x1830882976993024:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066793.918382:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066793.918396:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cad6600/0xfb36a14ee608bc0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e96e expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.918419:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 12 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.918429:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.918430:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066793.918434:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cad6600/0xfb36a14ee608bc0a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e96e expref: 25 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.918458:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 12 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066793.918468:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 12 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066793.918477:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976870656:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066793.918554:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acce39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066793.919099:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.919156:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.919194:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066793.919245:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976993536 00000100:00100000:2.0:1746066793.919248:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976993536 00002000:00100000:2.0:1746066793.919273:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880099710380 x1830882976993536/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.919282:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099710380 with x1830882976993536 ext(2097152->3145727) 00002000:00010000:2.0:1746066793.919286:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099710380 00000100:00100000:2.0:1746066793.919302:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976993792 00000100:00100000:2.0:1746066793.919304:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976993792 00002000:00100000:2.0:1746066793.919319:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880099711180 x1830882976993792/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.919325:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099711180 with x1830882976993792 ext(3145728->4194303) 00002000:00010000:2.0:1746066793.919327:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099711180 00000100:00100000:2.0:1746066793.919334:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976994048 00000100:00100000:2.0:1746066793.919336:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976994048 00002000:00100000:2.0:1746066793.919345:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880099712a00 x1830882976994048/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.919350:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099712a00 with x1830882976994048 ext(3145728->4194303) 00010000:00010000:2.0:1746066793.919355:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 13 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.919363:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 13 pid: 10402 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746066793.919368:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099712a00 00000100:00100000:2.0:1746066793.919377:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2165 00000100:00100000:2.0:1746066793.919382:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882976994048:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066793.919601:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6651 00000100:00100000:3.0:1746066793.919608:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882976993536:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066793.920275:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6652 00000100:00100000:1.0:1746066793.920282:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882976993792:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066793.922153:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.923146:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976994304 00000100:00100000:0.0:1746066793.923155:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976994304 00000100:00100000:0.0:1746066793.923190:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4181 00000100:00100000:0.0:1746066793.923196:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f5af850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:31663:x1830882976994304:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:0.0:1746066793.923365:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f5af850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+9:31663:x1830882976994304:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 168us (1216us total) trans 8589944073 rc 0/0 00000100:00100000:0.0:1746066793.923371:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4181 00000100:00100000:3.0:1746066793.926138:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976870656:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066793.926164:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cad6600/0xfb36a14ee608bc0a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e96e expref: 25 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.926181:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cad6600, rc 0) 00000100:00100000:3.0:1746066793.926231:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31667:x1830882976993024:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7866us (10209us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.926238:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14708 00000100:00100000:2.0:1746066793.926353:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.926711:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976994432 00000100:00100000:3.0:1746066793.926717:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976994432 00002000:00100000:3.0:1746066793.926745:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->2650111) req@ffff88009e635500 x1830882976994432/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.926753:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e635500 with x1830882976994432 ext(2097152->2650111) 00010000:00010000:3.0:1746066793.926759:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 15 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.926770:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 15 pid: 10402 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746066793.926775:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e635500 00000100:00100000:3.0:1746066793.926800:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2166 00000100:00100000:3.0:1746066793.926807:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882976994432:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066793.935637:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882976993536:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16020us (16529us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066793.935647:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6651 00002000:00100000:3.0:1746066793.935656:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880099710380 x1830882976993536/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.935664:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099710380 with x1830882976993536 ext(2097152->3145727) 00002000:00010000:3.0:1746066793.935669:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099710380 00000100:00100000:2.0:1746066793.939481:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882976994048:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20091us (20280us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066793.939491:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2165 00002000:00100000:2.0:1746066793.939500:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880099712a00 x1830882976994048/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.939510:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099712a00 with x1830882976994048 ext(3145728->4194303) 00010000:00010000:2.0:1746066793.939517:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 15 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.939532:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 15 pid: 10402 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746066793.939538:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099712a00 00000100:00100000:1.0:1746066793.942839:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882976993792:12345-192.168.202.57@tcp:3:cat.0 Request processed in 22550us (23674us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066793.942848:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6652 00002000:00100000:1.0:1746066793.942858:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880099711180 x1830882976993792/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.942865:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099711180 with x1830882976993792 ext(3145728->4194303) 00002000:00010000:1.0:1746066793.942871:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099711180 00000100:00100000:0.0:1746066793.944343:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.945655:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976994560 00000100:00100000:3.0:1746066793.945663:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976994560 00000100:00100000:3.0:1746066793.945719:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14709 00000100:00100000:3.0:1746066793.945726:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:31666:x1830882976994560:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066793.945739:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066793.945751:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009391ee00/0xfb36a14ee608bc11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e975 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.945773:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066793.945777:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009391ee00/0xfb36a14ee608bc11 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e975 expref: 16 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.945787:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009391ee00/0xfb36a14ee608bc11 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e975 expref: 16 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.945795:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009391ee00, rc 0) 00000100:00100000:3.0:1746066793.945831:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+16:31666:x1830882976994560:12345-192.168.202.57@tcp:101:cat.0 Request processed in 106us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.945836:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14709 00000100:00100000:2.0:1746066793.948931:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882976994432:12345-192.168.202.57@tcp:4:cat.0 Request processed in 22117us (22571us total) trans 17179873631 rc 0/0 00000100:00100000:2.0:1746066793.948942:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2166 00002000:00100000:2.0:1746066793.948951:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->2650111) req@ffff88009e635500 x1830882976994432/t17179873631(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/448 e 0 to 0 dl 1746066804 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.948959:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e635500 with x1830882976994432 ext(2097152->2650111) 00010000:00010000:2.0:1746066793.948968:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 16 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066793.948980:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 16 pid: 10402 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746066793.948987:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e635500 00000100:00100000:0.0:1746066793.952942:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066793.953005:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976994688 00000100:00100000:3.0:1746066793.953013:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976994688 00010000:00010000:3.0:1746066793.953044:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 16 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066793.953079:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7541 00000100:00100000:3.0:1746066793.953085:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099711c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882976994688:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066793.953097:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066793.953116:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 16 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.953125:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 16 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.953144:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf4c000/0xfb36a14ee608bbfc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2650111) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e960 expref: 16 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066793.953747:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.953749:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.953757:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cad6600/0xfb36a14ee608bc0a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e96e expref: 24 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.953765:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cad6600/0xfb36a14ee608bc0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e96e expref: 24 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.953773:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.953774:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066793.953777:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009391ee00/0xfb36a14ee608bc11 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e975 expref: 15 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.953788:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009391ee00/0xfb36a14ee608bc11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e975 expref: 15 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066793.953813:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009391ee00/0xfb36a14ee608bc11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e975 expref: 15 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.953825:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976870784:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.953956:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cad6600/0xfb36a14ee608bc0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e96e expref: 24 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066793.953964:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976870912:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066793.953983:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066793.961553:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976870784:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066793.961564:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976870912:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066793.961580:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066793.961627:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099711c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882976994688:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8541us (8691us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066793.961636:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7541 00000100:00100000:0.0:1746066793.964966:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.965006:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.965048:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.965182:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976995200 00000100:00100000:1.0:1746066793.965191:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976995200 00002000:00100000:1.0:1746066793.965230:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a590d180 x1830882976995200/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.965239:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590d180 with x1830882976995200 ext(3145728->4194303) 00002000:00010000:1.0:1746066793.965245:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590d180 00000100:00100000:1.0:1746066793.965260:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976994944 00000100:00100000:1.0:1746066793.965262:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976994944 00002000:00100000:1.0:1746066793.965272:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009e851500 x1830882976994944/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.965278:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e851500 with x1830882976994944 ext(3145728->4194303) 00002000:00010000:1.0:1746066793.965281:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e851500 00000100:00100000:1.0:1746066793.965287:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976995456 00000100:00100000:1.0:1746066793.965288:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976995456 00002000:00100000:1.0:1746066793.965297:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e852a00 x1830882976995456/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.965302:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e852a00 with x1830882976995456 ext(3145728->4194303) 00002000:00010000:1.0:1746066793.965305:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e852a00 00000100:00100000:1.0:1746066793.965315:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6653 00000100:00100000:1.0:1746066793.965322:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882976995200:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066793.965895:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6654 00000100:00100000:2.0:1746066793.965903:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882976994944:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066793.966137:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6655 00000100:00100000:2.0:1746066793.966142:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1965:x1830882976995456:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066793.979876:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882976994944:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13967us (14862us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066793.979886:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6654 00002000:00100000:3.0:1746066793.979895:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009e851500 x1830882976994944/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066793.979907:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e851500 with x1830882976994944 ext(3145728->4194303) 00002000:00010000:3.0:1746066793.979913:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e851500 00000100:00100000:1.0:1746066793.986630:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882976995200:12345-192.168.202.57@tcp:3:cat.0 Request processed in 21298us (21664us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066793.986641:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6653 00002000:00100000:1.0:1746066793.986652:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a590d180 x1830882976995200/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066793.986660:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590d180 with x1830882976995200 ext(3145728->4194303) 00002000:00010000:1.0:1746066793.986665:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590d180 00000100:00100000:2.0:1746066793.990810:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1965:x1830882976995456:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24659us (25753us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066793.990820:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6655 00002000:00100000:2.0:1746066793.990830:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e852a00 x1830882976995456/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.990838:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e852a00 with x1830882976995456 ext(3145728->4194303) 00002000:00010000:2.0:1746066793.990844:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e852a00 00000100:00100000:0.0:1746066793.996568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066793.996624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066793.996856:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976995840 00000100:00100000:1.0:1746066793.996864:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976995840 00000100:00100000:1.0:1746066793.996917:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14710 00000100:00100000:1.0:1746066793.996924:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882976995840:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066793.996939:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066793.996953:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eea3400/0xfb36a14ee608bc18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e97c expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066793.997009:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976871040:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066793.997069:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066793.997331:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976995712 00000100:00100000:2.0:1746066793.997336:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976995712 00002000:00100000:2.0:1746066793.997361:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e851180 x1830882976995712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/0 e 0 to 0 dl 1746066804 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066793.997369:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e851180 with x1830882976995712 ext(4194304->5091327) 00002000:00010000:2.0:1746066793.997372:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e851180 00000100:00100000:2.0:1746066793.997385:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6656 00000100:00100000:2.0:1746066793.997390:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882976995712:12345-192.168.202.57@tcp:3:cat.0 00002000:00010000:1.0:1746066793.998546:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime: 1746066792 -> 1746066793 00000100:00100000:1.0:1746066793.998567:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976871040:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066793.998589:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eea3400/0xfb36a14ee608bc18 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e97c expref: 26 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.998613:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eea3400/0xfb36a14ee608bc18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e97c expref: 26 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066793.998824:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea3400, rc 0) 00000100:00100000:1.0:1746066793.999234:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882976995840:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2309us (2672us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066793.999240:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14710 00000100:00100000:0.0:1746066794.006254:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.006335:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976996096 00000100:00100000:2.0:1746066794.006343:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976996096 00002000:00100000:2.0:1746066794.006379:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e850380 x1830882976996096/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.006387:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e850380 with x1830882976996096 ext(4194304->5091327) 00002000:00010000:2.0:1746066794.006392:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e850380 00000100:00100000:2.0:1746066794.006423:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6657 00000100:00100000:2.0:1746066794.006430:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882976996096:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066794.007261:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882976995712:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9868us (10634us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066794.007268:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6656 00002000:00100000:3.0:1746066794.007274:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e851180 x1830882976995712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:199/0 lens 488/440 e 0 to 0 dl 1746066804 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.007281:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e851180 with x1830882976995712 ext(4194304->5091327) 00002000:00010000:3.0:1746066794.007283:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e851180 00000100:00100000:2.0:1746066794.013148:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882976996096:12345-192.168.202.57@tcp:3:cat.0 Request processed in 6710us (6893us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066794.013159:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6657 00002000:00100000:2.0:1746066794.013169:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e850380 x1830882976996096/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.013178:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e850380 with x1830882976996096 ext(4194304->5091327) 00002000:00010000:2.0:1746066794.013183:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e850380 00000100:00100000:0.0:1746066794.014742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.015083:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976996352 00000100:00100000:3.0:1746066794.015090:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976996352 00000100:00100000:3.0:1746066794.015147:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4182 00000100:00100000:3.0:1746066794.015153:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+9:31666:x1830882976996352:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:3.0:1746066794.015326:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:31666:x1830882976996352:12345-192.168.202.57@tcp:35:cat.0 Request processed in 173us (587us total) trans 8589944074 rc 0/0 00000100:00100000:3.0:1746066794.015331:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4182 00000100:00100000:0.0:1746066794.019164:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.019435:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976996480 00000100:00100000:2.0:1746066794.019442:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976996480 00000100:00100000:2.0:1746066794.019915:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14711 00000100:00100000:2.0:1746066794.019923:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882976996480:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066794.019936:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.019948:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab79800/0xfb36a14ee608bc1f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e983 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.019989:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976871168:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066794.020580:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acce3900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.024278:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976871168:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066794.024311:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab79800/0xfb36a14ee608bc1f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e983 expref: 26 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.024324:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab79800/0xfb36a14ee608bc1f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e983 expref: 26 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.024337:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab79800, rc 0) 00000100:00100000:2.0:1746066794.024384:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882976996480:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4462us (5226us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066794.024392:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14711 00000100:00100000:0.0:1746066794.033638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.033764:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976996608 00000100:00100000:2.0:1746066794.033773:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976996608 00000100:00100000:2.0:1746066794.034703:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14712 00000100:00100000:2.0:1746066794.034715:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882976996608:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066794.034730:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.034744:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e98a expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.034792:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976871296:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066794.034864:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acce3900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.038709:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976871296:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066794.038802:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc26 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e98a expref: 26 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.038995:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e98a expref: 26 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.039097:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab79200, rc 0) 00000100:00100000:2.0:1746066794.039296:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882976996608:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4583us (5663us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066794.039303:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14712 00000100:00100000:0.0:1746066794.048662:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.048859:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976996864 00000100:00100000:2.0:1746066794.048866:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976996864 00000100:00100000:2.0:1746066794.048955:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4183 00000100:00100000:2.0:1746066794.048962:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31667:x1830882976996864:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066794.050495:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31667:x1830882976996864:12345-192.168.202.57@tcp:35:cat.0 Request processed in 170us (477us total) trans 8589944075 rc 0/0 00000100:00100000:2.0:1746066794.050504:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4183 00000100:00100000:0.0:1746066794.066655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.066798:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976997120 00000100:00100000:2.0:1746066794.066805:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976997120 00000100:00100000:2.0:1746066794.066838:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10015 00000100:00100000:2.0:1746066794.066844:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+10:31674:x1830882976997120:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066794.066864:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.066877:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab78c00/0xfb36a14ee608bc2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e991 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.066957:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79800/0xfb36a14ee608bc34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.066967:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79800/0xfb36a14ee608bc34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.066976:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79800/0xfb36a14ee608bc34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.066985:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79200/0xfb36a14ee608bc3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.066989:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79200/0xfb36a14ee608bc3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.066993:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79200/0xfb36a14ee608bc3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067069:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57c6000/0xfb36a14ee608bc42 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067075:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57c6000/0xfb36a14ee608bc42 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067079:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57c6000/0xfb36a14ee608bc42 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:2.0:1746066794.067085:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066794.067141:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79800/0xfb36a14ee608bc34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067147:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79800/0xfb36a14ee608bc34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067152:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79800/0xfb36a14ee608bc34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067156:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab79800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066794.067158:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79800/0xfb36a14ee608bc34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067163:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79800/0xfb36a14ee608bc34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067171:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066794.067174:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066794.067177:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79800/0xfb36a14ee608bc34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067181:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79800/0xfb36a14ee608bc34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067192:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79200/0xfb36a14ee608bc3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067196:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79200/0xfb36a14ee608bc3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067201:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79200/0xfb36a14ee608bc3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067204:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab79200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066794.067206:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79200/0xfb36a14ee608bc3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067210:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79200/0xfb36a14ee608bc3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067216:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13400) 00010000:00010000:2.0:1746066794.067217:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066794.067219:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79200/0xfb36a14ee608bc3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067223:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab79200/0xfb36a14ee608bc3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.067249:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab78c00/0xfb36a14ee608bc2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e991 expref: 13 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.067259:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57c6000/0xfb36a14ee608bc42 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e991 expref: 12 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.067264:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066794.067266:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066794.067268:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57c6000, rc 0) 00000100:00100000:2.0:1746066794.067301:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+12:31674:x1830882976997120:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 458us (655us total) trans 8589944076 rc 0/0 00000100:00100000:2.0:1746066794.067307:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10015 00000100:00100000:0.0:1746066794.107258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.107379:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976997248 00000100:00100000:2.0:1746066794.107387:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976997248 00000100:00100000:2.0:1746066794.107440:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14713 00000100:00100000:2.0:1746066794.107447:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+15:31674:x1830882976997248:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066794.107462:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.107476:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e998 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.107501:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cad6600/0xfb36a14ee608bc0a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e96e expref: 24 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.107508:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009391ee00/0xfb36a14ee608bc11 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e975 expref: 16 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.107513:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.107515:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.107518:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2633728->3055615] (req 2633728->3055615) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.107545:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009391ee00/0xfb36a14ee608bc11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e975 expref: 16 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.107554:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009391ee00/0xfb36a14ee608bc11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e975 expref: 16 pid: 8452 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.107564:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976871424:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066794.107702:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cad6600/0xfb36a14ee608bc0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e96e expref: 24 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.107710:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cad6600/0xfb36a14ee608bc0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e96e expref: 24 pid: 8452 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.107718:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976871552:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066794.107751:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acce3900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.111886:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976871424:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066794.111898:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976871552:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066794.111928:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2633728->3055615] (req 2633728->3055615) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.111943:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab79200, rc 0) 00000100:00100000:2.0:1746066794.111991:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:31674:x1830882976997248:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4544us (4739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.112002:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14713 00000100:00100000:0.0:1746066794.113374:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.115378:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976997376 00000100:00100000:3.0:1746066794.115387:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976997376 00010000:00010000:3.0:1746066794.115419:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009391ee00/0xfb36a14ee608bc11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e975 expref: 16 pid: 8452 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.115444:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7542 00000100:00100000:3.0:1746066794.115451:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009baebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882976997376:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066794.115462:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066794.115480:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009391ee00/0xfb36a14ee608bc11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e975 expref: 16 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.115490:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009391ee00/0xfb36a14ee608bc11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e975 expref: 16 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.115508:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009391ee00/0xfb36a14ee608bc11 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e975 expref: 16 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.115725:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066794.115766:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009baebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882976997376:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 316us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.115772:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7542 00000100:00100000:0.0:1746066794.118720:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.119480:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976997504 00000100:00100000:3.0:1746066794.119487:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976997504 00010000:00010000:3.0:1746066794.119513:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cad6600/0xfb36a14ee608bc0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e96e expref: 25 pid: 8452 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.119550:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7543 00000100:00100000:3.0:1746066794.119557:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882976997504:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066794.119568:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066794.119584:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cad6600/0xfb36a14ee608bc0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e96e expref: 25 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.119605:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cad6600/0xfb36a14ee608bc0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e96e expref: 25 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.119629:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cad6600/0xfb36a14ee608bc0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e96e expref: 25 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.119641:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.119642:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.119647:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 14 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.119655:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 14 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.119701:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 14 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.119712:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976871680:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066794.119786:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066794.121412:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976871680:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066794.121428:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066794.121459:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882976997504:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1901us (2789us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.121468:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7543 00000100:00100000:1.0:1746066794.121785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.121804:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976997760 00000100:00100000:1.0:1746066794.121808:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976997760 00000100:00100000:1.0:1746066794.121847:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10016 00000100:00100000:1.0:1746066794.121853:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31677:x1830882976997760:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066794.121870:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.121883:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2000/0xfb36a14ee608bc57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e99f expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.121962:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.121972:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.121980:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.121992:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bc65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.121997:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bc65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122002:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bc65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122082:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608bc6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122089:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608bc6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122095:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608bc6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066794.122102:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066794.122167:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122173:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122178:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122183:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eea3200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066794.122186:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122190:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122199:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066794.122201:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066794.122204:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122209:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122220:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bc65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122224:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bc65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122229:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bc65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122236:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eea2800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066794.122238:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bc65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122243:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bc65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122248:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012fd76600) 00010000:00010000:1.0:1746066794.122249:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066794.122251:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bc65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122255:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bc65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.122282:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2000/0xfb36a14ee608bc57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e99f expref: 256 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.122291:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608bc6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e99f expref: 255 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.122297:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066794.122299:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066794.122301:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea3e00, rc 0) 00000100:00100000:1.0:1746066794.122320:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31677:x1830882976997760:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 467us (536us total) trans 8589944077 rc 0/0 00000100:00100000:1.0:1746066794.122325:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10016 00000100:00100000:0.0:1746066794.122505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.122558:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976998016 00000100:00100000:2.0:1746066794.122562:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976998016 00002000:00100000:2.0:1746066794.122583:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2633728->2637823) req@ffff88009e93d180 x1830882976998016/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.122601:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93d180 with x1830882976998016 ext(2633728->2637823) 00002000:00010000:2.0:1746066794.122604:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93d180 00000100:00100000:2.0:1746066794.122616:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6658 00000100:00100000:2.0:1746066794.122622:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882976998016:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066794.122751:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882976998016:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 129us (245us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066794.122757:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6658 00002000:00100000:2.0:1746066794.122761:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2633728->2637823) req@ffff88009e93d180 x1830882976998016/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/4536 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.122768:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93d180 with x1830882976998016 ext(2633728->2637823) 00002000:00010000:2.0:1746066794.122770:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93d180 00000100:00100000:2.0:1746066794.144382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.145341:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976998272 00000100:00100000:3.0:1746066794.145351:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976998272 00002000:00100000:3.0:1746066794.145396:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3051520->3055615) req@ffff88009e637100 x1830882976998272/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.145412:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e637100 with x1830882976998272 ext(3051520->3055615) 00002000:00010000:3.0:1746066794.145418:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e637100 00000100:00100000:3.0:1746066794.145462:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6659 00000100:00100000:3.0:1746066794.145470:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882976998272:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066794.145636:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882976998272:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 166us (1262us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066794.145641:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6659 00002000:00100000:3.0:1746066794.145647:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3051520->3055615) req@ffff88009e637100 x1830882976998272/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/4536 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.145653:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e637100 with x1830882976998272 ext(3051520->3055615) 00002000:00010000:3.0:1746066794.145655:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e637100 00000100:00100000:0.0:1746066794.149615:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.149666:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.149769:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976998784 00000100:00100000:3.0:1746066794.149777:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976998784 00000100:00100000:3.0:1746066794.149820:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4184 00000100:00100000:3.0:1746066794.149827:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:31674:x1830882976998784:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066794.150007:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:31674:x1830882976998784:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 179us (340us total) trans 8589944078 rc 0/0 00000100:00100000:3.0:1746066794.150013:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4184 00000100:00100000:1.0:1746066794.153059:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976998528 00000100:00100000:1.0:1746066794.153069:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976998528 00000100:00100000:1.0:1746066794.153117:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10017 00000100:00100000:1.0:1746066794.153123:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+13:31680:x1830882976998528:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066794.153138:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.153152:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bc7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e9a6 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.154917:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc81 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066794.154935:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc81 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066794.154944:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc81 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:1.0:1746066794.154955:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066794.155073:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bc7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9a6 expref: 16 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.156415:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9a6 expref: 15 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.156424:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066794.156426:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746066794.156429:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea3200, rc 0) 00000100:00100000:1.0:1746066794.158291:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:31680:x1830882976998528:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5160us (8676us total) trans 8589944079 rc 0/0 00000100:00100000:1.0:1746066794.158301:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10017 00000100:00100000:0.0:1746066794.171830:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.171929:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976999040 00000100:00100000:3.0:1746066794.171938:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976999040 00002000:00100000:3.0:1746066794.171975:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e93ca80 x1830882976999040/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.171984:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93ca80 with x1830882976999040 ext(0->1048575) 00002000:00010000:3.0:1746066794.171990:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93ca80 00000100:00100000:3.0:1746066794.172023:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6660 00000100:00100000:3.0:1746066794.172030:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882976999040:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066794.180836:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.185057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.185779:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.185814:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976999296 00000100:00100000:1.0:1746066794.185822:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976999296 00002000:00100000:1.0:1746066794.185857:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e93dc00 x1830882976999296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.185866:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93dc00 with x1830882976999296 ext(1048576->2097151) 00002000:00010000:1.0:1746066794.185871:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93dc00 00000100:00100000:1.0:1746066794.185885:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976999424 00000100:00100000:1.0:1746066794.185888:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976999424 00002000:00100000:1.0:1746066794.185898:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009412b480 x1830882976999424/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.185903:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412b480 with x1830882976999424 ext(1048576->2097151) 00002000:00010000:1.0:1746066794.185906:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009412b480 00000100:00100000:1.0:1746066794.185914:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976999808 00000100:00100000:1.0:1746066794.185916:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976999808 00002000:00100000:1.0:1746066794.185927:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x390:0x0] (1048576->1875967) req@ffff88009412aa00 x1830882976999808/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.185933:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412aa00 with x1830882976999808 ext(1048576->1875967) 00002000:00010000:1.0:1746066794.185935:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009412aa00 00000100:00100000:1.0:1746066794.185955:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6661 00000100:00100000:1.0:1746066794.185961:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+13:1965:x1830882976999296:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066794.187127:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6662 00000100:00100000:3.0:1746066794.187135:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:1966:x1830882976999424:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066794.188220:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6663 00000100:00100000:3.0:1746066794.188228:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882976999808:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066794.189469:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882976999040:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17437us (17643us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066794.189476:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6660 00002000:00100000:0.0:1746066794.189485:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e93ca80 x1830882976999040/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.189493:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93ca80 with x1830882976999040 ext(0->1048575) 00002000:00010000:0.0:1746066794.189497:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93ca80 00000100:00100000:0.0:1746066794.194711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.195437:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976999936 00000100:00100000:2.0:1746066794.195447:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976999936 00000100:00100000:2.0:1746066794.195499:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14714 00000100:00100000:2.0:1746066794.195505:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:31677:x1830882976999936:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066794.195523:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.195538:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e9ad expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.195560:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbf5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e959 expref: 21 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.195568:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13a00/0xfb36a14ee608bc03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e967 expref: 15 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.195574:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.195575:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.195578:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3858432->4194303] (req 3858432->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 21 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.195614:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13a00/0xfb36a14ee608bc03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e967 expref: 15 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.195625:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13a00/0xfb36a14ee608bc03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e967 expref: 15 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.195636:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976871808:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066794.195728:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e959 expref: 21 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.195735:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbf5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e959 expref: 21 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.195742:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f618e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976871936:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066794.195758:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acce3300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.200938:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976871808:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066794.200950:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f618e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976871936:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066794.200980:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3858432->4194303] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 21 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.200994:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f60f800, rc 0) 00000100:00100000:2.0:1746066794.201028:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:31677:x1830882976999936:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 5523us (6323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.201035:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14714 00000100:00100000:1.0:1746066794.203780:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+14:1965:x1830882976999296:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17811us (22942us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066794.203791:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6661 00002000:00100000:1.0:1746066794.203800:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e93dc00 x1830882976999296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.203815:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93dc00 with x1830882976999296 ext(1048576->2097151) 00002000:00010000:1.0:1746066794.203819:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93dc00 00000100:00100000:0.0:1746066794.206034:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.206467:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977000064 00000100:00100000:3.0:1746066794.206475:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977000064 00010000:00010000:3.0:1746066794.206504:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13a00/0xfb36a14ee608bc03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e967 expref: 14 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.206527:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7544 00000100:00100000:3.0:1746066794.206533:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977000064:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066794.206543:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066794.206559:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13a00/0xfb36a14ee608bc03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e967 expref: 14 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.206569:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13a00/0xfb36a14ee608bc03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e967 expref: 14 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.206587:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4e13a00/0xfb36a14ee608bc03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e967 expref: 14 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.206840:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066794.207402:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977000064:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 866us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.207409:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7544 00000100:00100000:3.0:1746066794.215170:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+11:1966:x1830882976999424:12345-192.168.202.57@tcp:3:cat.0 Request processed in 28028us (30113us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066794.215181:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6662 00002000:00100000:3.0:1746066794.215191:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009412b480 x1830882976999424/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.215199:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412b480 with x1830882976999424 ext(1048576->2097151) 00002000:00010000:3.0:1746066794.215204:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009412b480 00000100:00100000:2.0:1746066794.215353:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.215474:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977000192 00000100:00100000:3.0:1746066794.215480:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977000192 00010000:00010000:3.0:1746066794.215503:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbf5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e959 expref: 21 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.215522:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7545 00000100:00100000:3.0:1746066794.215527:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977000192:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066794.215537:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066794.215552:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbf5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e959 expref: 21 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.215562:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e959 expref: 21 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.215580:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf4c400/0xfb36a14ee608bbf5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e959 expref: 21 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.216255:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.216258:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.216266:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 20 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.216275:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 20 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.216303:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 20 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.216314:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976872064:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066794.216359:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.217478:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882976999808:12345-192.168.202.57@tcp:3:cat.0 Request processed in 29247us (31696us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746066794.217486:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6663 00002000:00100000:2.0:1746066794.217494:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x390:0x0] (1048576->1875967) req@ffff88009412aa00 x1830882976999808/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.217503:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412aa00 with x1830882976999808 ext(1048576->1875967) 00002000:00010000:2.0:1746066794.217507:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009412aa00 00000100:00100000:0.0:1746066794.221315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.221528:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977000448 00000100:00100000:2.0:1746066794.221536:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977000448 00002000:00100000:2.0:1746066794.221575:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3858432->3862527) req@ffff880135df9c00 x1830882977000448/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.221585:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9c00 with x1830882977000448 ext(3858432->3862527) 00002000:00010000:2.0:1746066794.221602:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135df9c00 00000100:00100000:2.0:1746066794.221622:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6664 00000100:00100000:3.0:1746066794.221697:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976872064:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066794.221712:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066794.221769:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977000192:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6241us (6416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.221777:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7545 00000100:00100000:2.0:1746066794.222037:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1966:x1830882977000448:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066794.223397:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1966:x1830882977000448:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 1765us (2086us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066794.223525:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6664 00002000:00100000:2.0:1746066794.223532:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3858432->3862527) req@ffff880135df9c00 x1830882977000448/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/4536 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.223541:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9c00 with x1830882977000448 ext(3858432->3862527) 00002000:00010000:2.0:1746066794.223544:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135df9c00 00000100:00100000:0.0:1746066794.228368:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066794.228449:0:9849:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746066794.228810:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977000704 00000100:00100000:2.0:1746066794.228818:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977000704 00002000:00100000:2.0:1746066794.228853:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880135dfa300 x1830882977000704/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 504/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.228861:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfa300 with x1830882977000704 ext(2097152->3145727) 00002000:00010000:2.0:1746066794.228866:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135dfa300 00000100:00100000:2.0:1746066794.228881:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6665 00000100:00100000:2.0:1746066794.228888:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977000704:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066794.229741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.233733:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977000832 00000100:00100000:2.0:1746066794.233744:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977000832 00000100:00100000:2.0:1746066794.233808:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14715 00000100:00100000:2.0:1746066794.233816:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:31677:x1830882977000832:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066794.233830:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.233846:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e9b4 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.233874:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.233881:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066794.233882:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066794.233885:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [4194304->4386815] (req 4194304->4386815) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.233912:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.233922:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 16 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.233932:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f618e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976872192:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066794.234380:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acce3300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.236236:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977000704:12345-192.168.202.57@tcp:3:cat.0 Request processed in 7343us (7869us total) trans 0 rc 626688/626688 00000100:00100000:2.0:1746066794.236245:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6665 00002000:00100000:2.0:1746066794.236254:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880135dfa300 x1830882977000704/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 504/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 626688/626688 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.236263:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfa300 with x1830882977000704 ext(2097152->3145727) 00010000:00010000:2.0:1746066794.236271:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 15 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.236287:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 15 pid: 10402 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746066794.236292:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135dfa300 00000100:00100000:2.0:1746066794.237488:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f618e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976872192:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066794.237510:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [4194304->4386815] (req 4194304->4386815) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.237524:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f60fe00, rc 0) 00000100:00100000:2.0:1746066794.237565:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31677:x1830882977000832:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3750us (7826us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.237572:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14715 00000100:00100000:0.0:1746066794.241364:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.241911:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.242141:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977000960 00000100:00100000:2.0:1746066794.242149:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977000960 00002000:00100000:2.0:1746066794.242185:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2633728->3055615) req@ffff880135df8380 x1830882977000960/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.242193:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df8380 with x1830882977000960 ext(2633728->3055615) 00010000:00010000:2.0:1746066794.242200:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 15 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.242211:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 15 pid: 10402 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746066794.242217:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135df8380 00000100:00100000:2.0:1746066794.242233:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2167 00000100:00100000:2.0:1746066794.242239:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977000960:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066794.242813:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977001088 00000100:00100000:3.0:1746066794.242818:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977001088 00000100:00100000:3.0:1746066794.242852:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14716 00000100:00100000:3.0:1746066794.242857:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:31680:x1830882977001088:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066794.242866:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.242878:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092590800/0xfb36a14ee608bc9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e9bb expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.242895:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 19 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.242901:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066794.242903:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066794.242906:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092590800/0xfb36a14ee608bc9d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9bb expref: 12 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.242930:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 19 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.242938:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 19 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.242948:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976872320:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066794.242994:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.246958:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.246983:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977001216 00000100:00100000:0.0:1746066794.246990:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977001216 00002000:00100000:0.0:1746066794.247025:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3858432->4194303) req@ffff880135dfbb80 x1830882977001216/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.247040:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfbb80 with x1830882977001216 ext(3858432->4194303) 00010000:00010000:0.0:1746066794.247049:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 20 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746066794.247059:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 20 pid: 10402 timeout: 855 lvb_type: 0 00002000:00010000:0.0:1746066794.247065:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135dfbb80 00000100:00100000:3.0:1746066794.247384:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976872320:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066794.247407:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092590800/0xfb36a14ee608bc9d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9bb expref: 12 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.247418:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092590800, rc 0) 00000100:00100000:3.0:1746066794.247455:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:31680:x1830882977001088:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4597us (5545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.247462:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14716 00000100:00100000:2.0:1746066794.249887:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977000960:12345-192.168.202.57@tcp:4:cat.0 Request processed in 7643us (8525us total) trans 17179873632 rc 0/0 00000100:00100000:2.0:1746066794.249896:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2167 00002000:00100000:2.0:1746066794.249905:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2633728->3055615) req@ffff880135df8380 x1830882977000960/t17179873632(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/448 e 0 to 0 dl 1746066805 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.249914:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df8380 with x1830882977000960 ext(2633728->3055615) 00010000:00010000:2.0:1746066794.249921:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 17 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.249932:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 17 pid: 10402 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746066794.249937:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135df8380 00000100:00100000:2.0:1746066794.249953:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2168 00000100:00100000:2.0:1746066794.249960:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977001216:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066794.255284:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.255360:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977001344 00000100:00100000:3.0:1746066794.255369:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977001344 00010000:00010000:3.0:1746066794.255398:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 17 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.255422:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7546 00000100:00100000:3.0:1746066794.255429:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977001344:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066794.255444:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066794.255461:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 17 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.255470:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 17 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.255490:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab79200/0xfb36a14ee608bc50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2633728->3055615) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e998 expref: 17 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.255517:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.255518:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.255524:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 24 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.255579:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 24 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.255614:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 24 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.255625:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976872448:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066794.255694:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.256511:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977001216:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 6551us (9560us total) trans 21474840950 rc 0/0 00000100:00100000:2.0:1746066794.256520:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2168 00002000:00100000:2.0:1746066794.256526:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3858432->4194303) req@ffff880135dfbb80 x1830882977001216/t21474840950(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/448 e 0 to 0 dl 1746066805 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.256534:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfbb80 with x1830882977001216 ext(3858432->4194303) 00010000:00010000:2.0:1746066794.256539:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 22 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.256549:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 22 pid: 10402 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746066794.256554:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135dfbb80 00000100:00100000:3.0:1746066794.257281:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976872448:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066794.257294:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066794.257326:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882977001344:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1897us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.257332:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7546 00000100:00100000:0.0:1746066794.258527:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.259045:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977001472 00000100:00100000:3.0:1746066794.259052:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977001472 00010000:00010000:3.0:1746066794.259074:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 22 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.259109:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7547 00000100:00100000:3.0:1746066794.259115:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977001472:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066794.259125:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066794.259130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066794.259142:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 22 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.259152:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 22 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.259203:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977001728 00000100:00100000:2.0:1746066794.259207:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977001728 00010000:00010000:3.0:1746066794.259227:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608bc8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ad expref: 22 pid: 10402 timeout: 855 lvb_type: 0 00002000:00100000:2.0:1746066794.259228:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (4382720->4386815) req@ffff880135dfad80 x1830882977001728/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.259235:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfad80 with x1830882977001728 ext(4382720->4386815) 00002000:00010000:2.0:1746066794.259238:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135dfad80 00010000:00010000:3.0:1746066794.259240:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.259242:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.259246:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092590800/0xfb36a14ee608bc9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9bb expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.259258:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6666 00010000:00010000:3.0:1746066794.259259:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092590800/0xfb36a14ee608bc9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9bb expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.259263:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977001728:12345-192.168.202.57@tcp:3:multiop.0 00010000:00010000:3.0:1746066794.259282:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092590800/0xfb36a14ee608bc9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9bb expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.259292:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976872576:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066794.259729:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.259733:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977001728:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 469us (601us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066794.259739:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6666 00002000:00100000:2.0:1746066794.259744:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (4382720->4386815) req@ffff880135dfad80 x1830882977001728/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/4536 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.259750:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfad80 with x1830882977001728 ext(4382720->4386815) 00002000:00010000:2.0:1746066794.259753:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135dfad80 00000100:00100000:0.0:1746066794.262164:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.262384:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977001984 00000100:00100000:2.0:1746066794.262390:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977001984 00000100:00100000:2.0:1746066794.262432:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4185 00000100:00100000:2.0:1746066794.262439:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31677:x1830882977001984:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066794.262626:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:31677:x1830882977001984:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 186us (467us total) trans 8589944080 rc 0/0 00000100:00100000:2.0:1746066794.262631:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4185 00000100:00100000:3.0:1746066794.262959:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976872576:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066794.262975:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066794.262998:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977001472:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3883us (4473us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.263004:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7547 00000100:00100000:0.0:1746066794.264292:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.264407:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977002240 00000100:00100000:2.0:1746066794.264412:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977002240 00002000:00100000:2.0:1746066794.264439:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880135dfb800 x1830882977002240/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.264447:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfb800 with x1830882977002240 ext(2097152->3145727) 00002000:00010000:2.0:1746066794.264451:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135dfb800 00000100:00100000:2.0:1746066794.264474:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6667 00000100:00100000:2.0:1746066794.264479:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977002240:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066794.274019:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977002240:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9531us (9722us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066794.274030:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6667 00002000:00100000:2.0:1746066794.274041:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880135dfb800 x1830882977002240/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.274049:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfb800 with x1830882977002240 ext(2097152->3145727) 00002000:00010000:2.0:1746066794.274054:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135dfb800 00000100:00100000:0.0:1746066794.277098:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.278358:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977002368 00000100:00100000:3.0:1746066794.278366:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977002368 00000100:00100000:3.0:1746066794.278471:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14717 00000100:00100000:3.0:1746066794.278480:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:31680:x1830882977002368:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066794.278496:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.278509:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092590200/0xfb36a14ee608bca4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e9c2 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.278531:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 24 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.278537:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066794.278539:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066794.278542:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092590200/0xfb36a14ee608bca4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c2 expref: 17 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.278567:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 24 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.278578:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 24 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.278588:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976872704:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066794.278937:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.279051:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.279104:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977002624 00000100:00100000:2.0:1746066794.279108:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977002624 00000100:00100000:2.0:1746066794.279145:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10018 00000100:00100000:2.0:1746066794.279151:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:31685:x1830882977002624:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066794.279163:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.279173:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099014800/0xfb36a14ee608bcab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e9c9 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.279242:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099015400/0xfb36a14ee608bcb2 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.279253:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099015400/0xfb36a14ee608bcb2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066794.279261:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099015400/0xfb36a14ee608bcb2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:2.0:1746066794.279270:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066794.279362:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099014800/0xfb36a14ee608bcab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c9 expref: 259 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.279386:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099015400/0xfb36a14ee608bcb2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c9 expref: 258 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.279392:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066794.279395:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746066794.279397:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099015400, rc 0) 00000100:00100000:2.0:1746066794.279422:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+258:31685:x1830882977002624:12345-192.168.202.57@tcp:101:cat.0 Request processed in 271us (371us total) trans 8589944081 rc 0/0 00000100:00100000:2.0:1746066794.279428:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10018 00000100:00100000:3.0:1746066794.280239:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976872704:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066794.280255:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092590200/0xfb36a14ee608bca4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c2 expref: 17 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.280264:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092590200, rc 0) 00000100:00100000:3.0:1746066794.280283:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:31680:x1830882977002368:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1806us (3193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.280288:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14717 00000100:00100000:0.0:1746066794.280767:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.280907:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977002752 00000100:00100000:2.0:1746066794.280911:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977002752 00002000:00100000:2.0:1746066794.280934:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4386815) req@ffff880135431c00 x1830882977002752/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.280942:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135431c00 with x1830882977002752 ext(4194304->4386815) 00010000:00010000:2.0:1746066794.280947:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 25 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.280958:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 25 pid: 10402 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746066794.280964:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135431c00 00000100:00100000:2.0:1746066794.281167:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2169 00000100:00100000:2.0:1746066794.281173:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882977002752:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066794.281743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.281983:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977002880 00000100:00100000:3.0:1746066794.281987:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977002880 00000100:00100000:3.0:1746066794.282006:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14718 00000100:00100000:3.0:1746066794.282011:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977002880:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066794.282019:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.282029:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092591800/0xfb36a14ee608bcc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e9d0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066794.282047:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.282065:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977003008 00000100:00100000:3.0:1746066794.282067:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977003008 00000100:00100000:0.0:1746066794.282075:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.282079:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977003136 00000100:00100000:3.0:1746066794.282081:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977003136 00000100:00100000:3.0:1746066794.282093:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14719 00000100:00100000:3.0:1746066794.282096:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977003008:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066794.282101:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.282106:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092590000/0xfb36a14ee608bcc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e9d7 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.282127:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976872832:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066794.282165:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066794.282180:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14720 00000100:00100000:3.0:1746066794.282185:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977003136:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066794.282191:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.282199:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092591400/0xfb36a14ee608bcce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e9de expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.282209:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.282210:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.282894:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092591400/0xfb36a14ee608bcce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9de expref: 22 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.282911:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092591400/0xfb36a14ee608bcce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9de expref: 22 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.282923:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092591400, rc 0) 00000100:00100000:3.0:1746066794.282942:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977003136:12345-192.168.202.57@tcp:101:cat.0 Request processed in 757us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.282947:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14720 00000100:00100000:3.0:1746066794.282967:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976872960:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066794.283539:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.285433:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1965:x1830882977002752:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 4252us (4659us total) trans 17179873633 rc 0/0 00000100:00100000:2.0:1746066794.285442:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2169 00002000:00100000:2.0:1746066794.285451:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4386815) req@ffff880135431c00 x1830882977002752/t17179873633(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/448 e 0 to 0 dl 1746066805 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.285460:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135431c00 with x1830882977002752 ext(4194304->4386815) 00010000:00010000:2.0:1746066794.285468:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 31 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.285481:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 31 pid: 10402 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746066794.285486:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135431c00 00002000:00010000:2.0:1746066794.287826:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime: 1746066793 -> 1746066794 00000100:00100000:2.0:1746066794.287847:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976872960:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066794.287873:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092591800/0xfb36a14ee608bcc0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9d0 expref: 30 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.287890:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092591800/0xfb36a14ee608bcc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9d0 expref: 30 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.287898:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092591800, rc 0) 00000100:00100000:2.0:1746066794.287932:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977002880:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5919us (6193us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066794.287939:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14718 00000100:00100000:3.0:1746066794.289050:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976872832:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066794.289066:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092590000/0xfb36a14ee608bcc7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9d7 expref: 28 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.289074:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092590000/0xfb36a14ee608bcc7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9d7 expref: 28 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.289092:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092590000, rc 0) 00000100:00100000:3.0:1746066794.289118:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977003008:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7020us (7070us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066794.289124:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14719 00000100:00100000:0.0:1746066794.289473:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.289562:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977003264 00000100:00100000:3.0:1746066794.289567:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977003264 00010000:00010000:3.0:1746066794.289585:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 27 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.289618:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7548 00000100:00100000:3.0:1746066794.289624:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977003264:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066794.289635:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066794.289643:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 27 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.289652:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 27 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.289667:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608bc96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9b4 expref: 27 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.289693:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.289695:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.289700:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092590200/0xfb36a14ee608bca4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c2 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.289708:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092590200/0xfb36a14ee608bca4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c2 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.289730:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092590200/0xfb36a14ee608bca4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c2 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.289739:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976873088:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066794.289794:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.303570:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.303618:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.303643:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.303718:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977003776 00000100:00100000:2.0:1746066794.303719:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977004032 00000100:00100000:2.0:1746066794.303725:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977004032 00000100:00100000:0.0:1746066794.303725:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977003776 00002000:00100000:2.0:1746066794.303760:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e841500 x1830882977004032/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.303760:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135430a80 x1830882977003776/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.303769:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e841500 with x1830882977004032 ext(3145728->4194303) 00002000:00010000:2.0:1746066794.303773:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e841500 00002000:00100000:0.0:1746066794.303774:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135430a80 with x1830882977003776 ext(3145728->4194303) 00002000:00010000:0.0:1746066794.303776:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135430a80 00000100:00100000:2.0:1746066794.303800:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977003520 00000100:00100000:2.0:1746066794.303802:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977003520 00000100:00100000:0.0:1746066794.303803:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6668 00000100:00100000:0.0:1746066794.303810:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882977004032:12345-192.168.202.57@tcp:3:cat.0 00002000:00100000:2.0:1746066794.303812:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e843100 x1830882977003520/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.303817:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e843100 with x1830882977003520 ext(0->1048575) 00002000:00010000:2.0:1746066794.303820:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e843100 00000100:00100000:2.0:1746066794.303834:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6669 00000100:00100000:2.0:1746066794.303837:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977003776:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066794.304145:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6670 00000100:00100000:3.0:1746066794.304153:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1966:x1830882977003520:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066794.304759:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.304772:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977004288 00000100:00100000:1.0:1746066794.304775:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977004288 00000100:00100000:0.0:1746066794.304781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:1.0:1746066794.304791:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880094128380 x1830882977004288/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.304796:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094128380 with x1830882977004288 ext(1048576->2097151) 00002000:00010000:1.0:1746066794.304799:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094128380 00000100:00100000:1.0:1746066794.304808:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977004544 00000100:00100000:1.0:1746066794.304810:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977004544 00002000:00100000:1.0:1746066794.304818:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009e842300 x1830882977004544/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.304824:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e842300 with x1830882977004544 ext(1048576->2097151) 00002000:00010000:1.0:1746066794.304826:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e842300 00000100:00100000:1.0:1746066794.304834:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6671 00000100:00100000:1.0:1746066794.304839:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1966:x1830882977004288:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066794.304842:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6672 00000100:00100000:0.0:1746066794.304848:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1966:x1830882977004544:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066794.305530:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976873088:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066794.305545:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066794.305567:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977003264:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 15943us (16094us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.305575:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7548 00000100:00100000:1.0:1746066794.316006:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882977004032:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12188us (12379us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066794.316017:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6668 00002000:00100000:1.0:1746066794.316026:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e841500 x1830882977004032/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.316035:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e841500 with x1830882977004032 ext(3145728->4194303) 00002000:00010000:1.0:1746066794.316041:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e841500 00000100:00100000:3.0:1746066794.320385:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1966:x1830882977003520:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16226us (16733us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066794.320396:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6670 00002000:00100000:3.0:1746066794.320405:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e843100 x1830882977003520/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.320413:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e843100 with x1830882977003520 ext(0->1048575) 00002000:00010000:3.0:1746066794.320418:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e843100 00000100:00100000:1.0:1746066794.326652:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1966:x1830882977004288:12345-192.168.202.57@tcp:3:cat.0 Request processed in 21803us (21884us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066794.326664:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6671 00002000:00100000:1.0:1746066794.326687:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880094128380 x1830882977004288/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.326697:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094128380 with x1830882977004288 ext(1048576->2097151) 00002000:00010000:1.0:1746066794.326702:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094128380 00000100:00100000:2.0:1746066794.334538:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977004544:12345-192.168.202.57@tcp:3:cat.0 Request processed in 29683us (29748us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066794.334549:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6672 00002000:00100000:2.0:1746066794.334560:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009e842300 x1830882977004544/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.334568:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e842300 with x1830882977004544 ext(1048576->2097151) 00002000:00010000:2.0:1746066794.334573:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e842300 00000100:00100000:2.0:1746066794.337171:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977003776:12345-192.168.202.57@tcp:3:cat.0 Request processed in 33324us (33600us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066794.337181:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6669 00002000:00100000:2.0:1746066794.337191:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135430a80 x1830882977003776/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.337200:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135430a80 with x1830882977003776 ext(3145728->4194303) 00002000:00010000:2.0:1746066794.337205:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135430a80 00000100:00100000:0.0:1746066794.347523:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.347572:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.347935:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977004800 00000100:00100000:3.0:1746066794.347944:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977004800 00000100:00100000:3.0:1746066794.347992:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14721 00000100:00100000:3.0:1746066794.348000:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31685:x1830882977004800:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066794.348015:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.348030:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092590600/0xfb36a14ee608bcd5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e9e5 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.348055:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 16 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.348062:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066794.348064:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066794.348067:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092590600/0xfb36a14ee608bcd5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9e5 expref: 27 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.348097:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 16 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.348109:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 16 pid: 8452 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.348119:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976873216:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066794.348201:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.349619:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977004928 00000100:00100000:2.0:1746066794.349626:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977004928 00002000:00100000:2.0:1746066794.349655:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e840380 x1830882977004928/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.349664:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e840380 with x1830882977004928 ext(4194304->5091327) 00002000:00010000:2.0:1746066794.349667:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e840380 00000100:00100000:0.0:1746066794.349695:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6673 00000100:00100000:0.0:1746066794.349703:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977004928:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066794.350801:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976873216:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066794.350822:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092590600/0xfb36a14ee608bcd5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9e5 expref: 27 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.350834:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092590600, rc 0) 00000100:00100000:3.0:1746066794.350857:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:31685:x1830882977004800:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2858us (3341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.350863:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14721 00000100:00100000:0.0:1746066794.357747:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.357809:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977005056 00000100:00100000:2.0:1746066794.357818:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977005056 00002000:00100000:2.0:1746066794.357852:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x390:0x0] (1875968->2097151) req@ffff88009e840700 x1830882977005056/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.357862:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e840700 with x1830882977005056 ext(1875968->2097151) 00010000:00010000:2.0:1746066794.357869:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 19 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.357885:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 19 pid: 8452 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746066794.357891:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e840700 00000100:00100000:2.0:1746066794.357912:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2170 00000100:00100000:2.0:1746066794.357918:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977005056:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066794.358600:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882977004928:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8887us (11016us total) trans 0 rc 897024/897024 00000100:00100000:0.0:1746066794.358609:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6673 00002000:00100000:0.0:1746066794.358741:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e840380 x1830882977004928/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.358748:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e840380 with x1830882977004928 ext(4194304->5091327) 00002000:00010000:0.0:1746066794.358751:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e840380 00000100:00100000:2.0:1746066794.364261:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977005056:12345-192.168.202.57@tcp:4:cat.0 Request processed in 6333us (6514us total) trans 17179873634 rc 0/0 00000100:00100000:2.0:1746066794.364274:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2170 00002000:00100000:2.0:1746066794.364284:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x390:0x0] (1875968->2097151) req@ffff88009e840700 x1830882977005056/t17179873634(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/448 e 0 to 0 dl 1746066805 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.364293:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e840700 with x1830882977005056 ext(1875968->2097151) 00010000:00010000:2.0:1746066794.364302:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 19 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.364316:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 19 pid: 8452 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746066794.364322:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e840700 00000100:00100000:0.0:1746066794.367371:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.367413:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.367495:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.367721:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977005312 00000100:00100000:2.0:1746066794.367728:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977005312 00010000:00010000:2.0:1746066794.367758:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 19 pid: 8452 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.367863:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977005184 00000100:00100000:3.0:1746066794.367867:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977005184 00000100:00100000:3.0:1746066794.367889:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14722 00000100:00100000:3.0:1746066794.367895:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977005184:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066794.367908:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.367919:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092591600/0xfb36a14ee608bcdc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e9ec expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.367962:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976873344:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066794.368015:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066794.369047:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977005440 00000100:00100000:1.0:1746066794.369052:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977005440 00000100:00100000:1.0:1746066794.369089:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10019 00000100:00100000:1.0:1746066794.369094:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:31686:x1830882977005440:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:2.0:1746066794.369105:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7549 00010000:00010000:1.0:1746066794.369107:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066794.369110:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977005312:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066794.369116:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7c00/0xfb36a14ee608bce3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e9f3 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.369119:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066794.369136:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 21 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.369146:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 21 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.369155:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bcea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066794.369161:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.369163:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.369164:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bcea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066794.369168:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092590600/0xfb36a14ee608bcd5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9e5 expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.369171:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bcea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066794.369174:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092590600/0xfb36a14ee608bcd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9e5 expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.369182:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bcf1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369187:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bcf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066794.369192:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092590600/0xfb36a14ee608bcd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9e5 expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.369192:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bcf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746066794.369200:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f618e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976873472:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066794.369237:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acce39c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066794.369277:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bcf8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369284:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bcf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369290:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bcf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066794.369613:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:1.0:1746066794.369617:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746066794.369630:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bcf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369638:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bcf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369645:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bcea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369650:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bcea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369654:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bcea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369659:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931e6a00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066794.369662:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bcea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369668:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bcea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369695:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066794.369698:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066794.369701:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bcea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369705:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bcea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369726:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bcf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369731:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bcf1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369734:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bcf1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369738:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931e6400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066794.369739:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bcf1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369743:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bcf1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369748:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b6da00) 00010000:00010000:1.0:1746066794.369749:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066794.369751:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bcf1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369754:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bcf1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.369776:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7c00/0xfb36a14ee608bce3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9f3 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.369790:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bcf8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9f3 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.369796:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066794.369798:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066794.369800:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931e7a00, rc 0) 00000100:00100000:1.0:1746066794.369832:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31686:x1830882977005440:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 737us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.369838:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10019 00000100:00100000:2.0:1746066794.371299:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f618e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976873472:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066794.371316:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066794.371342:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977005312:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2231us (3928us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.371349:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7549 00010000:00010000:3.0:1746066794.371495:0:4614:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.57@tcp) returned -22 from glimpse AST (req@ffff88009a0d3480 x1830882976873344) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 20 pid: 8452 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.371522:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac47000/0xfb36a14ee608bbd2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e93d expref: 20 pid: 8452 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.371549:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976873344:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066794.371567:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092591600/0xfb36a14ee608bcdc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ec expref: 19 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.371576:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092591600/0xfb36a14ee608bcdc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9ec expref: 19 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.371582:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092591600, rc 0) 00000100:00100000:3.0:1746066794.371614:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977005184:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3719us (4250us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066794.371620:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14722 00000100:00100000:3.0:1746066794.375022:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.376370:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.376402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.376420:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977005568 00000100:00100000:3.0:1746066794.376428:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977005568 00000100:00100000:3.0:1746066794.376460:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977005696 00000100:00100000:3.0:1746066794.376462:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977005696 00000100:00100000:3.0:1746066794.376487:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977005824 00000100:00100000:3.0:1746066794.376489:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977005824 00000100:00100000:3.0:1746066794.376501:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14723 00000100:00100000:3.0:1746066794.376508:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977005568:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066794.376521:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.376535:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092590000/0xfb36a14ee608bcff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97e9fa expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.376553:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.376555:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.376562:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092590000/0xfb36a14ee608bcff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9fa expref: 9 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.376575:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092590000/0xfb36a14ee608bcff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9fa expref: 9 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.376585:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092590000, rc 0) 00000100:00100000:1.0:1746066794.376688:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14724 00000100:00100000:1.0:1746066794.376696:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977005696:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066794.376703:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.376712:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931e6c00/0xfb36a14ee608bd06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea01 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.376722:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.376723:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.376728:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931e6c00/0xfb36a14ee608bd06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea01 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066794.376729:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14725 00000100:00100000:2.0:1746066794.376737:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977005824:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066794.376738:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931e6c00/0xfb36a14ee608bd06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea01 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.376744:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931e6c00, rc 0) 00010000:00010000:2.0:1746066794.376745:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.376752:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b4b9a00/0xfb36a14ee608bd0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea08 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.376762:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.376764:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.376768:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b4b9a00/0xfb36a14ee608bd0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea08 expref: 11 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.376782:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b4b9a00/0xfb36a14ee608bd0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea08 expref: 11 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.376789:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b4b9a00, rc 0) 00000100:00100000:3.0:1746066794.376985:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977005568:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 476us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.376991:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14723 00000100:00100000:2.0:1746066794.377033:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977005824:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 295us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.377038:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14725 00000100:00100000:1.0:1746066794.377254:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977005696:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 559us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.377262:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14724 00000100:00100000:3.0:1746066794.377316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.377356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.377381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.377418:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977005952 00000100:00100000:2.0:1746066794.377422:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977005952 00000100:00100000:2.0:1746066794.377439:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977006080 00000100:00100000:2.0:1746066794.377441:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977006080 00000100:00100000:2.0:1746066794.377467:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977006208 00000100:00100000:2.0:1746066794.377469:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977006208 00000100:00100000:2.0:1746066794.377490:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14726 00000100:00100000:2.0:1746066794.377495:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977005952:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:0.0:1746066794.377499:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14727 00010000:00010000:2.0:1746066794.377502:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066794.377506:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977006080:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066794.377508:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8800/0xfb36a14ee608bd14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea0f expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.377512:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.377518:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ff41c00/0xfb36a14ee608bd1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea16 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.377519:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.377520:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.377524:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8800/0xfb36a14ee608bd14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea0f expref: 12 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.377527:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.377528:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.377532:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff41c00/0xfb36a14ee608bd1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea16 expref: 12 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.377533:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8800/0xfb36a14ee608bd14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea0f expref: 12 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.377540:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b4b8800, rc 0) 00010000:00010000:0.0:1746066794.377540:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ff41c00/0xfb36a14ee608bd1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea16 expref: 12 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.377546:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff41c00, rc 0) 00000100:00100000:2.0:1746066794.377559:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977005952:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 64us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.377560:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882977006080:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 56us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.377565:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14726 00000100:00100000:0.0:1746066794.377568:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14727 00000100:00100000:2.0:1746066794.377576:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14728 00000100:00100000:2.0:1746066794.377581:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977006208:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066794.377586:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.377603:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b4b8400/0xfb36a14ee608bd22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea1d expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.377613:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.377614:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746066794.377617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066794.377618:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b4b8400/0xfb36a14ee608bd22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea1d expref: 11 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.377638:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b4b8400/0xfb36a14ee608bd22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea1d expref: 11 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.377645:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b4b8400, rc 0) 00000100:00100000:2.0:1746066794.377661:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977006208:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.377666:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14728 00000100:00100000:2.0:1746066794.378073:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977006464 00000100:00100000:2.0:1746066794.378077:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977006464 00002000:00100000:2.0:1746066794.378099:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88008efb5180 x1830882977006464/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.378108:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb5180 with x1830882977006464 ext(1048576->2097151) 00002000:00010000:2.0:1746066794.378112:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb5180 00000100:00100000:2.0:1746066794.378124:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6674 00000100:00100000:2.0:1746066794.378129:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977006464:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066794.379251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.379265:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977006592 00000100:00100000:3.0:1746066794.379268:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977006592 00000100:00100000:3.0:1746066794.379288:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14729 00000100:00100000:3.0:1746066794.379293:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977006592:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066794.379300:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.379309:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092590400/0xfb36a14ee608bd29 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea24 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.379320:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.379322:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.379326:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092590400/0xfb36a14ee608bd29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea24 expref: 19 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.379336:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092590400/0xfb36a14ee608bd29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea24 expref: 19 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.379343:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092590400, rc 0) 00000100:00100000:3.0:1746066794.379380:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882977006592:12345-192.168.202.57@tcp:101:cat.0 Request processed in 86us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.379385:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14729 00000100:00100000:0.0:1746066794.384280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.384462:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977006848 00000100:00100000:1.0:1746066794.384469:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977006848 00000100:00100000:1.0:1746066794.384509:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10020 00000100:00100000:1.0:1746066794.384516:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31686:x1830882977006848:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066794.384532:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.384546:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea2b expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.384631:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.384644:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57c6000/0xfb36a14ee608bc42 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e991 expref: 14 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.384652:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608bc6c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e99f expref: 257 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.384658:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bcf8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9f3 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.384664:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.384704:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bcf8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9f3 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.384714:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bcf8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9f3 expref: 8 pid: 14548 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.384729:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094129180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976873600:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066794.384815:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608bc6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e99f expref: 257 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.384823:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608bc6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e99f expref: 257 pid: 14548 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.384830:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094129880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976873728:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066794.384854:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57c6000/0xfb36a14ee608bc42 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e991 expref: 14 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.384861:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57c6000/0xfb36a14ee608bc42 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e991 expref: 14 pid: 20127 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.384868:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976873856:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066794.384883:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.388878:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.389231:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.389252:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977007232 00000100:00100000:2.0:1746066794.389258:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977007232 00010000:00010000:2.0:1746066794.389285:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bcf8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9f3 expref: 9 pid: 14548 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.389455:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094129180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976873600:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066794.389465:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094129880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976873728:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066794.389472:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976873856:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066794.389491:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746066794.389532:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977007104 00000100:00100000:3.0:1746066794.389535:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977007104 00000100:00100000:3.0:1746066794.389567:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10021 00000100:00100000:3.0:1746066794.389573:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:31690:x1830882977007104:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066794.389602:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.389615:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092591c00/0xfb36a14ee608bd3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea32 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.389713:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066794.389727:0:20127:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066794.389733:0:20127:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000100:00100000:2.0:1746066794.390101:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7550 00000100:00100000:2.0:1746066794.390107:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977007232:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066794.390115:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066794.390120:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bcf8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9f3 expref: 9 pid: 14548 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.390133:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bcf8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9f3 expref: 9 pid: 14548 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.390147:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bcf8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9f3 expref: 9 pid: 14548 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.390170:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066794.390173:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066794.390178:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066794.390182:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066794.390218:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977007232:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 111us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.390224:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7550 00000100:00100000:0.0:1746066794.390406:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.390474:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.390556:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977007360 00000100:00100000:3.0:1746066794.390559:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977007360 00010000:00010000:3.0:1746066794.390574:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608bc6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e99f expref: 258 pid: 14548 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.390597:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977007488 00000100:00100000:3.0:1746066794.390599:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977007488 00010000:00010000:3.0:1746066794.390608:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57c6000/0xfb36a14ee608bc42 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e991 expref: 17 pid: 20127 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.390620:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7551 00000100:00100000:3.0:1746066794.390624:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+258:1963:x1830882977007360:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066794.390630:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066794.390633:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608bc6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e99f expref: 258 pid: 14548 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.390640:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608bc6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e99f expref: 258 pid: 14548 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.390650:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608bc6c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e99f expref: 258 pid: 14548 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.390661:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066794.390664:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066794.390669:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066794.390672:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066794.390702:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:1963:x1830882977007360:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 77us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.390706:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7551 00000100:00100000:3.0:1746066794.390715:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7552 00000100:00100000:3.0:1746066794.390718:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977007488:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066794.390723:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066794.390726:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57c6000/0xfb36a14ee608bc42 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e991 expref: 17 pid: 20127 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.390733:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57c6000/0xfb36a14ee608bc42 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e991 expref: 17 pid: 20127 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.390741:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57c6000/0xfb36a14ee608bc42 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e991 expref: 17 pid: 20127 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.390748:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066794.390750:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066794.390756:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066794.390761:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066794.390767:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066794.390772:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066794.390777:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066794.390790:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066794.390804:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977007488:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 85us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.390809:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7552 00010000:00010000:3.0:1746066794.390843:0:20127:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066794.390847:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:3.0:1746066794.390857:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066794.390946:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092591c00/0xfb36a14ee608bd3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea32 expref: 17 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.390956:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea32 expref: 16 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.390961:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066794.390963:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066794.390965:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092591800, rc 0) 00000100:00100000:3.0:1746066794.390984:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:31690:x1830882977007104:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 1411us (2111us total) trans 8589944082 rc 0/0 00000100:00100000:3.0:1746066794.390989:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10021 00010000:00010000:1.0:1746066794.391089:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.391097:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066794.391107:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066794.391152:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea2b expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.391163:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea2b expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.391168:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066794.391169:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066794.391171:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931e6a00, rc 0) 00000100:00100000:1.0:1746066794.391197:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31686:x1830882977006848:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 6683us (6925us total) trans 8589944083 rc 0/0 00000100:00100000:1.0:1746066794.391201:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10020 00000100:00100000:2.0:1746066794.391242:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977006464:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13112us (13625us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066794.391248:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6674 00002000:00100000:2.0:1746066794.391256:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88008efb5180 x1830882977006464/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.391263:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb5180 with x1830882977006464 ext(1048576->2097151) 00002000:00010000:2.0:1746066794.391267:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb5180 00000100:00100000:0.0:1746066794.402486:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.402603:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.402634:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.403011:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977008000 00000100:00100000:1.0:1746066794.403019:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977008000 00000100:00100000:1.0:1746066794.403060:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977007744 00000100:00100000:1.0:1746066794.403062:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977007744 00000100:00100000:1.0:1746066794.403079:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10022 00000100:00100000:1.0:1746066794.403084:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:31688:x1830882977008000:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066794.403104:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.403119:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1600/0xfb36a14ee608bd5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea47 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.403208:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1000/0xfb36a14ee608bd61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403222:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1000/0xfb36a14ee608bd61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403230:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1000/0xfb36a14ee608bd61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403242:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1400/0xfb36a14ee608bd68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403247:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1400/0xfb36a14ee608bd68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403251:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1400/0xfb36a14ee608bd68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403335:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0a00/0xfb36a14ee608bd6f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403342:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0a00/0xfb36a14ee608bd6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403348:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0a00/0xfb36a14ee608bd6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066794.403355:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066794.403420:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1000/0xfb36a14ee608bd61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403426:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1000/0xfb36a14ee608bd61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403431:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1000/0xfb36a14ee608bd61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403439:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dee1000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066794.403443:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1000/0xfb36a14ee608bd61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403448:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1000/0xfb36a14ee608bd61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403456:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066794.403458:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066794.403462:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1000/0xfb36a14ee608bd61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403467:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1000/0xfb36a14ee608bd61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403481:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1400/0xfb36a14ee608bd68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403486:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1400/0xfb36a14ee608bd68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403490:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1400/0xfb36a14ee608bd68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403494:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dee1400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066794.403496:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1400/0xfb36a14ee608bd68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403500:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1400/0xfb36a14ee608bd68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403505:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a523fa00) 00010000:00010000:1.0:1746066794.403507:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066794.403509:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1400/0xfb36a14ee608bd68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066794.403513:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1400/0xfb36a14ee608bd68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746066794.403549:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10023 00000100:00100000:1.0:1746066794.403555:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31686:x1830882977007744:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066794.403563:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.403575:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bd7d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea40 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.403626:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.403635:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea2b expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.403642:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea32 expref: 15 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.403647:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.403671:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea32 expref: 15 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.403703:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea32 expref: 15 pid: 20127 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.403714:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976873984:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066794.403730:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977007616 00000100:00100000:3.0:1746066794.403737:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977007616 00000100:00100000:3.0:1746066794.403770:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14730 00000100:00100000:3.0:1746066794.403778:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:31685:x1830882977007616:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066794.403785:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea2b expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.403788:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.403792:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea2b expref: 9 pid: 14548 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.403799:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092591000/0xfb36a14ee608bd8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea39 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066794.403803:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094129880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976874112:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066794.403817:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.403819:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066794.403822:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746066794.403827:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092591000/0xfb36a14ee608bd8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea39 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.403839:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092591000/0xfb36a14ee608bd8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea39 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.403848:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092591000, rc 0) 00010000:00010000:1.0:1746066794.403850:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1600/0xfb36a14ee608bd5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea47 expref: 260 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.403860:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0a00/0xfb36a14ee608bd6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea47 expref: 259 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.403865:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066794.403867:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066794.403869:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.403875:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.403878:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee0a00, rc 0) 00000100:00100000:3.0:1746066794.403879:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31685:x1830882977007616:12345-192.168.202.57@tcp:101:cat.0 Request processed in 101us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.403884:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14730 00000100:00100000:1.0:1746066794.403897:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:31688:x1830882977008000:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 813us (1294us total) trans 8589944084 rc 0/0 00000100:00100000:1.0:1746066794.403902:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10022 00000100:00100000:0.0:1746066794.413245:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.413287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.413417:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976873984:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066794.413432:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094129880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976874112:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066794.413458:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746066794.413488:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977008256 00000100:00100000:1.0:1746066794.413495:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977008256 00010000:00010000:1.0:1746066794.413526:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea2b expref: 10 pid: 14548 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.413566:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977008128 00000100:00100000:1.0:1746066794.413569:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977008128 00010000:00010000:1.0:1746066794.413578:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea32 expref: 16 pid: 20127 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.413587:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7553 00000100:00100000:2.0:1746066794.413608:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1965:x1830882977008256:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066794.413621:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066794.413626:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea2b expref: 10 pid: 14548 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.413634:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea2b expref: 10 pid: 14548 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.413642:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7554 00000100:00100000:1.0:1746066794.413646:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882977008128:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066794.413651:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066794.413652:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd37 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea2b expref: 10 pid: 14548 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.413654:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea32 expref: 16 pid: 20127 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.413661:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea32 expref: 16 pid: 20127 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.413671:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092591800/0xfb36a14ee608bd45 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea32 expref: 16 pid: 20127 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.413690:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066794.413694:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066794.413705:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066794.413713:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.416846:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066794.416856:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066794.416908:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882977008128:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3257us (3617us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.416921:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7554 00010000:00010000:2.0:1746066794.416929:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066794.416947:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1965:x1830882977008256:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3342us (3713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.416953:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7553 00010000:00010000:0.0:1746066794.417002:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066794.417010:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746066794.417053:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:0.0:1746066794.417056:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746066794.417069:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066794.417099:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7a00/0xfb36a14ee608bd7d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea40 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.417129:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea40 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.417135:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066794.417138:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066794.417140:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931e6400, rc 0) 00000100:00100000:0.0:1746066794.417893:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31686:x1830882977007744:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 14336us (15256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.417898:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10023 00000100:00100000:0.0:1746066794.422036:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.422131:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977008512 00000100:00100000:1.0:1746066794.422138:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977008512 00000100:00100000:1.0:1746066794.422176:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10024 00000100:00100000:1.0:1746066794.422183:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ad0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31686:x1830882977008512:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066794.422199:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.422215:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd92 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea4e expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.422289:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7c00/0xfb36a14ee608bd99 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.422301:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7c00/0xfb36a14ee608bd99 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.422309:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7c00/0xfb36a14ee608bd99 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.422318:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7c00/0xfb36a14ee608bd99 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.422323:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7c00/0xfb36a14ee608bd99 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.422329:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7c00/0xfb36a14ee608bd99 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.422333:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931e7c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066794.422336:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7c00/0xfb36a14ee608bd99 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.422345:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7c00/0xfb36a14ee608bd99 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.422353:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066794.422356:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066794.422359:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7c00/0xfb36a14ee608bd99 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.422363:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e7c00/0xfb36a14ee608bd99 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066794.422385:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd92 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea4e expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.422391:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6a00/0xfb36a14ee608bd92 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea4e expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.422398:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931e6a00, rc 0) 00000100:00100000:1.0:1746066794.422447:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ad0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31686:x1830882977008512:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 264us (419us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066794.422452:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10024 00000100:00100000:0.0:1746066794.429770:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.429840:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977008768 00000100:00100000:2.0:1746066794.429847:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977008768 00000100:00100000:2.0:1746066794.429886:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4186 00000100:00100000:2.0:1746066794.429894:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31686:x1830882977008768:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:2.0:1746066794.430070:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31686:x1830882977008768:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 176us (308us total) trans 8589944085 rc 0/0 00000100:00100000:2.0:1746066794.430076:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4186 00000100:00100000:0.0:1746066794.441922:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.441957:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.441979:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977009152 00000100:00100000:2.0:1746066794.441986:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977009152 00002000:00100000:2.0:1746066794.442022:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009bb2ea00 x1830882977009152/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066794.442031:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:2.0:1746066794.442032:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ea00 with x1830882977009152 ext(3145728->4194303) 00002000:00010000:2.0:1746066794.442036:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2ea00 00000100:00100000:2.0:1746066794.442050:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977009024 00000100:00100000:2.0:1746066794.442052:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977009024 00002000:00100000:2.0:1746066794.442062:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009bb2e300 x1830882977009024/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.442068:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2e300 with x1830882977009024 ext(2097152->3145727) 00002000:00010000:2.0:1746066794.442070:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2e300 00000100:00100000:1.0:1746066794.442174:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977009408 00000100:00100000:1.0:1746066794.442178:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977009408 00000100:00100000:1.0:1746066794.442215:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14731 00000100:00100000:1.0:1746066794.442223:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:31688:x1830882977009408:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066794.442236:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.442251:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea55 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.442282:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f161600/0xfb36a14ee608baf2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8aa expref: 18 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.442288:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092590000/0xfb36a14ee608bcff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9fa expref: 10 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.442293:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ef93600/0xfb36a14ee608bb38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8cd expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.442298:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.442300:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.442302:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [675840->974847] (req 675840->974847) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 31 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.442327:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ef93600/0xfb36a14ee608bb38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8cd expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.442337:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ef93600/0xfb36a14ee608bb38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8cd expref: 31 pid: 21203 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.442346:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009412ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976874240:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066794.442411:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092590000/0xfb36a14ee608bcff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9fa expref: 10 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.442418:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092590000/0xfb36a14ee608bcff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9fa expref: 10 pid: 20532 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746066794.442430:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009412b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976874368:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066794.442453:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f161600/0xfb36a14ee608baf2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8aa expref: 18 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.442460:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f161600/0xfb36a14ee608baf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8aa expref: 18 pid: 21203 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.442466:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094128e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976874496:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066794.442481:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.442553:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6675 00000100:00100000:0.0:1746066794.442560:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977009152:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066794.442562:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6676 00000100:00100000:2.0:1746066794.442566:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882977009024:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066794.453173:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.454799:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009412ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976874240:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066794.454885:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977009664 00000100:00100000:3.0:1746066794.454892:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977009664 00002000:00100000:3.0:1746066794.454929:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800924d0a80 x1830882977009664/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.454938:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d0a80 with x1830882977009664 ext(2097152->3145727) 00002000:00010000:3.0:1746066794.454943:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d0a80 00000100:00100000:3.0:1746066794.454973:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6677 00000100:00100000:3.0:1746066794.454980:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977009664:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066794.460641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.460661:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.460705:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977010176 00000100:00100000:1.0:1746066794.460712:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977010176 00010000:00010000:1.0:1746066794.460743:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092590000/0xfb36a14ee608bcff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9fa expref: 11 pid: 20532 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746066794.460766:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977010048 00000100:00100000:1.0:1746066794.460768:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977010048 00010000:00010000:1.0:1746066794.460777:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef93600/0xfb36a14ee608bb38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8cd expref: 34 pid: 21203 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.460790:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7555 00000100:00100000:1.0:1746066794.460796:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977010176:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066794.460809:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066794.460827:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092590000/0xfb36a14ee608bcff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9fa expref: 11 pid: 20532 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746066794.460837:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092590000/0xfb36a14ee608bcff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9fa expref: 11 pid: 20532 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746066794.460856:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066794.460886:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977010176:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 89us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.460891:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7555 00000100:00100000:1.0:1746066794.460903:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7556 00000100:00100000:1.0:1746066794.460907:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977010048:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066794.460913:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066794.460918:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ef93600/0xfb36a14ee608bb38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8cd expref: 34 pid: 21203 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.460926:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ef93600/0xfb36a14ee608bb38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8cd expref: 34 pid: 21203 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.460936:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef93600/0xfb36a14ee608bb38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8cd expref: 34 pid: 21203 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.460949:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066794.460961:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977010048:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 53us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.460967:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7556 00000100:00100000:1.0:1746066794.460990:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.461000:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977010304 00000100:00100000:1.0:1746066794.461002:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977010304 00010000:00010000:1.0:1746066794.461011:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f161600/0xfb36a14ee608baf2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8aa expref: 19 pid: 21203 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.461025:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7557 00000100:00100000:1.0:1746066794.461029:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977010304:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066794.461035:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066794.461040:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f161600/0xfb36a14ee608baf2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8aa expref: 19 pid: 21203 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.461047:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f161600/0xfb36a14ee608baf2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8aa expref: 19 pid: 21203 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.461057:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.461058:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.461064:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 32 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.461071:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 32 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.461097:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 32 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066794.461110:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135f81880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976874624:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066794.461158:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066794.461208:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.461328:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977009792 00000100:00100000:0.0:1746066794.461332:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977009792 00002000:00100000:0.0:1746066794.461354:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009ed73480 x1830882977009792/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.461361:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73480 with x1830882977009792 ext(3145728->4194303) 00002000:00010000:0.0:1746066794.461364:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed73480 00000100:00100000:0.0:1746066794.461376:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6678 00000100:00100000:0.0:1746066794.461380:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977009792:12345-192.168.202.57@tcp:3:multiop.0 00010000:00010000:0.0:1746066794.462382:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092590000/0xfb36a14ee608bcff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9fa expref: 10 pid: 20532 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746066794.462394:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009412b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976874368:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066794.462404:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f161600/0xfb36a14ee608baf2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8aa expref: 19 pid: 21203 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746066794.462412:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094128e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976874496:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066794.462434:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 32 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.462442:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931e6000, rc 0) 00000100:00100000:0.0:1746066794.462474:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:31688:x1830882977009408:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 20252us (20516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.462483:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14731 00000100:00100000:2.0:1746066794.467313:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977009152:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24745us (25388us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066794.467323:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6675 00002000:00100000:2.0:1746066794.467333:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009bb2ea00 x1830882977009152/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.467341:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ea00 with x1830882977009152 ext(3145728->4194303) 00002000:00010000:2.0:1746066794.467346:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2ea00 00000100:00100000:1.0:1746066794.471841:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135f81880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976874624:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066794.471861:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066794.471897:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977010304:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 10865us (10905us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.471905:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7557 00000100:00100000:2.0:1746066794.472422:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977009024:12345-192.168.202.57@tcp:3:cat.0 Request processed in 29853us (30388us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066794.472432:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6676 00002000:00100000:2.0:1746066794.472440:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009bb2e300 x1830882977009024/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.472448:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2e300 with x1830882977009024 ext(2097152->3145727) 00002000:00010000:2.0:1746066794.472453:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2e300 00000100:00100000:0.0:1746066794.473018:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.473759:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977010560 00000100:00100000:2.0:1746066794.473765:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977010560 00002000:00100000:2.0:1746066794.473790:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (675840->679935) req@ffff8800924d1c00 x1830882977010560/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.473798:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d1c00 with x1830882977010560 ext(675840->679935) 00002000:00010000:2.0:1746066794.473801:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d1c00 00000100:00100000:2.0:1746066794.473816:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6679 00000100:00100000:2.0:1746066794.473822:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977010560:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066794.473952:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977010560:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 130us (935us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066794.473958:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6679 00002000:00100000:2.0:1746066794.473963:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (675840->679935) req@ffff8800924d1c00 x1830882977010560/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/4536 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.473969:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d1c00 with x1830882977010560 ext(675840->679935) 00002000:00010000:2.0:1746066794.473972:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d1c00 00000100:00100000:3.0:1746066794.474480:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977009664:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 19498us (21312us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066794.474486:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6677 00002000:00100000:3.0:1746066794.474491:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800924d0a80 x1830882977009664/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.474498:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d0a80 with x1830882977009664 ext(2097152->3145727) 00002000:00010000:3.0:1746066794.474500:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d0a80 00000100:00100000:2.0:1746066794.477910:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977009792:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 16521us (16693us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066794.477919:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6678 00002000:00100000:2.0:1746066794.477930:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009ed73480 x1830882977009792/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.477938:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73480 with x1830882977009792 ext(3145728->4194303) 00002000:00010000:2.0:1746066794.477942:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed73480 00000100:00100000:1.0:1746066794.479651:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.479736:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977010688 00000100:00100000:0.0:1746066794.479743:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977010688 00000100:00100000:0.0:1746066794.479900:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14732 00000100:00100000:0.0:1746066794.479906:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+12:31690:x1830882977010688:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066794.479920:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.479933:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea5c expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.479955:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f24400/0xfb36a14ee608bb3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8d4 expref: 13 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.479962:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931e6c00/0xfb36a14ee608bd06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea01 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.479967:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b51b9800/0xfb36a14ee608bb70 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8e9 expref: 21 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.479972:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.479973:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.479977:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1810432->2097151] (req 1810432->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 13 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.479999:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b51b9800/0xfb36a14ee608bb70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8e9 expref: 21 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.480011:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b51b9800/0xfb36a14ee608bb70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8e9 expref: 21 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746066794.480021:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976874752:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066794.480900:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931e6c00/0xfb36a14ee608bd06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea01 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.480910:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931e6c00/0xfb36a14ee608bd06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea01 expref: 10 pid: 8112 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746066794.480919:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976874880:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066794.481399:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f24400/0xfb36a14ee608bb3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8d4 expref: 13 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.481407:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f24400/0xfb36a14ee608bb3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8d4 expref: 13 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746066794.481415:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976875008:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066794.481433:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.484420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.484463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.484703:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976874752:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066794.484715:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976874880:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066794.484722:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976875008:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066794.484748:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1810432->2097151] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 13 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.484763:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff41000, rc 0) 00000100:00100000:0.0:1746066794.484949:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.485757:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977010816 00000100:00100000:1.0:1746066794.485764:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977010816 00010000:00010000:1.0:1746066794.485794:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931e6c00/0xfb36a14ee608bd06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea01 expref: 11 pid: 8112 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746066794.485817:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977010944 00000100:00100000:1.0:1746066794.485820:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977010944 00010000:00010000:1.0:1746066794.485829:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b51b9800/0xfb36a14ee608bb70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8e9 expref: 22 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.485844:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7558 00000100:00100000:1.0:1746066794.485851:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977010816:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066794.485861:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066794.485878:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931e6c00/0xfb36a14ee608bd06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea01 expref: 11 pid: 8112 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746066794.485891:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931e6c00/0xfb36a14ee608bd06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea01 expref: 11 pid: 8112 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746066794.485911:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931e6c00/0xfb36a14ee608bd06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea01 expref: 11 pid: 8112 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746066794.485925:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066794.485952:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977010816:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 101us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.485958:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7558 00000100:00100000:1.0:1746066794.485972:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7559 00000100:00100000:1.0:1746066794.485976:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977010944:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066794.485982:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066794.485989:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b51b9800/0xfb36a14ee608bb70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8e9 expref: 22 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.485998:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b51b9800/0xfb36a14ee608bb70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8e9 expref: 22 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.486008:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b51b9800/0xfb36a14ee608bb70 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8e9 expref: 22 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.486018:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066794.486031:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882977010944:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 55us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.486039:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7559 00000100:00100000:2.0:1746066794.486208:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+13:31690:x1830882977010688:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6301us (6561us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.486214:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14732 00000100:00100000:2.0:1746066794.486235:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977011328 00000100:00100000:2.0:1746066794.486238:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977011328 00002000:00100000:2.0:1746066794.486261:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (970752->974847) req@ffff8800924d0380 x1830882977011328/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.486269:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d0380 with x1830882977011328 ext(970752->974847) 00002000:00010000:2.0:1746066794.486273:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d0380 00000100:00100000:1.0:1746066794.486571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.486780:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977011072 00000100:00100000:3.0:1746066794.486784:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977011072 00010000:00010000:3.0:1746066794.486798:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f24400/0xfb36a14ee608bb3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8d4 expref: 13 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.486812:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7560 00000100:00100000:3.0:1746066794.486817:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977011072:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066794.486823:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066794.486832:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f24400/0xfb36a14ee608bb3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8d4 expref: 13 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.486838:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f24400/0xfb36a14ee608bb3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8d4 expref: 13 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.486849:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f24400/0xfb36a14ee608bb3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8d4 expref: 13 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.486860:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.486862:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.486867:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.486874:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.486903:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.486913:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976875136:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066794.486948:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066794.486964:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6680 00000100:00100000:3.0:1746066794.486969:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977011328:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066794.487087:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977011328:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 118us (2137us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066794.487092:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6680 00002000:00100000:3.0:1746066794.487098:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38e:0x0] (970752->974847) req@ffff8800924d0380 x1830882977011328/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/4536 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.487105:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d0380 with x1830882977011328 ext(970752->974847) 00002000:00010000:3.0:1746066794.487108:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d0380 00000100:00100000:0.0:1746066794.488934:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.489086:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977011584 00000100:00100000:2.0:1746066794.489093:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977011584 00000100:00100000:2.0:1746066794.489129:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4187 00000100:00100000:2.0:1746066794.489134:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:31688:x1830882977011584:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066794.489342:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:31688:x1830882977011584:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 207us (412us total) trans 8589944086 rc 0/0 00000100:00100000:2.0:1746066794.489348:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4187 00000100:00100000:0.0:1746066794.490541:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.490847:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977011712 00000100:00100000:2.0:1746066794.490852:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977011712 00000100:00100000:2.0:1746066794.490886:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14733 00000100:00100000:2.0:1746066794.490892:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882977011712:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066794.490902:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066794.491187:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976875136:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066794.491203:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066794.491252:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b4b9000/0xfb36a14ee608bdae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea63 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.491297:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976875264:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066794.491387:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977011072:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4569us (4815us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.491394:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7560 00000100:00100000:3.0:1746066794.491434:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.491504:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.491516:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977011968 00000100:00100000:2.0:1746066794.491519:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977011968 00002000:00100000:2.0:1746066794.491538:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1810432->1814527) req@ffff88009a0d0e00 x1830882977011968/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.491545:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d0e00 with x1830882977011968 ext(1810432->1814527) 00002000:00010000:2.0:1746066794.491548:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a0d0e00 00000100:00100000:2.0:1746066794.491566:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6681 00000100:00100000:2.0:1746066794.491572:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882977011968:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066794.491702:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882977011968:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 130us (268us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066794.491707:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6681 00002000:00100000:2.0:1746066794.491713:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1810432->1814527) req@ffff88009a0d0e00 x1830882977011968/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/4536 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.491719:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d0e00 with x1830882977011968 ext(1810432->1814527) 00002000:00010000:2.0:1746066794.491721:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a0d0e00 00002000:00010000:2.0:1746066794.494866:0:8112:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime: 1746066793 -> 1746066794 00002000:00010000:2.0:1746066794.494872:0:8112:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime: 1746066792 -> 1746066794 00002000:00010000:2.0:1746066794.494874:0:8112:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime: 1746066793 -> 1746066794 00000100:00100000:2.0:1746066794.494896:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976875264:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066794.494923:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b4b9000/0xfb36a14ee608bdae lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea63 expref: 22 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.494935:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b4b9000/0xfb36a14ee608bdae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea63 expref: 22 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.495295:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b4b9000, rc 0) 00000100:00100000:2.0:1746066794.495344:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882977011712:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4450us (4803us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066794.495352:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14733 00000100:00100000:0.0:1746066794.496185:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.496242:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977012096 00000100:00100000:2.0:1746066794.496246:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977012096 00000100:00100000:2.0:1746066794.496278:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14734 00000100:00100000:2.0:1746066794.496284:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+12:31690:x1830882977012096:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066794.496296:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.496307:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea6a expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.496332:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608bb7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8f0 expref: 13 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.496340:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b4b9a00/0xfb36a14ee608bd0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea08 expref: 9 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.496346:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608bb93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8fe expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.496351:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.496353:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.496356:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->1376255] (req 1048576->1376255) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 13 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.496378:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608bb93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8fe expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.496388:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608bb93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8fe expref: 20 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.496398:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976875392:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066794.497093:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b4b9a00/0xfb36a14ee608bd0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea08 expref: 9 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.497102:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b4b9a00/0xfb36a14ee608bd0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea08 expref: 9 pid: 8452 timeout: 855 lvb_type: 1 00000100:00100000:2.0:1746066794.497110:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976875520:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066794.497611:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608bb7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8f0 expref: 13 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.497619:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608bb7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8f0 expref: 13 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.497627:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f618700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976875648:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066794.497658:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.500029:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.500220:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f61b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976875392:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066794.500228:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976875520:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066794.500298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.500360:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977012224 00000100:00100000:1.0:1746066794.500365:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977012224 00010000:00010000:1.0:1746066794.500392:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b4b9a00/0xfb36a14ee608bd0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea08 expref: 10 pid: 8452 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746066794.500411:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977012352 00000100:00100000:1.0:1746066794.500412:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977012352 00010000:00010000:1.0:1746066794.500421:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608bb93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8fe expref: 21 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.500435:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7561 00000100:00100000:1.0:1746066794.500440:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977012224:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066794.500450:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066794.500468:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b4b9a00/0xfb36a14ee608bd0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea08 expref: 10 pid: 8452 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746066794.500477:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b4b9a00/0xfb36a14ee608bd0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea08 expref: 10 pid: 8452 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746066794.500494:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b4b9a00/0xfb36a14ee608bd0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea08 expref: 10 pid: 8452 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746066794.500508:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.500791:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7562 00000100:00100000:0.0:1746066794.500798:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1966:x1830882977012352:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.500805:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.500813:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608bb93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8fe expref: 21 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746066794.500822:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608bb93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8fe expref: 21 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746066794.500833:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608bb93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8fe expref: 21 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746066794.500845:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066794.501184:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977012224:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 742us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.501193:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7561 00000100:00100000:0.0:1746066794.501288:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1966:x1830882977012352:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 490us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.501293:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7562 00000100:00100000:2.0:1746066794.503036:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f618700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976875648:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066794.503063:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->1376255] (req 1048576->1376255) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 13 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.503073:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff40c00, rc 0) 00000100:00100000:2.0:1746066794.503111:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+13:31690:x1830882977012096:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6826us (6926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.503117:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14734 00000100:00100000:0.0:1746066794.503323:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.503408:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977012480 00000100:00100000:2.0:1746066794.503412:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977012480 00010000:00010000:2.0:1746066794.503427:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608bb7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8f0 expref: 13 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.503449:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7563 00000100:00100000:2.0:1746066794.503454:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977012480:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066794.503463:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066794.503476:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608bb7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8f0 expref: 13 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.503490:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608bb7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8f0 expref: 13 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.503506:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b19b200/0xfb36a14ee608bb7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e8f0 expref: 13 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.503518:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.503520:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.503525:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.503533:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.503556:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.503566:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f618700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976875776:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066794.503870:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.504701:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.504765:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977012736 00000100:00100000:2.0:1746066794.504864:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977012736 00002000:00100000:2.0:1746066794.504907:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880094129180 x1830882977012736/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.504919:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094129180 with x1830882977012736 ext(4194304->5091327) 00002000:00010000:2.0:1746066794.504924:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094129180 00000100:00100000:2.0:1746066794.504949:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6682 00000100:00100000:2.0:1746066794.504955:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977012736:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066794.511145:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.511391:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.511410:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977013248 00000100:00100000:0.0:1746066794.511417:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977013248 00002000:00100000:0.0:1746066794.511452:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1372160->1376255) req@ffff88009412b800 x1830882977013248/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.511467:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412b800 with x1830882977013248 ext(1372160->1376255) 00002000:00010000:0.0:1746066794.511472:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009412b800 00000100:00100000:0.0:1746066794.511487:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6683 00000100:00100000:0.0:1746066794.511493:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:1965:x1830882977013248:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066794.511634:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:1965:x1830882977013248:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 141us (243us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066794.511640:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6683 00002000:00100000:0.0:1746066794.511644:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1372160->1376255) req@ffff88009412b800 x1830882977013248/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/4536 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.511650:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412b800 with x1830882977013248 ext(1372160->1376255) 00002000:00010000:0.0:1746066794.511653:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009412b800 00000100:00100000:3.0:1746066794.511808:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f618700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976875776:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066794.511822:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066794.511839:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977012480:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8386us (8517us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.511845:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7563 00000100:00100000:1.0:1746066794.511921:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977012992 00000100:00100000:1.0:1746066794.511924:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977012992 00000100:00100000:1.0:1746066794.511945:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10025 00000100:00100000:1.0:1746066794.511950:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:31696:x1830882977012992:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066794.511962:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.511976:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608bdbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea71 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.512049:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608bdc3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512059:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608bdc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512067:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608bdc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512076:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608bdca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512081:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608bdca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512085:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608bdca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512169:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608bdd1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512176:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608bdd1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512181:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608bdd1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:1.0:1746066794.512189:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066794.512254:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608bdc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512259:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608bdc3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512264:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608bdc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512269:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f209200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066794.512272:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608bdc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512277:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608bdc3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512286:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066794.512289:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066794.512292:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608bdc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512296:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608bdc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512307:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608bdca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512312:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608bdca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512319:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608bdca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512322:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f208400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066794.512324:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608bdca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512328:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608bdca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512332:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ffede00) 00010000:00010000:1.0:1746066794.512334:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066794.512335:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608bdca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512339:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608bdca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.512363:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608bdbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea71 expref: 18 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.512371:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608bdd1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea71 expref: 17 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.512376:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066794.512377:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066794.512379:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f209000, rc 0) 00000100:00100000:1.0:1746066794.512397:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:31696:x1830882977012992:12345-192.168.202.57@tcp:101:cat.0 Request processed in 447us (1259us total) trans 8589944087 rc 0/0 00000100:00100000:1.0:1746066794.512401:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10025 00000100:00100000:2.0:1746066794.513965:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977012736:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9005us (9259us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066794.513972:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6682 00002000:00100000:2.0:1746066794.513979:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880094129180 x1830882977012736/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.513986:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094129180 with x1830882977012736 ext(4194304->5091327) 00002000:00010000:2.0:1746066794.513990:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094129180 00000100:00100000:0.0:1746066794.514470:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.514506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.515112:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977013504 00000100:00100000:2.0:1746066794.515118:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977013504 00000100:00100000:2.0:1746066794.515142:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977013760 00000100:00100000:2.0:1746066794.515143:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977013760 00000100:00100000:2.0:1746066794.515155:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4188 00000100:00100000:2.0:1746066794.515160:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:31690:x1830882977013504:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066794.515295:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:31690:x1830882977013504:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 134us (826us total) trans 8589944088 rc 0/0 00000100:00100000:2.0:1746066794.515301:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4188 00000100:00100000:2.0:1746066794.515311:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4189 00000100:00100000:2.0:1746066794.515316:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:31696:x1830882977013760:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066794.515372:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:31696:x1830882977013760:12345-192.168.202.57@tcp:35:cat.0 Request processed in 56us (865us total) trans 8589944089 rc 0/0 00000100:00100000:2.0:1746066794.515378:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4189 00000100:00100000:0.0:1746066794.518117:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.518225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.518498:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977014016 00000100:00100000:2.0:1746066794.518504:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977014016 00000100:00100000:2.0:1746066794.518535:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977013888 00000100:00100000:2.0:1746066794.518537:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977013888 00000100:00100000:2.0:1746066794.518754:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14735 00000100:00100000:2.0:1746066794.518761:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1966:x1830882977014016:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066794.518776:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.518789:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608bddf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea7f expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.518831:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976875904:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066794.518886:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066794.518978:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14736 00000100:00100000:3.0:1746066794.518985:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977013888:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066794.518991:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.518999:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5941200/0xfb36a14ee608bde6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea78 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.519020:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976876032:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066794.519041:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.521325:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.521940:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977014144 00000100:00100000:1.0:1746066794.521947:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977014144 00000100:00100000:1.0:1746066794.521975:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14737 00000100:00100000:1.0:1746066794.521980:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977014144:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066794.521992:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.522003:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f209600/0xfb36a14ee608bded lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea86 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066794.522036:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976876160:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066794.522091:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3180 going to sleep for 11 seconds 00002000:00010000:0.0:1746066794.522550:0:8112:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime: 1746066793 -> 1746066794 00002000:00010000:0.0:1746066794.522553:0:8112:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime: 1746066792 -> 1746066794 00002000:00010000:0.0:1746066794.522554:0:8112:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime: 1746066793 -> 1746066794 00000100:00100000:0.0:1746066794.522571:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f619500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976875904:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066794.522619:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608bddf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea7f expref: 23 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.522633:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608bddf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea7f expref: 23 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.522651:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff40a00, rc 0) 00000100:00100000:0.0:1746066794.522672:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977014016:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3912us (4560us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066794.522692:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14735 00000100:00100000:3.0:1746066794.522971:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976876032:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066794.522987:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5941200/0xfb36a14ee608bde6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea78 expref: 21 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.522994:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5941200/0xfb36a14ee608bde6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea78 expref: 21 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.523007:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5941200, rc 0) 00000100:00100000:3.0:1746066794.523028:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1966:x1830882977013888:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4045us (4804us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066794.523033:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14736 00002000:00010000:1.0:1746066794.524422:0:8451:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime: 1746066793 -> 1746066794 00002000:00010000:1.0:1746066794.524426:0:8451:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime: 1746066792 -> 1746066794 00002000:00010000:1.0:1746066794.524427:0:8451:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime: 1746066793 -> 1746066794 00000100:00100000:1.0:1746066794.524440:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976876160:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066794.524457:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f209600/0xfb36a14ee608bded lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea86 expref: 19 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.524466:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f209600/0xfb36a14ee608bded lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea86 expref: 19 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.524488:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f209600, rc 0) 00000100:00100000:1.0:1746066794.524523:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977014144:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2541us (3202us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066794.524528:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14737 00000100:00100000:0.0:1746066794.525663:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.525704:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.525759:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977014272 00000100:00100000:1.0:1746066794.525764:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977014272 00000100:00100000:1.0:1746066794.525790:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977014400 00000100:00100000:1.0:1746066794.525793:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977014400 00000100:00100000:1.0:1746066794.525805:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14738 00000100:00100000:1.0:1746066794.525811:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1965:x1830882977014272:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066794.525822:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.525833:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f208a00/0xfb36a14ee608bdf4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea8d expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066794.525866:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976876288:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066794.525966:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14739 00000100:00100000:3.0:1746066794.525972:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977014400:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066794.525978:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.525984:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608bdfb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea94 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.526005:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976876416:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066794.526396:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.526431:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977014528 00000100:00100000:0.0:1746066794.526433:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977014528 00000100:00100000:0.0:1746066794.526451:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14740 00000100:00100000:0.0:1746066794.526456:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+18:31696:x1830882977014528:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:1.0:1746066794.526460:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3180 going to sleep for 11 seconds 00010000:00010000:0.0:1746066794.526463:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.526472:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931e6c00/0xfb36a14ee608be02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ea9b expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.526488:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 27 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.526495:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066794.526496:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066794.526499:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931e6c00/0xfb36a14ee608be02 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea9b expref: 19 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.526502:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abf00 going to sleep for 11 seconds 00010000:00010000:0.0:1746066794.526519:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 27 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.526530:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 27 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746066794.526538:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976876544:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066794.526567:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066794.528232:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976876288:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066794.528256:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f208a00/0xfb36a14ee608bdf4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea8d expref: 23 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.528265:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f208a00/0xfb36a14ee608bdf4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea8d expref: 23 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.528272:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f208a00, rc 0) 00000100:00100000:1.0:1746066794.528307:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977014272:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2495us (2645us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066794.528313:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14738 00000100:00100000:3.0:1746066794.528477:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976876416:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066794.528491:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608bdfb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea94 expref: 21 pid: 10402 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066794.528759:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976876544:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066794.528775:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800931e6c00/0xfb36a14ee608be02 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea9b expref: 19 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.528785:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931e6c00, rc 0) 00000100:00100000:0.0:1746066794.528812:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+19:31696:x1830882977014528:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2355us (2416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.528817:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14740 00010000:00010000:3.0:1746066794.528865:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608bdfb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea94 expref: 21 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.529018:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5940600, rc 0) 00000100:00100000:3.0:1746066794.529037:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1965:x1830882977014400:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3066us (3333us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066794.529042:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14739 00000100:00100000:0.0:1746066794.529758:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.529778:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977014656 00000100:00100000:2.0:1746066794.529783:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977014656 00002000:00100000:2.0:1746066794.529814:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38e:0x0] (675840->974847) req@ffff880093213800 x1830882977014656/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.529823:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093213800 with x1830882977014656 ext(675840->974847) 00010000:00010000:2.0:1746066794.529829:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 28 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.529839:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 28 pid: 8112 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746066794.529848:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093213800 00000100:00100000:2.0:1746066794.529872:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2171 00000100:00100000:2.0:1746066794.529879:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977014656:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066794.538162:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977014656:12345-192.168.202.57@tcp:4:cat.0 Request processed in 8274us (8395us total) trans 17179873635 rc 0/0 00000100:00100000:2.0:1746066794.538173:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2171 00002000:00100000:2.0:1746066794.538184:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38e:0x0] (675840->974847) req@ffff880093213800 x1830882977014656/t17179873635(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/448 e 0 to 0 dl 1746066805 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.538193:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093213800 with x1830882977014656 ext(675840->974847) 00010000:00010000:2.0:1746066794.538201:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 30 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.538216:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 30 pid: 8112 timeout: 855 lvb_type: 0 00002000:00010000:2.0:1746066794.538222:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093213800 00000100:00100000:0.0:1746066794.540917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.540981:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977014784 00000100:00100000:3.0:1746066794.540987:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977014784 00010000:00010000:3.0:1746066794.541012:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 30 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.541068:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7564 00000100:00100000:3.0:1746066794.541074:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093212a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977014784:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066794.541085:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066794.541099:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 30 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.541109:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 30 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.541127:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931e6000/0xfb36a14ee608bda0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 675840->974847) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea55 expref: 30 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.541523:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.541525:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.541532:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931e6c00/0xfb36a14ee608be02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea9b expref: 18 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.541540:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931e6c00/0xfb36a14ee608be02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea9b expref: 18 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.541566:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800931e6c00/0xfb36a14ee608be02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea9b expref: 18 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.541581:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976876672:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066794.542716:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066794.545214:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976876672:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066794.545230:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066794.545273:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093212a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977014784:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4197us (4360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.545282:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7564 00000100:00100000:2.0:1746066794.550539:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.550558:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.550717:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.550841:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.550889:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977015296 00000100:00100000:0.0:1746066794.550897:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977015296 00000100:00100000:0.0:1746066794.550909:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977015168 00000100:00100000:0.0:1746066794.550910:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977015168 00002000:00100000:0.0:1746066794.550941:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->1810431) req@ffff88009f618000 x1830882977015168/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.550950:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f618000 with x1830882977015168 ext(1048576->1810431) 00002000:00010000:0.0:1746066794.550955:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f618000 00000100:00100000:0.0:1746066794.550972:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977015552 00000100:00100000:0.0:1746066794.550974:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977015552 00002000:00100000:0.0:1746066794.550985:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009f618e00 x1830882977015552/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.550991:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f618e00 with x1830882977015552 ext(0->1048575) 00002000:00010000:0.0:1746066794.550995:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f618e00 00000100:00100000:0.0:1746066794.551007:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6684 00000100:00100000:0.0:1746066794.551012:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977015168:12345-192.168.202.57@tcp:3:cat.0 00002000:00100000:0.0:1746066794.552334:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1376256->2097151) req@ffff88009f61b100 x1830882977015296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.552342:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f61b100 with x1830882977015296 ext(1376256->2097151) 00002000:00010000:0.0:1746066794.552345:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f61b100 00000100:00100000:0.0:1746066794.552361:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6685 00000100:00100000:0.0:1746066794.552367:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977015552:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066794.553842:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6686 00000100:00100000:3.0:1746066794.553852:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977015296:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066794.554052:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977015680 00000100:00100000:2.0:1746066794.554058:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977015680 00002000:00100000:2.0:1746066794.554079:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009f619500 x1830882977015680/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.554092:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f619500 with x1830882977015680 ext(1048576->2097151) 00002000:00010000:2.0:1746066794.554095:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f619500 00000100:00100000:2.0:1746066794.554114:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6687 00000100:00100000:2.0:1746066794.554119:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977015680:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066794.559164:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977015168:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8143us (8596us total) trans 0 rc 761856/761856 00000100:00100000:1.0:1746066794.559175:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6684 00002000:00100000:1.0:1746066794.559185:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->1810431) req@ffff88009f618000 x1830882977015168/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.559199:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f618000 with x1830882977015168 ext(1048576->1810431) 00002000:00010000:1.0:1746066794.559204:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f618000 00000100:00100000:2.0:1746066794.567077:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977015552:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14701us (16350us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066794.567089:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6685 00002000:00100000:2.0:1746066794.567099:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009f618e00 x1830882977015552/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.567108:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f618e00 with x1830882977015552 ext(0->1048575) 00002000:00010000:2.0:1746066794.567113:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f618e00 00000100:00100000:0.0:1746066794.570290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.570616:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977015936 00000100:00100000:2.0:1746066794.570624:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977015936 00000100:00100000:2.0:1746066794.570743:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10026 00000100:00100000:3.0:1746066794.570834:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31699:x1830882977015936:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066794.570857:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.570872:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4b200/0xfb36a14ee608be09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eaa2 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.570920:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.570931:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.570941:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.570954:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4be00/0xfb36a14ee608be17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.570963:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4be00/0xfb36a14ee608be17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.570969:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4be00/0xfb36a14ee608be17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571056:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571065:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571070:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066794.571093:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066794.571096:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066794.571108:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571115:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571121:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571126:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571131:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571136:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed4bc00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066794.571139:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571144:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571152:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066794.571155:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066794.571157:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571161:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571738:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4be00/0xfb36a14ee608be17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571744:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4be00/0xfb36a14ee608be17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571748:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4be00/0xfb36a14ee608be17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571752:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed4be00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066794.571754:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4be00/0xfb36a14ee608be17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571758:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4be00/0xfb36a14ee608be17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571764:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebeb100) 00010000:00010000:3.0:1746066794.571766:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066794.571768:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4be00/0xfb36a14ee608be17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571772:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4be00/0xfb36a14ee608be17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.571798:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4b200/0xfb36a14ee608be09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaa2 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.571809:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaa2 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.571814:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066794.571816:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066794.571818:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed4a800, rc 0) 00000100:00100000:3.0:1746066794.571874:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31699:x1830882977015936:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 1123us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.571879:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10026 00000100:00100000:3.0:1746066794.573117:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977015680:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18993us (22271us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066794.573124:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6687 00002000:00100000:3.0:1746066794.573132:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009f619500 x1830882977015680/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.573141:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f619500 with x1830882977015680 ext(1048576->2097151) 00002000:00010000:3.0:1746066794.573145:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f619500 00000100:00100000:3.0:1746066794.574029:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f61b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977015296:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20177us (23494us total) trans 0 rc 720896/720896 00000100:00100000:3.0:1746066794.574035:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6686 00002000:00100000:3.0:1746066794.574041:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1376256->2097151) req@ffff88009f61b100 x1830882977015296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 720896/720896 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.574053:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f61b100 with x1830882977015296 ext(1376256->2097151) 00002000:00010000:3.0:1746066794.574056:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f61b100 00000100:00100000:0.0:1746066794.579094:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.579133:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.579163:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.579237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.579312:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977016064 00000100:00100000:3.0:1746066794.579319:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977016064 00000100:00100000:3.0:1746066794.579362:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 714 00000100:00100000:3.0:1746066794.579369:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977016064:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066794.579379:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066794.579399:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be1e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaa2 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.579415:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066794.579418:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066794.579450:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977016064:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 82us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.579455:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 714 00000100:00100000:2.0:1746066794.579521:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977016192 00000100:00100000:2.0:1746066794.579525:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977016192 00000100:00100000:2.0:1746066794.579543:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977016320 00000100:00100000:2.0:1746066794.579545:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977016320 00000100:00100000:2.0:1746066794.579554:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977016448 00000100:00100000:2.0:1746066794.579556:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977016448 00000100:00100000:2.0:1746066794.579572:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14741 00000100:00100000:2.0:1746066794.579577:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1965:x1830882977016192:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066794.579599:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.579610:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec00600/0xfb36a14ee608be25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eaa9 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.579629:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.579630:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.579636:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec00600/0xfb36a14ee608be25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaa9 expref: 11 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.579647:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec00600/0xfb36a14ee608be25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaa9 expref: 11 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.579655:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec00600, rc 0) 00000100:00100000:2.0:1746066794.579671:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1965:x1830882977016192:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 94us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.579696:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14741 00000100:00100000:2.0:1746066794.579707:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14742 00000100:00100000:2.0:1746066794.579711:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977016320:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066794.579718:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.579726:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec01a00/0xfb36a14ee608be2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eab0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.579755:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f618700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976876800:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066794.579799:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.579811:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14743 00000100:00100000:2.0:1746066794.579816:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977016448:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066794.579821:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.579828:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec01200/0xfb36a14ee608be33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eab7 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.579846:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e853100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976876928:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066794.579861:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.582716:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e853100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976876928:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066794.582744:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec01200/0xfb36a14ee608be33 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eab7 expref: 12 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.582756:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec01200/0xfb36a14ee608be33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eab7 expref: 12 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.582778:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec01200, rc 0) 00000100:00100000:2.0:1746066794.582812:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977016448:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 2995us (3573us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066794.582819:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14743 00000100:00100000:2.0:1746066794.583316:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f618700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976876800:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066794.583329:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec01a00/0xfb36a14ee608be2c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eab0 expref: 10 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.583338:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec01a00/0xfb36a14ee608be2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eab0 expref: 10 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.583345:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec01a00, rc 0) 00000100:00100000:2.0:1746066794.583373:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882977016320:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 3661us (4209us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066794.583378:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14742 00000100:00100000:0.0:1746066794.584909:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.584958:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977016704 00000100:00100000:3.0:1746066794.584964:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977016704 00002000:00100000:3.0:1746066794.584991:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800a8695500 x1830882977016704/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.584998:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695500 with x1830882977016704 ext(2097152->3145727) 00002000:00010000:3.0:1746066794.585002:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8695500 00000100:00100000:3.0:1746066794.585019:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6688 00000100:00100000:3.0:1746066794.585023:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977016704:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066794.587471:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.587783:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977016960 00000100:00100000:3.0:1746066794.587791:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977016960 00000100:00100000:3.0:1746066794.587836:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10027 00000100:00100000:3.0:1746066794.587843:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31699:x1830882977016960:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066794.587859:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.587874:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4ac00/0xfb36a14ee608be3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eabe expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.587949:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be41 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.587961:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea40 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.587968:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608bdd1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea71 expref: 18 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.587974:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be41 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.588000:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608bdd1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea71 expref: 18 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.588009:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608bdd1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea71 expref: 18 pid: 14550 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.588019:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976877056:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066794.588077:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea40 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.588084:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea40 expref: 10 pid: 14549 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.588090:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976877184:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066794.588103:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066794.594038:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976877056:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066794.594319:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976877184:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066794.594320:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066794.594340:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be41 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066794.594412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.594489:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977017088 00000100:00100000:2.0:1746066794.594495:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977017088 00010000:00010000:2.0:1746066794.594520:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608bdd1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea71 expref: 19 pid: 14550 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.594548:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977017216 00000100:00100000:2.0:1746066794.594551:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977017216 00010000:00010000:2.0:1746066794.594557:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea40 expref: 11 pid: 14549 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.594571:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7565 00000100:00100000:2.0:1746066794.594576:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977017088:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066794.594585:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066794.594599:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608bdd1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea71 expref: 19 pid: 14550 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.594607:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608bdd1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea71 expref: 19 pid: 14550 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.594625:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608bdd1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea71 expref: 19 pid: 14550 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.594635:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066794.594640:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be41 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066794.594645:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be41 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066794.594652:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066794.594699:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977017088:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 122us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.594705:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977016704:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9682us (9800us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066794.594705:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7565 00000100:00100000:3.0:1746066794.594711:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6688 00002000:00100000:3.0:1746066794.594718:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800a8695500 x1830882977016704/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.594725:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695500 with x1830882977016704 ext(2097152->3145727) 00002000:00010000:3.0:1746066794.594729:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8695500 00000100:00100000:2.0:1746066794.594739:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7566 00000100:00100000:2.0:1746066794.594744:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977017216:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066794.594749:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066794.594753:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea40 expref: 11 pid: 14549 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.594760:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea40 expref: 11 pid: 14549 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.594769:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931e6400/0xfb36a14ee608bd84 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea40 expref: 11 pid: 14549 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.594776:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066794.594779:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be41 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066794.594785:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be41 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066794.594790:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be41 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066794.594916:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066794.594935:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977017216:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 190us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.594941:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7566 00010000:00010000:3.0:1746066794.595233:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be41 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.595239:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be41 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066794.595253:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066794.595506:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4ac00/0xfb36a14ee608be3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eabe expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.595900:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be41 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eabe expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.595907:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066794.595910:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066794.595912:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed4a800, rc 0) 00000100:00100000:3.0:1746066794.595936:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31699:x1830882977016960:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 8093us (8471us total) trans 8589944090 rc 0/0 00000100:00100000:3.0:1746066794.595941:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10027 00000100:00100000:0.0:1746066794.600549:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.600641:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977017472 00000100:00100000:3.0:1746066794.600648:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977017472 00000100:00100000:3.0:1746066794.600775:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10028 00000100:00100000:3.0:1746066794.600786:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31699:x1830882977017472:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066794.600810:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.600813:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066794.600838:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a800/0xfb36a14ee608be41 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eabe expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.600851:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066794.600853:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066794.600861:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be4f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eac5 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.600921:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5940c00/0xfb36a14ee608be56 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.600929:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5940c00/0xfb36a14ee608be56 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066794.600934:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5940c00/0xfb36a14ee608be56 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066794.600942:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066794.601016:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be4f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eac5 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.601024:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5940c00/0xfb36a14ee608be56 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eac5 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.601028:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066794.601030:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066794.601031:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5940c00, rc 0) 00000100:00100000:3.0:1746066794.601069:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:31699:x1830882977017472:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 288us (527us total) trans 8589944091 rc 0/0 00000100:00100000:3.0:1746066794.601077:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10028 00000100:00100000:0.0:1746066794.602568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.602643:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977017600 00000100:00100000:3.0:1746066794.602648:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977017600 00000100:00100000:1.0:1746066794.602751:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10029 00000100:00100000:1.0:1746066794.602758:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:31699:x1830882977017600:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066794.602771:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.602781:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608be64 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eacc expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.602811:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608be64 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eacc expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.602821:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608be64 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eacc expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.602833:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066794.602836:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066794.602838:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f209000, rc 0) 00000100:00100000:1.0:1746066794.602877:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31699:x1830882977017600:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 119us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.602882:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10029 00000100:00100000:0.0:1746066794.604779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.605038:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977017728 00000100:00100000:2.0:1746066794.605049:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977017728 00000100:00100000:1.0:1746066794.605335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.606118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.606141:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977017856 00000100:00100000:2.0:1746066794.606145:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977017856 00000100:00100000:3.0:1746066794.607101:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977017984 00000100:00100000:3.0:1746066794.607105:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977017984 00000100:00100000:2.0:1746066794.607110:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14744 00000100:00100000:2.0:1746066794.607118:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977017728:12345-192.168.202.57@tcp:1:mirror_io.0 00000100:00100000:0.0:1746066794.607118:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14745 00000100:00100000:0.0:1746066794.607126:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977017856:12345-192.168.202.57@tcp:1:mirror_io.0 00000100:00100000:3.0:1746066794.607141:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14746 00000100:00100000:3.0:1746066794.607146:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977017984:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066794.607152:0:4614:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ec00400/0xfb36a14ee608be6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.607152:0:8112:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608be72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.607157:0:8452:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608be79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.607166:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 11 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.607166:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931e6c00/0xfb36a14ee608be02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea9b expref: 18 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.607166:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 11 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.607172:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066794.607172:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec00600/0xfb36a14ee608be25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaa9 expref: 11 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.607172:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066794.607173:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066794.607174:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066794.607176:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608be79 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.607176:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608be72 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.607177:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.607178:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.607180:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec00400/0xfb36a14ee608be6b lrc: 5/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.607197:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 11 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.607197:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec00600/0xfb36a14ee608be25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaa9 expref: 11 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.607198:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 11 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.607207:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 11 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.607207:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec00600/0xfb36a14ee608be25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaa9 expref: 11 pid: 4614 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746066794.607207:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 11 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.607217:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976877568:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066794.607218:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8695f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976877440:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066794.607220:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976877312:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066794.607285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.607288:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066794.607298:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977018112 00000100:00100000:1.0:1746066794.607301:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977018112 00000100:00100000:1.0:1746066794.607317:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14747 00000100:00100000:1.0:1746066794.607322:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977018112:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066794.607336:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f208c00/0xfb36a14ee608be80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.607345:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092590600/0xfb36a14ee608bcd5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9e5 expref: 28 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.607352:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092590400/0xfb36a14ee608bd29 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea24 expref: 18 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.607358:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8800/0xfb36a14ee608bd14 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea0f expref: 12 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.607363:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.607364:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.607366:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f208c00/0xfb36a14ee608be80 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.607379:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8800/0xfb36a14ee608bd14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea0f expref: 12 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.607387:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8800/0xfb36a14ee608bd14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea0f expref: 12 pid: 8452 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746066794.607394:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135f81880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976877696:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066794.607420:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092590400/0xfb36a14ee608bd29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea24 expref: 18 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.607432:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092590400/0xfb36a14ee608bd29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea24 expref: 18 pid: 20532 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746066794.607440:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976877824:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066794.607458:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092590600/0xfb36a14ee608bcd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9e5 expref: 28 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.607465:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092590600/0xfb36a14ee608bcd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9e5 expref: 28 pid: 4614 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.607472:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976877952:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066794.607486:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066794.607525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.607601:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066794.607767:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931e6c00/0xfb36a14ee608be02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea9b expref: 18 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.607776:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931e6c00/0xfb36a14ee608be02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea9b expref: 18 pid: 20532 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.607783:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976878080:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066794.607841:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977018240 00000100:00100000:3.0:1746066794.607844:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977018240 00000100:00100000:3.0:1746066794.607862:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14748 00000100:00100000:3.0:1746066794.607866:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977018240:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:3.0:1746066794.607880:0:10402:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.607889:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092590200/0xfb36a14ee608bca4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c2 expref: 18 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.607896:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092591000/0xfb36a14ee608bd8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea39 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.607902:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ff41c00/0xfb36a14ee608bd1b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea16 expref: 13 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.607911:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.607913:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.607915:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be87 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.608029:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066794.608033:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066794.608118:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ff41c00/0xfb36a14ee608bd1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea16 expref: 13 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.608127:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ff41c00/0xfb36a14ee608bd1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea16 expref: 13 pid: 4614 timeout: 855 lvb_type: 1 00000100:00100000:3.0:1746066794.608135:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976878208:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066794.608166:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092591000/0xfb36a14ee608bd8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea39 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.608173:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092591000/0xfb36a14ee608bd8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea39 expref: 28 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.608179:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976878336:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066794.608199:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092590200/0xfb36a14ee608bca4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c2 expref: 18 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.608205:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092590200/0xfb36a14ee608bca4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c2 expref: 18 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.608216:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976878464:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066794.608228:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.608281:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977018368 00000100:00100000:0.0:1746066794.608285:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977018368 00000100:00100000:0.0:1746066794.608306:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14749 00000100:00100000:0.0:1746066794.608311:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977018368:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066794.608328:0:20532:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.608338:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092590800/0xfb36a14ee608bc9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9bb expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.608345:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b4b8400/0xfb36a14ee608bd22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea1d expref: 11 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.608351:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092591400/0xfb36a14ee608bcce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9de expref: 19 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.608355:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.608356:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.608358:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be8e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.608415:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092591400/0xfb36a14ee608bcce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9de expref: 19 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.608423:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092591400/0xfb36a14ee608bcce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9de expref: 19 pid: 20532 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746066794.608430:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976878592:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066794.608638:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b4b8400/0xfb36a14ee608bd22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea1d expref: 11 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066794.608645:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b4b8400/0xfb36a14ee608bd22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea1d expref: 11 pid: 8452 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746066794.608657:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976878720:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066794.608697:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092590800/0xfb36a14ee608bc9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9bb expref: 11 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.608705:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092590800/0xfb36a14ee608bc9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9bb expref: 11 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746066794.608713:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800942db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976878848:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066794.608744:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066794.615705:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.615715:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976877568:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066794.615715:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976877312:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066794.615735:0:8452:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608be79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.615736:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977018496 00000100:00100000:0.0:1746066794.615737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.615741:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977018496 00000100:00100000:3.0:1746066794.615753:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977018624 00000100:00100000:0.0:1746066794.615753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.615756:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977018624 00010000:00010000:2.0:1746066794.615766:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec00600/0xfb36a14ee608be25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaa9 expref: 14 pid: 4614 timeout: 855 lvb_type: 1 00002000:00100000:3.0:1746066794.615781:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1376255) req@ffff8800942daa00 x1830882977018624/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066794.615784:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8695f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976877440:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066794.615786:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977018752 00000100:00100000:2.0:1746066794.615788:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977018752 00002000:00100000:3.0:1746066794.615790:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942daa00 with x1830882977018624 ext(1048576->1376255) 00010000:00010000:2.0:1746066794.615796:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8800/0xfb36a14ee608bd14 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea0f expref: 15 pid: 8452 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746066794.615798:0:8112:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608be72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.615809:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7567 00000100:00100000:2.0:1746066794.615814:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1964:x1830882977018496:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066794.615824:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066794.615842:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec00600/0xfb36a14ee608be25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaa9 expref: 15 pid: 4614 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746066794.615849:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976878592:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066794.615850:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec00600/0xfb36a14ee608be25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaa9 expref: 15 pid: 4614 timeout: 855 lvb_type: 1 00010000:00010000:2.0:1746066794.615868:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec00600/0xfb36a14ee608be25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaa9 expref: 15 pid: 4614 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746066794.615868:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976878720:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066794.615882:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.615897:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800942db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976878848:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066794.615909:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882977018496:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 95us (234us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066794.615910:0:20532:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.615914:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7567 00000100:00100000:2.0:1746066794.615925:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7568 00000100:00100000:2.0:1746066794.615928:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977018752:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066794.615933:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066794.615940:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8800/0xfb36a14ee608bd14 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea0f expref: 13 pid: 8452 timeout: 855 lvb_type: 1 00010000:00010000:2.0:1746066794.615946:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8800/0xfb36a14ee608bd14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea0f expref: 13 pid: 8452 timeout: 855 lvb_type: 1 00010000:00010000:2.0:1746066794.615954:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066794.615963:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977018752:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 34us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.615966:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7568 00000100:00100000:2.0:1746066794.615983:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976878080:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066794.615994:0:4614:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ec00400/0xfb36a14ee608be6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.616019:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 12 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.616032:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 12 pid: 8112 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746066794.616039:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942daa00 00000100:00100000:3.0:1746066794.616052:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2172 00000100:00100000:3.0:1746066794.616058:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977018624:12345-192.168.202.57@tcp:4:cat.0 00010000:00010000:1.0:1746066794.616172:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8800/0xfb36a14ee608bd14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea0f expref: 12 pid: 8452 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746066794.616186:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135f81880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976877696:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066794.616193:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976877824:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066794.616204:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976877952:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066794.616221:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f208c00/0xfb36a14ee608be80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.616624:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976878208:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066794.616632:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976878336:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066794.616637:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976878464:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066794.616950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066794.616978:0:10402:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066794.616979:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.617013:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977019136 00000100:00100000:1.0:1746066794.617016:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977019136 00010000:00010000:1.0:1746066794.617031:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092590400/0xfb36a14ee608bd29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea24 expref: 19 pid: 20532 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746066794.617045:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977019392 00000100:00100000:1.0:1746066794.617047:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977019392 00010000:00010000:1.0:1746066794.617054:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff41c00/0xfb36a14ee608bd1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea16 expref: 12 pid: 4614 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746066794.617077:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7569 00000100:00100000:1.0:1746066794.617082:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977019136:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066794.617098:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7570 00000100:00100000:0.0:1746066794.617105:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1966:x1830882977019392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.617122:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.617134:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ff41c00/0xfb36a14ee608bd1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea16 expref: 12 pid: 4614 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746066794.617143:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ff41c00/0xfb36a14ee608bd1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea16 expref: 12 pid: 4614 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746066794.617156:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ff41c00/0xfb36a14ee608bd1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea16 expref: 12 pid: 4614 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746066794.617169:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066794.617185:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977019392:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.617190:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7570 00010000:00010000:1.0:1746066794.617907:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066794.617918:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092590400/0xfb36a14ee608bd29 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea24 expref: 19 pid: 20532 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746066794.617927:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092590400/0xfb36a14ee608bd29 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea24 expref: 19 pid: 20532 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746066794.617937:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092590400/0xfb36a14ee608bd29 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea24 expref: 19 pid: 20532 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746066794.617945:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066794.617961:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977019136:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 880us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.617966:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7569 00000100:00100000:0.0:1746066794.619770:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.619803:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.619823:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977019520 00000100:00100000:0.0:1746066794.619824:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.619829:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977019520 00000100:00100000:0.0:1746066794.619845:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066794.619850:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092590200/0xfb36a14ee608bca4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c2 expref: 18 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746066794.619855:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.619869:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977019648 00000100:00100000:2.0:1746066794.619871:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977019648 00010000:00010000:2.0:1746066794.619880:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b4b8400/0xfb36a14ee608bd22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea1d expref: 12 pid: 8452 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746066794.620006:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977019776 00000100:00100000:0.0:1746066794.620009:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977019776 00000100:00100000:2.0:1746066794.620016:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977018880 00000100:00100000:2.0:1746066794.620018:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977018880 00010000:00010000:0.0:1746066794.620024:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092591400/0xfb36a14ee608bcce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9de expref: 20 pid: 20532 timeout: 855 lvb_type: 1 00010000:00010000:2.0:1746066794.620029:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092590600/0xfb36a14ee608bcd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9e5 expref: 29 pid: 4614 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746066794.620039:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7571 00000100:00100000:2.0:1746066794.620043:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7572 00000100:00100000:0.0:1746066794.620045:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977019520:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066794.620048:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977019648:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066794.620054:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.620054:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.620068:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092590200/0xfb36a14ee608bca4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c2 expref: 18 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746066794.620078:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092590200/0xfb36a14ee608bca4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c2 expref: 18 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746066794.620094:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092590200/0xfb36a14ee608bca4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c2 expref: 18 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746066794.620105:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066794.620132:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7573 00000100:00100000:1.0:1746066794.620138:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977019776:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066794.620145:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066794.620153:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092591400/0xfb36a14ee608bcce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9de expref: 20 pid: 20532 timeout: 855 lvb_type: 1 00010000:00010000:1.0:1746066794.620159:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092591400/0xfb36a14ee608bcce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9de expref: 20 pid: 20532 timeout: 855 lvb_type: 1 00000100:00100000:3.0:1746066794.620163:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7574 00010000:00010000:1.0:1746066794.620170:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092591400/0xfb36a14ee608bcce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9de expref: 20 pid: 20532 timeout: 855 lvb_type: 1 00000100:00100000:3.0:1746066794.620171:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977018880:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066794.620177:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066794.620179:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066794.620189:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092590600/0xfb36a14ee608bcd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9e5 expref: 29 pid: 4614 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.620197:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092590600/0xfb36a14ee608bcd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9e5 expref: 29 pid: 4614 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.620201:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1963:x1830882977019776:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 63us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.620206:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7573 00010000:00010000:3.0:1746066794.620209:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092590600/0xfb36a14ee608bcd5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9e5 expref: 29 pid: 4614 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.620214:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b4b8400/0xfb36a14ee608bd22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea1d expref: 12 pid: 8452 timeout: 855 lvb_type: 1 00010000:00010000:2.0:1746066794.620222:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b4b8400/0xfb36a14ee608bd22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea1d expref: 12 pid: 8452 timeout: 855 lvb_type: 1 00000100:00100000:1.0:1746066794.620224:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977019008 00010000:00010000:3.0:1746066794.620226:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066794.620226:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977019008 00010000:00010000:3.0:1746066794.620228:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.620232:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f208c00/0xfb36a14ee608be80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.620233:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b4b8400/0xfb36a14ee608bd22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea1d expref: 12 pid: 8452 timeout: 855 lvb_type: 1 00010000:00010000:3.0:1746066794.620239:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f208c00/0xfb36a14ee608be80 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746066794.620245:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (1810432->2097151) req@ffff8800a8695f80 x1830882977019008/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746066794.620249:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746066794.620252:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695f80 with x1830882977019008 ext(1810432->2097151) 00010000:00010000:3.0:1746066794.620256:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066794.620257:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 14 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.620265:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1965:x1830882977019648:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 217us (461us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066794.620265:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 14 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.620271:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7572 00000100:00100000:3.0:1746066794.620272:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977018880:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 103us (416us total) trans 0 rc 0/0 00002000:00010000:1.0:1746066794.620274:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8695f80 00000100:00100000:3.0:1746066794.620276:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7574 00000100:00100000:1.0:1746066794.620284:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2173 00000100:00100000:1.0:1746066794.620288:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977019008:12345-192.168.202.57@tcp:4:cat.0 00010000:00010000:3.0:1746066794.620293:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f208c00/0xfb36a14ee608be80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.620298:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f208c00/0xfb36a14ee608be80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.620310:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f208c00/0xfb36a14ee608be80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.620314:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f208c00/0xfb36a14ee608be80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.620314:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066794.620318:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f208c00/0xfb36a14ee608be80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.620323:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f208c00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066794.620325:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f208c00/0xfb36a14ee608be80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.620329:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f208c00/0xfb36a14ee608be80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.620334:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f208c00/0xfb36a14ee608be80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.620337:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f208c00/0xfb36a14ee608be80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.620364:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977018112:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 13043us (13081us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.620369:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14747 00000100:00100000:3.0:1746066794.620379:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977019264 00000100:00100000:3.0:1746066794.620381:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977019264 00010000:00010000:3.0:1746066794.620389:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931e6c00/0xfb36a14ee608be02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea9b expref: 18 pid: 20532 timeout: 855 lvb_type: 0 00000100:00100000:3.0:1746066794.620397:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7575 00000100:00100000:3.0:1746066794.620400:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977019264:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066794.620404:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066794.620410:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931e6c00/0xfb36a14ee608be02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea9b expref: 18 pid: 20532 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.620415:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931e6c00/0xfb36a14ee608be02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea9b expref: 18 pid: 20532 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.620421:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931e6c00/0xfb36a14ee608be02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea9b expref: 18 pid: 20532 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.620425:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.620426:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.620428:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec00400/0xfb36a14ee608be6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.620432:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec00400/0xfb36a14ee608be6b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.620445:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066794.620454:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977019264:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 54us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.620458:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7575 00010000:00010000:2.0:1746066794.620560:0:4614:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ec00400/0xfb36a14ee608be6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.620567:0:4614:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec00400/0xfb36a14ee608be6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.620580:0:4614:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ec00400/0xfb36a14ee608be6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.620594:0:4614:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec00400/0xfb36a14ee608be6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.620600:0:4614:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ec00400/0xfb36a14ee608be6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.620604:0:4614:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec00400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066794.620607:0:4614:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ec00400/0xfb36a14ee608be6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.620613:0:4614:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ec00400/0xfb36a14ee608be6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.620626:0:4614:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ec00400/0xfb36a14ee608be6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.620631:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec00400/0xfb36a14ee608be6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.620659:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977017728:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 13542us (15885us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.620664:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14744 00000100:00100000:0.0:1746066794.621138:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882977019520:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1093us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.621145:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7571 00000100:00100000:1.0:1746066794.622362:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.622387:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.622431:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977019904 00000100:00100000:0.0:1746066794.622435:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977019904 00010000:00010000:0.0:1746066794.622498:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092591000/0xfb36a14ee608bd8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea39 expref: 28 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746066794.622515:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977020032 00000100:00100000:0.0:1746066794.622517:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977020032 00010000:00010000:0.0:1746066794.622524:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092590800/0xfb36a14ee608bc9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9bb expref: 16 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746066794.622553:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7576 00000100:00100000:0.0:1746066794.622559:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977019904:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.622567:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.622579:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092591000/0xfb36a14ee608bd8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea39 expref: 28 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746066794.622613:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092591000/0xfb36a14ee608bd8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea39 expref: 28 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.622628:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7577 00010000:00010000:0.0:1746066794.622628:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092591000/0xfb36a14ee608bd8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea39 expref: 28 pid: 10402 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.622635:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882977020032:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066794.622637:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.622639:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066794.622642:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.622643:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066794.622649:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be87 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.622653:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092590800/0xfb36a14ee608bc9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9bb expref: 16 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.622662:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092590800/0xfb36a14ee608bc9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9bb expref: 16 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746066794.622664:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066794.622673:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092590800/0xfb36a14ee608bc9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9bb expref: 16 pid: 10402 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.622694:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.622695:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746066794.622697:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977019904:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 138us (338us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066794.622698:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066794.622702:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7576 00010000:00010000:2.0:1746066794.622708:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be8e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.622722:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066794.622733:0:20532:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.622738:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882977020032:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 104us (350us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066794.622740:0:20532:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066794.622743:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7577 00010000:00010000:0.0:1746066794.622754:0:20532:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.622760:0:20532:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.622766:0:20532:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.622778:0:20532:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5941400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066794.622781:0:20532:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.622787:0:20532:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.622795:0:20532:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.622800:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608be8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066794.622830:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977018368:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 14519us (14797us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.622837:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14749 00000100:00100000:3.0:1746066794.624315:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977018624:12345-192.168.202.57@tcp:4:cat.0 Request processed in 8252us (8571us total) trans 21474840951 rc 0/0 00000100:00100000:3.0:1746066794.624324:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2172 00002000:00100000:3.0:1746066794.624332:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1376255) req@ffff8800942daa00 x1830882977018624/t21474840951(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/448 e 0 to 0 dl 1746066805 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.624340:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942daa00 with x1830882977018624 ext(1048576->1376255) 00010000:00010000:3.0:1746066794.624346:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 15 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:3.0:1746066794.624357:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 15 pid: 8112 timeout: 855 lvb_type: 0 00002000:00010000:3.0:1746066794.624363:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800942daa00 00010000:00010000:3.0:1746066794.624388:0:10402:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.624394:0:10402:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.624413:0:10402:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.624423:0:10402:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.624428:0:10402:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.624433:0:10402:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed4bc00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066794.624436:0:10402:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.624441:0:10402:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.624453:0:10402:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.624459:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608be87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.624494:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977018240:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 16627us (16969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.624501:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14748 00000100:00100000:1.0:1746066794.628557:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977019008:12345-192.168.202.57@tcp:4:cat.0 Request processed in 8260us (8724us total) trans 21474840952 rc 0/0 00000100:00100000:1.0:1746066794.628568:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2173 00002000:00100000:1.0:1746066794.628578:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (1810432->2097151) req@ffff8800a8695f80 x1830882977019008/t21474840952(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/448 e 0 to 0 dl 1746066805 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.628595:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695f80 with x1830882977019008 ext(1810432->2097151) 00010000:00010000:1.0:1746066794.628604:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 15 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.628616:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 15 pid: 8112 timeout: 855 lvb_type: 0 00002000:00010000:1.0:1746066794.628623:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8695f80 00000100:00100000:0.0:1746066794.629311:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.629530:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977020160 00000100:00100000:1.0:1746066794.629536:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977020160 00010000:00010000:1.0:1746066794.629556:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 15 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.629581:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7578 00000100:00100000:1.0:1746066794.629594:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977020160:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066794.629604:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066794.629617:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 15 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.629625:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 15 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.629641:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff40c00/0xfb36a14ee608bdb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea6a expref: 15 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.629651:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.629653:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.629656:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608be79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.629663:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608be79 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.629753:0:8452:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608be79 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.629760:0:8452:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608be79 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.629775:0:8452:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608be79 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.629782:0:8452:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608be79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.629787:0:8452:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608be79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.629793:0:8452:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5940600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066794.629795:0:8452:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608be79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.629802:0:8452:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608be79 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.629810:0:8452:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608be79 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.631791:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5940600/0xfb36a14ee608be79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.631820:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066794.631951:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977020160:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2359us (2637us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.631960:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7578 00000100:00100000:3.0:1746066794.632025:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977017984:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 24876us (25906us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.632033:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14746 00000100:00100000:0.0:1746066794.637988:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.638069:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.638161:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977020544 00000100:00100000:1.0:1746066794.638169:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977020544 00000100:00100000:1.0:1746066794.638219:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10030 00000100:00100000:1.0:1746066794.638226:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:31702:x1830882977020544:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066794.638247:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.638259:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093d2a800/0xfb36a14ee608be95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ead3 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.638345:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d2ae00/0xfb36a14ee608be9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.638356:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093d2ae00/0xfb36a14ee608be9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.638365:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093d2ae00/0xfb36a14ee608be9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.638375:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608bea3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.638380:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608bea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.638385:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608bea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.638467:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.638476:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5940c00/0xfb36a14ee608be56 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eac5 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.638482:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.638506:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5940c00/0xfb36a14ee608be56 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eac5 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.638515:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5940c00/0xfb36a14ee608be56 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eac5 expref: 11 pid: 14549 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.638526:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976878976:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066794.638583:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066794.638608:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977020288 00000100:00100000:1.0:1746066794.638611:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977020288 00010000:00010000:1.0:1746066794.638625:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 14 pid: 8112 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.638641:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7579 00000100:00100000:1.0:1746066794.638646:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977020288:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066794.638653:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066794.638669:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 14 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.638702:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 14 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.638717:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff41000/0xfb36a14ee608bda7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea5c expref: 14 pid: 8112 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.638727:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.638729:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.638732:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608be72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.638743:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608be72 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.638757:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066794.638775:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977020288:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 128us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.638781:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7579 00010000:00010000:0.0:1746066794.638915:0:8112:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608be72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.638922:0:8112:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608be72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.638937:0:8112:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608be72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.638944:0:8112:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608be72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.638950:0:8112:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608be72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.638956:0:8112:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a632200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066794.638959:0:8112:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608be72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.638965:0:8112:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608be72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.638974:0:8112:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608be72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.638979:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a632200/0xfb36a14ee608be72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066794.639035:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977017856:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 31910us (33700us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066794.639041:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14745 00000100:00100000:1.0:1746066794.645121:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976878976:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066794.645142:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066794.646087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.646155:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977020672 00000100:00100000:2.0:1746066794.646161:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977020672 00010000:00010000:2.0:1746066794.646188:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5940c00/0xfb36a14ee608be56 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eac5 expref: 12 pid: 14549 timeout: 855 lvb_type: 0 00000100:00100000:2.0:1746066794.646223:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7580 00000100:00100000:2.0:1746066794.646230:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882977020672:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066794.646241:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066794.646247:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5940c00/0xfb36a14ee608be56 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eac5 expref: 12 pid: 14549 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.646257:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5940c00/0xfb36a14ee608be56 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eac5 expref: 12 pid: 14549 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.646275:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5940c00/0xfb36a14ee608be56 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eac5 expref: 12 pid: 14549 timeout: 855 lvb_type: 0 00010000:00010000:2.0:1746066794.646291:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066794.646295:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.646303:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.646309:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.646322:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066794.646348:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977020672:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 120us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.646354:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7580 00010000:00010000:1.0:1746066794.646401:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646407:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:1.0:1746066794.646418:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066794.646494:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646500:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646505:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646510:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f208600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066794.646513:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646519:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646526:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066794.646528:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066794.646531:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 2/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646535:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208600/0xfb36a14ee608beaa lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646561:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d2ae00/0xfb36a14ee608be9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646566:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093d2ae00/0xfb36a14ee608be9c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646571:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093d2ae00/0xfb36a14ee608be9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646575:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093d2ae00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066794.646577:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093d2ae00/0xfb36a14ee608be9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646581:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093d2ae00/0xfb36a14ee608be9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646595:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066794.646597:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066794.646599:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093d2ae00/0xfb36a14ee608be9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646603:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093d2ae00/0xfb36a14ee608be9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646611:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608bea3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646616:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608bea3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646620:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608bea3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646624:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f208c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066794.646626:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608bea3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646630:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608bea3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646635:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ffeda00) 00010000:00010000:1.0:1746066794.646636:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066794.646638:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608bea3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646646:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608bea3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.646701:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d2a800/0xfb36a14ee608be95 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ead3 expref: 20 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.646708:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093d2a800/0xfb36a14ee608be95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ead3 expref: 20 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.646714:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093d2a800, rc 0) 00000100:00100000:1.0:1746066794.646734:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:31702:x1830882977020544:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 8510us (8665us total) trans 8589944092 rc 301/301 00000100:00100000:1.0:1746066794.646740:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10030 00000100:00100000:0.0:1746066794.646923:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.647390:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977020928 00000100:00100000:1.0:1746066794.647394:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977020928 00000100:00100000:1.0:1746066794.647424:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10031 00000100:00100000:1.0:1746066794.647429:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:31699:x1830882977020928:12345-192.168.202.57@tcp:36:mirror_io.0 00010000:00010000:1.0:1746066794.647564:0:14550:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066794.647576:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608be64 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eacc expref: 11 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.647597:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066794.647601:0:14550:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066794.649245:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31699:x1830882977020928:12345-192.168.202.57@tcp:36:mirror_io.0 Request processed in 1810us (2316us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746066794.649253:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10031 00000100:00100000:0.0:1746066794.652885:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.653102:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977021184 00000100:00100000:3.0:1746066794.653109:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977021184 00000100:00100000:3.0:1746066794.653160:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4190 00000100:00100000:3.0:1746066794.653167:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31699:x1830882977021184:12345-192.168.202.57@tcp:35:mirror_io.0 00000100:00100000:3.0:1746066794.653779:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:31699:x1830882977021184:12345-192.168.202.57@tcp:35:mirror_io.0 Request processed in 611us (900us total) trans 8589944093 rc 0/0 00000100:00100000:3.0:1746066794.653787:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4190 00000100:00100000:0.0:1746066794.657774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.657838:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977021440 00000100:00100000:3.0:1746066794.657845:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977021440 00000100:00100000:3.0:1746066794.657896:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4191 00000100:00100000:3.0:1746066794.657904:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:31699:x1830882977021440:12345-192.168.202.57@tcp:35:mirror_io.0 00000100:00100000:3.0:1746066794.658076:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31699:x1830882977021440:12345-192.168.202.57@tcp:35:mirror_io.0 Request processed in 171us (308us total) trans 8589944094 rc 0/0 00000100:00100000:3.0:1746066794.658082:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4191 00000100:00100000:0.0:1746066794.667384:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.668605:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977021696 00000100:00100000:1.0:1746066794.668615:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977021696 00000100:00100000:1.0:1746066794.668665:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10032 00000100:00100000:1.0:1746066794.668671:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:31705:x1830882977021696:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066794.668705:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.668719:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608beb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eada expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.668819:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2000/0xfb36a14ee608bebf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.668830:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2000/0xfb36a14ee608bebf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.668840:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2000/0xfb36a14ee608bebf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.668851:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bec6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.668855:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.668860:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.668949:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2e00/0xfb36a14ee608becd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.668956:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2e00/0xfb36a14ee608becd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.668962:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2e00/0xfb36a14ee608becd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:1.0:1746066794.668969:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066794.669032:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2000/0xfb36a14ee608bebf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.669038:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2000/0xfb36a14ee608bebf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.669043:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2000/0xfb36a14ee608bebf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.669053:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eea2000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066794.669056:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2000/0xfb36a14ee608bebf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.669062:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2000/0xfb36a14ee608bebf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.669071:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066794.669073:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066794.669076:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2000/0xfb36a14ee608bebf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.669080:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2000/0xfb36a14ee608bebf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.669105:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bec6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.669109:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bec6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.669269:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bec6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.669273:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eea3c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066794.669276:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bec6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.669280:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bec6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.669286:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ffed600) 00010000:00010000:1.0:1746066794.669288:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066794.669290:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bec6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.669295:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bec6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.669327:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608beb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eada expref: 263 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.669336:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2e00/0xfb36a14ee608becd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eada expref: 262 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.669342:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066794.669344:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066794.669346:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea2e00, rc 0) 00000100:00100000:1.0:1746066794.669822:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:31705:x1830882977021696:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1149us (2443us total) trans 8589944095 rc 0/0 00000100:00100000:1.0:1746066794.669989:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10032 00000100:00100000:0.0:1746066794.682357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.687143:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977021952 00000100:00100000:3.0:1746066794.687154:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977021952 00000100:00100000:3.0:1746066794.687198:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4192 00000100:00100000:3.0:1746066794.687205:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:31705:x1830882977021952:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:3.0:1746066794.687425:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:31705:x1830882977021952:12345-192.168.202.57@tcp:35:cat.0 Request processed in 219us (5076us total) trans 8589944096 rc 0/0 00000100:00100000:3.0:1746066794.687431:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4192 00000100:00100000:0.0:1746066794.692817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.692853:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.693950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.694012:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.694081:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.694092:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977022336 00000100:00100000:2.0:1746066794.694092:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977022080 00000100:00100000:1.0:1746066794.694093:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977022592 00000100:00100000:3.0:1746066794.694099:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977022336 00000100:00100000:2.0:1746066794.694099:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977022080 00000100:00100000:1.0:1746066794.694099:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977022592 00000100:00100000:2.0:1746066794.694129:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977022208 00000100:00100000:2.0:1746066794.694131:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977022208 00000100:00100000:3.0:1746066794.694133:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14750 00000100:00100000:3.0:1746066794.694139:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977022080:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:1.0:1746066794.694140:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14751 00000100:00100000:2.0:1746066794.694145:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14752 00000100:00100000:1.0:1746066794.694146:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977022336:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:2.0:1746066794.694148:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977022592:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066794.694153:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.694153:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.694154:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.694166:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf0c600/0xfb36a14ee608bee2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eae1 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.694166:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec00800/0xfb36a14ee608bedb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eafd expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.694166:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bee9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eaef expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066794.694184:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd6a, atime: 0x6812dd68, ctime: 0x6812dd6a, blocks: 0x7dd 00002000:00010000:2.0:1746066794.694184:0:8112:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 5090560, mtime: 0x6812dd69, atime: 0x6812dd69, ctime: 0x6812dd69, blocks: 0x1723 00002000:00010000:1.0:1746066794.694184:0:20532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd6a, atime: 0x6812dd6a, ctime: 0x6812dd6a, blocks: 0x821 00010000:00010000:3.0:1746066794.694198:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.694198:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.694198:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.694200:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.694200:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.694200:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.694206:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf0c600/0xfb36a14ee608bee2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae1 expref: 30 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.694206:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec00800/0xfb36a14ee608bedb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eafd expref: 30 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.694207:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bee9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaef expref: 21 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.694218:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bee9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaef expref: 21 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.694219:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf0c600/0xfb36a14ee608bee2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae1 expref: 30 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.694227:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf0c600, rc 0) 00010000:00010000:1.0:1746066794.694227:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea2800, rc 0) 00000100:00100000:3.0:1746066794.694261:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977022080:12345-192.168.202.57@tcp:101:cat.0 Request processed in 122us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.694261:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977022336:12345-192.168.202.57@tcp:101:cat.0 Request processed in 115us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.694266:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14750 00000100:00100000:1.0:1746066794.694270:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14751 00000100:00100000:3.0:1746066794.694279:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14753 00000100:00100000:3.0:1746066794.694283:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977022208:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066794.694288:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.694294:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d800/0xfb36a14ee608bef0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eae8 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066794.694303:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38d:0x0] initial LVB size: 2097152, mtime: 0x6812dd6a, atime: 0x6812dd6a, ctime: 0x6812dd6a, blocks: 0x821 00010000:00010000:3.0:1746066794.694309:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.694311:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.694314:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d800/0xfb36a14ee608bef0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae8 expref: 21 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.694323:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d800/0xfb36a14ee608bef0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae8 expref: 21 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.694329:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf0d800, rc 0) 00000100:00100000:3.0:1746066794.694342:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977022208:12345-192.168.202.57@tcp:101:cat.0 Request processed in 59us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.694347:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14753 00000100:00100000:3.0:1746066794.694374:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977022464 00000100:00100000:3.0:1746066794.694377:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977022464 00000100:00100000:3.0:1746066794.694396:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14754 00000100:00100000:3.0:1746066794.694400:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977022464:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066794.694405:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.694412:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5940c00/0xfb36a14ee608bef7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eaf6 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066794.694420:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00010000:3.0:1746066794.694421:0:10402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 2097152, mtime: 0x6812dd69, atime: 0x6812dd69, ctime: 0x6812dd69, blocks: 0x821 00010000:00010000:3.0:1746066794.694427:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.694429:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.694433:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5940c00/0xfb36a14ee608bef7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaf6 expref: 31 pid: 10402 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066794.694434:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977022720 00000100:00100000:1.0:1746066794.694438:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977022720 00010000:00010000:3.0:1746066794.694441:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5940c00/0xfb36a14ee608bef7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaf6 expref: 31 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.694447:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5940c00, rc 0) 00010000:00010000:2.0:1746066794.694462:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec00800/0xfb36a14ee608bedb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eafd expref: 31 pid: 8112 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066794.694462:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14755 00000100:00100000:1.0:1746066794.694466:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977022720:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066794.694472:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.694473:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec00800, rc 0) 00010000:00010000:1.0:1746066794.694479:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eea2600/0xfb36a14ee608befe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb04 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066794.694490:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882977022464:12345-192.168.202.57@tcp:101:cat.0 Request processed in 90us (408us total) trans 0 rc 0/0 00002000:00010000:1.0:1746066794.694490:0:4614:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38f:0x0] initial LVB size: 4194304, mtime: 0x6812dd69, atime: 0x6812dd68, ctime: 0x6812dd69, blocks: 0x102b 00000100:00100000:3.0:1746066794.694495:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14754 00010000:00010000:1.0:1746066794.694499:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.694500:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.694504:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea2600/0xfb36a14ee608befe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb04 expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.694513:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eea2600/0xfb36a14ee608befe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb04 expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.694520:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea2600, rc 0) 00000100:00100000:2.0:1746066794.694603:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977022592:12345-192.168.202.57@tcp:101:cat.0 Request processed in 453us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.694608:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14752 00000100:00100000:1.0:1746066794.695623:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977022720:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1154us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.695630:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14755 00000100:00100000:0.0:1746066794.715713:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.715755:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.715893:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977022976 00000100:00100000:3.0:1746066794.715900:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977022976 00002000:00100000:3.0:1746066794.715937:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009244f480 x1830882977022976/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.715945:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244f480 with x1830882977022976 ext(0->1048575) 00002000:00010000:3.0:1746066794.715949:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244f480 00000100:00100000:3.0:1746066794.715978:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977023232 00000100:00100000:3.0:1746066794.715980:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977023232 00002000:00100000:3.0:1746066794.715991:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009244ea00 x1830882977023232/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.715997:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244ea00 with x1830882977023232 ext(1048576->2097151) 00002000:00010000:3.0:1746066794.716000:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009244ea00 00000100:00100000:3.0:1746066794.716012:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6689 00000100:00100000:3.0:1746066794.716018:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977022976:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066794.716329:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6690 00000100:00100000:1.0:1746066794.716337:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977023232:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066794.717640:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.717654:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977023488 00000100:00100000:0.0:1746066794.717659:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977023488 00002000:00100000:0.0:1746066794.717707:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009244ce00 x1830882977023488/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.717716:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244ce00 with x1830882977023488 ext(1048576->2097151) 00002000:00010000:0.0:1746066794.717720:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009244ce00 00000100:00100000:0.0:1746066794.717737:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6691 00000100:00100000:0.0:1746066794.717743:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882977023488:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066794.721758:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.724231:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977023744 00000100:00100000:3.0:1746066794.724244:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977023744 00002000:00100000:3.0:1746066794.724283:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009bb2d500 x1830882977023744/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.724292:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d500 with x1830882977023744 ext(1048576->2097151) 00002000:00010000:3.0:1746066794.724297:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2d500 00000100:00100000:3.0:1746066794.724319:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6692 00000100:00100000:3.0:1746066794.724326:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977023744:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066794.730190:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.730252:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977024000 00000100:00100000:0.0:1746066794.730260:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977024000 00000100:00100000:0.0:1746066794.730305:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10033 00000100:00100000:0.0:1746066794.730313:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:31708:x1830882977024000:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066794.730332:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066794.730347:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed35600/0xfb36a14ee608bf05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb0b expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.730426:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066794.730438:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2e00/0xfb36a14ee608becd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eada expref: 264 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.730443:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066794.730467:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2e00/0xfb36a14ee608becd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eada expref: 264 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.730483:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2e00/0xfb36a14ee608becd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eada expref: 264 pid: 14550 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746066794.730494:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976879104:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066794.730565:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066794.739414:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977022976:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23386us (23739us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066794.739425:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6689 00002000:00100000:3.0:1746066794.739437:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009244f480 x1830882977022976/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.739446:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244f480 with x1830882977022976 ext(0->1048575) 00002000:00010000:3.0:1746066794.739451:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244f480 00000100:00100000:1.0:1746066794.750947:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977023232:12345-192.168.202.57@tcp:3:cat.0 Request processed in 34602us (35183us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066794.750957:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6690 00002000:00100000:1.0:1746066794.750967:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009244ea00 x1830882977023232/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.750980:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244ea00 with x1830882977023232 ext(1048576->2097151) 00002000:00010000:1.0:1746066794.750985:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009244ea00 00000100:00100000:2.0:1746066794.752129:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.754779:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977024128 00000100:00100000:1.0:1746066794.754789:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977024128 00010000:00010000:1.0:1746066794.754825:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2e00/0xfb36a14ee608becd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eada expref: 265 pid: 14550 timeout: 855 lvb_type: 0 00000100:00100000:1.0:1746066794.754870:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7581 00000100:00100000:1.0:1746066794.754878:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:1964:x1830882977024128:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066794.754888:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066794.754893:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2e00/0xfb36a14ee608becd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eada expref: 265 pid: 14550 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.754902:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2e00/0xfb36a14ee608becd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eada expref: 265 pid: 14550 timeout: 855 lvb_type: 0 00010000:00010000:1.0:1746066794.754919:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066794.754923:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.754932:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.754937:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066794.754951:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066794.754991:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:1964:x1830882977024128:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 114us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.754997:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7581 00010000:00010000:0.0:1746066794.755204:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2e00/0xfb36a14ee608becd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eada expref: 264 pid: 14550 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746066794.755233:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976879104:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066794.755246:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066794.755252:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066794.755255:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:0.0:1746066794.755268:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066794.755377:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed35600/0xfb36a14ee608bf05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb0b expref: 265 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.755388:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb0b expref: 264 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066794.755394:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066794.755397:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066794.755399:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed34a00, rc 0) 00000100:00100000:0.0:1746066794.755430:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:31708:x1830882977024000:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 25119us (25247us total) trans 8589944097 rc 0/0 00000100:00100000:0.0:1746066794.755436:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10033 00000100:00100000:1.0:1746066794.760028:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977023488:12345-192.168.202.57@tcp:3:cat.0 Request processed in 42276us (42381us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066794.760038:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6691 00002000:00100000:1.0:1746066794.760048:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009244ce00 x1830882977023488/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.760057:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244ce00 with x1830882977023488 ext(1048576->2097151) 00002000:00010000:1.0:1746066794.760063:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009244ce00 00000100:00100000:3.0:1746066794.764061:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977023744:12345-192.168.202.57@tcp:3:cat.0 Request processed in 39729us (42303us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066794.764071:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6692 00002000:00100000:3.0:1746066794.764080:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009bb2d500 x1830882977023744/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.764088:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d500 with x1830882977023744 ext(1048576->2097151) 00002000:00010000:3.0:1746066794.764093:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2d500 00000100:00100000:0.0:1746066794.801526:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.802174:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.802209:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977024640 00000100:00100000:1.0:1746066794.802216:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977024640 00002000:00100000:1.0:1746066794.802260:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009bb2ed80 x1830882977024640/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.802269:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ed80 with x1830882977024640 ext(3145728->4194303) 00002000:00010000:1.0:1746066794.802274:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2ed80 00000100:00100000:1.0:1746066794.802288:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977024512 00000100:00100000:1.0:1746066794.802290:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977024512 00002000:00100000:1.0:1746066794.802300:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009bb2d880 x1830882977024512/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.802311:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d880 with x1830882977024512 ext(2097152->3145727) 00002000:00010000:1.0:1746066794.802314:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2d880 00000100:00100000:2.0:1746066794.802364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.802413:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6693 00000100:00100000:1.0:1746066794.802420:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882977024640:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066794.802953:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977025024 00000100:00100000:3.0:1746066794.802958:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977025024 00000100:00100000:3.0:1746066794.802969:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6694 00000100:00100000:3.0:1746066794.802975:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882977024512:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066794.802978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:2.0:1746066794.803013:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800924d2300 x1830882977025024/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.803020:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d2300 with x1830882977025024 ext(3145728->4194303) 00002000:00010000:2.0:1746066794.803023:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d2300 00000100:00100000:2.0:1746066794.803035:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977024896 00000100:00100000:2.0:1746066794.803037:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977024896 00002000:00100000:2.0:1746066794.803046:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800924d3b80 x1830882977024896/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.803051:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d3b80 with x1830882977024896 ext(2097152->3145727) 00002000:00010000:2.0:1746066794.803053:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d3b80 00000100:00100000:2.0:1746066794.803067:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6695 00000100:00100000:3.0:1746066794.803071:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6696 00000100:00100000:2.0:1746066794.803071:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977025024:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066794.803074:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977024896:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066794.821894:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977024896:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18812us (18909us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066794.821905:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6696 00002000:00100000:3.0:1746066794.821915:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800924d3b80 x1830882977024896/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.821924:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d3b80 with x1830882977024896 ext(2097152->3145727) 00002000:00010000:3.0:1746066794.821929:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d3b80 00000100:00100000:0.0:1746066794.826152:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.826253:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977025408 00000100:00100000:2.0:1746066794.826261:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977025408 00000100:00100000:2.0:1746066794.826312:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10034 00000100:00100000:2.0:1746066794.826320:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:31712:x1830882977025408:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066794.826343:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.826356:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbb1400/0xfb36a14ee608bf1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb12 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.826445:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbb1600/0xfb36a14ee608bf21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.826455:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbb1600/0xfb36a14ee608bf21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.826465:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbb1600/0xfb36a14ee608bf21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.826477:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b448000/0xfb36a14ee608bf28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.826482:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b448000/0xfb36a14ee608bf28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.826487:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b448000/0xfb36a14ee608bf28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.826572:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b449800/0xfb36a14ee608bf2f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.826579:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b449800/0xfb36a14ee608bf2f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.826612:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b449800/0xfb36a14ee608bf2f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:2.0:1746066794.827411:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066794.827488:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbb1600/0xfb36a14ee608bf21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.827498:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbb1600/0xfb36a14ee608bf21 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.827503:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbb1600/0xfb36a14ee608bf21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.827508:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbb1600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066794.827511:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbb1600/0xfb36a14ee608bf21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.827517:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbb1600/0xfb36a14ee608bf21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.827526:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066794.827528:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066794.827531:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbb1600/0xfb36a14ee608bf21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.827535:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbb1600/0xfb36a14ee608bf21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.828822:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b448000/0xfb36a14ee608bf28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.828830:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b448000/0xfb36a14ee608bf28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.828835:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b448000/0xfb36a14ee608bf28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.828839:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b448000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066794.828841:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b448000/0xfb36a14ee608bf28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.828849:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b448000/0xfb36a14ee608bf28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.828857:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13b00) 00010000:00010000:2.0:1746066794.828859:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066794.828861:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b448000/0xfb36a14ee608bf28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.828865:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b448000/0xfb36a14ee608bf28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066794.828910:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbb1400/0xfb36a14ee608bf1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb12 expref: 22 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.828923:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b449800/0xfb36a14ee608bf2f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb12 expref: 21 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.828929:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066794.828930:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066794.828932:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b449800, rc 0) 00000100:00100000:2.0:1746066794.828981:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:31712:x1830882977025408:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2661us (2836us total) trans 8589944098 rc 0/0 00000100:00100000:2.0:1746066794.828989:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10034 00000100:00100000:3.0:1746066794.838301:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977024512:12345-192.168.202.57@tcp:3:cat.0 Request processed in 35318us (36118us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066794.838314:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6694 00002000:00100000:3.0:1746066794.838325:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009bb2d880 x1830882977024512/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.838333:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d880 with x1830882977024512 ext(2097152->3145727) 00002000:00010000:3.0:1746066794.838338:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2d880 00000100:00100000:1.0:1746066794.846133:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977024640:12345-192.168.202.57@tcp:3:cat.0 Request processed in 43705us (44607us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066794.846144:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6693 00002000:00100000:1.0:1746066794.846155:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009bb2ed80 x1830882977024640/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.846164:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ed80 with x1830882977024640 ext(3145728->4194303) 00002000:00010000:1.0:1746066794.846169:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2ed80 00000100:00100000:3.0:1746066794.849728:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977025024:12345-192.168.202.57@tcp:3:cat.0 Request processed in 46645us (47352us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066794.849740:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6695 00002000:00100000:3.0:1746066794.849753:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800924d2300 x1830882977025024/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.849761:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d2300 with x1830882977025024 ext(3145728->4194303) 00002000:00010000:3.0:1746066794.849767:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d2300 00000100:00100000:0.0:1746066794.849875:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.850492:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977025664 00000100:00100000:2.0:1746066794.850501:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977025664 00000100:00100000:2.0:1746066794.850543:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4193 00000100:00100000:2.0:1746066794.850549:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350d3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+21:31712:x1830882977025664:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066794.850741:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350d3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:31712:x1830882977025664:12345-192.168.202.57@tcp:35:cat.0 Request processed in 190us (865us total) trans 8589944099 rc 0/0 00000100:00100000:2.0:1746066794.850749:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4193 00000100:00100000:0.0:1746066794.854781:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.855419:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.855539:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.855553:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977025792 00000100:00100000:1.0:1746066794.855560:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977025792 00000100:00100000:1.0:1746066794.855612:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977025920 00000100:00100000:1.0:1746066794.855614:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977025920 00000100:00100000:1.0:1746066794.855629:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14756 00000100:00100000:1.0:1746066794.855635:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882977025792:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066794.855650:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.855664:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50c3a00/0xfb36a14ee608bf3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb19 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.855694:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.855696:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.855704:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50c3a00/0xfb36a14ee608bf3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb19 expref: 17 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.855722:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50c3a00/0xfb36a14ee608bf3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb19 expref: 17 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.855730:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50c3a00, rc 0) 00000100:00100000:1.0:1746066794.855764:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977025792:12345-192.168.202.57@tcp:101:cat.0 Request processed in 130us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.855770:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14756 00000100:00100000:1.0:1746066794.855783:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14757 00000100:00100000:1.0:1746066794.855787:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:1966:x1830882977025920:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066794.855793:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.855801:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50c3800/0xfb36a14ee608bf44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb20 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.855810:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.855811:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.855814:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50c3800/0xfb36a14ee608bf44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb20 expref: 14 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.855824:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50c3800/0xfb36a14ee608bf44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb20 expref: 14 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.855831:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50c3800, rc 0) 00000100:00100000:1.0:1746066794.855844:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+14:1966:x1830882977025920:12345-192.168.202.57@tcp:101:cat.0 Request processed in 57us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.855849:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14757 00000100:00100000:2.0:1746066794.863230:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977026048 00000100:00100000:1.0:1746066794.863232:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.863238:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977026048 00000100:00100000:1.0:1746066794.863262:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.863276:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977026176 00000100:00100000:2.0:1746066794.863278:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977026176 00000100:00100000:1.0:1746066794.863282:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977026304 00000100:00100000:1.0:1746066794.863284:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977026304 00000100:00100000:2.0:1746066794.863294:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14758 00000100:00100000:2.0:1746066794.863304:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+14:1965:x1830882977026048:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:1.0:1746066794.863308:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14759 00000100:00100000:1.0:1746066794.863312:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977026176:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066794.863320:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.863320:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066794.863333:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbb1400/0xfb36a14ee608bf4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb27 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.863333:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a32600/0xfb36a14ee608bf52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb2e expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.863349:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.863349:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.863351:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.863351:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.863358:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbb1400/0xfb36a14ee608bf4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb27 expref: 15 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.863358:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a32600/0xfb36a14ee608bf52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb2e expref: 19 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.863370:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbb1400/0xfb36a14ee608bf4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb27 expref: 15 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.863370:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a32600/0xfb36a14ee608bf52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb2e expref: 19 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066794.863378:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbb1400, rc 0) 00010000:00010000:1.0:1746066794.863378:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a32600, rc 0) 00000100:00100000:1.0:1746066794.863412:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977026176:12345-192.168.202.57@tcp:101:cat.0 Request processed in 99us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.863416:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14759 00000100:00100000:1.0:1746066794.863428:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14760 00000100:00100000:1.0:1746066794.863432:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977026304:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066794.863437:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.863443:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608bf59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb35 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.863455:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.863456:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.863460:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608bf59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb35 expref: 19 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.863467:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608bf59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb35 expref: 19 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.863473:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a33200, rc 0) 00000100:00100000:2.0:1746066794.863482:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882977026048:12345-192.168.202.57@tcp:101:cat.0 Request processed in 182us (7943us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.863484:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882977026304:12345-192.168.202.57@tcp:101:cat.0 Request processed in 52us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.863487:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14758 00000100:00100000:1.0:1746066794.863490:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14760 00000100:00100000:3.0:1746066794.863546:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.863602:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977026432 00000100:00100000:1.0:1746066794.863605:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977026432 00000100:00100000:1.0:1746066794.864392:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14761 00000100:00100000:1.0:1746066794.864402:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882977026432:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066794.864409:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.864415:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a32800/0xfb36a14ee608bf60 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb3c expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.864425:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.864426:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.864430:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a32800/0xfb36a14ee608bf60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb3c expref: 16 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.864439:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a32800/0xfb36a14ee608bf60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb3c expref: 16 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.864450:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a32800, rc 0) 00000100:00100000:1.0:1746066794.864472:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882977026432:12345-192.168.202.57@tcp:101:cat.0 Request processed in 71us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.864477:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14761 00000100:00100000:0.0:1746066794.868438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.868722:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977026688 00000100:00100000:3.0:1746066794.868732:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977026688 00002000:00100000:3.0:1746066794.868779:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a8695c00 x1830882977026688/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.868788:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695c00 with x1830882977026688 ext(4194304->5091327) 00002000:00010000:3.0:1746066794.868793:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8695c00 00000100:00100000:3.0:1746066794.868844:0:31365:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6697 00000100:00100000:3.0:1746066794.868854:0:31365:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1965:x1830882977026688:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066794.880348:0:31365:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1965:x1830882977026688:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11445us (11868us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066794.880358:0:31365:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6697 00002000:00100000:3.0:1746066794.880369:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a8695c00 x1830882977026688/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.880377:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695c00 with x1830882977026688 ext(4194304->5091327) 00002000:00010000:3.0:1746066794.880383:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8695c00 00000100:00100000:0.0:1746066794.883479:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066794.883561:0:31365:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977026944 00000100:00100000:3.0:1746066794.883569:0:31365:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977026944 00000100:00100000:0.0:1746066794.883660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.883708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:3.0:1746066794.885335:0:31365:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff8800942d8000 x1830882977026944/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066794.885346:0:31365:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942d8000 with x1830882977026944 ext(0->1048575) 00002000:00010000:3.0:1746066794.885351:0:31365:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942d8000 00000100:00100000:1.0:1746066794.885864:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977027328 00000100:00100000:1.0:1746066794.885872:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977027328 00002000:00100000:1.0:1746066794.885897:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800942d8380 x1830882977027328/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.885904:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942d8380 with x1830882977027328 ext(1048576->2097151) 00002000:00010000:1.0:1746066794.885907:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942d8380 00000100:00100000:1.0:1746066794.885928:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977027200 00000100:00100000:1.0:1746066794.885932:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977027200 00002000:00100000:1.0:1746066794.885947:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8800942d9f80 x1830882977027200/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.885954:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942d9f80 with x1830882977027200 ext(1048576->2097151) 00002000:00010000:1.0:1746066794.885957:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942d9f80 00000100:00100000:1.0:1746066794.885990:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6698 00000100:00100000:1.0:1746066794.885999:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882977026944:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066794.887425:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6699 00000100:00100000:2.0:1746066794.887440:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977027328:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066794.888846:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6700 00000100:00100000:2.0:1746066794.888858:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977027200:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066794.898777:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066794.898830:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977027712 00000100:00100000:0.0:1746066794.898838:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977027712 00002000:00100000:0.0:1746066794.898874:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff8800942db800 x1830882977027712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066794.898883:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942db800 with x1830882977027712 ext(1048576->2097151) 00002000:00010000:0.0:1746066794.898888:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942db800 00000100:00100000:0.0:1746066794.898928:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6701 00000100:00100000:0.0:1746066794.898937:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1965:x1830882977027712:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066794.923866:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977027328:12345-192.168.202.57@tcp:3:cat.0 Request processed in 36420us (40193us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066794.923878:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6699 00002000:00100000:2.0:1746066794.923892:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800942d8380 x1830882977027328/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.923902:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942d8380 with x1830882977027328 ext(1048576->2097151) 00002000:00010000:2.0:1746066794.923908:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942d8380 00000100:00100000:2.0:1746066794.926947:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882977027200:12345-192.168.202.57@tcp:3:cat.0 Request processed in 38086us (43232us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066794.926957:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6700 00002000:00100000:2.0:1746066794.926965:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8800942d9f80 x1830882977027200/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.926974:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942d9f80 with x1830882977027200 ext(1048576->2097151) 00002000:00010000:2.0:1746066794.926979:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800942d9f80 00000100:00100000:2.0:1746066794.934969:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1965:x1830882977027712:12345-192.168.202.57@tcp:3:cat.0 Request processed in 36024us (36189us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066794.934979:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6701 00002000:00100000:2.0:1746066794.934991:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff8800942db800 x1830882977027712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.935000:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942db800 with x1830882977027712 ext(1048576->2097151) 00002000:00010000:2.0:1746066794.935006:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942db800 00000100:00100000:1.0:1746066794.939224:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882977026944:12345-192.168.202.57@tcp:3:cat.0 Request processed in 53218us (55745us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066794.939236:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6698 00002000:00100000:1.0:1746066794.939247:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff8800942d8000 x1830882977026944/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/440 e 0 to 0 dl 1746066805 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.939261:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800942d8000 with x1830882977026944 ext(0->1048575) 00002000:00010000:1.0:1746066794.939266:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800942d8000 00000100:00100000:0.0:1746066794.950808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.954672:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977027840 00000100:00100000:1.0:1746066794.954721:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977027840 00000100:00100000:1.0:1746066794.954777:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14762 00000100:00100000:1.0:1746066794.954784:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:31702:x1830882977027840:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066794.954800:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.954815:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb43 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.954840:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec00800/0xfb36a14ee608bedb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eafd expref: 29 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.954847:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608bf59 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb35 expref: 20 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.954852:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.954854:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.954856:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2465792->3145727] (req 2465792->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.954882:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608bf59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb35 expref: 20 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.954892:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608bf59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb35 expref: 20 pid: 4614 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746066794.954907:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976879232:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066794.955007:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec00800/0xfb36a14ee608bedb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eafd expref: 29 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066794.955014:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec00800/0xfb36a14ee608bedb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eafd expref: 29 pid: 8112 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746066794.955020:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976879360:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066794.955037:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540df00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066794.958732:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976879232:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066794.961159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.961293:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976879360:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066794.961319:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2465792->3145727] (req 2465792->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.961334:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb96400, rc 0) 00000100:00100000:1.0:1746066794.961379:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:31702:x1830882977027840:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6595us (10577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.961387:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14762 00000100:00100000:2.0:1746066794.961782:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977027968 00000100:00100000:2.0:1746066794.961788:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977027968 00010000:00010000:2.0:1746066794.961809:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608bf59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb35 expref: 20 pid: 4614 timeout: 856 lvb_type: 1 00000100:00100000:2.0:1746066794.961826:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7582 00000100:00100000:2.0:1746066794.961831:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977027968:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066794.961841:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066794.961857:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608bf59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb35 expref: 20 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066794.961866:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608bf59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb35 expref: 20 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066794.961881:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608bf59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb35 expref: 20 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066794.961903:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066794.961930:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977027968:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 98us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.961935:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7582 00000100:00100000:0.0:1746066794.968358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.971202:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977028096 00000100:00100000:1.0:1746066794.971213:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977028096 00000100:00100000:1.0:1746066794.971269:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14763 00000100:00100000:1.0:1746066794.971277:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:31712:x1830882977028096:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066794.971291:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066794.971307:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb97400/0xfb36a14ee608bf6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb4a expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.971327:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066794.971332:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2465792->3145727] (req 2465792->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.971337:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066794.971341:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb97400/0xfb36a14ee608bf6e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb4a expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.971371:0:4614:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2465792->3145727] (req 2465792->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.971381:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb97400/0xfb36a14ee608bf6e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb4a expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066794.971390:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb97400, rc 0) 00000100:00100000:1.0:1746066794.971439:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:31712:x1830882977028096:12345-192.168.202.57@tcp:101:cat.0 Request processed in 162us (3091us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066794.971444:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14763 00000100:00100000:0.0:1746066794.971661:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.971804:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977028224 00000100:00100000:2.0:1746066794.971808:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977028224 00010000:00010000:2.0:1746066794.971826:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec00800/0xfb36a14ee608bedb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eafd expref: 30 pid: 8112 timeout: 856 lvb_type: 1 00000100:00100000:2.0:1746066794.971847:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7583 00000100:00100000:2.0:1746066794.971853:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977028224:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066794.971863:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066794.971879:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec00800/0xfb36a14ee608bedb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eafd expref: 30 pid: 8112 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066794.971889:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec00800/0xfb36a14ee608bedb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eafd expref: 30 pid: 8112 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066794.971905:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec00800/0xfb36a14ee608bedb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eafd expref: 30 pid: 8112 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066794.971914:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.971916:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066794.971921:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.971928:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.971947:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066794.971957:0:9852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 19 pid: 4614 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746066794.971966:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009270b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976879616:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066794.973039:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21f8900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.976433:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009270b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976879616:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066794.976448:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066794.977633:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977028224:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5777us (5969us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066794.977642:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7583 00000100:00100000:0.0:1746066794.978316:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066794.978369:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977028480 00000100:00100000:1.0:1746066794.978375:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977028480 00002000:00100000:1.0:1746066794.978408:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2465792->2469887) req@ffff88009ef5c380 x1830882977028480/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.978417:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5c380 with x1830882977028480 ext(2465792->2469887) 00010000:00010000:1.0:1746066794.978424:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 20 pid: 4614 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066794.978440:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 20 pid: 4614 timeout: 856 lvb_type: 0 00002000:00010000:1.0:1746066794.978446:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef5c380 00000100:00100000:1.0:1746066794.978469:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2174 00000100:00100000:1.0:1746066794.978475:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977028480:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066794.978609:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977028480:12345-192.168.202.57@tcp:3:cat.0 Request processed in 133us (294us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066794.978615:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2174 00002000:00100000:1.0:1746066794.978620:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2465792->2469887) req@ffff88009ef5c380 x1830882977028480/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/4536 e 0 to 0 dl 1746066805 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066794.978626:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5c380 with x1830882977028480 ext(2465792->2469887) 00010000:00010000:1.0:1746066794.978630:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 20 pid: 4614 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066794.978638:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 20 pid: 4614 timeout: 856 lvb_type: 0 00002000:00010000:1.0:1746066794.978643:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef5c380 00000100:00100000:0.0:1746066794.992947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066794.993007:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977028736 00000100:00100000:2.0:1746066794.993015:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977028736 00000100:00100000:0.0:1746066794.993034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:2.0:1746066794.993048:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2465792->3145727) req@ffff88009ef5fb80 x1830882977028736/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/0 e 0 to 0 dl 1746066805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066794.993057:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5fb80 with x1830882977028736 ext(2465792->3145727) 00010000:00010000:2.0:1746066794.993065:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 20 pid: 4614 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066794.993451:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 20 pid: 4614 timeout: 856 lvb_type: 0 00002000:00010000:2.0:1746066794.993459:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef5fb80 00000100:00100000:3.0:1746066794.993523:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977028864 00000100:00100000:3.0:1746066794.993526:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977028864 00000100:00100000:3.0:1746066794.993548:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14764 00000100:00100000:3.0:1746066794.993553:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:31702:x1830882977028864:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066794.993564:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066794.993575:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb51 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.993602:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eea2600/0xfb36a14ee608befe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb04 expref: 21 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.993609:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a32800/0xfb36a14ee608bf60 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb3c expref: 17 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.993616:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.993617:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066794.993620:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->2461695] (req 2097152->2461695) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.993642:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a32800/0xfb36a14ee608bf60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb3c expref: 17 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.993651:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a32800/0xfb36a14ee608bf60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb3c expref: 17 pid: 4614 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746066794.993661:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976879744:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066794.993739:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eea2600/0xfb36a14ee608befe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb04 expref: 21 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066794.993746:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eea2600/0xfb36a14ee608befe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb04 expref: 21 pid: 4614 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746066794.993754:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135dfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976879872:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066794.993769:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e18000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066794.994136:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2175 00000100:00100000:2.0:1746066794.994143:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977028736:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066794.995874:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976879744:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066794.995883:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135dfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976879872:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066794.995903:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->2461695] (req 2097152->2461695) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066794.995921:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5941400, rc 0) 00000100:00100000:3.0:1746066794.995956:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:31702:x1830882977028864:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2401us (2920us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066794.995962:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14764 00000100:00100000:2.0:1746066795.001149:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.001177:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.001271:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977028992 00000100:00100000:2.0:1746066795.001274:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.001279:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977028992 00010000:00010000:0.0:1746066795.001314:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a32800/0xfb36a14ee608bf60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb3c expref: 17 pid: 4614 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746066795.001334:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977029248 00000100:00100000:0.0:1746066795.001336:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977029248 00010000:00010000:0.0:1746066795.001344:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea2600/0xfb36a14ee608befe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb04 expref: 22 pid: 4614 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746066795.001355:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7584 00000100:00100000:0.0:1746066795.001361:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977028992:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.001371:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.001387:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a32800/0xfb36a14ee608bf60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb3c expref: 17 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.001396:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a32800/0xfb36a14ee608bf60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb3c expref: 17 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.001415:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a32800/0xfb36a14ee608bf60 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb3c expref: 17 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.001430:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.001460:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977028992:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 98us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.001465:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7584 00000100:00100000:0.0:1746066795.001477:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7585 00000100:00100000:0.0:1746066795.001481:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977029248:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.001487:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.001493:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eea2600/0xfb36a14ee608befe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb04 expref: 22 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.001500:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eea2600/0xfb36a14ee608befe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb04 expref: 22 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.001510:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eea2600/0xfb36a14ee608befe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb04 expref: 22 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.001517:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.001519:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.001524:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 15 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.001530:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 15 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.001554:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 15 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066795.001563:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976880000:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066795.001614:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed9c0 going to sleep for 11 seconds 00000100:00080000:1.0:1746066795.001694:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746066795.001894:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977029120 00000100:00100000:3.0:1746066795.001898:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977029120 00000100:00100000:3.0:1746066795.001919:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14765 00000100:00100000:3.0:1746066795.001923:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31708:x1830882977029120:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066795.001934:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066795.001944:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb58 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.001959:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 15 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.001964:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066795.001965:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066795.001968:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.001983:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 15 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.001991:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 15 pid: 21203 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746066795.002003:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135dfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976880128:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066795.002029:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e18000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066795.003964:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977028736:12345-192.168.202.57@tcp:4:cat.0 Request processed in 9815us (11019us total) trans 17179873636 rc 0/0 00000100:00100000:2.0:1746066795.003973:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2175 00002000:00100000:2.0:1746066795.003982:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2465792->3145727) req@ffff88009ef5fb80 x1830882977028736/t17179873636(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:200/0 lens 488/448 e 0 to 0 dl 1746066805 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.003996:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5fb80 with x1830882977028736 ext(2465792->3145727) 00010000:00010000:2.0:1746066795.004003:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 22 pid: 4614 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.004013:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 22 pid: 4614 timeout: 856 lvb_type: 0 00002000:00010000:2.0:1746066795.004019:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef5fb80 00000100:00100000:0.0:1746066795.005372:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976880000:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066795.005388:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.005996:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882977029248:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4511us (4719us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.006005:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7585 00000100:00100000:0.0:1746066795.008745:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.010198:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977029504 00000100:00100000:2.0:1746066795.010206:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977029504 00002000:00100000:2.0:1746066795.010240:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2457600->2461695) req@ffff88009ef5d180 x1830882977029504/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.010249:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5d180 with x1830882977029504 ext(2457600->2461695) 00010000:00010000:2.0:1746066795.010256:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 16 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.010265:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 16 pid: 21203 timeout: 856 lvb_type: 0 00002000:00010000:2.0:1746066795.010271:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef5d180 00000100:00100000:2.0:1746066795.010287:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2176 00000100:00100000:2.0:1746066795.010293:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977029504:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066795.010428:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977029504:12345-192.168.202.57@tcp:3:cat.0 Request processed in 134us (1688us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066795.010433:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2176 00002000:00100000:2.0:1746066795.010439:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2457600->2461695) req@ffff88009ef5d180 x1830882977029504/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/4536 e 0 to 0 dl 1746066806 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.010444:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5d180 with x1830882977029504 ext(2457600->2461695) 00010000:00010000:2.0:1746066795.010448:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 16 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.010456:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 16 pid: 21203 timeout: 856 lvb_type: 0 00002000:00010000:2.0:1746066795.010460:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef5d180 00000100:00100000:3.0:1746066795.010710:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135dfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976880128:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066795.010893:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.010905:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea3c00, rc 0) 00000100:00100000:3.0:1746066795.011185:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31708:x1830882977029120:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 9259us (10005us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066795.011191:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14765 00000100:00100000:0.0:1746066795.012313:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.012375:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.012536:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977029632 00000100:00100000:2.0:1746066795.012541:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977029632 00010000:00010000:2.0:1746066795.012578:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 22 pid: 4614 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746066795.012605:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7586 00000100:00100000:2.0:1746066795.012611:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977029632:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066795.012620:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066795.012632:0:9852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066793 -> 1746066794 00002000:00010000:2.0:1746066795.012635:0:9852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066793 -> 1746066794 00010000:00010000:2.0:1746066795.012639:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 22 pid: 4614 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.012648:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 22 pid: 4614 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.012671:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96400/0xfb36a14ee608bf67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb43 expref: 22 pid: 4614 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.012703:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.012704:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.012711:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb97400/0xfb36a14ee608bf6e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb4a expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.012717:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb97400/0xfb36a14ee608bf6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb4a expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.012741:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb97400/0xfb36a14ee608bf6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb4a expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066795.012752:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b43100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976880256:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066795.012803:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21f8900 going to sleep for 11 seconds 00000100:00080000:1.0:1746066795.012858:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066795.013020:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977030144 00000100:00100000:3.0:1746066795.013023:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977030144 00000100:00100000:3.0:1746066795.013047:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4194 00000100:00100000:3.0:1746066795.013052:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:31702:x1830882977030144:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066795.013196:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:31702:x1830882977030144:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 143us (820us total) trans 8589944100 rc 0/0 00000100:00100000:3.0:1746066795.013202:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4194 00000100:00080000:1.0:1746066795.013508:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066795.013833:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.013928:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977029888 00000100:00100000:1.0:1746066795.013932:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977029888 00002000:00100000:1.0:1746066795.013953:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->2461695) req@ffff88009ef5d880 x1830882977029888/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066795.013962:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5d880 with x1830882977029888 ext(2097152->2461695) 00010000:00010000:1.0:1746066795.013968:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 16 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.013979:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 16 pid: 21203 timeout: 856 lvb_type: 0 00002000:00010000:1.0:1746066795.013985:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef5d880 00000100:00100000:1.0:1746066795.014009:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2177 00000100:00100000:1.0:1746066795.014015:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882977029888:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066795.017005:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136b43100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976880256:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066795.017023:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066795.017482:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977029632:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4870us (5170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066795.017492:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7586 00000100:00100000:0.0:1746066795.018599:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066795.018630:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977030400 00000100:00100000:3.0:1746066795.018636:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977030400 00002000:00100000:3.0:1746066795.018665:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009ef5ce00 x1830882977030400/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066795.018673:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5ce00 with x1830882977030400 ext(2097152->3145727) 00002000:00010000:3.0:1746066795.018697:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef5ce00 00000100:00100000:3.0:1746066795.018711:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6702 00000100:00100000:3.0:1746066795.018716:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1965:x1830882977030400:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066795.021577:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977029888:12345-192.168.202.57@tcp:4:cat.0 Request processed in 7554us (7782us total) trans 21474840953 rc 0/0 00000100:00100000:2.0:1746066795.021594:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2177 00002000:00100000:2.0:1746066795.021604:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->2461695) req@ffff88009ef5d880 x1830882977029888/t21474840953(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/448 e 0 to 0 dl 1746066806 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.021611:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5d880 with x1830882977029888 ext(2097152->2461695) 00010000:00010000:2.0:1746066795.021620:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 18 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.021637:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 18 pid: 21203 timeout: 856 lvb_type: 0 00002000:00010000:2.0:1746066795.021644:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef5d880 00000100:00100000:0.0:1746066795.028379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066795.028488:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977030528 00000100:00100000:3.0:1746066795.028496:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977030528 00010000:00010000:3.0:1746066795.028525:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 18 pid: 21203 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746066795.029377:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7587 00000100:00100000:3.0:1746066795.029386:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977030528:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066795.029400:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066795.029416:0:9852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066793 -> 1746066794 00002000:00010000:3.0:1746066795.029419:0:9852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066793 -> 1746066794 00010000:00010000:3.0:1746066795.029424:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 18 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:3.0:1746066795.029435:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 18 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:3.0:1746066795.029456:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5941400/0xfb36a14ee608bf75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2461695) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb51 expref: 18 pid: 21203 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746066795.030882:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1965:x1830882977030400:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12162us (12295us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066795.030890:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6702 00002000:00100000:2.0:1746066795.030898:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009ef5ce00 x1830882977030400/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/440 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.030906:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5ce00 with x1830882977030400 ext(2097152->3145727) 00002000:00010000:2.0:1746066795.030911:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef5ce00 00010000:00010000:3.0:1746066795.031084:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066795.031086:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066795.031094:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.031102:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.031129:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066795.031139:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135dfa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976880384:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066795.031177:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e18000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066795.037779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.037870:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.037894:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977030912 00000100:00100000:2.0:1746066795.037900:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977030912 00000100:00100000:3.0:1746066795.038038:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977030656 00000100:00100000:3.0:1746066795.038042:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977030656 00000100:00100000:3.0:1746066795.038072:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14766 00000100:00100000:3.0:1746066795.038078:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:31712:x1830882977030656:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066795.038093:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066795.038113:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecca600/0xfb36a14ee608bf83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb5f expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.038136:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.038143:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066795.038145:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066795.038148:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecca600/0xfb36a14ee608bf83 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb5f expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.038172:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.038183:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 22 pid: 21203 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746066795.038194:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976880512:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066795.038249:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00002000:00100000:2.0:1746066795.038300:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3006464->3010559) req@ffff880136b40a80 x1830882977030912/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.038307:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b40a80 with x1830882977030912 ext(3006464->3010559) 00000100:00100000:0.0:1746066795.038818:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135dfa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976880384:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066795.038833:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.038856:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977030528:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 9471us (10484us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.038865:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7587 00010000:00010000:2.0:1746066795.038952:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 22 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.038963:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 22 pid: 21203 timeout: 856 lvb_type: 0 00002000:00010000:2.0:1746066795.038974:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136b40a80 00000100:00100000:2.0:1746066795.038987:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2178 00000100:00100000:2.0:1746066795.038993:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977030912:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066795.039108:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977030912:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 115us (1236us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066795.039113:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2178 00002000:00100000:2.0:1746066795.039118:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3006464->3010559) req@ffff880136b40a80 x1830882977030912/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/4536 e 0 to 0 dl 1746066806 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.039126:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b40a80 with x1830882977030912 ext(3006464->3010559) 00010000:00010000:2.0:1746066795.039130:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 22 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.039139:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 22 pid: 21203 timeout: 856 lvb_type: 0 00002000:00010000:2.0:1746066795.039144:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136b40a80 00000100:00100000:3.0:1746066795.044005:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976880512:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066795.044030:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecca600/0xfb36a14ee608bf83 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb5f expref: 18 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.044047:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecca600, rc 0) 00000100:00100000:3.0:1746066795.044093:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:31712:x1830882977030656:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6014us (6320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066795.044101:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14766 00000100:00100000:0.0:1746066795.048157:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.048209:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.048292:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977031168 00000100:00100000:2.0:1746066795.048301:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977031168 00002000:00100000:2.0:1746066795.048340:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3006464->3145727) req@ffff88009ef5ed80 x1830882977031168/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.048349:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5ed80 with x1830882977031168 ext(3006464->3145727) 00010000:00010000:2.0:1746066795.048358:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 22 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.048376:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 22 pid: 21203 timeout: 856 lvb_type: 0 00002000:00010000:2.0:1746066795.048382:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef5ed80 00000100:00100000:2.0:1746066795.048397:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2179 00000100:00100000:2.0:1746066795.048404:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977031168:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066795.048648:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977031296 00000100:00100000:3.0:1746066795.048652:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977031296 00000100:00100000:3.0:1746066795.048927:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14767 00000100:00100000:3.0:1746066795.048931:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:31708:x1830882977031296:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066795.048938:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066795.048950:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb66 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.048967:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb97400/0xfb36a14ee608bf6e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb4a expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.048973:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066795.048975:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066795.048978:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4030463] (req 3145728->4030463) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.049000:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb97400/0xfb36a14ee608bf6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb4a expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.049008:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eb97400/0xfb36a14ee608bf6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb4a expref: 20 pid: 4614 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746066795.049017:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976880640:192.168.202.57@tcp:104: 00000100:00080000:1.0:1746066795.049100:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066795.049454:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066795.054133:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977031168:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 5722us (5975us total) trans 21474840954 rc 0/0 00000100:00100000:2.0:1746066795.054143:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2179 00002000:00100000:2.0:1746066795.054153:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3006464->3145727) req@ffff88009ef5ed80 x1830882977031168/t21474840954(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/448 e 0 to 0 dl 1746066806 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.054162:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5ed80 with x1830882977031168 ext(3006464->3145727) 00010000:00010000:2.0:1746066795.054171:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 24 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.054183:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 24 pid: 21203 timeout: 856 lvb_type: 0 00002000:00010000:2.0:1746066795.054189:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ef5ed80 00000100:00100000:0.0:1746066795.054970:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.055037:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977031424 00000100:00100000:1.0:1746066795.055043:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977031424 00010000:00010000:1.0:1746066795.055067:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb97400/0xfb36a14ee608bf6e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb4a expref: 21 pid: 4614 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746066795.055085:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7588 00000100:00100000:1.0:1746066795.055090:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977031424:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066795.055099:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066795.055114:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eb97400/0xfb36a14ee608bf6e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb4a expref: 21 pid: 4614 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.055122:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eb97400/0xfb36a14ee608bf6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb4a expref: 21 pid: 4614 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.055147:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.055148:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.055155:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.055163:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.055191:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066795.055201:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976880768:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066795.055242:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a540df00 going to sleep for 11 seconds 00010000:00010000:3.0:1746066795.055431:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb97400/0xfb36a14ee608bf6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb4a expref: 21 pid: 4614 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746066795.055538:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976880640:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066795.055557:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.055565:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eccaa00, rc 0) 00000100:00100000:3.0:1746066795.055596:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:31708:x1830882977031296:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6663us (7387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066795.055603:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14767 00000100:00100000:0.0:1746066795.056564:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.059454:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977031552 00000100:00100000:1.0:1746066795.059463:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977031552 00010000:00010000:1.0:1746066795.059490:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 24 pid: 21203 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746066795.059518:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7589 00000100:00100000:1.0:1746066795.059523:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1966:x1830882977031552:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066795.059533:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066795.059550:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 24 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.059559:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 24 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.059576:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eea3c00/0xfb36a14ee608bf7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb58 expref: 24 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.059609:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.059611:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.059617:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecca600/0xfb36a14ee608bf83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb5f expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.059624:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecca600/0xfb36a14ee608bf83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb5f expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.059652:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecca600/0xfb36a14ee608bf83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb5f expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066795.059661:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976880896:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066795.059733:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a494d480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066795.060084:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976880768:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066795.060097:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066795.060129:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977031424:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5038us (5161us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066795.060134:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7588 00000100:00100000:1.0:1746066795.071782:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976880896:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066795.071799:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066795.071843:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1966:x1830882977031552:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 12319us (15279us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066795.071856:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7589 00000100:00100000:0.0:1746066795.073487:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.073921:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977031808 00000100:00100000:2.0:1746066795.073929:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977031808 00002000:00100000:2.0:1746066795.073964:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800931d1500 x1830882977031808/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.073973:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d1500 with x1830882977031808 ext(2097152->3145727) 00002000:00010000:2.0:1746066795.073977:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800931d1500 00000100:00100000:2.0:1746066795.073993:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6703 00000100:00100000:2.0:1746066795.073999:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977031808:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066795.077855:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.079276:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977032064 00000100:00100000:2.0:1746066795.079284:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977032064 00002000:00100000:2.0:1746066795.079318:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4026368->4030463) req@ffff8800931d0000 x1830882977032064/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.079326:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0000 with x1830882977032064 ext(4026368->4030463) 00002000:00010000:2.0:1746066795.079331:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d0000 00000100:00100000:2.0:1746066795.079348:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6704 00000100:00100000:2.0:1746066795.079353:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977032064:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066795.081924:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977032064:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 2559us (4066us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066795.081935:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6704 00002000:00100000:2.0:1746066795.081944:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4026368->4030463) req@ffff8800931d0000 x1830882977032064/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/4536 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.081952:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0000 with x1830882977032064 ext(4026368->4030463) 00002000:00010000:2.0:1746066795.081957:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d0000 00000100:00100000:3.0:1746066795.082941:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977031808:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8938us (9456us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066795.082948:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6703 00002000:00100000:3.0:1746066795.082954:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800931d1500 x1830882977031808/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/440 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066795.082960:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d1500 with x1830882977031808 ext(2097152->3145727) 00002000:00010000:3.0:1746066795.082964:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800931d1500 00000100:00100000:0.0:1746066795.091197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066795.092410:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977032192 00000100:00100000:3.0:1746066795.092418:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977032192 00000100:00100000:3.0:1746066795.092470:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14768 00000100:00100000:3.0:1746066795.092476:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:31712:x1830882977032192:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066795.092492:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066795.092510:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eccb600/0xfb36a14ee608bf91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb6d expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.092534:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 29 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.092540:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066795.092542:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066795.092545:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eccb600/0xfb36a14ee608bf91 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb6d expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.092568:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 29 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.092592:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 29 pid: 21203 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746066795.092602:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976881024:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066795.093548:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066795.096139:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976881024:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066795.096167:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eccb600/0xfb36a14ee608bf91 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb6d expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.096182:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eccb600, rc 0) 00000100:00100000:3.0:1746066795.096230:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:31712:x1830882977032192:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3753us (5041us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066795.096237:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14768 00000100:00100000:0.0:1746066795.098104:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066795.098354:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977032320 00000100:00100000:3.0:1746066795.098361:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977032320 00002000:00100000:3.0:1746066795.098392:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4030463) req@ffff8800931d0700 x1830882977032320/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066795.098401:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0700 with x1830882977032320 ext(3145728->4030463) 00010000:00010000:3.0:1746066795.098408:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 30 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:3.0:1746066795.098419:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 30 pid: 21203 timeout: 856 lvb_type: 0 00002000:00010000:3.0:1746066795.098430:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800931d0700 00000100:00100000:3.0:1746066795.098455:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2180 00000100:00100000:3.0:1746066795.098461:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977032320:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066795.112371:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977032320:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 13900us (14261us total) trans 17179873637 rc 0/0 00000100:00100000:3.0:1746066795.112382:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2180 00002000:00100000:3.0:1746066795.112392:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4030463) req@ffff8800931d0700 x1830882977032320/t17179873637(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/448 e 0 to 0 dl 1746066806 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066795.112401:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0700 with x1830882977032320 ext(3145728->4030463) 00010000:00010000:3.0:1746066795.112409:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 32 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:3.0:1746066795.112422:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 32 pid: 21203 timeout: 856 lvb_type: 0 00002000:00010000:3.0:1746066795.112428:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800931d0700 00000100:00100000:0.0:1746066795.114148:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.114189:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.114240:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977032448 00000100:00100000:2.0:1746066795.114248:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977032448 00000100:00100000:3.0:1746066795.114429:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977032576 00000100:00100000:3.0:1746066795.114433:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977032576 00000100:00100000:2.0:1746066795.114434:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14769 00000100:00100000:2.0:1746066795.114442:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882977032448:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066795.114456:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066795.114457:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14770 00000100:00100000:3.0:1746066795.114462:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1965:x1830882977032576:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066795.114468:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ff40000/0xfb36a14ee608bf98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb74 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.114469:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066795.114478:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092591600/0xfb36a14ee608bf9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb7b expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.114493:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066795.114495:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066795.114501:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092591600/0xfb36a14ee608bf9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb7b expref: 24 pid: 8452 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066795.114510:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976881152:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066795.114512:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092591600/0xfb36a14ee608bf9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb7b expref: 24 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066795.114521:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092591600, rc 0) 00000100:00100000:3.0:1746066795.115786:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1965:x1830882977032576:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1318us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066795.115793:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14770 00000100:00100000:1.0:1746066795.115807:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.115824:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977032704 00000100:00100000:0.0:1746066795.115828:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977032704 00010000:00010000:0.0:1746066795.115844:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 34 pid: 21203 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746066795.115855:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21f8900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066795.115867:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7590 00000100:00100000:0.0:1746066795.115873:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882977032704:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.115882:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.115899:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 34 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746066795.115908:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 34 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746066795.115925:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.115926:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.115931:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eccb600/0xfb36a14ee608bf91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb6d expref: 20 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.115939:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eccb600/0xfb36a14ee608bf91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb6d expref: 20 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.115958:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eccb600/0xfb36a14ee608bf91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb6d expref: 20 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066795.115966:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976881280:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066795.115989:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066795.121777:0:4614:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.57@tcp) returned -22 from glimpse AST (req@ffff880136b43100 x1830882976881152) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 34 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.121808:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eccaa00/0xfb36a14ee608bf8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4030463) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb66 expref: 34 pid: 21203 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746066795.121831:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136b43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976881152:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066795.121856:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ff40000/0xfb36a14ee608bf98 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb74 expref: 33 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066795.121866:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ff40000/0xfb36a14ee608bf98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb74 expref: 33 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066795.121872:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff40000, rc 0) 00000100:00100000:2.0:1746066795.121918:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882977032448:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7477us (7776us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066795.121925:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14769 00000100:00100000:2.0:1746066795.126065:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.126085:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976881280:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066795.126101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066795.126102:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066795.126120:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977032960 00000100:00100000:2.0:1746066795.126125:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977032960 00000100:00100000:0.0:1746066795.126145:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882977032704:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 10271us (10337us total) trans 0 rc 0/0 00002000:00100000:2.0:1746066795.126154:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880136b43100 x1830882977032960/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066795.126154:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7590 00002000:00100000:2.0:1746066795.126164:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b43100 with x1830882977032960 ext(3145728->4194303) 00002000:00010000:2.0:1746066795.126168:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b43100 00000100:00100000:2.0:1746066795.126177:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977033216 00000100:00100000:2.0:1746066795.126179:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977033216 00002000:00100000:2.0:1746066795.126186:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009ed73100 x1830882977033216/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066795.126191:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6705 00002000:00100000:2.0:1746066795.126192:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73100 with x1830882977033216 ext(3145728->4194303) 00002000:00010000:2.0:1746066795.126194:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed73100 00000100:00100000:0.0:1746066795.126198:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1966:x1830882977032960:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066795.126202:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6706 00000100:00100000:2.0:1746066795.126206:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977033216:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066795.146224:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977033216:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20009us (20114us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066795.146234:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6706 00002000:00100000:2.0:1746066795.146245:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009ed73100 x1830882977033216/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/440 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.146254:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73100 with x1830882977033216 ext(3145728->4194303) 00002000:00010000:2.0:1746066795.146259:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed73100 00000100:00100000:1.0:1746066795.152551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.152626:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977033344 00000100:00100000:2.0:1746066795.152633:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977033344 00000100:00100000:2.0:1746066795.152700:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14771 00000100:00100000:2.0:1746066795.152706:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:31719:x1830882977033344:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066795.152720:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066795.152734:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608bfa6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb82 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.152754:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.152756:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.152762:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608bfa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb82 expref: 32 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.152773:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608bfa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb82 expref: 32 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.152781:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff40200, rc 0) 00000100:00100000:2.0:1746066795.152821:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:31719:x1830882977033344:12345-192.168.202.57@tcp:101:cat.0 Request processed in 115us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.152826:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14771 00000100:00100000:0.0:1746066795.154860:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1966:x1830882977032960:12345-192.168.202.57@tcp:3:cat.0 Request processed in 28657us (28797us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066795.154868:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6705 00002000:00100000:0.0:1746066795.154877:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880136b43100 x1830882977032960/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/440 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.154885:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b43100 with x1830882977032960 ext(3145728->4194303) 00002000:00010000:0.0:1746066795.154889:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b43100 00000100:00100000:0.0:1746066795.164240:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.164590:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977033600 00000100:00100000:2.0:1746066795.164598:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977033600 00002000:00100000:2.0:1746066795.164633:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800931d0e00 x1830882977033600/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.164642:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0e00 with x1830882977033600 ext(4194304->5091327) 00002000:00010000:2.0:1746066795.164646:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d0e00 00000100:00100000:2.0:1746066795.164671:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6707 00000100:00100000:2.0:1746066795.164694:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1965:x1830882977033600:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066795.174089:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.174118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.174143:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.174167:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.174187:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977033984 00000100:00100000:1.0:1746066795.174194:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977033984 00002000:00100000:1.0:1746066795.174228:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88012c7b2450 x1830882977033984/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066795.174236:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c7b2450 with x1830882977033984 ext(2097152->3145727) 00002000:00010000:1.0:1746066795.174241:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c7b2450 00000100:00100000:1.0:1746066795.174254:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977034112 00000100:00100000:1.0:1746066795.174256:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977034112 00002000:00100000:1.0:1746066795.174266:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a590f100 x1830882977034112/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066795.174272:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590f100 with x1830882977034112 ext(3145728->4194303) 00002000:00010000:1.0:1746066795.174274:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590f100 00000100:00100000:1.0:1746066795.174282:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977034496 00000100:00100000:1.0:1746066795.174284:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977034496 00002000:00100000:1.0:1746066795.174293:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a590dc00 x1830882977034496/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066795.174299:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590dc00 with x1830882977034496 ext(3145728->4194303) 00002000:00010000:1.0:1746066795.174301:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590dc00 00000100:00100000:1.0:1746066795.174309:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977034368 00000100:00100000:1.0:1746066795.174310:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977034368 00002000:00100000:1.0:1746066795.174318:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a590c000 x1830882977034368/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066795.174322:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590c000 with x1830882977034368 ext(2097152->3145727) 00002000:00010000:1.0:1746066795.174324:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590c000 00000100:00100000:1.0:1746066795.174332:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6708 00000100:00100000:1.0:1746066795.174337:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c7b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977033984:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066795.175281:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6709 00000100:00100000:1.0:1746066795.175287:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977034112:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066795.176480:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6710 00000100:00100000:0.0:1746066795.176489:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977034496:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066795.177520:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6711 00000100:00100000:2.0:1746066795.177528:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977034368:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066795.181336:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1965:x1830882977033600:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16650us (17094us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066795.181351:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6707 00002000:00100000:2.0:1746066795.181361:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800931d0e00 x1830882977033600/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/440 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.181369:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0e00 with x1830882977033600 ext(4194304->5091327) 00002000:00010000:2.0:1746066795.181374:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d0e00 00000100:00100000:1.0:1746066795.196738:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c7b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977033984:12345-192.168.202.57@tcp:3:cat.0 Request processed in 22392us (22647us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066795.196750:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6708 00002000:00100000:1.0:1746066795.196759:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88012c7b2450 x1830882977033984/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/440 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066795.196767:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c7b2450 with x1830882977033984 ext(2097152->3145727) 00002000:00010000:1.0:1746066795.196771:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c7b2450 00000100:00100000:1.0:1746066795.205044:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977034112:12345-192.168.202.57@tcp:3:cat.0 Request processed in 29744us (30912us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066795.205055:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6709 00002000:00100000:1.0:1746066795.205067:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a590f100 x1830882977034112/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/440 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066795.205075:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590f100 with x1830882977034112 ext(3145728->4194303) 00002000:00010000:1.0:1746066795.205081:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590f100 00000100:00100000:2.0:1746066795.209839:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977034496:12345-192.168.202.57@tcp:3:cat.0 Request processed in 33345us (35687us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066795.209849:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6710 00002000:00100000:2.0:1746066795.209859:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a590dc00 x1830882977034496/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/440 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.209868:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590dc00 with x1830882977034496 ext(3145728->4194303) 00002000:00010000:2.0:1746066795.209872:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590dc00 00000100:00100000:2.0:1746066795.215848:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977034368:12345-192.168.202.57@tcp:3:cat.0 Request processed in 38311us (41670us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066795.215860:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6711 00002000:00100000:2.0:1746066795.215872:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a590c000 x1830882977034368/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/440 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.215881:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590c000 with x1830882977034368 ext(2097152->3145727) 00002000:00010000:2.0:1746066795.215886:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590c000 00000100:00100000:0.0:1746066795.221102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.221150:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066795.221234:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977034880 00000100:00100000:3.0:1746066795.221241:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977034880 00000100:00100000:3.0:1746066795.221279:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14772 00000100:00100000:3.0:1746066795.221286:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:31721:x1830882977034880:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066795.221305:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066795.221320:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb89 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.221342:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5940c00/0xfb36a14ee608bef7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaf6 expref: 33 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066795.221349:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a32600/0xfb36a14ee608bf52 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb2e expref: 20 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066795.221359:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066795.221361:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066795.221364:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 5/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1269760->1294335] (req 1269760->1294335) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 33 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.221385:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a32600/0xfb36a14ee608bf52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb2e expref: 20 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066795.221394:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a32600/0xfb36a14ee608bf52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb2e expref: 20 pid: 4614 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746066795.221403:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976881408:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066795.221471:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5940c00/0xfb36a14ee608bef7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaf6 expref: 33 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066795.221477:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5940c00/0xfb36a14ee608bef7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaf6 expref: 33 pid: 10402 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746066795.221483:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976881536:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066795.221496:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066795.221550:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977035008 00000100:00100000:2.0:1746066795.221553:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977035008 00002000:00100000:2.0:1746066795.221572:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800931d3800 x1830882977035008/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.221594:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d3800 with x1830882977035008 ext(4194304->5091327) 00002000:00010000:2.0:1746066795.221597:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d3800 00000100:00100000:2.0:1746066795.221615:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6712 00000100:00100000:2.0:1746066795.221619:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977035008:12345-192.168.202.57@tcp:3:multiop.0 00010000:00010000:2.0:1746066795.230111:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746066795.237528:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976881408:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066795.238150:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977035008:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 16528us (16997us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066795.238159:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6712 00002000:00100000:2.0:1746066795.238169:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800931d3800 x1830882977035008/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/440 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 897024/897024 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066795.238177:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d3800 with x1830882977035008 ext(4194304->5091327) 00002000:00010000:2.0:1746066795.238182:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d3800 00000100:00100000:3.0:1746066795.239111:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976881536:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066795.239134:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1269760->1294335] (req 1269760->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 33 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.239151:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50c2a00, rc 0) 00000100:00100000:3.0:1746066795.239186:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:31721:x1830882977034880:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 17899us (18091us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066795.239192:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14772 00000100:00100000:0.0:1746066795.239897:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.239950:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977035136 00000100:00100000:2.0:1746066795.239956:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977035136 00010000:00010000:2.0:1746066795.239975:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a32600/0xfb36a14ee608bf52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb2e expref: 21 pid: 4614 timeout: 856 lvb_type: 1 00000100:00100000:2.0:1746066795.240002:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7591 00000100:00100000:2.0:1746066795.240007:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977035136:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066795.240016:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066795.240030:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a32600/0xfb36a14ee608bf52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb2e expref: 21 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066795.240038:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a32600/0xfb36a14ee608bf52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb2e expref: 21 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066795.240054:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a32600/0xfb36a14ee608bf52 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb2e expref: 21 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066795.240091:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066795.240195:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977035136:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 186us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.240200:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7591 00000100:00100000:0.0:1746066795.245337:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.245701:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977035264 00000100:00100000:2.0:1746066795.245708:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977035264 00010000:00010000:2.0:1746066795.245736:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5940c00/0xfb36a14ee608bef7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaf6 expref: 33 pid: 10402 timeout: 856 lvb_type: 1 00000100:00100000:2.0:1746066795.245766:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7592 00000100:00100000:2.0:1746066795.245771:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977035264:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066795.245782:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066795.245798:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5940c00/0xfb36a14ee608bef7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaf6 expref: 33 pid: 10402 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066795.245808:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5940c00/0xfb36a14ee608bef7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaf6 expref: 33 pid: 10402 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066795.245825:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5940c00/0xfb36a14ee608bef7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaf6 expref: 33 pid: 10402 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066795.245847:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.245850:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.245855:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1294335) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 32 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.245861:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1294335) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 32 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.245886:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 32 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066795.245895:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976881664:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066795.245955:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21f8900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066795.251994:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066795.252228:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977035392 00000100:00100000:3.0:1746066795.252235:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977035392 00000100:00100000:3.0:1746066795.252277:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14773 00000100:00100000:3.0:1746066795.252284:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977035392:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066795.252298:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066795.252312:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb97800/0xfb36a14ee608bfb4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb90 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066795.252352:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976881792:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066795.252939:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c88a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066795.253573:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.253950:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976881664:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066795.253962:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066795.253985:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977035264:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8213us (8664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.253992:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7592 00000100:00100000:3.0:1746066795.254461:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977035648 00000100:00100000:3.0:1746066795.254465:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977035648 00002000:00100000:3.0:1746066795.254492:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x390:0x0] (1269760->1273855) req@ffff8800931d0380 x1830882977035648/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066795.254500:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0380 with x1830882977035648 ext(1269760->1273855) 00002000:00010000:3.0:1746066795.254504:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d0380 00000100:00100000:3.0:1746066795.254528:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6713 00000100:00100000:3.0:1746066795.254534:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882977035648:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066795.254704:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882977035648:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 169us (1131us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066795.254709:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6713 00002000:00100000:3.0:1746066795.254714:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x390:0x0] (1269760->1273855) req@ffff8800931d0380 x1830882977035648/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/4536 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066795.254720:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0380 with x1830882977035648 ext(1269760->1273855) 00002000:00010000:3.0:1746066795.254723:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d0380 00000100:00100000:1.0:1746066795.257606:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00010000:3.0:1746066795.257711:0:8452:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime: 1746066793 -> 1746066794 00002000:00010000:3.0:1746066795.257714:0:8452:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime: 1746066793 -> 1746066794 00002000:00010000:3.0:1746066795.257716:0:8452:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime: 1746066793 -> 1746066794 00000100:00100000:3.0:1746066795.257732:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976881792:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066795.257756:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb97800/0xfb36a14ee608bfb4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb90 expref: 33 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066795.257767:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb97800/0xfb36a14ee608bfb4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb90 expref: 33 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066795.257780:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb97800, rc 0) 00000100:00100000:2.0:1746066795.257869:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977035904 00000100:00100000:2.0:1746066795.257875:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977035904 00000100:00100000:2.0:1746066795.257906:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10035 00000100:00100000:2.0:1746066795.257912:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:31724:x1830882977035904:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066795.257927:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066795.257938:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41c00/0xfb36a14ee608bfbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb97 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.258012:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608bfc2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258024:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608bfc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258032:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608bfc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258042:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258047:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258052:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258131:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608bfd0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258139:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608bfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258144:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608bfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:2.0:1746066795.258151:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066795.258214:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608bfc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258220:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608bfc2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258225:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608bfc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258233:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ff40800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066795.258236:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608bfc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258241:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608bfc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258250:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066795.258252:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066795.258256:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608bfc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258260:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608bfc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258271:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258275:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfc9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258279:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258283:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ff41600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066795.258285:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258289:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfc9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258294:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13100) 00010000:00010000:2.0:1746066795.258296:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066795.258298:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfc9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258301:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.258326:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41c00/0xfb36a14ee608bfbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb97 expref: 26 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.258334:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608bfd0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb97 expref: 25 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.258339:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066795.258341:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066795.258343:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff40a00, rc 0) 00000100:00100000:3.0:1746066795.258572:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977035392:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6287us (6584us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066795.258579:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14773 00000100:00100000:2.0:1746066795.260148:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:31724:x1830882977035904:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2231us (2544us total) trans 8589944101 rc 0/0 00000100:00100000:2.0:1746066795.260155:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10035 00000100:00100000:0.0:1746066795.260316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.260378:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977036160 00000100:00100000:0.0:1746066795.260383:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977036160 00002000:00100000:0.0:1746066795.260407:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1290240->1294335) req@ffff8800931d0000 x1830882977036160/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.260415:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0000 with x1830882977036160 ext(1290240->1294335) 00002000:00010000:0.0:1746066795.260418:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d0000 00000100:00100000:0.0:1746066795.260444:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6714 00000100:00100000:0.0:1746066795.260449:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977036160:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066795.260559:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977036160:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 109us (243us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066795.260565:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6714 00002000:00100000:0.0:1746066795.260569:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1290240->1294335) req@ffff8800931d0000 x1830882977036160/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/4536 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.260590:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d0000 with x1830882977036160 ext(1290240->1294335) 00002000:00010000:0.0:1746066795.260592:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d0000 00000100:00100000:0.0:1746066795.263335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.265152:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977036288 00000100:00100000:2.0:1746066795.265161:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977036288 00000100:00100000:2.0:1746066795.265217:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 715 00000100:00100000:2.0:1746066795.265224:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882977036288:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066795.265237:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066795.265262:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608bfd0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb97 expref: 25 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.265287:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066795.265291:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066795.265329:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882977036288:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 106us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.265335:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 715 00000100:00100000:0.0:1746066795.268367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066795.268972:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977036416 00000100:00100000:3.0:1746066795.268979:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977036416 00000100:00100000:3.0:1746066795.269061:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14774 00000100:00100000:3.0:1746066795.269068:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:31724:x1830882977036416:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066795.269082:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066795.269096:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eb9e expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.269117:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eccb600/0xfb36a14ee608bf91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb6d expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.269125:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608bfa6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb82 expref: 31 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.269131:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066795.269132:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066795.269135:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2985984->3145727] (req 2985984->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 21 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.269158:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608bfa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb82 expref: 31 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.269168:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608bfa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb82 expref: 31 pid: 4614 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746066795.269178:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976881920:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066795.269568:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eccb600/0xfb36a14ee608bf91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb6d expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.269576:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eccb600/0xfb36a14ee608bf91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb6d expref: 21 pid: 21203 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746066795.269594:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976882048:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066795.269614:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a866ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066795.273945:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976881920:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066795.273955:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976882048:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066795.273978:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2985984->3145727] (req 2985984->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 21 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.273995:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb96c00, rc 0) 00000100:00100000:2.0:1746066795.274030:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:31724:x1830882977036416:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4963us (5668us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.274038:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14774 00000100:00100000:0.0:1746066795.274981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.275053:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977036544 00000100:00100000:0.0:1746066795.275060:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.275061:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977036544 00010000:00010000:1.0:1746066795.275083:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608bfa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb82 expref: 32 pid: 4614 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746066795.275105:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977036672 00000100:00100000:1.0:1746066795.275107:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977036672 00000100:00100000:0.0:1746066795.275115:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7593 00010000:00010000:1.0:1746066795.275116:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eccb600/0xfb36a14ee608bf91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb6d expref: 21 pid: 21203 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746066795.275122:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977036544:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066795.275128:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7594 00000100:00100000:1.0:1746066795.275132:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977036672:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.275132:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066795.275138:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066795.275149:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eccb600/0xfb36a14ee608bf91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb6d expref: 21 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746066795.275149:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608bfa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb82 expref: 32 pid: 4614 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746066795.275158:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608bfa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb82 expref: 32 pid: 4614 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.275173:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eccb600/0xfb36a14ee608bf91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb6d expref: 21 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746066795.275189:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608bfa6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb82 expref: 32 pid: 4614 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.275192:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eccb600/0xfb36a14ee608bf91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb6d expref: 21 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746066795.275210:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.275212:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.275217:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.275223:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.275248:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.275251:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.275258:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976882176:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066795.275273:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977036672:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 140us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066795.275278:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7594 00000100:00100000:0.0:1746066795.275383:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066795.276557:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976882176:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066795.276571:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066795.276615:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882977036544:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1494us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.276622:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7593 00000100:00100000:0.0:1746066795.276763:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066795.276810:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977036928 00000100:00100000:3.0:1746066795.276815:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977036928 00002000:00100000:3.0:1746066795.276950:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (2985984->2990079) req@ffff8800931d2a00 x1830882977036928/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066795.276958:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d2a00 with x1830882977036928 ext(2985984->2990079) 00002000:00010000:3.0:1746066795.276962:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d2a00 00000100:00100000:3.0:1746066795.277006:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6715 00000100:00100000:3.0:1746066795.277013:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977036928:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066795.277198:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977036928:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 185us (437us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066795.277203:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6715 00002000:00100000:3.0:1746066795.277207:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (2985984->2990079) req@ffff8800931d2a00 x1830882977036928/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/4536 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066795.277214:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d2a00 with x1830882977036928 ext(2985984->2990079) 00002000:00010000:3.0:1746066795.277216:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931d2a00 00000100:00100000:0.0:1746066795.279668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.279760:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977037056 00000100:00100000:2.0:1746066795.279766:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977037056 00000100:00100000:2.0:1746066795.279793:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14775 00000100:00100000:2.0:1746066795.279799:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:31724:x1830882977037056:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066795.279811:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066795.279823:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eba5 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.279843:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecca600/0xfb36a14ee608bf83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb5f expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.279851:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092591600/0xfb36a14ee608bf9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb7b expref: 23 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066795.279856:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.279858:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.279861:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->2109439] (req 2097152->2109439) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.279884:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092591600/0xfb36a14ee608bf9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb7b expref: 23 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066795.279894:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092591600/0xfb36a14ee608bf9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb7b expref: 23 pid: 8452 timeout: 856 lvb_type: 1 00000100:00100000:2.0:1746066795.279903:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976882304:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066795.279974:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecca600/0xfb36a14ee608bf83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb5f expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.279981:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ecca600/0xfb36a14ee608bf83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb5f expref: 19 pid: 21203 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746066795.279988:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976882432:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066795.280004:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066795.282128:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976882304:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066795.282141:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976882432:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066795.282163:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->2109439] (req 2097152->2109439) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.282176:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff41600, rc 0) 00000100:00100000:2.0:1746066795.282218:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:31724:x1830882977037056:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2418us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.282225:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14775 00000100:00100000:0.0:1746066795.284143:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.284243:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977037184 00000100:00100000:2.0:1746066795.284250:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977037184 00010000:00010000:2.0:1746066795.284389:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecca600/0xfb36a14ee608bf83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb5f expref: 19 pid: 21203 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746066795.284485:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7595 00000100:00100000:2.0:1746066795.284493:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977037184:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066795.284504:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066795.284717:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066795.284756:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ecca600/0xfb36a14ee608bf83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb5f expref: 19 pid: 21203 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.284767:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ecca600/0xfb36a14ee608bf83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb5f expref: 19 pid: 21203 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746066795.284771:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977037312 00000100:00100000:0.0:1746066795.284774:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977037312 00010000:00010000:0.0:1746066795.284786:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092591600/0xfb36a14ee608bf9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb7b expref: 24 pid: 8452 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066795.284792:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecca600/0xfb36a14ee608bf83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb5f expref: 19 pid: 21203 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746066795.284809:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7596 00000100:00100000:0.0:1746066795.284814:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1966:x1830882977037312:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.284820:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.284828:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092591600/0xfb36a14ee608bf9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb7b expref: 24 pid: 8452 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.284835:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092591600/0xfb36a14ee608bf9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb7b expref: 24 pid: 8452 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.284847:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092591600/0xfb36a14ee608bf9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb7b expref: 24 pid: 8452 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066795.284853:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066795.284858:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.284860:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.284864:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.284871:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066795.284879:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977037184:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 387us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.284884:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7595 00010000:00010000:0.0:1746066795.284894:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 17 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066795.284904:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976882560:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066795.284960:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066795.286053:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976882560:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066795.286069:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066795.286098:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1966:x1830882977037312:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1283us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.286104:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7596 00000100:00100000:0.0:1746066795.286394:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066795.286521:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977037568 00000100:00100000:3.0:1746066795.286525:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977037568 00002000:00100000:3.0:1746066795.286552:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38f:0x0] (2105344->2109439) req@ffff8800931d2680 x1830882977037568/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066795.286561:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d2680 with x1830882977037568 ext(2105344->2109439) 00002000:00010000:3.0:1746066795.286568:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800931d2680 00000100:00100000:3.0:1746066795.286598:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6716 00000100:00100000:3.0:1746066795.286604:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977037568:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066795.286749:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977037568:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 144us (355us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066795.286754:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6716 00002000:00100000:3.0:1746066795.286759:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38f:0x0] (2105344->2109439) req@ffff8800931d2680 x1830882977037568/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/4536 e 0 to 0 dl 1746066806 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066795.286766:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931d2680 with x1830882977037568 ext(2105344->2109439) 00002000:00010000:3.0:1746066795.286769:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800931d2680 00000100:00100000:0.0:1746066795.288284:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.288321:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977037824 00000100:00100000:2.0:1746066795.288326:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977037824 00000100:00100000:2.0:1746066795.288359:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4195 00000100:00100000:2.0:1746066795.288364:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:31724:x1830882977037824:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066795.288539:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:31724:x1830882977037824:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 174us (258us total) trans 8589944102 rc 0/0 00000100:00100000:2.0:1746066795.288545:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4195 00000100:00100000:0.0:1746066795.297645:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.297786:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977037952 00000100:00100000:2.0:1746066795.297793:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977037952 00000100:00100000:2.0:1746066795.297851:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10036 00000100:00100000:2.0:1746066795.297859:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31728:x1830882977037952:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066795.297879:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066795.297896:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f160400/0xfb36a14ee608bfec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ebac expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.297944:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092591600/0xfb36a14ee608bff3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.297955:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092591600/0xfb36a14ee608bff3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.297964:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092591600/0xfb36a14ee608bff3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.297975:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee608bffa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.297981:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee608bffa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.297985:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee608bffa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.298073:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.298081:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb0b expref: 263 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.298087:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.298111:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb0b expref: 263 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.298120:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb0b expref: 263 pid: 14550 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746066795.298131:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976882688:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066795.298188:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191a80 going to sleep for 11 seconds 00000100:00080000:1.0:1746066795.298273:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066795.299430:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976882688:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066795.299448:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066795.299825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066795.299869:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977038208 00000100:00100000:3.0:1746066795.299874:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977038208 00000100:00100000:3.0:1746066795.300115:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4196 00000100:00100000:3.0:1746066795.300122:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:27101:x1830882977038208:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00080000:1.0:1746066795.300159:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066795.300291:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:27101:x1830882977038208:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 170us (467us total) trans 8589944103 rc 0/0 00000100:00100000:3.0:1746066795.300298:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4196 00000100:00100000:0.0:1746066795.302115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.302207:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977038336 00000100:00100000:2.0:1746066795.302212:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977038336 00010000:00010000:2.0:1746066795.302234:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb0b expref: 265 pid: 14550 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746066795.302263:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7597 00000100:00100000:2.0:1746066795.302269:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:1963:x1830882977038336:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066795.302278:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066795.302283:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb0b expref: 265 pid: 14550 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.302291:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb0b expref: 265 pid: 14550 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.302308:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608bf0c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb0b expref: 265 pid: 14550 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.302330:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066795.302334:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.302343:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.302348:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.302376:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066795.302398:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:1963:x1830882977038336:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 130us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.302404:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7597 00010000:00010000:3.0:1746066795.303087:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303094:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:3.0:1746066795.303125:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066795.303129:0:14550:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066795.303140:0:14550:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303148:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303158:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092591600/0xfb36a14ee608bff3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303164:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092591600/0xfb36a14ee608bff3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303169:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092591600/0xfb36a14ee608bff3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303173:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092591600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066795.303177:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092591600/0xfb36a14ee608bff3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303182:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092591600/0xfb36a14ee608bff3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303191:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066795.303193:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066795.303196:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092591600/0xfb36a14ee608bff3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303199:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092591600/0xfb36a14ee608bff3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303208:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee608bffa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303212:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee608bffa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303216:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee608bffa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303220:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092590800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066795.303222:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee608bffa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303227:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee608bffa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303232:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13100) 00010000:00010000:3.0:1746066795.303234:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066795.303236:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee608bffa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303240:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092590800/0xfb36a14ee608bffa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.303263:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f160400/0xfb36a14ee608bfec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebac expref: 14 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.303274:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebac expref: 13 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.303279:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066795.303280:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066795.303282:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092591000, rc 0) 00000100:00100000:3.0:1746066795.303321:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:31728:x1830882977037952:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 5463us (5685us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066795.303326:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10036 00000100:00100000:0.0:1746066795.306036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.306071:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.306091:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.306113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.306136:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977038464 00000100:00100000:0.0:1746066795.306143:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977038464 00000100:00100000:0.0:1746066795.306189:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977038720 00000100:00100000:0.0:1746066795.306191:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977038720 00000100:00100000:0.0:1746066795.306204:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977038592 00000100:00100000:0.0:1746066795.306205:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977038592 00000100:00100000:0.0:1746066795.306213:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977038848 00000100:00100000:0.0:1746066795.306215:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977038848 00000100:00100000:0.0:1746066795.306228:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14776 00000100:00100000:0.0:1746066795.306234:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977038464:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066795.306248:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066795.306261:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eea3e00/0xfb36a14ee608c008 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ebb3 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.306277:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.306279:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.306286:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eea3e00/0xfb36a14ee608c008 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebb3 expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066795.306298:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eea3e00/0xfb36a14ee608c008 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebb3 expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066795.306307:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea3e00, rc 0) 00000100:00100000:0.0:1746066795.306334:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977038464:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 101us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.306340:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14776 00000100:00100000:0.0:1746066795.306352:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14777 00000100:00100000:0.0:1746066795.306356:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977038720:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066795.306361:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066795.306371:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eea3600/0xfb36a14ee608c00f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ebc1 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.306380:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.306381:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.306385:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea3600/0xfb36a14ee608c00f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebc1 expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066795.306393:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eea3600/0xfb36a14ee608c00f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebc1 expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066795.306400:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea3600, rc 0) 00000100:00100000:0.0:1746066795.306413:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977038720:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 57us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.306417:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14777 00000100:00100000:0.0:1746066795.306426:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14778 00000100:00100000:0.0:1746066795.306430:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977038592:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066795.306435:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066795.306440:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eea2400/0xfb36a14ee608c016 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ebba expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.306448:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.306449:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.306453:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea2400/0xfb36a14ee608c016 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebba expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066795.306460:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eea2400/0xfb36a14ee608c016 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebba expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066795.306471:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea2400, rc 0) 00000100:00100000:0.0:1746066795.306484:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977038592:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 54us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.306489:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14778 00000100:00100000:0.0:1746066795.306497:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14779 00000100:00100000:0.0:1746066795.306502:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977038848:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066795.306507:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066795.306512:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c01d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ebc8 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066795.306540:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976882816:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066795.306594:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedc00 going to sleep for 11 seconds 00000100:00080000:1.0:1746066795.306815:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746066795.306818:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066795.308385:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.308413:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.308563:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976882816:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066795.308593:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c01d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebc8 expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.308607:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c01d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebc8 expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.308620:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea2000, rc 0) 00000100:00100000:1.0:1746066795.308655:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977038848:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 2153us (2541us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066795.308661:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14779 00000100:00100000:1.0:1746066795.308693:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977038976 00000100:00100000:1.0:1746066795.308697:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977038976 00000100:00100000:1.0:1746066795.308714:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977039104 00000100:00100000:1.0:1746066795.308716:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977039104 00000100:00100000:1.0:1746066795.308726:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14780 00000100:00100000:1.0:1746066795.308730:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977038976:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066795.308738:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066795.308746:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092586200/0xfb36a14ee608c024 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ebcf expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066795.308775:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976882944:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066795.308818:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a494d480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066795.308831:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14781 00000100:00100000:1.0:1746066795.308837:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977039104:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066795.308843:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066795.308853:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092586a00/0xfb36a14ee608c02b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ebd6 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066795.308875:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976883072:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066795.308892:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a494d3c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746066795.310801:0:9776:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime: 1746066794 -> 1746066795 00002000:00010000:2.0:1746066795.310807:0:9776:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime: 1746066792 -> 1746066794 00002000:00010000:2.0:1746066795.310809:0:9776:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime: 1746066794 -> 1746066795 00000100:00100000:2.0:1746066795.310824:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976883072:192.168.202.57@tcp:106: 00002000:00010000:1.0:1746066795.311338:0:10402:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime: 1746066794 -> 1746066795 00002000:00010000:1.0:1746066795.311342:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime: 1746066793 -> 1746066794 00002000:00010000:1.0:1746066795.311343:0:10402:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime: 1746066794 -> 1746066795 00000100:00100000:1.0:1746066795.311356:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976882944:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066795.311368:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092586a00/0xfb36a14ee608c02b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebd6 expref: 11 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.311371:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092586200/0xfb36a14ee608c024 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebcf expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066795.311381:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092586a00/0xfb36a14ee608c02b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebd6 expref: 11 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.311381:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092586200/0xfb36a14ee608c024 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebcf expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.311390:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092586200, rc 0) 00010000:00010000:2.0:1746066795.311405:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092586a00, rc 0) 00000100:00100000:1.0:1746066795.311431:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977038976:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 2700us (3049us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066795.311439:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14780 00000100:00100000:2.0:1746066795.311787:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977039104:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 2949us (3372us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066795.311794:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14781 00000100:00100000:0.0:1746066795.314027:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066795.314203:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977039360 00000100:00100000:3.0:1746066795.314212:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977039360 00000100:00100000:3.0:1746066795.314254:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10037 00000100:00100000:3.0:1746066795.314261:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:31728:x1830882977039360:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066795.314277:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066795.314456:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96e00/0xfb36a14ee608c032 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ebdd expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.314524:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96a00/0xfb36a14ee608c039 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.314536:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebac expref: 14 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.314542:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96a00/0xfb36a14ee608c039 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.314566:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebac expref: 14 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.314574:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebac expref: 14 pid: 14550 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746066795.314788:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976883200:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066795.314859:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a866ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066795.317440:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976883200:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066795.317549:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96a00/0xfb36a14ee608c039 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066795.318830:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.318998:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977039488 00000100:00100000:1.0:1746066795.319005:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977039488 00010000:00010000:1.0:1746066795.319036:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebac expref: 15 pid: 14550 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746066795.319071:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7598 00000100:00100000:1.0:1746066795.319077:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1963:x1830882977039488:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066795.319089:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066795.319094:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebac expref: 15 pid: 14550 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.319103:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebac expref: 15 pid: 14550 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.319121:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092591000/0xfb36a14ee608c001 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebac expref: 15 pid: 14550 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.319133:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066795.319137:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96a00/0xfb36a14ee608c039 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066795.319145:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96a00/0xfb36a14ee608c039 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066795.319150:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96a00/0xfb36a14ee608c039 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066795.319165:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066795.319199:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882977039488:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 121us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066795.319204:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7598 00010000:00010000:3.0:1746066795.319315:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96a00/0xfb36a14ee608c039 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.319322:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96a00/0xfb36a14ee608c039 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:3.0:1746066795.319375:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066795.319493:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96e00/0xfb36a14ee608c032 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebdd expref: 15 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.319508:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96a00/0xfb36a14ee608c039 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebdd expref: 14 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.319514:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066795.319516:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066795.319519:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb96a00, rc 0) 00000100:00100000:3.0:1746066795.319541:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:31728:x1830882977039360:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 5281us (5519us total) trans 8589944104 rc 0/0 00000100:00100000:3.0:1746066795.320173:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10037 00000100:00100000:2.0:1746066795.322851:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.323007:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977039744 00000100:00100000:0.0:1746066795.323014:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977039744 00000100:00100000:0.0:1746066795.323060:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10038 00000100:00100000:0.0:1746066795.323067:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:31728:x1830882977039744:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066795.323085:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066795.323088:0:14550:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746066795.323111:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96a00/0xfb36a14ee608c039 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebdd expref: 14 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.323140:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066795.323145:0:14550:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066795.323154:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3400/0xfb36a14ee608c047 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ebe4 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.323229:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2600/0xfb36a14ee608c04e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066795.323240:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2600/0xfb36a14ee608c04e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066795.323249:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2600/0xfb36a14ee608c04e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:0.0:1746066795.323258:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066795.323343:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3400/0xfb36a14ee608c047 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebe4 expref: 16 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.323354:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2600/0xfb36a14ee608c04e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebe4 expref: 15 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.323359:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066795.323361:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066795.323363:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea2600, rc 0) 00000100:00100000:0.0:1746066795.323409:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:31728:x1830882977039744:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 342us (563us total) trans 8589944105 rc 0/0 00000100:00100000:0.0:1746066795.323414:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10038 00000100:00100000:0.0:1746066795.327650:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.327702:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977039872 00000100:00100000:2.0:1746066795.327711:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977039872 00000100:00100000:2.0:1746066795.328145:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10039 00000100:00100000:2.0:1746066795.328153:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:31728:x1830882977039872:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066795.328172:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066795.328187:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092591400/0xfb36a14ee608c05c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ebeb expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.328232:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092591400/0xfb36a14ee608c05c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebeb expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.328243:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092591400/0xfb36a14ee608c05c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebeb expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.328257:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066795.328260:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066795.328263:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092591400, rc 0) 00000100:00100000:2.0:1746066795.328463:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:31728:x1830882977039872:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 311us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.328469:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10039 00000100:00100000:0.0:1746066795.331039:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.331072:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.331098:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.331119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.331130:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.331151:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066795.331165:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977040000 00000100:00100000:3.0:1746066795.331172:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977040000 00000100:00100000:1.0:1746066795.331302:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977040128 00000100:00100000:1.0:1746066795.331306:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977040128 00000100:00100000:2.0:1746066795.331356:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977040384 00000100:00100000:2.0:1746066795.331359:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977040384 00000100:00100000:0.0:1746066795.331819:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977040640 00000100:00100000:0.0:1746066795.331822:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977040640 00000100:00100000:3.0:1746066795.332105:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977040256 00000100:00100000:3.0:1746066795.332108:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977040256 00000100:00100000:2.0:1746066795.332154:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977040512 00000100:00100000:2.0:1746066795.332157:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977040512 00000100:00100000:1.0:1746066795.332194:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14782 00000100:00100000:1.0:1746066795.332201:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977040000:12345-192.168.202.57@tcp:1:mirror_io.0 00000100:00100000:2.0:1746066795.332232:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14783 00000100:00100000:2.0:1746066795.332237:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977040128:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066795.332268:0:9776:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092590400/0xfb36a14ee608c063 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.332283:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d800/0xfb36a14ee608bef0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae8 expref: 22 pid: 8452 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066795.332354:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14784 00000100:00100000:0.0:1746066795.332360:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977040384:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066795.332375:0:10402:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c06a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.332385:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 30 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.332391:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066795.332392:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066795.332394:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c06a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066795.332414:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14785 00010000:00010000:0.0:1746066795.332418:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1294335) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 30 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066795.332421:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977040512:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066795.332428:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1294335) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 30 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:3.0:1746066795.332437:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009eb97c00/0xfb36a14ee608c071 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066795.332439:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976883328:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066795.332447:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.332453:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066795.332454:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066795.332457:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb97c00/0xfb36a14ee608c071 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.332472:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.332480:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 19 pid: 8452 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746066795.332489:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135dfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976883456:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066795.332493:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066795.332509:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14786 00000100:00100000:3.0:1746066795.332511:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066795.332513:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977040640:12345-192.168.202.57@tcp:1:mirror_io.0 00000100:00100000:3.0:1746066795.332525:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14787 00010000:00010000:0.0:1746066795.332525:0:20532:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608c078 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066795.332531:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977040256:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066795.332533:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 17 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.332538:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066795.332539:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066795.332541:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608c078 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.332544:0:8112:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009eb96600/0xfb36a14ee608c07f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.332553:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bee9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaef expref: 22 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066795.332553:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 17 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.332560:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eea3600/0xfb36a14ee608c00f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebc1 expref: 12 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066795.332560:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 17 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:3.0:1746066795.332567:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbb1400/0xfb36a14ee608bf4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb27 expref: 17 pid: 21203 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066795.332568:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976883584:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066795.332572:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066795.332573:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066795.332576:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb96600/0xfb36a14ee608c07f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066795.332600:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedc00 going to sleep for 11 seconds 00010000:00010000:3.0:1746066795.332606:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cbb1400/0xfb36a14ee608bf4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb27 expref: 17 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066795.332613:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cbb1400/0xfb36a14ee608bf4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb27 expref: 17 pid: 21203 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746066795.332622:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976883712:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066795.332643:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eea3600/0xfb36a14ee608c00f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebc1 expref: 12 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066795.332651:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eea3600/0xfb36a14ee608c00f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebc1 expref: 12 pid: 10402 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746066795.332657:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135dfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976883840:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066795.332673:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bee9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaef expref: 22 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066795.332697:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bee9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaef expref: 22 pid: 20532 timeout: 856 lvb_type: 1 00000100:00100000:3.0:1746066795.332704:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976883968:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066795.332722:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092c0b000 going to sleep for 11 seconds 00010000:00010000:2.0:1746066795.332833:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eea2400/0xfb36a14ee608c016 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebba expref: 12 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066795.332844:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50c3800/0xfb36a14ee608bf44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb20 expref: 17 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066795.332848:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.332850:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.332852:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092590400/0xfb36a14ee608c063 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.332866:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50c3800/0xfb36a14ee608bf44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb20 expref: 17 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066795.332872:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50c3800/0xfb36a14ee608bf44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb20 expref: 17 pid: 4614 timeout: 856 lvb_type: 1 00000100:00100000:2.0:1746066795.332879:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976884096:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066795.332959:0:21203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092586800/0xfb36a14ee608c086 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.332969:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf0c600/0xfb36a14ee608bee2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae1 expref: 30 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.332976:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eea3e00/0xfb36a14ee608c008 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebb3 expref: 11 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.332982:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50c3a00/0xfb36a14ee608bf3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb19 expref: 19 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.332987:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.332988:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.332990:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092586800/0xfb36a14ee608c086 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.333004:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50c3a00/0xfb36a14ee608bf3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb19 expref: 19 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.333010:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50c3a00/0xfb36a14ee608bf3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb19 expref: 19 pid: 4614 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746066795.333018:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976884224:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066795.333323:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eea2400/0xfb36a14ee608c016 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebba expref: 12 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066795.333331:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eea2400/0xfb36a14ee608c016 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebba expref: 12 pid: 10402 timeout: 856 lvb_type: 1 00000100:00100000:2.0:1746066795.333339:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976884352:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066795.333357:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eea3e00/0xfb36a14ee608c008 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebb3 expref: 11 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066795.333360:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d800/0xfb36a14ee608bef0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae8 expref: 22 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.333365:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eea3e00/0xfb36a14ee608c008 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebb3 expref: 11 pid: 10402 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066795.333371:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d800/0xfb36a14ee608bef0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae8 expref: 22 pid: 8452 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746066795.333372:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976884480:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066795.333377:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976884608:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066795.333388:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191a80 going to sleep for 11 seconds 00010000:00010000:1.0:1746066795.333445:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf0c600/0xfb36a14ee608bee2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae1 expref: 30 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.333452:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf0c600/0xfb36a14ee608bee2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae1 expref: 30 pid: 8452 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746066795.333459:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976884736:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066795.333488:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a494d480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066795.336650:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135dfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976883456:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066795.336671:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009eb97c00/0xfb36a14ee608c071 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066795.336773:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976884480:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066795.337006:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976883328:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066795.337019:0:10402:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c06a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066795.337109:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.337147:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976883584:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066795.337156:0:20532:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608c078 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066795.337225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.337241:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977040768 00000100:00100000:0.0:1746066795.337245:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977040768 00002000:00100000:0.0:1746066795.337277:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1269760->1294335) req@ffff8800921c1f80 x1830882977040768/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.337286:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c1f80 with x1830882977040768 ext(1269760->1294335) 00010000:00010000:0.0:1746066795.337292:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 31 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746066795.337301:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 31 pid: 8452 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746066795.337306:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800921c1f80 00000100:00100000:0.0:1746066795.337319:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977040896 00000100:00100000:0.0:1746066795.337321:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977040896 00002000:00100000:0.0:1746066795.337331:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2985984->3145727) req@ffff8800921c1500 x1830882977040896/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066795.337337:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c1500 with x1830882977040896 ext(2985984->3145727) 00010000:00010000:0.0:1746066795.337341:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 20 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746066795.337348:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 20 pid: 8452 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746066795.337353:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800921c1500 00000100:00100000:0.0:1746066795.337364:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2181 00000100:00100000:0.0:1746066795.337370:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1965:x1830882977040768:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066795.337571:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976884096:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066795.337578:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976884352:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066795.337596:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976884608:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066795.337608:0:9776:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092590400/0xfb36a14ee608c063 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066795.337658:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2182 00000100:00100000:1.0:1746066795.337665:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977040896:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066795.337873:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135dfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976883840:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066795.337879:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976883968:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066795.338018:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976884224:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066795.338026:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976884736:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066795.338038:0:21203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092586800/0xfb36a14ee608c086 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066795.339421:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976883712:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066795.339436:0:8112:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009eb96600/0xfb36a14ee608c07f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066795.343760:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.344039:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977041280 00000100:00100000:1.0:1746066795.344047:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977041280 00002000:00100000:1.0:1746066795.344083:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->2109439) req@ffff8800921c3800 x1830882977041280/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 12776/0 e 0 to 0 dl 1746066806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066795.344092:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c3800 with x1830882977041280 ext(2097152->2109439) 00010000:00010000:1.0:1746066795.344100:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 18 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.344111:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 18 pid: 8452 timeout: 856 lvb_type: 0 00002000:00010000:1.0:1746066795.344117:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800921c3800 00000100:00100000:1.0:1746066795.344147:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2183 00000100:00100000:1.0:1746066795.344154:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977041280:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:1.0:1746066795.345167:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977041280:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 1009us (1412us total) trans 21474840955 rc 0/0 00000100:00100000:1.0:1746066795.345175:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2183 00002000:00100000:1.0:1746066795.345182:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->2109439) req@ffff8800921c3800 x1830882977041280/t21474840955(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 12776/448 e 0 to 0 dl 1746066806 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066795.345190:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c3800 with x1830882977041280 ext(2097152->2109439) 00010000:00010000:1.0:1746066795.345195:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 20 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.345205:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 20 pid: 8452 timeout: 856 lvb_type: 0 00002000:00010000:1.0:1746066795.345211:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800921c3800 00000100:00100000:0.0:1746066795.346369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.346619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.346633:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.346646:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.346664:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977041152 00000100:00100000:0.0:1746066795.346668:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977041152 00010000:00010000:0.0:1746066795.346709:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d800/0xfb36a14ee608bef0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae8 expref: 23 pid: 8452 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746066795.346729:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977041024 00000100:00100000:0.0:1746066795.346731:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977041024 00010000:00010000:0.0:1746066795.346741:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eea3e00/0xfb36a14ee608c008 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebb3 expref: 12 pid: 10402 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746066795.346752:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977041664 00000100:00100000:0.0:1746066795.346754:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977041664 00010000:00010000:0.0:1746066795.346762:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf0c600/0xfb36a14ee608bee2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae1 expref: 33 pid: 8452 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746066795.346769:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977041408 00000100:00100000:0.0:1746066795.346771:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977041408 00010000:00010000:0.0:1746066795.346779:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea3600/0xfb36a14ee608c00f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebc1 expref: 13 pid: 10402 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746066795.346789:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7599 00000100:00100000:0.0:1746066795.346794:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882977041152:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.346805:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.346821:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d800/0xfb36a14ee608bef0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae8 expref: 23 pid: 8452 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.346830:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d800/0xfb36a14ee608bef0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae8 expref: 23 pid: 8452 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.346849:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d800/0xfb36a14ee608bef0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae8 expref: 23 pid: 8452 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.346865:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.346892:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977041152:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 97us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.346898:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7599 00000100:00100000:0.0:1746066795.346935:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7600 00000100:00100000:0.0:1746066795.346939:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977041024:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.346946:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.346956:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eea3e00/0xfb36a14ee608c008 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebb3 expref: 12 pid: 10402 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.346963:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eea3e00/0xfb36a14ee608c008 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebb3 expref: 12 pid: 10402 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.346975:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eea3e00/0xfb36a14ee608c008 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebb3 expref: 12 pid: 10402 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.346988:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.347001:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977041024:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 62us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.347006:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7600 00000100:00100000:0.0:1746066795.347015:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7601 00000100:00100000:0.0:1746066795.347020:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977041664:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.347025:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.347031:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bf0c600/0xfb36a14ee608bee2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae1 expref: 33 pid: 8452 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347038:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bf0c600/0xfb36a14ee608bee2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae1 expref: 33 pid: 8452 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347046:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf0c600/0xfb36a14ee608bee2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eae1 expref: 33 pid: 8452 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347053:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.347065:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977041664:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 45us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.347069:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7601 00000100:00100000:0.0:1746066795.347078:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7602 00000100:00100000:0.0:1746066795.347082:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882977041408:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.347086:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.347095:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eea3600/0xfb36a14ee608c00f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebc1 expref: 13 pid: 10402 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347103:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eea3600/0xfb36a14ee608c00f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebc1 expref: 13 pid: 10402 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347111:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eea3600/0xfb36a14ee608c00f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebc1 expref: 13 pid: 10402 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347118:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.347130:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977041408:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 48us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.347134:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7602 00000100:00100000:0.0:1746066795.347158:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.347168:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977041792 00000100:00100000:0.0:1746066795.347171:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977041792 00010000:00010000:0.0:1746066795.347180:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50c3800/0xfb36a14ee608bf44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb20 expref: 20 pid: 4614 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746066795.347190:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7603 00000100:00100000:0.0:1746066795.347193:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1965:x1830882977041792:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.347198:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.347203:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50c3800/0xfb36a14ee608bf44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb20 expref: 20 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347210:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50c3800/0xfb36a14ee608bf44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb20 expref: 20 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347222:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50c3800/0xfb36a14ee608bf44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb20 expref: 20 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347231:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.347243:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882977041792:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 49us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.347247:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7603 00000100:00100000:0.0:1746066795.347281:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.347290:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977041536 00000100:00100000:0.0:1746066795.347292:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977041536 00010000:00010000:0.0:1746066795.347299:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bee9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaef expref: 22 pid: 20532 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746066795.347309:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7604 00000100:00100000:0.0:1746066795.347313:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977041536:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.347317:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.347322:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bee9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaef expref: 22 pid: 20532 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347328:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bee9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaef expref: 22 pid: 20532 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347337:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eea2800/0xfb36a14ee608bee9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eaef expref: 22 pid: 20532 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347347:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.347357:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1965:x1830882977041536:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 44us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.347361:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7604 00000100:00100000:0.0:1746066795.347385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.347392:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977041920 00000100:00100000:0.0:1746066795.347395:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977041920 00010000:00010000:0.0:1746066795.347402:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea2400/0xfb36a14ee608c016 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebba expref: 12 pid: 10402 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746066795.347410:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7605 00000100:00100000:0.0:1746066795.347413:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977041920:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.347418:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.347423:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eea2400/0xfb36a14ee608c016 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebba expref: 12 pid: 10402 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347429:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eea2400/0xfb36a14ee608c016 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebba expref: 12 pid: 10402 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347437:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eea2400/0xfb36a14ee608c016 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebba expref: 12 pid: 10402 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347443:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.347445:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.347448:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092590400/0xfb36a14ee608c063 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.347459:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092590400/0xfb36a14ee608c063 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.347476:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.347485:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1965:x1830882977041920:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 72us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.347490:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7605 00000100:00100000:0.0:1746066795.347518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.347526:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977042048 00000100:00100000:0.0:1746066795.347529:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977042048 00010000:00010000:0.0:1746066795.347536:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbb1400/0xfb36a14ee608bf4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb27 expref: 19 pid: 21203 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746066795.347545:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7606 00000100:00100000:0.0:1746066795.347549:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977042048:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066795.347554:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066795.347559:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cbb1400/0xfb36a14ee608bf4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb27 expref: 19 pid: 21203 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347565:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cbb1400/0xfb36a14ee608bf4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb27 expref: 19 pid: 21203 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347573:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbb1400/0xfb36a14ee608bf4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb27 expref: 19 pid: 21203 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746066795.347596:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.347598:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.347600:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb96600/0xfb36a14ee608c07f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.347605:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb96600/0xfb36a14ee608c07f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.347616:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066795.347628:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977042048:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 78us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.347632:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7606 00000100:00100000:1.0:1746066795.348401:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+22:1966:x1830882977040896:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 10736us (11174us total) trans 17179873638 rc 0/0 00000100:00100000:1.0:1746066795.348408:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2182 00002000:00100000:1.0:1746066795.348415:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2985984->3145727) req@ffff8800921c1500 x1830882977040896/t17179873638(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:201/0 lens 488/448 e 0 to 0 dl 1746066806 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066795.348423:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c1500 with x1830882977040896 ext(2985984->3145727) 00010000:00010000:1.0:1746066795.348429:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 22 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.348437:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 22 pid: 8452 timeout: 856 lvb_type: 0 00002000:00010000:1.0:1746066795.348442:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800921c1500 00000100:00100000:1.0:1746066795.348736:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1965:x1830882977040768:12345-192.168.202.57@tcp:4:cat.0 Request processed in 11365us (11627us total) trans 17179873639 rc 0/0 00000100:00100000:1.0:1746066795.348742:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2181 00002000:00100000:1.0:1746066795.348747:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1269760->1294335) req@ffff8800921c1f80 x1830882977040768/t17179873639(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:201/0 lens 488/448 e 0 to 0 dl 1746066806 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066795.348753:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c1f80 with x1830882977040768 ext(1269760->1294335) 00010000:00010000:1.0:1746066795.348758:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 32 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.348765:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 32 pid: 8452 timeout: 856 lvb_type: 0 00002000:00010000:1.0:1746066795.348770:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800921c1f80 00010000:00010000:3.0:1746066795.348856:0:8112:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009eb96600/0xfb36a14ee608c07f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.348864:0:8112:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb96600/0xfb36a14ee608c07f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.348878:0:8112:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009eb96600/0xfb36a14ee608c07f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.348884:0:8112:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb96600/0xfb36a14ee608c07f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.348890:0:8112:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009eb96600/0xfb36a14ee608c07f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.348895:0:8112:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eb96600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066795.348898:0:8112:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009eb96600/0xfb36a14ee608c07f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.348905:0:8112:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009eb96600/0xfb36a14ee608c07f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.348915:0:8112:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009eb96600/0xfb36a14ee608c07f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.348920:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb96600/0xfb36a14ee608c07f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066795.348957:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977040256:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 16426us (17825us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066795.348963:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14787 00010000:00010000:2.0:1746066795.349038:0:9776:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092590400/0xfb36a14ee608c063 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.349045:0:9776:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092590400/0xfb36a14ee608c063 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.349058:0:9776:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092590400/0xfb36a14ee608c063 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.349068:0:9776:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092590400/0xfb36a14ee608c063 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.349073:0:9776:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092590400/0xfb36a14ee608c063 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.349078:0:9776:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092590400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066795.349081:0:9776:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092590400/0xfb36a14ee608c063 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.349087:0:9776:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092590400/0xfb36a14ee608c063 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.349095:0:9776:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092590400/0xfb36a14ee608c063 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.349100:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092590400/0xfb36a14ee608c063 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066795.349142:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977040128:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 16904us (18069us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.349148:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14783 00000100:00100000:0.0:1746066795.353286:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.355027:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977042176 00000100:00100000:2.0:1746066795.355035:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977042176 00010000:00010000:2.0:1746066795.355068:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50c3a00/0xfb36a14ee608bf3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb19 expref: 22 pid: 4614 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746066795.355075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.355591:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.355664:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977042304 00000100:00100000:2.0:1746066795.355667:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977042304 00010000:00010000:2.0:1746066795.355691:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 18 pid: 8452 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746066795.355700:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.355808:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977042432 00000100:00100000:2.0:1746066795.355811:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977042432 00000100:00100000:1.0:1746066795.355815:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977042560 00000100:00100000:1.0:1746066795.355817:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977042560 00010000:00010000:2.0:1746066795.355821:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 32 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.355828:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 23 pid: 8452 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746066795.355832:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7607 00000100:00100000:2.0:1746066795.355837:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882977042176:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066795.355838:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7608 00000100:00100000:1.0:1746066795.355842:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977042304:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066795.355847:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066795.355848:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066795.355864:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50c3a00/0xfb36a14ee608bf3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb19 expref: 23 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746066795.355864:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 18 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.355873:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 18 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.355874:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50c3a00/0xfb36a14ee608bf3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb19 expref: 23 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:2.0:1746066795.355891:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50c3a00/0xfb36a14ee608bf3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb19 expref: 23 pid: 4614 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746066795.355891:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608bfe5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eba5 expref: 18 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.355905:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.355905:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.355907:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.355907:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.355910:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092586800/0xfb36a14ee608c086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.355910:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608c078 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.355917:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608c078 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.355921:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092586800/0xfb36a14ee608c086 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.355937:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066795.355937:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066795.355965:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977042176:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 127us (2686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066795.355965:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977042304:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 121us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066795.355970:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7608 00000100:00100000:2.0:1746066795.355972:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7607 00000100:00100000:1.0:1746066795.355981:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7609 00000100:00100000:2.0:1746066795.355983:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7610 00000100:00100000:1.0:1746066795.355985:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882977042432:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066795.355987:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+21:1966:x1830882977042560:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066795.355991:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066795.355991:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066795.355999:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 21 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.355999:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 32 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.356006:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 21 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.356006:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1294335) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 32 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.356015:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608bfde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb9e expref: 21 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.356016:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50c2a00/0xfb36a14ee608bfad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1294335) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb89 expref: 32 pid: 8452 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.356021:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.356022:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.356023:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.356023:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.356025:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb97c00/0xfb36a14ee608c071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.356026:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c06a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.356031:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c06a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.356042:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066795.356055:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882977042432:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 69us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066795.356060:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7609 00010000:00010000:1.0:1746066795.356076:0:21203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092586800/0xfb36a14ee608c086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.356082:0:21203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092586800/0xfb36a14ee608c086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.356099:0:21203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092586800/0xfb36a14ee608c086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.356105:0:21203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092586800/0xfb36a14ee608c086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.356112:0:21203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092586800/0xfb36a14ee608c086 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.356117:0:21203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092586800 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066795.356120:0:21203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092586800/0xfb36a14ee608c086 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.356127:0:21203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092586800/0xfb36a14ee608c086 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.356135:0:21203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092586800/0xfb36a14ee608c086 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.356140:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092586800/0xfb36a14ee608c086 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066795.356173:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977040000:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 23973us (25140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066795.356178:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14782 00010000:00010000:0.0:1746066795.356566:0:20532:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608c078 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.356573:0:20532:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608c078 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.356596:0:20532:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608c078 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.356602:0:20532:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608c078 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.356608:0:20532:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608c078 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.356613:0:20532:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eea3a00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066795.356616:0:20532:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608c078 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.356621:0:20532:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608c078 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.356629:0:20532:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608c078 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066795.356634:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eea3a00/0xfb36a14ee608c078 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066795.356669:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977040640:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 24155us (25549us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.356692:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14786 00010000:00010000:3.0:1746066795.357797:0:10402:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c06a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.357808:0:10402:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c06a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.357826:0:10402:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c06a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.357832:0:10402:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c06a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.357837:0:10402:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c06a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.357847:0:10402:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eea2000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066795.357850:0:10402:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c06a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.357856:0:10402:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c06a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.357866:0:10402:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c06a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.357871:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eea2000/0xfb36a14ee608c06a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066795.357927:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977040384:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 25565us (26826us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066795.357933:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14784 00010000:00010000:2.0:1746066795.358461:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb97c00/0xfb36a14ee608c071 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066795.358503:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066795.358534:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977042560:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2544us (2831us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.358541:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7610 00010000:00010000:3.0:1746066795.359301:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009eb97c00/0xfb36a14ee608c071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.359309:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb97c00/0xfb36a14ee608c071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.359327:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009eb97c00/0xfb36a14ee608c071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.359333:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb97c00/0xfb36a14ee608c071 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.359339:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009eb97c00/0xfb36a14ee608c071 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.359344:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eb97c00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066795.359347:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009eb97c00/0xfb36a14ee608c071 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.359352:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009eb97c00/0xfb36a14ee608c071 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.359362:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009eb97c00/0xfb36a14ee608c071 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.359367:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb97c00/0xfb36a14ee608c071 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066795.359404:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977040512:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 26984us (28251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066795.359409:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14785 00000100:00100000:0.0:1746066795.362183:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.362290:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977042816 00000100:00100000:1.0:1746066795.362298:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977042816 00000100:00100000:1.0:1746066795.362345:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10040 00000100:00100000:1.0:1746066795.362351:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:31728:x1830882977042816:12345-192.168.202.57@tcp:36:mirror_io.0 00010000:00010000:1.0:1746066795.362387:0:14550:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066795.362413:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092591400/0xfb36a14ee608c05c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebeb expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.362427:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066795.362431:0:14550:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066795.362457:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066795.362467:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e905 expref: 24 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.362474:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 24 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.362480:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac47400/0xfb36a14ee608bbbd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e921 expref: 263 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.362486:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc81 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9a6 expref: 24 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.362497:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099015400/0xfb36a14ee608bcb2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c9 expref: 263 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.362503:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0a00/0xfb36a14ee608bd6f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea47 expref: 263 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.362509:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b449800/0xfb36a14ee608bf2f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb12 expref: 24 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.362515:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 10/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066795.362538:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b449800/0xfb36a14ee608bf2f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb12 expref: 24 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.362548:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b449800/0xfb36a14ee608bf2f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb12 expref: 24 pid: 14550 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746066795.362559:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976884864:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066795.363171:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0a00/0xfb36a14ee608bd6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea47 expref: 263 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.363179:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0a00/0xfb36a14ee608bd6f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea47 expref: 263 pid: 14548 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746066795.363187:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976884992:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066795.363234:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099015400/0xfb36a14ee608bcb2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c9 expref: 263 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.363242:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099015400/0xfb36a14ee608bcb2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c9 expref: 263 pid: 20127 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746066795.363319:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976885120:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066795.363344:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9a6 expref: 24 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.363427:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc81 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9a6 expref: 24 pid: 20127 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746066795.363436:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976885248:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066795.363465:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac47400/0xfb36a14ee608bbbd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e921 expref: 263 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.363473:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac47400/0xfb36a14ee608bbbd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e921 expref: 263 pid: 14549 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746066795.363479:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976885376:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066795.363497:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 24 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.363502:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 24 pid: 20127 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746066795.363508:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976885504:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066795.363527:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e905 expref: 24 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.363533:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e905 expref: 24 pid: 14548 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746066795.363540:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976885632:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066795.363553:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a494d480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066795.366009:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.366033:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.366070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.366083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.366100:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977043328 00000100:00100000:2.0:1746066795.366106:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977043328 00000100:00100000:2.0:1746066795.366133:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977043584 00000100:00100000:2.0:1746066795.366135:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977043584 00000100:00100000:2.0:1746066795.366147:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4197 00000100:00100000:2.0:1746066795.366154:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:27101:x1830882977043328:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066795.366305:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:27101:x1830882977043328:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 151us (233us total) trans 8589944106 rc 0/0 00000100:00100000:2.0:1746066795.366311:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4197 00000100:00100000:2.0:1746066795.366324:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4198 00000100:00100000:2.0:1746066795.366328:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:7643:x1830882977043584:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066795.366382:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+26:7643:x1830882977043584:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 53us (298us total) trans 8589944107 rc 0/0 00000100:00100000:2.0:1746066795.366387:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4198 00000100:00100000:2.0:1746066795.366439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.366452:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977042944 00000100:00100000:2.0:1746066795.366455:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977042944 00010000:00010000:2.0:1746066795.366467:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b449800/0xfb36a14ee608bf2f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb12 expref: 26 pid: 14550 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746066795.366482:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977043072 00000100:00100000:2.0:1746066795.366484:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977043072 00010000:00010000:2.0:1746066795.366491:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0a00/0xfb36a14ee608bd6f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea47 expref: 265 pid: 14548 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746066795.366500:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977043712 00000100:00100000:2.0:1746066795.366502:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977043712 00010000:00010000:2.0:1746066795.366508:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac47400/0xfb36a14ee608bbbd lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e921 expref: 266 pid: 14549 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746066795.366519:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7611 00000100:00100000:2.0:1746066795.366523:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977042944:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066795.366529:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066795.366534:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b449800/0xfb36a14ee608bf2f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb12 expref: 26 pid: 14550 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.366543:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b449800/0xfb36a14ee608bf2f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb12 expref: 26 pid: 14550 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.366559:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066795.366563:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.366570:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066795.366598:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977042944:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 74us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.366606:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7611 00000100:00100000:2.0:1746066795.366616:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7612 00000100:00100000:2.0:1746066795.366620:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:1963:x1830882977043072:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066795.366626:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066795.366629:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0a00/0xfb36a14ee608bd6f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea47 expref: 266 pid: 14548 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.366636:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0a00/0xfb36a14ee608bd6f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea47 expref: 266 pid: 14548 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.366645:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066795.366648:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.366653:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066795.366665:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:1963:x1830882977043072:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 45us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.366670:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7612 00000100:00100000:2.0:1746066795.366698:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7613 00000100:00100000:2.0:1746066795.366702:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:1963:x1830882977043712:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066795.366708:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066795.366711:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac47400/0xfb36a14ee608bbbd lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e921 expref: 265 pid: 14549 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.366718:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac47400/0xfb36a14ee608bbbd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e921 expref: 265 pid: 14549 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.366731:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066795.366734:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.366738:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066795.366751:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:1963:x1830882977043712:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 49us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.366756:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7613 00000100:00100000:2.0:1746066795.366816:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.366828:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977043968 00000100:00100000:2.0:1746066795.366831:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977043968 00010000:00010000:2.0:1746066795.366840:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e905 expref: 26 pid: 14548 timeout: 856 lvb_type: 0 00000100:00100000:2.0:1746066795.366853:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7614 00000100:00100000:2.0:1746066795.366856:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977043968:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066795.366861:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066795.366864:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e905 expref: 26 pid: 14548 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.366870:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e905 expref: 26 pid: 14548 timeout: 856 lvb_type: 0 00010000:00010000:2.0:1746066795.366878:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066795.366881:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066795.366885:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066795.366897:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977043968:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 40us (80us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.366901:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7614 00010000:00010000:0.0:1746066795.367009:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b449800/0xfb36a14ee608bf2f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eb12 expref: 25 pid: 14550 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746066795.367021:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976884864:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066795.367030:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0a00/0xfb36a14ee608bd6f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ea47 expref: 264 pid: 14548 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746066795.367042:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976884992:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066795.367049:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976885120:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066795.367055:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976885248:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066795.367061:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac47400/0xfb36a14ee608bbbd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e921 expref: 263 pid: 14549 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746066795.367068:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976885376:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066795.367074:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976885504:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066795.367079:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608bba1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e905 expref: 24 pid: 14548 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746066795.367086:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976885632:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066795.367107:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066795.368161:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.368231:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977043840 00000100:00100000:1.0:1746066795.368236:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977043840 00010000:00010000:1.0:1746066795.368253:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 24 pid: 20127 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746066795.368281:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7615 00000100:00100000:1.0:1746066795.368287:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882977043840:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066795.368295:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066795.368299:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 24 pid: 20127 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.368306:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 24 pid: 20127 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.368318:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608bbb6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e91a expref: 24 pid: 20127 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.368328:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066795.368331:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066795.368337:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066795.368782:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882977043840:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 493us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066795.368788:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7615 00000100:00100000:0.0:1746066795.369188:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.369311:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.369658:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977044096 00000100:00100000:1.0:1746066795.369662:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977044096 00010000:00010000:1.0:1746066795.369694:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099015400/0xfb36a14ee608bcb2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c9 expref: 263 pid: 20127 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746066795.370338:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977044224 00000100:00100000:1.0:1746066795.370342:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977044224 00010000:00010000:1.0:1746066795.370353:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc81 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9a6 expref: 23 pid: 20127 timeout: 856 lvb_type: 0 00000100:00100000:3.0:1746066795.370356:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7616 00000100:00100000:3.0:1746066795.370365:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:1963:x1830882977044096:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066795.370367:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7617 00000100:00100000:1.0:1746066795.370372:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882977044224:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066795.370375:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066795.370377:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066795.370380:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099015400/0xfb36a14ee608bcb2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c9 expref: 263 pid: 20127 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.370381:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc81 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9a6 expref: 23 pid: 20127 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.370388:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc81 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9a6 expref: 23 pid: 20127 timeout: 856 lvb_type: 0 00010000:00010000:3.0:1746066795.370395:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099015400/0xfb36a14ee608bcb2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c9 expref: 263 pid: 20127 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.370411:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3200/0xfb36a14ee608bc81 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9a6 expref: 23 pid: 20127 timeout: 856 lvb_type: 0 00010000:00010000:3.0:1746066795.370416:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099015400/0xfb36a14ee608bcb2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97e9c9 expref: 263 pid: 20127 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746066795.370422:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066795.370427:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066795.370434:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066795.370439:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.370445:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066795.370448:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066795.370458:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066795.370475:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:1963:x1830882977044096:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 113us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066795.370476:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882977044224:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 104us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066795.370481:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7616 00000100:00100000:1.0:1746066795.370484:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7617 00010000:00010000:1.0:1746066795.370501:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066795.370506:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000040:00080000:1.0:1746066795.371043:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3125, 88 off264256 00000004:00080000:1.0:1746066795.371050:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756548373656ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066795.371113:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3138, 88 off265312 00000004:00080000:1.0:1746066795.371118:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756548441650ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066795.371145:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3139, 88 off265400 00000004:00080000:1.0:1746066795.371148:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756548471728ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066795.371154:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3126, 88 off264344 00000004:00080000:1.0:1746066795.371156:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756548480133ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066795.371166:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3127, 88 off264432 00000004:00080000:1.0:1746066795.371168:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756548491918ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066795.371176:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3140, 88 off265488 00000004:00080000:1.0:1746066795.371179:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756548502715ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066795.371185:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3141, 88 off265576 00000004:00080000:1.0:1746066795.371187:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756548511056ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066795.371193:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3142, 88 off265664 00000004:00080000:1.0:1746066795.371195:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756548518935ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066795.371201:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3128, 88 off264520 00000004:00080000:1.0:1746066795.371202:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756548526586ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066795.371211:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3143, 88 off265752 00000004:00080000:1.0:1746066795.371213:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756548537028ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066795.371218:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3129, 88 off264608 00000004:00080000:1.0:1746066795.371221:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756548545233ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066795.371229:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3144, 88 off265840 00000004:00080000:1.0:1746066795.371231:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756548555348ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066795.371236:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3130, 88 off264696 00000004:00080000:1.0:1746066795.371239:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756548562668ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066795.371246:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3131, 88 off264784 00000004:00080000:1.0:1746066795.371248:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756548572113ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066795.371255:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3132, 88 off264872 00000004:00080000:1.0:1746066795.371258:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756548581750ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066795.371265:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3133, 88 off264960 00000004:00080000:1.0:1746066795.371267:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 756548591135ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066795.371275:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3145, 88 off265928 00000004:00080000:1.0:1746066795.371277:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 756548601073ns, next at 749511475809ns, rc = 0 00000004:00010000:1.0:1746066795.413530:0:14550:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800921c3480 reply state ffff88009a450800 transno 8589944108 ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:1.0:1746066795.413544:0:14550:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746066795.413654:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:31728:x1830882977042816:12345-192.168.202.57@tcp:36:mirror_io.0 Request processed in 51298us (51474us total) trans 8589944108 rc 0/0 00000100:00100000:1.0:1746066795.413664:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10040 00000001:00080000:1.0:1746066795.413709:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944105 is committed 00000001:00080000:1.0:1746066795.413715:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944097 is committed 00000001:00080000:1.0:1746066795.413719:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944073 is committed 00000001:00080000:1.0:1746066795.413738:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944108 is committed 00000004:00080000:1.0:1746066795.413742:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2419 committed 00000004:00080000:1.0:1746066795.413747:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2406 committed 00000004:00080000:1.0:1746066795.413751:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2405 committed 00000004:00080000:1.0:1746066795.413753:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2404 committed 00000004:00080000:1.0:1746066795.413754:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2403 committed 00000004:00080000:1.0:1746066795.413755:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2418 committed 00000004:00080000:1.0:1746066795.413757:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2402 committed 00000004:00080000:1.0:1746066795.413758:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2417 committed 00000004:00080000:1.0:1746066795.413762:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2401 committed 00000004:00080000:1.0:1746066795.413763:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2416 committed 00000004:00080000:1.0:1746066795.413764:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2415 committed 00000004:00080000:1.0:1746066795.413765:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2414 committed 00010000:00010000:3.0:1746066795.413767:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00000004:00080000:1.0:1746066795.413767:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2400 committed 00000004:00080000:1.0:1746066795.413768:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2399 committed 00000004:00080000:1.0:1746066795.413769:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2413 committed 00000004:00080000:1.0:1746066795.413771:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2412 committed 00000004:00080000:1.0:1746066795.413772:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2398 committed 00010000:00010000:3.0:1746066795.413775:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00000001:00080000:1.0:1746066795.413780:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944092 is committed 00010000:00010000:3.0:1746066795.413781:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.413786:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092586200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066795.413789:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00000001:00080000:1.0:1746066795.413794:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944107 is committed 00010000:00010000:3.0:1746066795.413796:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00000001:00080000:1.0:1746066795.413797:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944106 is committed 00010000:00010000:3.0:1746066795.413809:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066795.413812:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066795.413816:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066795.413821:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092586200/0xfb36a14ee608c08d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00000100:00100000:3.0:1746066795.413904:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976885888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066795.413928:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976886272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066795.413943:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066795.413959:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066795.413977:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976885888 00000100:00100000:1.0:1746066795.413982:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976885888 00000100:00100000:3.0:1746066795.413983:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976885760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066795.413997:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066795.414007:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976886400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066795.414010:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976886272 00000100:00100000:1.0:1746066795.414011:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976886272 00000100:00100000:3.0:1746066795.414018:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066795.414024:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976885760 00000100:00100000:1.0:1746066795.414025:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976885760 00000100:00100000:3.0:1746066795.414031:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976886912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066795.414032:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976886400 00000100:00100000:1.0:1746066795.414034:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976886400 00000100:00100000:1.0:1746066795.414044:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14788 00000100:00100000:3.0:1746066795.414045:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066795.414049:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3294:x1830882976885888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066795.414054:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976887424:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066795.414064:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066795.414081:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976886016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066795.414092:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066795.414099:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976886528:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066795.414108:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066795.414113:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976887040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066795.414123:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066795.414128:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976887552:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066795.414138:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066795.414145:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746066795.414148:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976886144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066795.414160:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066795.414166:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976886656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066795.414175:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066795.414180:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976887168:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066795.414191:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066795.414192:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3294:x1830882976885888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (250us total) trans 17179873640 rc 0/0 00000100:00100000:3.0:1746066795.414197:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976887680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066795.414198:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14788 00000100:00100000:1.0:1746066795.414205:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976886912 00000100:00100000:3.0:1746066795.414207:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066795.414208:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976886912 00000100:00100000:1.0:1746066795.414214:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976887424 00000100:00100000:1.0:1746066795.414216:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976887424 00000100:00100000:1.0:1746066795.414221:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976886016 00000100:00100000:1.0:1746066795.414223:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976886016 00000100:00100000:3.0:1746066795.414225:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976886528 00000100:00100000:3.0:1746066795.414226:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976886528 00000100:00100000:1.0:1746066795.414228:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976887040 00000100:00100000:1.0:1746066795.414230:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976887040 00000100:00100000:3.0:1746066795.414234:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976887552 00000100:00100000:1.0:1746066795.414235:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976886144 00000100:00100000:3.0:1746066795.414236:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976887552 00000100:00100000:1.0:1746066795.414236:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976886144 00000100:00100000:1.0:1746066795.414241:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976886656 00000100:00100000:3.0:1746066795.414242:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976887168 00000100:00100000:3.0:1746066795.414243:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976887168 00000100:00100000:1.0:1746066795.414243:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976886656 00000100:00100000:3.0:1746066795.414248:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976887680 00000100:00100000:3.0:1746066795.414249:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976887680 00000100:00100000:1.0:1746066795.414249:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14789 00000100:00100000:1.0:1746066795.414254:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3293:x1830882976886272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066795.414256:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14790 00000100:00100000:3.0:1746066795.414259:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3294:x1830882976885760:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1746066795.414291:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066795.414532:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14791 00000100:00100000:3.0:1746066795.415449:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3294:x1830882976885760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1187us (1450us total) trans 21474840956 rc 0/0 00000100:00100000:3.0:1746066795.415454:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14790 00000100:00100000:3.0:1746066795.415464:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14792 00000100:00100000:3.0:1746066795.415468:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3294:x1830882976886912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066795.415542:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3294:x1830882976886912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (1496us total) trans 17179873641 rc 0/0 00000100:00100000:3.0:1746066795.415547:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14792 00000100:00100000:3.0:1746066795.415554:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14793 00000100:00100000:3.0:1746066795.415558:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3294:x1830882976887424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066795.415618:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14794 00000100:00100000:3.0:1746066795.415637:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3294:x1830882976887424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (1571us total) trans 17179873642 rc 0/0 00000100:00100000:3.0:1746066795.415641:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14793 00000100:00100000:3.0:1746066795.415649:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14795 00000100:00080000:1.0:1746066795.416512:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066795.416526:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14796 00000100:00100000:1.0:1746066795.416533:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3295:x1830882976887040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066795.417029:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3294:x1830882976886400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066795.417139:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3294:x1830882976886400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2601us (3119us total) trans 21474840957 rc 0/0 00000100:00100000:2.0:1746066795.417144:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14791 00000100:00100000:2.0:1746066795.417156:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14797 00000100:00100000:2.0:1746066795.417160:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3295:x1830882976886144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066795.417291:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3295:x1830882976886528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066795.417291:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3295:x1830882976886016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066795.417307:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14798 00000100:00100000:3.0:1746066795.417312:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3295:x1830882976887552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066795.417375:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746066795.417378:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746066795.417379:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066795.417381:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746066795.417382:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746066795.417431:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3295:x1830882976887040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 899us (3305us total) trans 17179873643 rc 0/0 00000100:00100000:1.0:1746066795.417437:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14796 00000100:00100000:1.0:1746066795.417446:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14799 00000100:00100000:1.0:1746066795.417450:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3295:x1830882976887168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066795.417637:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3295:x1830882976887552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 324us (3497us total) trans 17179873644 rc 0/0 00000100:00100000:0.0:1746066795.417637:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3295:x1830882976886016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2012us (3542us total) trans 21474840958 rc 0/0 00000100:00100000:3.0:1746066795.417642:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14798 00000100:00100000:0.0:1746066795.417649:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14794 00000100:00100000:3.0:1746066795.417653:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14800 00000100:00100000:3.0:1746066795.417657:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3295:x1830882976886656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066795.417657:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14801 00000100:00100000:0.0:1746066795.417661:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3295:x1830882976887680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066795.417742:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3295:x1830882976886656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (3566us total) trans 21474840959 rc 0/0 00000100:00100000:0.0:1746066795.417742:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3295:x1830882976887680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (3533us total) trans 17179873646 rc 0/0 00000100:00100000:3.0:1746066795.417747:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14800 00000100:00100000:0.0:1746066795.417749:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14801 00000004:00080000:3.0:1746066795.417786:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a590ea00/2, rc 0, transno 17179873641 00000100:00100000:3.0:1746066795.417794:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976886912:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066795.417802:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a590d500/2, rc 0, transno 17179873642 00000100:00100000:3.0:1746066795.417805:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976887424:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066795.417813:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a590d180/2, rc 0, transno 17179873640 00000100:00100000:3.0:1746066795.417816:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976885888:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066795.417824:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135df8000/2, rc 0, transno 21474840956 00000100:00100000:3.0:1746066795.417827:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976885760:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066795.417832:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135df9f80/2, rc 0, transno 21474840957 00000100:00100000:3.0:1746066795.417835:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976886400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066795.417860:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3293:x1830882976886272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3606us (3899us total) trans 21474840960 rc 0/0 00000100:00100000:0.0:1746066795.417865:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14789 00000100:00100000:3.0:1746066795.417959:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830882976886528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2305us (3848us total) trans 21474840961 rc 0/0 00000100:00100000:3.0:1746066795.417963:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14795 00000100:00100000:1.0:1746066795.418120:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3295:x1830882976887168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 669us (3926us total) trans 17179873645 rc 0/0 00000100:00100000:1.0:1746066795.418125:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14799 00000004:00080000:1.0:1746066795.418170:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135dfb480/2, rc 0, transno 21474840960 00000100:00100000:1.0:1746066795.418173:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976886272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066795.418180:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976886784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066795.418200:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066795.418215:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976887296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066795.418227:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066795.418276:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135df9c00/2, rc 0, transno 21474840959 00000100:00100000:1.0:1746066795.418279:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976886656:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066795.418286:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a590ca80/2, rc 0, transno 17179873645 00000100:00100000:1.0:1746066795.418288:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976887168:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066795.418293:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a590c380/2, rc 0, transno 17179873646 00000100:00100000:1.0:1746066795.418295:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976887680:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066795.418301:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135df9180/2, rc 0, transno 21474840958 00000100:00100000:1.0:1746066795.418303:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976886016:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066795.418308:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135dfb100/2, rc 0, transno 21474840961 00000100:00100000:1.0:1746066795.418310:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976886528:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066795.418317:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a590f480/2, rc 0, transno 17179873643 00000100:00100000:1.0:1746066795.418319:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976887040:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066795.418324:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a590f800/2, rc 0, transno 17179873644 00000100:00100000:1.0:1746066795.418326:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976887552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066795.418334:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976887808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066795.418349:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066795.418491:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3295:x1830882976886144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1329us (4328us total) trans 21474840962 rc 0/0 00000100:00100000:2.0:1746066795.418496:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14797 00000100:00100000:2.0:1746066795.418505:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976886784 00000100:00100000:2.0:1746066795.418510:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976886784 00000100:00100000:2.0:1746066795.418526:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976887296 00000100:00100000:2.0:1746066795.418528:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976887296 00000100:00100000:2.0:1746066795.418536:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976887808 00000100:00100000:2.0:1746066795.418538:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976887808 00000100:00100000:2.0:1746066795.418547:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14802 00000100:00100000:2.0:1746066795.418551:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3293:x1830882976886784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066795.418635:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3293:x1830882976886784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (433us total) trans 21474840963 rc 0/0 00000100:00100000:2.0:1746066795.418640:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14802 00000100:00100000:2.0:1746066795.418648:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14803 00000100:00100000:2.0:1746066795.418652:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3293:x1830882976887296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066795.418740:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3293:x1830882976887296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (512us total) trans 17179873647 rc 0/0 00000100:00100000:2.0:1746066795.418745:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14803 00000100:00100000:2.0:1746066795.418752:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14804 00000100:00100000:2.0:1746066795.418757:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3293:x1830882976887808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066795.418824:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3293:x1830882976887808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (474us total) trans 17179873648 rc 0/0 00000100:00100000:2.0:1746066795.418829:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14804 00000004:00080000:1.0:1746066795.418923:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a590fb80/2, rc 0, transno 17179873648 00000100:00100000:1.0:1746066795.418927:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976887808:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066795.418933:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135dfa300/2, rc 0, transno 21474840963 00000100:00100000:1.0:1746066795.418936:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976886784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066795.418941:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a590e680/2, rc 0, transno 17179873647 00000100:00100000:1.0:1746066795.418943:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976887296:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066795.418957:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135dfaa00/2, rc 0, transno 21474840962 00000100:00100000:1.0:1746066795.418960:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135dfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976886144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066795.420238:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066795.420403:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977044352 00000100:00100000:1.0:1746066795.420408:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977044352 00000100:00100000:1.0:1746066795.420448:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10041 00000100:00100000:1.0:1746066795.420453:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31728:x1830882977044352:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066795.420470:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066795.420484:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46a00/0xfb36a14ee608c094 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ebf2 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.420524:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46a00/0xfb36a14ee608c094 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf2 expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.420539:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46a00/0xfb36a14ee608c094 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf2 expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066795.420552:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066795.420555:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066795.420557:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac46a00, rc 0) 00000100:00100000:1.0:1746066795.420611:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31728:x1830882977044352:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 156us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066795.420617:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10041 00000100:00100000:0.0:1746066795.433087:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066795.433711:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977044480 00000100:00100000:3.0:1746066795.433718:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977044480 00000100:00100000:3.0:1746066795.433758:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10042 00000100:00100000:3.0:1746066795.433764:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31728:x1830882977044480:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066795.433780:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066795.433795:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bada00/0xfb36a14ee608c09b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ebf9 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.433859:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c0a2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066795.433871:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066795.433880:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066795.433901:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066795.433905:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066795.433917:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066795.433936:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bada00/0xfb36a14ee608c09b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf9 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.433965:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf9 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.433971:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066795.433974:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066795.433977:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bac200, rc 0) 00000100:00100000:3.0:1746066795.434015:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31728:x1830882977044480:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 250us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066795.434020:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10042 00000100:00100000:0.0:1746066795.439783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.439821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.439843:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.439902:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066795.439986:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977044736 00000100:00100000:2.0:1746066795.439993:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977044736 00000100:00100000:2.0:1746066795.440024:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977044992 00000100:00100000:2.0:1746066795.440026:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977044992 00000100:00100000:2.0:1746066795.440036:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977044608 00000100:00100000:2.0:1746066795.440038:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977044608 00000100:00100000:2.0:1746066795.440045:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977044864 00000100:00100000:2.0:1746066795.440047:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977044864 00000100:00100000:2.0:1746066795.440058:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14805 00000100:00100000:2.0:1746066795.440064:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977044736:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066795.440080:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066795.440096:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092591c00/0xfb36a14ee608c0a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec07 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066795.440115:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38d:0x0] initial LVB size: 2097152, mtime: 0x6812dd6a, atime: 0x6812dd6a, ctime: 0x6812dd6a, blocks: 0x821 00010000:00010000:2.0:1746066795.440130:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.440132:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066795.440139:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092591c00/0xfb36a14ee608c0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec07 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066795.440157:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092591c00/0xfb36a14ee608c0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec07 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066795.440167:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092591c00, rc 0) 00000100:00100000:1.0:1746066795.440312:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14806 00000100:00100000:1.0:1746066795.440320:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977044992:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066795.440329:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066795.440339:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac47800/0xfb36a14ee608c0b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec15 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066795.440354:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 2097152, mtime: 0x6812dd6a, atime: 0x6812dd6a, ctime: 0x6812dd6a, blocks: 0x821 00010000:00010000:1.0:1746066795.440362:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.440364:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.440368:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac47800/0xfb36a14ee608c0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec15 expref: 10 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.440376:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac47800/0xfb36a14ee608c0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec15 expref: 10 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.440383:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac47800, rc 0) 00000100:00100000:1.0:1746066795.440400:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977044992:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 82us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066795.440405:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14806 00000100:00100000:1.0:1746066795.440418:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14807 00000100:00100000:1.0:1746066795.440423:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977044608:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066795.440428:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066795.440434:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac47400/0xfb36a14ee608c0b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec00 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066795.440444:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd6a, atime: 0x6812dd68, ctime: 0x6812dd6a, blocks: 0x7dd 00010000:00010000:1.0:1746066795.440451:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.440452:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.440455:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac47400/0xfb36a14ee608c0b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec00 expref: 10 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.440463:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac47400/0xfb36a14ee608c0b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec00 expref: 10 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.440469:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac47400, rc 0) 00000100:00100000:1.0:1746066795.440481:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977044608:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 58us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066795.440486:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14807 00000100:00100000:1.0:1746066795.440494:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14808 00000100:00100000:1.0:1746066795.440498:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977044864:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066795.440502:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066795.440509:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e200/0xfb36a14ee608c0be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec0e expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066795.440518:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd6a, atime: 0x6812dd6a, ctime: 0x6812dd6a, blocks: 0x821 00010000:00010000:1.0:1746066795.440524:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.440525:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066795.440529:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e200/0xfb36a14ee608c0be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec0e expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.440536:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e200/0xfb36a14ee608c0be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec0e expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066795.440542:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb6e200, rc 0) 00000100:00100000:1.0:1746066795.440554:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977044864:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 56us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066795.440558:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14808 00000100:00100000:2.0:1746066795.440992:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977044736:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 136us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066795.440997:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14805 00000100:00100000:0.0:1746066795.441694:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.441745:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066795.441806:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977045120 00000100:00100000:0.0:1746066795.441810:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977045120 00000100:00100000:0.0:1746066795.441841:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977045248 00000100:00100000:0.0:1746066795.441843:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977045248 00000100:00100000:0.0:1746066795.441856:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14809 00000100:00100000:0.0:1746066795.441862:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977045120:12345-192.168.202.57@tcp:101:mirror_io.0 00000100:00100000:3.0:1746066795.441864:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14810 00000100:00100000:3.0:1746066795.441870:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977045248:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066795.441870:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066795.441876:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066795.441879:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608c0c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec1c expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066795.441883:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bace00/0xfb36a14ee608c0cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec23 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066795.441892:0:10402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 5090560, mtime: 0x6812dd6b, atime: 0x6812dd69, ctime: 0x6812dd6b, blocks: 0x1723 00002000:00010000:3.0:1746066795.441893:0:8112:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38f:0x0] initial LVB size: 4194304, mtime: 0x6812dd6b, atime: 0x6812dd68, ctime: 0x6812dd6b, blocks: 0x102b 00010000:00010000:3.0:1746066795.441901:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.441901:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066795.441902:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066795.441902:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066795.441907:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bace00/0xfb36a14ee608c0cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec23 expref: 11 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066795.441907:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608c0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec1c expref: 11 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066795.441916:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bace00/0xfb36a14ee608c0cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec23 expref: 11 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066795.441916:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608c0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec1c expref: 11 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066795.441922:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bace00, rc 0) 00010000:00010000:0.0:1746066795.441922:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff40200, rc 0) 00000100:00100000:3.0:1746066795.442784:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977045248:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 911us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066795.442784:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977045120:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 920us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066795.442790:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14810 00000100:00100000:0.0:1746066795.442795:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14809 00010000:00010000:1.0:1746066796.234126:0:9850:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066796.469643:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.470197:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977045504 00000100:00100000:1.0:1746066796.470205:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977045504 00000100:00100000:1.0:1746066796.470652:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6717 00000100:00100000:1.0:1746066796.470660:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977045504:12345-192.168.202.57@tcp:3:mirror_io.0 00010000:00010000:1.0:1746066796.470724:0:8456:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b4b9e00/0xfb36a14ee608c0d3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.470736:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066796.470737:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066796.470741:0:8456:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b4b9e00/0xfb36a14ee608c0d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.470752:0:8456:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b4b9e00/0xfb36a14ee608c0d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.480270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.481300:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977045888 00000100:00100000:2.0:1746066796.481308:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977045888 00000100:00100000:2.0:1746066796.481365:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6718 00000100:00100000:2.0:1746066796.481373:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977045888:12345-192.168.202.57@tcp:3:mirror_io.0 00010000:00010000:2.0:1746066796.481403:0:25585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092591000/0xfb36a14ee608c0da lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.481415:0:25585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.481416:0:25585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.481428:0:25585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092591000/0xfb36a14ee608c0da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.481439:0:25585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092591000/0xfb36a14ee608c0da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.481533:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066796.482807:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977045760 00000100:00100000:3.0:1746066796.482815:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977045760 00000100:00100000:3.0:1746066796.482855:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6719 00000100:00100000:3.0:1746066796.482861:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977045760:12345-192.168.202.57@tcp:3:mirror_io.0 00010000:00010000:3.0:1746066796.482882:0:1992:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009eb97c00/0xfb36a14ee608c0e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.482893:0:1992:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066796.482895:0:1992:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066796.482898:0:1992:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb97c00/0xfb36a14ee608c0e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.482908:0:1992:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb97c00/0xfb36a14ee608c0e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.486887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.486906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.486918:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.486932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.486947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.486969:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977046272 00000100:00100000:0.0:1746066796.486977:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977046272 00000100:00100000:2.0:1746066796.488088:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977046400 00000100:00100000:2.0:1746066796.488093:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977046400 00000100:00100000:2.0:1746066796.488135:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977046784 00000100:00100000:2.0:1746066796.488137:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977046784 00000100:00100000:2.0:1746066796.488150:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977046656 00000100:00100000:2.0:1746066796.488153:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977046656 00000100:00100000:2.0:1746066796.488163:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977046912 00000100:00100000:2.0:1746066796.488165:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977046912 00000100:00100000:2.0:1746066796.488180:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6720 00000100:00100000:2.0:1746066796.488185:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1964:x1830882977046400:12345-192.168.202.57@tcp:3:mirror_io.0 00010000:00010000:2.0:1746066796.488213:0:21552:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012eb96600/0xfb36a14ee608c0e8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.488224:0:21552:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.488225:0:21552:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.488229:0:21552:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb96600/0xfb36a14ee608c0e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.488239:0:21552:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb96600/0xfb36a14ee608c0e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066796.488536:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6721 00000100:00100000:1.0:1746066796.488544:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1964:x1830882977046784:12345-192.168.202.57@tcp:3:mirror_io.0 00010000:00010000:1.0:1746066796.488561:0:1993:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8e00/0xfb36a14ee608c0ef lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.488567:0:1993:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066796.488569:0:1993:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066796.488582:0:1993:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8e00/0xfb36a14ee608c0ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.488591:0:1993:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8e00/0xfb36a14ee608c0ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066796.489641:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6722 00000100:00100000:1.0:1746066796.489648:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1964:x1830882977046656:12345-192.168.202.57@tcp:3:mirror_io.0 00010000:00010000:1.0:1746066796.489667:0:21550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608c0f6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.489690:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066796.489692:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066796.489694:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608c0f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.489701:0:21550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608c0f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.490402:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6723 00000100:00100000:0.0:1746066796.490409:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:1964:x1830882977046912:12345-192.168.202.57@tcp:3:mirror_io.0 00010000:00010000:0.0:1746066796.490425:0:8455:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012ff40a00/0xfb36a14ee608c0fd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.490431:0:8455:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066796.490433:0:8455:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066796.490436:0:8455:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff40a00/0xfb36a14ee608c0fd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.490444:0:8455:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ff40a00/0xfb36a14ee608c0fd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066796.494204:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6724 00000100:00100000:3.0:1746066796.494230:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1964:x1830882977046272:12345-192.168.202.57@tcp:3:mirror_io.0 00010000:00010000:3.0:1746066796.494292:0:8457:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d600/0xfb36a14ee608c104 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.494307:0:8457:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066796.494310:0:8457:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066796.494316:0:8457:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d600/0xfb36a14ee608c104 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.494331:0:8457:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d600/0xfb36a14ee608c104 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.513182:0:8456:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b4b9e00/0xfb36a14ee608c0d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.513197:0:8456:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b4b9e00/0xfb36a14ee608c0d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.513204:0:8456:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b4b9e00/0xfb36a14ee608c0d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.513209:0:8456:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b4b9e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066796.513213:0:8456:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b4b9e00/0xfb36a14ee608c0d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.513220:0:8456:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b4b9e00/0xfb36a14ee608c0d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.513234:0:8456:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b4b9e00/0xfb36a14ee608c0d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.513240:0:8456:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b4b9e00/0xfb36a14ee608c0d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066796.514412:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:1964:x1830882977045504:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 43748us (44771us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066796.514422:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6717 00010000:00010000:3.0:1746066796.528320:0:1992:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009eb97c00/0xfb36a14ee608c0e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.528333:0:1992:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb97c00/0xfb36a14ee608c0e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.528341:0:1992:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009eb97c00/0xfb36a14ee608c0e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.528347:0:1992:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eb97c00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066796.528350:0:1992:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009eb97c00/0xfb36a14ee608c0e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.528357:0:1992:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009eb97c00/0xfb36a14ee608c0e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.528372:0:1992:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009eb97c00/0xfb36a14ee608c0e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.528377:0:1992:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb97c00/0xfb36a14ee608c0e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066796.528438:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:1964:x1830882977045760:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 45572us (46901us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066796.528447:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6719 00010000:00010000:0.0:1746066796.528895:0:25585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092591000/0xfb36a14ee608c0da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.528903:0:25585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092591000/0xfb36a14ee608c0da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.528908:0:25585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092591000/0xfb36a14ee608c0da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.528913:0:25585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092591000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066796.528915:0:25585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092591000/0xfb36a14ee608c0da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.528921:0:25585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092591000/0xfb36a14ee608c0da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.528929:0:25585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092591000/0xfb36a14ee608c0da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.528934:0:25585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092591000/0xfb36a14ee608c0da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066796.528976:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1963:x1830882977045888:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 47604us (48713us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066796.528985:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6718 00010000:00010000:1.0:1746066796.544272:0:1993:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8e00/0xfb36a14ee608c0ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.544285:0:1993:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8e00/0xfb36a14ee608c0ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.544298:0:1993:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8e00/0xfb36a14ee608c0ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.544304:0:1993:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b4b8e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066796.544307:0:1993:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8e00/0xfb36a14ee608c0ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.544314:0:1993:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8e00/0xfb36a14ee608c0ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.544329:0:1993:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8e00/0xfb36a14ee608c0ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.544335:0:1993:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8e00/0xfb36a14ee608c0ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066796.544427:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1964:x1830882977046784:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 55880us (57503us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066796.544436:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6721 00010000:00010000:2.0:1746066796.546070:0:8455:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012ff40a00/0xfb36a14ee608c0fd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.546080:0:8455:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff40a00/0xfb36a14ee608c0fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.546086:0:8455:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ff40a00/0xfb36a14ee608c0fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.546090:0:8455:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ff40a00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066796.546093:0:8455:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ff40a00/0xfb36a14ee608c0fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.546099:0:8455:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ff40a00/0xfb36a14ee608c0fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.546109:0:8455:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ff40a00/0xfb36a14ee608c0fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.546114:0:8455:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ff40a00/0xfb36a14ee608c0fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066796.546234:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977046912:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 55823us (59283us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066796.546240:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6723 00010000:00010000:3.0:1746066796.554086:0:8457:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d600/0xfb36a14ee608c104 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.554104:0:8457:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d600/0xfb36a14ee608c104 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.554112:0:8457:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d600/0xfb36a14ee608c104 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.554118:0:8457:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf0d600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066796.554121:0:8457:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d600/0xfb36a14ee608c104 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.554128:0:8457:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d600/0xfb36a14ee608c104 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.554144:0:8457:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d600/0xfb36a14ee608c104 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.554150:0:8457:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf0d600/0xfb36a14ee608c104 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066796.554242:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977046272:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 60021us (67359us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066796.554252:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6724 00010000:00010000:2.0:1746066796.558029:0:21552:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012eb96600/0xfb36a14ee608c0e8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.558045:0:21552:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb96600/0xfb36a14ee608c0e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.558054:0:21552:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012eb96600/0xfb36a14ee608c0e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.558060:0:21552:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb96600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066796.558064:0:21552:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012eb96600/0xfb36a14ee608c0e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.558071:0:21552:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012eb96600/0xfb36a14ee608c0e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.558087:0:21552:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012eb96600/0xfb36a14ee608c0e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.558097:0:21552:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb96600/0xfb36a14ee608c0e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066796.558160:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977046400:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 69970us (71248us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066796.558170:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6720 00010000:00010000:1.0:1746066796.562628:0:21550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608c0f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.562642:0:21550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608c0f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.562649:0:21550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608c0f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.562657:0:21550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecca600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066796.562660:0:21550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608c0f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.562667:0:21550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608c0f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.562706:0:21550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608c0f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.562712:0:21550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ecca600/0xfb36a14ee608c0f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066796.562775:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977046656:12345-192.168.202.57@tcp:3:mirror_io.0 Request processed in 73124us (75838us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066796.562783:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6722 00000100:00100000:0.0:1746066796.571113:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.571503:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977047168 00000100:00100000:2.0:1746066796.571510:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977047168 00000100:00100000:2.0:1746066796.571564:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 716 00000100:00100000:2.0:1746066796.571598:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31728:x1830882977047168:12345-192.168.202.57@tcp:103:mirror_io.0 00010000:00010000:2.0:1746066796.571611:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066796.571631:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2600/0xfb36a14ee608c04e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebe4 expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.571670:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066796.571696:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066796.571730:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31728:x1830882977047168:12345-192.168.202.57@tcp:103:mirror_io.0 Request processed in 160us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066796.571736:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 716 00000100:00100000:0.0:1746066796.573397:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066796.574235:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977047424 00000100:00100000:3.0:1746066796.574242:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977047424 00000100:00100000:3.0:1746066796.574443:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4199 00000100:00100000:3.0:1746066796.574451:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31728:x1830882977047424:12345-192.168.202.57@tcp:35:mirror_io.0 00000100:00100000:3.0:1746066796.574710:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31728:x1830882977047424:12345-192.168.202.57@tcp:35:mirror_io.0 Request processed in 259us (1316us total) trans 8589944109 rc 0/0 00000100:00100000:3.0:1746066796.574716:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4199 00000100:00100000:0.0:1746066796.576380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.576457:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977047680 00000100:00100000:2.0:1746066796.576462:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977047680 00000100:00100000:2.0:1746066796.576493:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4200 00000100:00100000:2.0:1746066796.576499:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31728:x1830882977047680:12345-192.168.202.57@tcp:35:mirror_io.0 00000100:00100000:2.0:1746066796.576937:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31728:x1830882977047680:12345-192.168.202.57@tcp:35:mirror_io.0 Request processed in 437us (559us total) trans 8589944110 rc 0/0 00000100:00100000:2.0:1746066796.576946:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4200 00000100:00100000:0.0:1746066796.599953:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.600051:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977047936 00000100:00100000:1.0:1746066796.600059:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977047936 00000100:00100000:1.0:1746066796.600112:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10043 00000100:00100000:1.0:1746066796.600120:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+250:31740:x1830882977047936:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066796.600196:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066796.600212:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c10b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec2a expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.600297:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608c112 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600310:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608c112 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600318:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608c112 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600328:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c5d800/0xfb36a14ee608c119 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600333:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c5d800/0xfb36a14ee608c119 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600338:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c5d800/0xfb36a14ee608c119 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600422:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608c120 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600429:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608c120 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600434:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608c120 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:1.0:1746066796.600440:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066796.600504:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608c112 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600510:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608c112 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600515:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608c112 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600523:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eccaa00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066796.600526:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608c112 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600531:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608c112 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600539:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066796.600542:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066796.600545:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608c112 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600549:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608c112 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600583:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c5d800/0xfb36a14ee608c119 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600587:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c5d800/0xfb36a14ee608c119 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600592:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093c5d800/0xfb36a14ee608c119 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600596:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c5d800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066796.600598:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c5d800/0xfb36a14ee608c119 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600603:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c5d800/0xfb36a14ee608c119 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600608:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ffed700) 00010000:00010000:1.0:1746066796.600610:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066796.600613:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093c5d800/0xfb36a14ee608c119 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600616:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c5d800/0xfb36a14ee608c119 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.600647:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c10b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec2a expref: 253 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.600656:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608c120 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec2a expref: 252 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.600661:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066796.600663:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066796.600665:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed34a00, rc 0) 00000100:00100000:1.0:1746066796.600732:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31740:x1830882977047936:12345-192.168.202.57@tcp:101:cat.0 Request processed in 612us (786us total) trans 8589944111 rc 0/0 00000100:00100000:1.0:1746066796.600738:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10043 00000100:00100000:0.0:1746066796.602356:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066796.602480:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977048192 00000100:00100000:3.0:1746066796.602485:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977048192 00000100:00100000:3.0:1746066796.602520:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10044 00000100:00100000:3.0:1746066796.602526:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+6:31735:x1830882977048192:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066796.602543:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066796.602562:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3600/0xfb36a14ee608c12e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec31 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.602640:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2200/0xfb36a14ee608c135 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602649:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2200/0xfb36a14ee608c135 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602657:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2200/0xfb36a14ee608c135 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602669:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2c00/0xfb36a14ee608c13c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602718:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2c00/0xfb36a14ee608c13c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602724:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2c00/0xfb36a14ee608c13c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602820:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608c143 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602827:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608c143 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602832:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608c143 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066796.602838:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066796.602897:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2200/0xfb36a14ee608c135 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602902:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2200/0xfb36a14ee608c135 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602907:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2200/0xfb36a14ee608c135 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602912:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eea2200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066796.602915:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2200/0xfb36a14ee608c135 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602920:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2200/0xfb36a14ee608c135 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602928:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066796.602930:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066796.602933:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2200/0xfb36a14ee608c135 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602937:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2200/0xfb36a14ee608c135 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602964:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2c00/0xfb36a14ee608c13c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602969:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2c00/0xfb36a14ee608c13c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602973:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2c00/0xfb36a14ee608c13c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602977:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eea2c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066796.602979:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2c00/0xfb36a14ee608c13c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602983:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2c00/0xfb36a14ee608c13c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602989:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a4c34700) 00010000:00010000:3.0:1746066796.602991:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066796.602993:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2c00/0xfb36a14ee608c13c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.602997:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2c00/0xfb36a14ee608c13c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066796.603032:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea3600/0xfb36a14ee608c12e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec31 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.603042:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608c143 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec31 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.603048:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066796.603050:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066796.603052:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea2800, rc 0) 00000100:00100000:3.0:1746066796.603088:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+8:31735:x1830882977048192:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 562us (736us total) trans 8589944112 rc 0/0 00000100:00100000:3.0:1746066796.603094:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10044 00000100:00100000:0.0:1746066796.614979:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.615049:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977048320 00000100:00100000:2.0:1746066796.615074:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977048320 00000100:00100000:2.0:1746066796.615119:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14811 00000100:00100000:2.0:1746066796.615127:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977048320:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066796.615141:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066796.615156:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009acd2600/0xfb36a14ee608c151 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec38 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.615174:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.615176:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.615183:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd2600/0xfb36a14ee608c151 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec38 expref: 32 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066796.615195:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009acd2600/0xfb36a14ee608c151 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec38 expref: 32 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066796.615204:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd2600, rc 0) 00000100:00100000:2.0:1746066796.615242:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977048320:12345-192.168.202.57@tcp:101:cat.0 Request processed in 116us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066796.615248:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14811 00000100:00100000:0.0:1746066796.622438:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.623434:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.623511:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.623559:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977049472 00000100:00100000:0.0:1746066796.623567:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977049472 00000100:00100000:3.0:1746066796.623652:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977048832 00000100:00100000:3.0:1746066796.623656:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977048832 00000100:00100000:0.0:1746066796.623951:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10045 00000100:00100000:0.0:1746066796.623959:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:31741:x1830882977049472:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066796.623978:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066796.623993:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc1c00/0xfb36a14ee608c158 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec69 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.624071:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0600/0xfb36a14ee608c15f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624080:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0600/0xfb36a14ee608c15f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624089:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0600/0xfb36a14ee608c15f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624099:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0000/0xfb36a14ee608c166 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624108:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0000/0xfb36a14ee608c166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624113:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0000/0xfb36a14ee608c166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624186:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0200/0xfb36a14ee608c16d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624192:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0200/0xfb36a14ee608c16d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624198:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0200/0xfb36a14ee608c16d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:0.0:1746066796.624204:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066796.624261:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0600/0xfb36a14ee608c15f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624266:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0600/0xfb36a14ee608c15f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624271:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0600/0xfb36a14ee608c15f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624276:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009acc0600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066796.624279:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0600/0xfb36a14ee608c15f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624285:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0600/0xfb36a14ee608c15f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624293:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066796.624296:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066796.624299:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0600/0xfb36a14ee608c15f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624304:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0600/0xfb36a14ee608c15f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624321:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0000/0xfb36a14ee608c166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624325:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0000/0xfb36a14ee608c166 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624329:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0000/0xfb36a14ee608c166 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624333:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009acc0000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066796.624336:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0000/0xfb36a14ee608c166 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624340:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0000/0xfb36a14ee608c166 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624344:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012dc13700) 00010000:00010000:0.0:1746066796.624346:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066796.624348:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0000/0xfb36a14ee608c166 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624352:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0000/0xfb36a14ee608c166 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066796.624376:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc1c00/0xfb36a14ee608c158 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec69 expref: 11 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.624390:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0200/0xfb36a14ee608c16d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec69 expref: 10 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.624395:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066796.624397:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066796.624399:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acc0200, rc 0) 00000100:00100000:0.0:1746066796.624430:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:31741:x1830882977049472:12345-192.168.202.57@tcp:101:cat.0 Request processed in 473us (1002us total) trans 8589944113 rc 0/0 00000100:00100000:0.0:1746066796.624435:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10045 00000100:00100000:3.0:1746066796.625865:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977048960 00000100:00100000:3.0:1746066796.625873:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977048960 00000100:00100000:3.0:1746066796.625916:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14812 00000100:00100000:3.0:1746066796.625923:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1966:x1830882977048832:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066796.625936:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066796.625985:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608c17b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec4d expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.626002:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066796.626004:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066796.626010:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608c17b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec4d expref: 22 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066796.626021:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608c17b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec4d expref: 22 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066796.626030:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea3e00, rc 0) 00000100:00100000:3.0:1746066796.626063:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977048832:12345-192.168.202.57@tcp:101:cat.0 Request processed in 141us (5703us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066796.626068:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14812 00000100:00100000:3.0:1746066796.626079:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14813 00000100:00100000:3.0:1746066796.626084:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882977048960:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066796.626090:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066796.626098:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eea2e00/0xfb36a14ee608c182 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec54 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.626107:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066796.626108:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066796.626111:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eea2e00/0xfb36a14ee608c182 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec54 expref: 33 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066796.626120:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eea2e00/0xfb36a14ee608c182 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec54 expref: 33 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066796.626125:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eea2e00, rc 0) 00000100:00100000:3.0:1746066796.626138:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1966:x1830882977048960:12345-192.168.202.57@tcp:101:cat.0 Request processed in 54us (2628us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066796.626143:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14813 00000100:00100000:0.0:1746066796.629614:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.633703:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977049088 00000100:00100000:2.0:1746066796.633716:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977049088 00000100:00100000:1.0:1746066796.634397:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.635172:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.635250:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.635416:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977049216 00000100:00100000:2.0:1746066796.635421:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977049216 00000100:00100000:2.0:1746066796.635449:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14814 00000100:00100000:2.0:1746066796.635456:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1966:x1830882977049088:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066796.635472:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066796.635485:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009acd2a00/0xfb36a14ee608c189 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec5b expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.635504:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.635506:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.635512:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd2a00/0xfb36a14ee608c189 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec5b expref: 34 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066796.635525:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009acd2a00/0xfb36a14ee608c189 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec5b expref: 34 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066796.635535:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd2a00, rc 0) 00000100:00100000:2.0:1746066796.635586:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882977049088:12345-192.168.202.57@tcp:101:cat.0 Request processed in 131us (5980us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066796.635592:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14814 00000100:00100000:2.0:1746066796.635604:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14815 00000100:00100000:2.0:1746066796.635609:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977049216:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066796.635615:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066796.635623:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c190 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec62 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.635632:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.635634:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.635637:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec62 expref: 23 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066796.635650:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec62 expref: 23 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066796.635657:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd2400, rc 0) 00000100:00100000:2.0:1746066796.635670:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1966:x1830882977049216:12345-192.168.202.57@tcp:101:cat.0 Request processed in 61us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066796.635689:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14815 00000100:00100000:2.0:1746066796.635702:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977048576 00000100:00100000:2.0:1746066796.635704:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977048576 00000100:00100000:2.0:1746066796.635722:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10046 00000100:00100000:2.0:1746066796.635726:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:31735:x1830882977048576:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066796.635734:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066796.635736:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746066796.635751:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eea2800/0xfb36a14ee608c143 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec31 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.635766:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066796.635770:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066796.635776:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2c00/0xfb36a14ee608c197 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec3f expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.635811:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066796.635820:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46a00/0xfb36a14ee608c094 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf2 expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.635830:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c0a2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf9 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.635835:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608c120 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec2a expref: 251 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.635840:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0200/0xfb36a14ee608c16d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec69 expref: 10 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.635893:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 7/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066796.635916:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0200/0xfb36a14ee608c16d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec69 expref: 10 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.635926:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0200/0xfb36a14ee608c16d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec69 expref: 10 pid: 14550 timeout: 857 lvb_type: 0 00000100:00100000:2.0:1746066796.635935:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976887936:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066796.635983:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608c120 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec2a expref: 251 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.635990:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608c120 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec2a expref: 251 pid: 14550 timeout: 857 lvb_type: 0 00000100:00100000:2.0:1746066796.635996:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed70700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976888064:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066796.636014:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf9 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.636020:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c0a2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf9 expref: 9 pid: 14549 timeout: 857 lvb_type: 0 00000100:00100000:2.0:1746066796.636026:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976888192:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066796.636041:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46a00/0xfb36a14ee608c094 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf2 expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.636046:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46a00/0xfb36a14ee608c094 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf2 expref: 9 pid: 14550 timeout: 857 lvb_type: 0 00000100:00100000:2.0:1746066796.636052:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976888320:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066796.636066:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066796.636852:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977048704 00000100:00100000:0.0:1746066796.636857:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977048704 00000100:00100000:0.0:1746066796.636880:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14816 00000100:00100000:0.0:1746066796.636885:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882977048704:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066796.636893:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066796.636901:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acc1c00/0xfb36a14ee608c1a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec46 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066796.636911:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066796.636912:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066796.636916:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009acc1c00/0xfb36a14ee608c1a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec46 expref: 24 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.636924:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acc1c00/0xfb36a14ee608c1a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec46 expref: 24 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066796.636935:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acc1c00, rc 0) 00000100:00100000:0.0:1746066796.636955:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977048704:12345-192.168.202.57@tcp:101:cat.0 Request processed in 71us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.636959:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14816 00000100:00100000:0.0:1746066796.647607:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.647645:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.647817:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.647964:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.648020:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977049600 00000100:00100000:2.0:1746066796.648028:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977049600 00000100:00100000:2.0:1746066796.648074:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977049728 00000100:00100000:2.0:1746066796.648076:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977049728 00000100:00100000:2.0:1746066796.648093:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977049856 00000100:00100000:2.0:1746066796.648095:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977049856 00000100:00100000:2.0:1746066796.648109:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14817 00000100:00100000:2.0:1746066796.648115:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977049600:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066796.648130:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066796.648143:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed6ce00/0xfb36a14ee608c1ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec70 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.648162:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.648164:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.648170:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed6ce00/0xfb36a14ee608c1ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec70 expref: 21 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066796.648184:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed6ce00/0xfb36a14ee608c1ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec70 expref: 21 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066796.648194:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed6ce00, rc 0) 00000100:00100000:2.0:1746066796.648228:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977049600:12345-192.168.202.57@tcp:101:cat.0 Request processed in 114us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066796.648234:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14817 00000100:00100000:2.0:1746066796.648247:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14818 00000100:00100000:2.0:1746066796.648252:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977049728:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066796.648258:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066796.648266:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c1b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec77 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.648276:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.648277:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.648282:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c1b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec77 expref: 19 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066796.648291:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c1b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec77 expref: 19 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066796.648297:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd2200, rc 0) 00000100:00100000:2.0:1746066796.648310:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977049728:12345-192.168.202.57@tcp:101:cat.0 Request processed in 58us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066796.648315:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14818 00000100:00100000:2.0:1746066796.648324:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14819 00000100:00100000:2.0:1746066796.648328:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977049856:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066796.648333:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066796.648339:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c1ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec7e expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.648346:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.648348:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.648351:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c1ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec7e expref: 19 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066796.648358:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c1ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec7e expref: 19 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066796.648365:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd2000, rc 0) 00000100:00100000:2.0:1746066796.648378:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977049856:12345-192.168.202.57@tcp:101:cat.0 Request processed in 49us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066796.648382:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14819 00000100:00100000:0.0:1746066796.648835:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.648846:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.648915:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976887936:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066796.648923:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed70700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976888064:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066796.648930:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976888192:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066796.648935:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976888320:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066796.648959:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746066796.649007:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977049984 00000100:00100000:1.0:1746066796.649011:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977049984 00000100:00100000:1.0:1746066796.649025:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977050112 00000100:00100000:1.0:1746066796.649027:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977050112 00000100:00100000:1.0:1746066796.649033:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977050240 00000100:00100000:1.0:1746066796.649035:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977050240 00000100:00100000:1.0:1746066796.649045:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14820 00000100:00100000:1.0:1746066796.649049:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977049984:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066796.649058:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066796.649065:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608c1c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec85 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.649075:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066796.649077:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066796.649081:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608c1c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec85 expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066796.649090:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608c1c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec85 expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066796.649096:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed4bc00, rc 0) 00000100:00100000:1.0:1746066796.649113:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882977049984:12345-192.168.202.57@tcp:101:cat.0 Request processed in 64us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066796.649118:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14820 00000100:00100000:1.0:1746066796.649126:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14821 00000100:00100000:1.0:1746066796.649129:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977050112:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066796.649134:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066796.649139:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608c1c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec8c expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.649146:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066796.649147:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066796.649151:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608c1c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec8c expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066796.649158:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608c1c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec8c expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066796.649165:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed4a000, rc 0) 00000100:00100000:1.0:1746066796.649174:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882977050112:12345-192.168.202.57@tcp:101:cat.0 Request processed in 44us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066796.649178:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14821 00000100:00100000:1.0:1746066796.649184:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14822 00000100:00100000:1.0:1746066796.649188:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977050240:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066796.649192:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066796.649197:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eccb600/0xfb36a14ee608c1cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec93 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.649205:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066796.649206:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066796.649209:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eccb600/0xfb36a14ee608c1cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec93 expref: 20 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066796.649216:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eccb600/0xfb36a14ee608c1cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec93 expref: 20 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066796.649222:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eccb600, rc 0) 00000100:00100000:1.0:1746066796.649231:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977050240:12345-192.168.202.57@tcp:101:cat.0 Request processed in 42us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066796.649235:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14822 00000100:00100000:1.0:1746066796.651004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.651041:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.652050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.652071:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977050368 00000100:00100000:1.0:1746066796.652077:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977050368 00010000:00010000:1.0:1746066796.652106:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0200/0xfb36a14ee608c16d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec69 expref: 11 pid: 14550 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746066796.653026:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977050624 00000100:00100000:1.0:1746066796.653031:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977050624 00010000:00010000:1.0:1746066796.653046:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c0a2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf9 expref: 10 pid: 14549 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746066796.653198:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977050496 00000100:00100000:0.0:1746066796.653202:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977050496 00010000:00010000:0.0:1746066796.653217:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608c120 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec2a expref: 252 pid: 14550 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746066796.653399:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7618 00000100:00100000:0.0:1746066796.653406:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:1965:x1830882977050368:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066796.653419:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066796.653425:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0200/0xfb36a14ee608c16d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec69 expref: 11 pid: 14550 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746066796.653434:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0200/0xfb36a14ee608c16d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec69 expref: 11 pid: 14550 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746066796.653452:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acc0200/0xfb36a14ee608c16d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec69 expref: 11 pid: 14550 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746066796.653466:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066796.653470:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066796.653476:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066796.653481:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066796.653552:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7619 00000100:00100000:2.0:1746066796.653559:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1965:x1830882977050624:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066796.653565:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066796.653579:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c0a2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf9 expref: 10 pid: 14549 timeout: 857 lvb_type: 0 00010000:00010000:2.0:1746066796.653586:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf9 expref: 10 pid: 14549 timeout: 857 lvb_type: 0 00010000:00010000:2.0:1746066796.653601:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c0a2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf9 expref: 10 pid: 14549 timeout: 857 lvb_type: 0 00010000:00010000:2.0:1746066796.653612:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066796.653615:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066796.653620:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066796.653624:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066796.653663:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7620 00000100:00100000:1.0:1746066796.653669:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:1965:x1830882977050496:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066796.653687:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066796.653690:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608c120 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec2a expref: 252 pid: 14550 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746066796.653697:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608c120 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec2a expref: 252 pid: 14550 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746066796.653707:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed34a00/0xfb36a14ee608c120 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec2a expref: 252 pid: 14550 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746066796.653717:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066796.653719:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066796.653724:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066796.653728:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066796.654375:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1965:x1830882977050624:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 815us (3332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066796.654381:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7619 00000100:00100000:1.0:1746066796.654438:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:1965:x1830882977050496:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 769us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066796.654443:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7620 00000100:00100000:3.0:1746066796.654521:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.654735:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:1965:x1830882977050368:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1329us (3736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066796.654741:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7618 00000100:00100000:1.0:1746066796.654818:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977051136 00000100:00100000:1.0:1746066796.654821:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977051136 00000100:00100000:1.0:1746066796.654842:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10047 00000100:00100000:1.0:1746066796.654847:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:31738:x1830882977051136:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066796.654862:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066796.655387:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608c1d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eca1 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.655476:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608c1dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655485:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608c1dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655494:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608c1dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655506:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac000/0xfb36a14ee608c1e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655511:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac000/0xfb36a14ee608c1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655516:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac000/0xfb36a14ee608c1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655609:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bada00/0xfb36a14ee608c1eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655615:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bada00/0xfb36a14ee608c1eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655622:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bada00/0xfb36a14ee608c1eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:1.0:1746066796.655630:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066796.655707:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bada00/0xfb36a14ee608c1eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655713:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bada00/0xfb36a14ee608c1eb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655718:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bada00/0xfb36a14ee608c1eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655723:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bada00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066796.655726:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bada00/0xfb36a14ee608c1eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655731:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bada00/0xfb36a14ee608c1eb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655739:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066796.655742:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1746066796.655744:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bada00/0xfb36a14ee608c1eb lrc: 2/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655748:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bada00/0xfb36a14ee608c1eb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655757:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608c1dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655761:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608c1dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655768:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608c1dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655772:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b19ae00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066796.655773:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608c1dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655777:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608c1dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655781:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066796.655783:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066796.655785:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608c1dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655788:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ae00/0xfb36a14ee608c1dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655794:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac000/0xfb36a14ee608c1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655798:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac000/0xfb36a14ee608c1e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655802:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac000/0xfb36a14ee608c1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655805:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bac000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066796.655806:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac000/0xfb36a14ee608c1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655810:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac000/0xfb36a14ee608c1e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655817:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ffed900) 00010000:00010000:1.0:1746066796.655819:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066796.655820:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac000/0xfb36a14ee608c1e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655824:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bac000/0xfb36a14ee608c1e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066796.655847:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608c1d6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca1 expref: 253 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.655853:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccaa00/0xfb36a14ee608c1d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca1 expref: 253 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.655859:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eccaa00, rc 0) 00000100:00100000:1.0:1746066796.655896:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31738:x1830882977051136:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 1048us (1374us total) trans 8589944114 rc 301/301 00000100:00100000:1.0:1746066796.655900:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10047 00000100:00100000:1.0:1746066796.655937:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.656010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.656021:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977050880 00000100:00100000:1.0:1746066796.656024:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977050880 00000100:00100000:1.0:1746066796.656041:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10048 00000100:00100000:1.0:1746066796.656045:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31740:x1830882977050880:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066796.656052:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066796.656057:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ec9a expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.656081:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066796.656087:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec9a expref: 253 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.656099:0:14550:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 4/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066796.656108:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec9a expref: 253 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.656115:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066796.656117:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066796.656119:0:14550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066796.656123:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecca600, rc 0) 00000100:00100000:1.0:1746066796.656139:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31740:x1830882977050880:12345-192.168.202.57@tcp:101:cat.0 Request processed in 93us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066796.656143:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10048 00000100:00100000:1.0:1746066796.656190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.656201:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977051264 00000100:00100000:1.0:1746066796.656204:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977051264 00000100:00100000:1.0:1746066796.656219:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10049 00000100:00100000:1.0:1746066796.656223:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:31741:x1830882977051264:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066796.656230:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066796.656236:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608c200 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eca8 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.656255:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608c200 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca8 expref: 11 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.656262:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608c200 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca8 expref: 11 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.656268:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066796.656270:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066796.656272:0:14550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066796.656277:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff41600, rc 0) 00000100:00100000:1.0:1746066796.656292:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+11:31741:x1830882977051264:12345-192.168.202.57@tcp:101:cat.0 Request processed in 67us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066796.656297:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10049 00000100:00100000:1.0:1746066796.656321:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977050752 00000100:00100000:1.0:1746066796.656323:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977050752 00010000:00010000:1.0:1746066796.656333:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46a00/0xfb36a14ee608c094 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf2 expref: 9 pid: 14550 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746066796.656347:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7621 00000100:00100000:1.0:1746066796.656352:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1965:x1830882977050752:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066796.656358:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066796.656362:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46a00/0xfb36a14ee608c094 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf2 expref: 9 pid: 14550 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746066796.656370:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46a00/0xfb36a14ee608c094 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf2 expref: 9 pid: 14550 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746066796.656381:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46a00/0xfb36a14ee608c094 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ebf2 expref: 9 pid: 14550 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746066796.656388:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066796.656390:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066796.656396:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066796.656401:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066796.656407:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec9a expref: 252 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.656418:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066796.656432:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977050752:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 80us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066796.656437:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7621 00010000:00010000:1.0:1746066796.656459:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066796.656464:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00000040:00080000:1.0:1746066796.656979:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3134, 88 off265048 00000004:00080000:1.0:1746066796.656985:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757834309214ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066796.657047:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3146, 88 off266016 00000004:00080000:1.0:1746066796.657051:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757834375136ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066796.657080:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3147, 88 off266104 00000004:00080000:1.0:1746066796.657083:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757834407362ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066796.657094:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3135, 88 off265136 00000004:00080000:1.0:1746066796.657096:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757834420334ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066796.657105:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3136, 88 off265224 00000004:00080000:1.0:1746066796.657108:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757834431916ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066796.657116:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3148, 88 off266192 00000004:00080000:1.0:1746066796.657119:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757834442964ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066796.657128:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3149, 88 off266280 00000004:00080000:1.0:1746066796.657131:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757834454626ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066796.657139:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3150, 88 off266368 00000004:00080000:1.0:1746066796.657142:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757834465923ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066796.657151:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3137, 88 off265312 00000004:00080000:1.0:1746066796.657153:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757834477391ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066796.657162:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3151, 88 off266456 00000004:00080000:1.0:1746066796.657165:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757834489021ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066796.657174:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3138, 88 off265400 00000004:00080000:1.0:1746066796.657176:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757834500298ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066796.657184:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3152, 88 off266544 00000004:00080000:1.0:1746066796.657187:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757834510864ns, next at 749511475809ns, rc = 0 00000040:00080000:1.0:1746066796.657195:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3139, 88 off265488 00000004:00080000:1.0:1746066796.657197:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757834521164ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066796.657206:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3140, 88 off265576 00000004:00080000:1.0:1746066796.657208:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757834532404ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066796.657218:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3141, 88 off265664 00000004:00080000:1.0:1746066796.657220:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757834543958ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066796.657229:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3142, 88 off265752 00000004:00080000:1.0:1746066796.657232:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 757834555774ns, next at 749511128030ns, rc = 0 00000040:00080000:1.0:1746066796.657241:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3153, 88 off266632 00000004:00080000:1.0:1746066796.657244:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757834567762ns, next at 749511475809ns, rc = 0 00010000:00010000:1.0:1746066796.701825:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec3f expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.701838:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066796.701840:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746066796.701845:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec9a expref: 252 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.701853:0:14549:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec9a expref: 252 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.701860:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec9a expref: 252 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.701866:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608c200 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca8 expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.701871:0:14549:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608c200 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca8 expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.701876:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608c200 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca8 expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.701905:0:14549:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608c200 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca8 expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066796.701916:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976888448:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066796.702524:0:14549:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec9a expref: 252 pid: 14550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066796.702534:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976888576:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066796.702563:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab240 going to sleep for 11 seconds 00000001:00080000:1.0:1746066796.702593:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944113 is committed 00000001:00080000:1.0:1746066796.702604:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944115 is committed 00000004:00080000:1.0:1746066796.702608:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2427 committed 00000004:00080000:1.0:1746066796.703061:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2415 committed 00000004:00080000:1.0:1746066796.703067:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2414 committed 00000004:00080000:1.0:1746066796.703068:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2413 committed 00000004:00080000:1.0:1746066796.703069:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2412 committed 00000004:00080000:1.0:1746066796.703071:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2426 committed 00000004:00080000:1.0:1746066796.703072:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2411 committed 00000004:00080000:1.0:1746066796.703074:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2425 committed 00000004:00080000:1.0:1746066796.703075:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2410 committed 00000004:00080000:1.0:1746066796.703076:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2424 committed 00000004:00080000:1.0:1746066796.703077:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2423 committed 00000004:00080000:1.0:1746066796.703079:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2422 committed 00000004:00080000:1.0:1746066796.703080:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2409 committed 00000004:00080000:1.0:1746066796.703082:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2408 committed 00000004:00080000:1.0:1746066796.703083:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2421 committed 00000004:00080000:1.0:1746066796.703084:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2420 committed 00000004:00080000:1.0:1746066796.703085:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2407 committed 00000001:00080000:1.0:1746066796.703090:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944114 is committed 00000001:00080000:1.0:1746066796.703096:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944110 is committed 00000100:00100000:1.0:1746066796.703207:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976889088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066796.703238:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066796.703256:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976889600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066796.703270:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066796.703285:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746066796.703288:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976888704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066796.703300:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066796.703618:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976888832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066796.703832:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976889728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066796.703858:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976888960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066796.704282:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976889216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066796.704299:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066796.704751:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976890112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066796.704766:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066796.704823:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976889088 00000100:00100000:2.0:1746066796.704830:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976889088 00000100:00100000:2.0:1746066796.704859:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976889600 00000100:00100000:2.0:1746066796.704861:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976889600 00000100:00100000:2.0:1746066796.704871:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976888704 00000100:00100000:2.0:1746066796.704873:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976888704 00000100:00100000:2.0:1746066796.704880:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976889216 00000100:00100000:2.0:1746066796.704882:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976889216 00000100:00100000:2.0:1746066796.704893:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14823 00000100:00100000:2.0:1746066796.704899:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3293:x1830882976889088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066796.705055:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3293:x1830882976889088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (1816us total) trans 17179873649 rc 0/0 00000100:00100000:2.0:1746066796.705061:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14823 00000100:00100000:2.0:1746066796.705073:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14824 00000100:00100000:2.0:1746066796.705077:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3293:x1830882976889600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066796.705151:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3293:x1830882976889600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1880us total) trans 17179873650 rc 0/0 00000100:00100000:2.0:1746066796.705156:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14824 00000100:00100000:2.0:1746066796.705165:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14825 00000100:00100000:2.0:1746066796.705168:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3293:x1830882976888704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066796.705237:0:9776:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746066796.705240:0:9776:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066794 -> 1746066794 00002000:00010000:2.0:1746066796.705242:0:9776:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:2.0:1746066796.705243:0:9776:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066794 -> 1746066794 00002000:00010000:2.0:1746066796.705245:0:9776:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2013 -> 2013 00000100:00100000:2.0:1746066796.705263:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3293:x1830882976888704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (1962us total) trans 17179873651 rc 0/0 00000100:00100000:2.0:1746066796.705269:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14825 00000100:00100000:2.0:1746066796.705277:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14826 00000100:00100000:2.0:1746066796.705280:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3293:x1830882976889216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066796.705344:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3293:x1830882976889216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (1044us total) trans 17179873652 rc 0/0 00000100:00100000:2.0:1746066796.705348:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14826 00000100:00100000:1.0:1746066796.705580:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976890624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066796.705598:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066796.705621:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929cc700/2, rc 0, transno 17179873651 00000100:00100000:1.0:1746066796.705627:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976888704:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066796.705633:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092849880/2, rc 0, transno 17179873652 00000100:00100000:1.0:1746066796.705636:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976889216:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066796.705641:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929ced80/2, rc 0, transno 17179873649 00000100:00100000:1.0:1746066796.705643:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976889088:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066796.705649:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092848a80/2, rc 0, transno 17179873650 00000100:00100000:1.0:1746066796.705651:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976889600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066796.705666:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976890112 00000100:00100000:1.0:1746066796.705668:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976890112 00000100:00100000:1.0:1746066796.705698:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976890624 00000100:00100000:1.0:1746066796.705700:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976890624 00000100:00100000:1.0:1746066796.705709:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14827 00000100:00100000:1.0:1746066796.705713:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3293:x1830882976890112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066796.705815:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3293:x1830882976890112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (1047us total) trans 21474840964 rc 0/0 00000100:00100000:1.0:1746066796.705820:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14827 00000100:00100000:1.0:1746066796.705830:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14828 00000100:00100000:1.0:1746066796.705834:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3293:x1830882976890624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066796.705900:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3293:x1830882976890624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (301us total) trans 21474840965 rc 0/0 00000100:00100000:1.0:1746066796.705905:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14828 00000100:00100000:1.0:1746066796.705917:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066796.705931:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976889472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066796.705944:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066796.705951:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976889984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066796.705962:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066796.705968:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976890496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066796.705977:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066796.705989:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976888960 00000100:00100000:1.0:1746066796.705991:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976888960 00000100:00100000:1.0:1746066796.706001:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976889472 00000100:00100000:1.0:1746066796.706002:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976889472 00000100:00100000:1.0:1746066796.706008:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976889984 00000100:00100000:1.0:1746066796.706010:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976889984 00000100:00100000:1.0:1746066796.706014:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976890496 00000100:00100000:1.0:1746066796.706015:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976890496 00000100:00100000:1.0:1746066796.706021:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14829 00000100:00100000:1.0:1746066796.706024:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3296:x1830882976888960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066796.706086:0:4614:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:1.0:1746066796.706088:0:4614:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066795 -> 1746066795 00002000:00010000:1.0:1746066796.706090:0:4614:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066793 -> 1746066793 00002000:00010000:1.0:1746066796.706092:0:4614:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066795 -> 1746066795 00002000:00010000:1.0:1746066796.706094:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5923 -> 5923 00000100:00100000:1.0:1746066796.706113:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:3296:x1830882976888960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (195us total) trans 17179873653 rc 0/0 00000100:00100000:1.0:1746066796.706118:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14829 00000100:00100000:1.0:1746066796.706127:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14830 00000100:00100000:1.0:1746066796.706131:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3296:x1830882976889472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066796.706200:0:4614:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746066796.706202:0:4614:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746066796.706204:0:4614:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066796.706205:0:4614:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746066796.706206:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746066796.706234:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:3296:x1830882976889472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (286us total) trans 17179873654 rc 0/0 00000100:00100000:1.0:1746066796.706239:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14830 00000100:00100000:1.0:1746066796.706253:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14831 00000100:00100000:1.0:1746066796.706258:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3296:x1830882976889984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066796.706344:0:4614:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746066796.706347:0:4614:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066795 -> 1746066795 00002000:00010000:1.0:1746066796.706349:0:4614:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066792 -> 1746066792 00002000:00010000:1.0:1746066796.706350:0:4614:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066795 -> 1746066795 00002000:00010000:1.0:1746066796.706351:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746066796.706380:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3296:x1830882976889984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (415us total) trans 21474840966 rc 0/0 00000100:00100000:1.0:1746066796.706385:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14831 00000100:00100000:1.0:1746066796.706399:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14832 00000100:00100000:1.0:1746066796.706405:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3296:x1830882976890496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066796.706506:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3296:x1830882976890496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (525us total) trans 21474840967 rc 0/0 00000100:00100000:1.0:1746066796.706512:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14832 00000004:00080000:1.0:1746066796.706589:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929cdf80/2, rc 0, transno 17179873653 00000100:00100000:1.0:1746066796.706593:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976888960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066796.706604:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284b800/2, rc 0, transno 17179873654 00000100:00100000:1.0:1746066796.706607:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976889472:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066796.706615:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e58000/2, rc 0, transno 21474840966 00000100:00100000:1.0:1746066796.706618:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976889984:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066796.706625:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921c2d80/2, rc 0, transno 21474840967 00000100:00100000:1.0:1746066796.706627:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976890496:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066796.706651:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e58a80/2, rc 0, transno 21474840964 00000100:00100000:1.0:1746066796.706656:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976890112:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066796.706663:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800931d3100/2, rc 0, transno 21474840965 00000100:00100000:1.0:1746066796.706666:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976890624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066796.706671:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746066796.706708:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976890752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066796.706735:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066796.706762:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976890752 00000100:00100000:1.0:1746066796.706767:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976890752 00000100:00100000:1.0:1746066796.706790:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14833 00000100:00100000:1.0:1746066796.706795:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3293:x1830882976890752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066796.706908:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3293:x1830882976890752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (172us total) trans 17179873655 rc 0/0 00000100:00100000:1.0:1746066796.706915:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14833 00000004:00080000:1.0:1746066796.706944:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e636300/2, rc 0, transno 17179873655 00000100:00100000:1.0:1746066796.706949:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976890752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066796.707026:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066796.707053:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976889344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066796.707080:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066796.707097:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976889856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066796.707118:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066796.707135:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976890368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066796.707156:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066796.707224:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976888832 00000100:00100000:0.0:1746066796.707229:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976888832 00000100:00100000:0.0:1746066796.707246:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976889344 00000100:00100000:0.0:1746066796.707249:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976889344 00000100:00100000:0.0:1746066796.707257:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976889856 00000100:00100000:0.0:1746066796.707260:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976889856 00000100:00100000:0.0:1746066796.707268:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976890368 00000100:00100000:0.0:1746066796.707270:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976890368 00000100:00100000:0.0:1746066796.707280:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14834 00000100:00100000:0.0:1746066796.707286:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3295:x1830882976888832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066796.707379:0:8452:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066796.707382:0:8452:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066794 -> 1746066794 00002000:00010000:0.0:1746066796.707384:0:8452:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066794 -> 1746066794 00002000:00010000:0.0:1746066796.707386:0:8452:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066794 -> 1746066794 00002000:00010000:0.0:1746066796.707387:0:8452:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746066796.707423:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3295:x1830882976888832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 136us (397us total) trans 17179873656 rc 0/0 00000100:00100000:0.0:1746066796.707429:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14834 00000100:00100000:0.0:1746066796.707444:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14835 00000100:00100000:0.0:1746066796.707450:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3295:x1830882976889344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066796.707553:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3295:x1830882976889344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (471us total) trans 17179873657 rc 0/0 00000100:00100000:0.0:1746066796.707559:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14835 00000100:00100000:0.0:1746066796.707584:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14836 00000100:00100000:0.0:1746066796.707591:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3295:x1830882976889856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066796.707720:0:8452:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066796.707723:0:8452:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066794 -> 1746066794 00002000:00010000:0.0:1746066796.707725:0:8452:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066794 -> 1746066794 00002000:00010000:0.0:1746066796.707727:0:8452:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066794 -> 1746066794 00002000:00010000:0.0:1746066796.707728:0:8452:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746066796.707757:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3295:x1830882976889856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (638us total) trans 21474840968 rc 0/0 00000100:00100000:0.0:1746066796.707763:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14836 00000100:00100000:0.0:1746066796.707776:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14837 00000100:00100000:0.0:1746066796.707782:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3295:x1830882976890368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066796.707884:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3295:x1830882976890368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (726us total) trans 21474840969 rc 0/0 00000100:00100000:0.0:1746066796.707890:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14837 00000004:00080000:0.0:1746066796.707919:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929cca80/2, rc 0, transno 17179873656 00000100:00100000:0.0:1746066796.707924:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976888832:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066796.707933:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284bb80/2, rc 0, transno 17179873657 00000100:00100000:0.0:1746066796.707936:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976889344:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066796.707944:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e58380/2, rc 0, transno 21474840968 00000100:00100000:0.0:1746066796.707947:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976889856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066796.707953:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921c1880/2, rc 0, transno 21474840969 00000100:00100000:0.0:1746066796.707956:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976890368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066796.708041:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066796.708067:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976890240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066796.708094:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066796.708122:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976889728 00000100:00100000:3.0:1746066796.708126:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976889728 00000100:00100000:3.0:1746066796.708143:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976890240 00000100:00100000:3.0:1746066796.708146:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976890240 00000100:00100000:3.0:1746066796.708157:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14838 00000100:00100000:3.0:1746066796.708162:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3294:x1830882976889728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066796.708260:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066796.708264:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066794 -> 1746066794 00002000:00010000:3.0:1746066796.708266:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066794 -> 1746066794 00002000:00010000:3.0:1746066796.708267:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066794 -> 1746066794 00002000:00010000:3.0:1746066796.708269:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746066796.708295:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3294:x1830882976889728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 133us (256us total) trans 21474840970 rc 0/0 00000100:00100000:3.0:1746066796.708299:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14838 00000100:00100000:3.0:1746066796.708423:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14839 00000100:00100000:3.0:1746066796.708429:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3294:x1830882976890240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066796.708536:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3294:x1830882976890240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (440us total) trans 21474840971 rc 0/0 00000100:00100000:3.0:1746066796.708542:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14839 00000004:00080000:3.0:1746066796.708583:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135e59180/2, rc 0, transno 21474840970 00000100:00100000:3.0:1746066796.708588:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976889728:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066796.708600:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921c0e00/2, rc 0, transno 21474840971 00000100:00100000:3.0:1746066796.708603:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976890240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066796.713591:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.713670:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976888448:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066796.714638:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977051392 00000100:00100000:2.0:1746066796.714644:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977051392 00000100:00100000:2.0:1746066796.714803:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4201 00000100:00100000:2.0:1746066796.714811:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+10:31741:x1830882977051392:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:2.0:1746066796.714908:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+10:31741:x1830882977051392:12345-192.168.202.57@tcp:49:cat.0 Request processed in 98us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066796.714917:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4201 00000100:00100000:0.0:1746066796.716417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.722820:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976888576:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066796.722869:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2c00/0xfb36a14ee608c197 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec3f expref: 9 pid: 14549 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746066796.722922:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec3f expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.722953:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd2e00, rc 0) 00000100:00100000:1.0:1746066796.723010:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+8:31735:x1830882977048576:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 87280us (87835us total) trans 8589944115 rc 0/0 00000100:00100000:1.0:1746066796.723019:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10046 00000100:00100000:3.0:1746066796.723224:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977051520 00000100:00100000:3.0:1746066796.723233:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977051520 00000100:00100000:3.0:1746066796.723289:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4202 00000100:00100000:3.0:1746066796.723295:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:31740:x1830882977051520:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:3.0:1746066796.723375:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:31740:x1830882977051520:12345-192.168.202.57@tcp:49:cat.0 Request processed in 79us (6958us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066796.723382:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4202 00000100:00100000:0.0:1746066796.743117:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.743204:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977051776 00000100:00100000:1.0:1746066796.743213:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977051776 00002000:00100000:1.0:1746066796.743250:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88012c0fd500 x1830882977051776/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066796.743259:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fd500 with x1830882977051776 ext(0->1048575) 00002000:00010000:1.0:1746066796.743263:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fd500 00000100:00100000:1.0:1746066796.743294:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6725 00000100:00100000:1.0:1746066796.743301:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882977051776:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066796.751213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.751257:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.751335:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977052288 00000100:00100000:2.0:1746066796.751343:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977052288 00002000:00100000:2.0:1746066796.751380:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88012c0fc000 x1830882977052288/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.751389:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fc000 with x1830882977052288 ext(1048576->2097151) 00002000:00010000:2.0:1746066796.751394:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fc000 00000100:00100000:2.0:1746066796.751407:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977052544 00000100:00100000:2.0:1746066796.751409:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977052544 00002000:00100000:2.0:1746066796.751420:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88012c0ff100 x1830882977052544/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.751426:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0ff100 with x1830882977052544 ext(1048576->2097151) 00002000:00010000:2.0:1746066796.751429:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0ff100 00000100:00100000:2.0:1746066796.751455:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6726 00000100:00100000:2.0:1746066796.751461:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977052288:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066796.752588:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6727 00000100:00100000:1.0:1746066796.752596:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977052544:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066796.761593:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.762636:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.763542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.765209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.765268:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977052800 00000100:00100000:2.0:1746066796.765275:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977052800 00002000:00100000:2.0:1746066796.765311:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88012c0ff800 x1830882977052800/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.765320:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0ff800 with x1830882977052800 ext(0->1048575) 00002000:00010000:2.0:1746066796.765324:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0ff800 00000100:00100000:2.0:1746066796.765340:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977053056 00000100:00100000:2.0:1746066796.765343:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977053056 00002000:00100000:2.0:1746066796.765353:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88012c0ff480 x1830882977053056/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.765364:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0ff480 with x1830882977053056 ext(1048576->2097151) 00002000:00010000:2.0:1746066796.765367:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0ff480 00000100:00100000:2.0:1746066796.765376:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977053312 00000100:00100000:2.0:1746066796.765378:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977053312 00002000:00100000:2.0:1746066796.765386:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88012c0fc700 x1830882977053312/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.765392:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fc700 with x1830882977053312 ext(1048576->2097151) 00002000:00010000:2.0:1746066796.765395:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fc700 00000100:00100000:2.0:1746066796.765405:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6728 00000100:00100000:2.0:1746066796.765411:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882977052800:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066796.766390:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6729 00000100:00100000:2.0:1746066796.766396:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882977053056:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066796.769060:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6730 00000100:00100000:3.0:1746066796.769073:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882977053312:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066796.770623:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977053568 00000100:00100000:0.0:1746066796.770631:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977053568 00002000:00100000:0.0:1746066796.770656:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88012c0fdf80 x1830882977053568/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.770666:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fdf80 with x1830882977053568 ext(1048576->2097151) 00002000:00010000:0.0:1746066796.770670:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fdf80 00000100:00100000:0.0:1746066796.770697:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6731 00000100:00100000:0.0:1746066796.770702:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1965:x1830882977053568:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066796.771739:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977051776:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 28437us (28626us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066796.771744:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6725 00002000:00100000:0.0:1746066796.771749:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88012c0fd500 x1830882977051776/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.771756:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fd500 with x1830882977051776 ext(0->1048575) 00002000:00010000:0.0:1746066796.771759:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fd500 00000100:00100000:0.0:1746066796.784211:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.784980:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977053696 00000100:00100000:1.0:1746066796.784988:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977053696 00000100:00100000:1.0:1746066796.785025:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14840 00000100:00100000:1.0:1746066796.785032:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:31735:x1830882977053696:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066796.785046:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066796.785060:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ecaf expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.785084:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac47400/0xfb36a14ee608c0b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec00 expref: 10 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066796.785091:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed6ce00/0xfb36a14ee608c1ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec70 expref: 26 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066796.785098:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009acd2600/0xfb36a14ee608c151 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec38 expref: 37 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066796.785104:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066796.785105:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066796.785108:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [81920->360447] (req 81920->360447) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066796.785134:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009acd2600/0xfb36a14ee608c151 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec38 expref: 37 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066796.785144:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009acd2600/0xfb36a14ee608c151 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec38 expref: 37 pid: 9776 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746066796.785154:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e636d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976890880:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066796.785810:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977052288:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 34347us (34601us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066796.785818:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6726 00002000:00100000:2.0:1746066796.785825:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88012c0fc000 x1830882977052288/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.785833:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fc000 with x1830882977052288 ext(1048576->2097151) 00002000:00010000:2.0:1746066796.785836:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fc000 00010000:00010000:1.0:1746066796.785904:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed6ce00/0xfb36a14ee608c1ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec70 expref: 26 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066796.785911:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed6ce00/0xfb36a14ee608c1ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec70 expref: 26 pid: 21973 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746066796.785919:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976891008:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066796.786408:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac47400/0xfb36a14ee608c0b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec00 expref: 10 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066796.786416:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac47400/0xfb36a14ee608c0b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec00 expref: 10 pid: 21203 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746066796.786424:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e635f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976891136:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066796.790377:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066796.795322:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.798668:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977052032 00000100:00100000:2.0:1746066796.798702:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977052032 00002000:00100000:2.0:1746066796.798744:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88012c0fe300 x1830882977052032/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.798759:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fe300 with x1830882977052032 ext(1048576->2097151) 00002000:00010000:2.0:1746066796.798763:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fe300 00000100:00100000:1.0:1746066796.800414:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977052544:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 47814us (49151us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066796.800424:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6727 00002000:00100000:1.0:1746066796.800431:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88012c0ff100 x1830882977052544/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066796.800438:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0ff100 with x1830882977052544 ext(1048576->2097151) 00002000:00010000:1.0:1746066796.800441:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0ff100 00000100:00100000:1.0:1746066796.800460:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6732 00000100:00100000:1.0:1746066796.800467:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977052032:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066796.802090:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.802124:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.802186:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e636d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976890880:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066796.802196:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976891008:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066796.802202:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e635f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976891136:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066796.802226:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [81920->360447] (req 81920->360447) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.802241:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9dda00, rc 0) 00000100:00100000:2.0:1746066796.802262:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+24:31735:x1830882977053696:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 17231us (18059us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066796.802269:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14840 00000100:00100000:1.0:1746066796.803983:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977053952 00000100:00100000:1.0:1746066796.803992:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977053952 00010000:00010000:1.0:1746066796.804018:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac47400/0xfb36a14ee608c0b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec00 expref: 11 pid: 21203 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746066796.804271:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977053824 00000100:00100000:1.0:1746066796.804275:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977053824 00010000:00010000:1.0:1746066796.804301:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed6ce00/0xfb36a14ee608c1ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec70 expref: 24 pid: 21973 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746066796.804329:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7622 00000100:00100000:1.0:1746066796.804335:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977053952:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066796.804345:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066796.804361:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac47400/0xfb36a14ee608c0b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec00 expref: 11 pid: 21203 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746066796.804370:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac47400/0xfb36a14ee608c0b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec00 expref: 11 pid: 21203 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746066796.804388:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac47400/0xfb36a14ee608c0b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec00 expref: 11 pid: 21203 timeout: 857 lvb_type: 1 00000100:00100000:3.0:1746066796.804736:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7623 00000100:00100000:3.0:1746066796.804744:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+24:1966:x1830882977053824:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066796.804752:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066796.804761:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed6ce00/0xfb36a14ee608c1ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec70 expref: 24 pid: 21973 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746066796.804768:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed6ce00/0xfb36a14ee608c1ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec70 expref: 24 pid: 21973 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746066796.804779:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed6ce00/0xfb36a14ee608c1ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec70 expref: 24 pid: 21973 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746066796.807154:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066796.807200:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977053952:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2862us (5110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066796.807213:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7622 00010000:00010000:3.0:1746066796.807882:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066796.807901:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882977053824:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3158us (5776us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066796.807906:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7623 00000100:00100000:1.0:1746066796.814712:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1965:x1830882977053568:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 44001us (49498us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066796.814723:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6731 00002000:00100000:1.0:1746066796.814734:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88012c0fdf80 x1830882977053568/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066796.814742:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fdf80 with x1830882977053568 ext(1048576->2097151) 00002000:00010000:1.0:1746066796.814748:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fdf80 00000100:00100000:2.0:1746066796.814819:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882977052800:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 49406us (53230us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066796.814826:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6728 00002000:00100000:2.0:1746066796.814831:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88012c0ff800 x1830882977052800/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.814839:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0ff800 with x1830882977052800 ext(0->1048575) 00010000:00010000:2.0:1746066796.814846:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009acd2600/0xfb36a14ee608c151 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec38 expref: 34 pid: 9776 timeout: 857 lvb_type: 1 00010000:00010000:2.0:1746066796.814859:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009acd2600/0xfb36a14ee608c151 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec38 expref: 34 pid: 9776 timeout: 857 lvb_type: 1 00002000:00010000:2.0:1746066796.814869:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c0ff800 00000100:00100000:2.0:1746066796.819724:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1965:x1830882977053312:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 50647us (56173us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066796.819733:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6730 00002000:00100000:2.0:1746066796.819742:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88012c0fc700 x1830882977053312/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.819751:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fc700 with x1830882977053312 ext(1048576->2097151) 00002000:00010000:2.0:1746066796.819756:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fc700 00000100:00100000:0.0:1746066796.825896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066796.826774:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1965:x1830882977053056:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 60375us (64136us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066796.826784:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6729 00002000:00100000:3.0:1746066796.826794:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88012c0ff480 x1830882977053056/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066796.826807:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0ff480 with x1830882977053056 ext(1048576->2097151) 00002000:00010000:3.0:1746066796.826812:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0ff480 00000100:00100000:2.0:1746066796.826959:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977054080 00000100:00100000:2.0:1746066796.826965:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977054080 00000100:00100000:2.0:1746066796.826993:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14841 00000100:00100000:2.0:1746066796.826999:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:31738:x1830882977054080:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066796.827011:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066796.827025:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ecb6 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.827044:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.827050:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [81920->360447] (req 81920->360447) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.827054:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066796.827057:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [90112->655359] (req 90112->655359) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.827082:0:4614:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [81920->360447] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.827094:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [90112->655359] (req 90112->655359) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.827102:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd3000, rc 0) 00000100:00100000:2.0:1746066796.827118:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:31738:x1830882977054080:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 120us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066796.827122:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14841 00000100:00100000:0.0:1746066796.827799:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066796.828225:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977054208 00000100:00100000:3.0:1746066796.828229:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977054208 00010000:00010000:3.0:1746066796.828243:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd2600/0xfb36a14ee608c151 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec38 expref: 35 pid: 9776 timeout: 857 lvb_type: 1 00000100:00100000:3.0:1746066796.828266:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7624 00000100:00100000:3.0:1746066796.828271:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1965:x1830882977054208:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066796.828279:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066796.828294:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009acd2600/0xfb36a14ee608c151 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec38 expref: 35 pid: 9776 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746066796.828302:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009acd2600/0xfb36a14ee608c151 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec38 expref: 35 pid: 9776 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746066796.828317:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009acd2600/0xfb36a14ee608c151 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec38 expref: 35 pid: 9776 timeout: 857 lvb_type: 1 00010000:00010000:3.0:1746066796.828334:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066796.828335:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066796.828340:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.828346:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.828366:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066796.828374:0:21351:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x70000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 22 pid: 4614 timeout: 858 lvb_type: 0 00000100:00100000:3.0:1746066796.828381:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976891392:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066796.828429:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066796.833585:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977052032:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 33111us (38261us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066796.833594:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6732 00002000:00100000:1.0:1746066796.833604:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88012c0fe300 x1830882977052032/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066796.833613:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fe300 with x1830882977052032 ext(1048576->2097151) 00002000:00010000:1.0:1746066796.833617:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fe300 00000100:00100000:0.0:1746066796.840893:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066796.841016:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976891392:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066796.841034:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066796.841081:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882977054208:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 12808us (13281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066796.841090:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7624 00000100:00100000:1.0:1746066796.841235:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977054464 00000100:00100000:1.0:1746066796.841241:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977054464 00002000:00100000:1.0:1746066796.841271:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x38e:0x0] (81920->86015) req@ffff88009ed08000 x1830882977054464/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066796.841280:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed08000 with x1830882977054464 ext(81920->86015) 00010000:00010000:1.0:1746066796.841287:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 23 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066796.841299:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 23 pid: 4614 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746066796.841305:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed08000 00000100:00100000:1.0:1746066796.841319:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2184 00000100:00100000:1.0:1746066796.841325:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882977054464:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066796.841459:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882977054464:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 134us (572us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066796.841465:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2184 00002000:00100000:1.0:1746066796.841470:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x38e:0x0] (81920->86015) req@ffff88009ed08000 x1830882977054464/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/4536 e 0 to 0 dl 1746066807 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066796.841477:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed08000 with x1830882977054464 ext(81920->86015) 00010000:00010000:1.0:1746066796.841481:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 23 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066796.841490:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 23 pid: 4614 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746066796.841496:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed08000 00000100:00100000:0.0:1746066796.853199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066796.853276:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977054720 00000100:00100000:3.0:1746066796.853284:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977054720 00002000:00100000:3.0:1746066796.853316:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x38e:0x0] (356352->360447) req@ffff88009ed0b100 x1830882977054720/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066796.853325:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed0b100 with x1830882977054720 ext(356352->360447) 00010000:00010000:3.0:1746066796.853332:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 23 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066796.853343:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 23 pid: 4614 timeout: 858 lvb_type: 0 00002000:00010000:3.0:1746066796.853353:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed0b100 00000100:00100000:3.0:1746066796.853377:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2185 00000100:00100000:3.0:1746066796.853382:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882977054720:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066796.853526:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882977054720:12345-192.168.202.57@tcp:3:cat.0 Request processed in 142us (334us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066796.853531:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2185 00002000:00100000:3.0:1746066796.853536:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x38e:0x0] (356352->360447) req@ffff88009ed0b100 x1830882977054720/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/4536 e 0 to 0 dl 1746066807 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066796.853542:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed0b100 with x1830882977054720 ext(356352->360447) 00010000:00010000:3.0:1746066796.853546:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 23 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066796.853554:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 23 pid: 4614 timeout: 858 lvb_type: 0 00002000:00010000:3.0:1746066796.853560:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed0b100 00000100:00100000:0.0:1746066796.858017:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.858326:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.858641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.859460:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.859508:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977054976 00000100:00100000:1.0:1746066796.859516:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977054976 00002000:00100000:1.0:1746066796.859551:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009ed09f80 x1830882977054976/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066796.859560:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed09f80 with x1830882977054976 ext(2097152->3145727) 00002000:00010000:1.0:1746066796.859565:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed09f80 00000100:00100000:3.0:1746066796.859637:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977055232 00000100:00100000:3.0:1746066796.859641:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977055232 00002000:00100000:3.0:1746066796.859657:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009ed0b480 x1830882977055232/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066796.859664:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed0b480 with x1830882977055232 ext(3145728->4194303) 00002000:00010000:3.0:1746066796.859667:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed0b480 00000100:00100000:3.0:1746066796.859690:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977055488 00000100:00100000:3.0:1746066796.859692:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977055488 00002000:00100000:3.0:1746066796.859702:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ed0bb80 x1830882977055488/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066796.859708:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed0bb80 with x1830882977055488 ext(2097152->3145727) 00002000:00010000:3.0:1746066796.859710:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed0bb80 00000100:00100000:3.0:1746066796.859720:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6733 00000100:00100000:3.0:1746066796.859725:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1963:x1830882977054976:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066796.860666:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6734 00000100:00100000:3.0:1746066796.860673:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882977055232:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066796.861905:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977055744 00000100:00100000:2.0:1746066796.861911:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977055744 00000100:00100000:0.0:1746066796.861914:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:2.0:1746066796.861934:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009ed08700 x1830882977055744/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.861941:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed08700 with x1830882977055744 ext(3145728->4194303) 00002000:00010000:2.0:1746066796.861945:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed08700 00000100:00100000:0.0:1746066796.861945:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.861973:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977056000 00000100:00100000:2.0:1746066796.861976:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6735 00000100:00100000:0.0:1746066796.861976:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977056000 00000100:00100000:2.0:1746066796.861982:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977055488:12345-192.168.202.57@tcp:3:cat.0 00002000:00100000:0.0:1746066796.861994:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009ed09880 x1830882977056000/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.862002:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed09880 with x1830882977056000 ext(2097152->3145727) 00002000:00010000:0.0:1746066796.862005:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed09880 00000100:00100000:0.0:1746066796.862018:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6736 00000100:00100000:0.0:1746066796.862023:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977055744:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066796.862934:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977056512 00000100:00100000:2.0:1746066796.862939:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977056512 00000100:00100000:2.0:1746066796.862971:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4203 00000100:00100000:2.0:1746066796.862977:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+8:31735:x1830882977056512:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:1.0:1746066796.863185:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6737 00000100:00100000:1.0:1746066796.863192:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882977056000:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066796.863338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.863350:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977056640 00000100:00100000:0.0:1746066796.863353:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977056640 00002000:00100000:0.0:1746066796.863369:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x38e:0x0] (81920->360447) req@ffff88009e93c380 x1830882977056640/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.863376:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93c380 with x1830882977056640 ext(81920->360447) 00010000:00010000:0.0:1746066796.863383:0:11692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 24 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746066796.863399:0:11692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 24 pid: 4614 timeout: 858 lvb_type: 0 00002000:00010000:0.0:1746066796.863405:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e93c380 00000100:00100000:0.0:1746066796.863415:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2186 00000100:00100000:0.0:1746066796.863420:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+24:1966:x1830882977056640:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066796.863665:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.863687:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977056256 00000100:00100000:0.0:1746066796.863689:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977056256 00002000:00100000:0.0:1746066796.863702:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009e93e300 x1830882977056256/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.863708:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93e300 with x1830882977056256 ext(3145728->4194303) 00002000:00010000:0.0:1746066796.863711:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93e300 00000100:00100000:0.0:1746066796.863720:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6738 00000100:00100000:0.0:1746066796.863723:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977056256:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066796.864169:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066796.864180:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977057024 00000100:00100000:1.0:1746066796.864183:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977057024 00002000:00100000:1.0:1746066796.864199:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009e637480 x1830882977057024/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066796.864206:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e637480 with x1830882977057024 ext(2097152->3145727) 00002000:00010000:1.0:1746066796.864210:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e637480 00000100:00100000:1.0:1746066796.864220:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6739 00000100:00100000:1.0:1746066796.864225:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977057024:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066796.864633:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.864648:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977057280 00000100:00100000:0.0:1746066796.864651:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977057280 00002000:00100000:0.0:1746066796.864713:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e93d880 x1830882977057280/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.864720:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93d880 with x1830882977057280 ext(3145728->4194303) 00002000:00010000:0.0:1746066796.864723:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93d880 00000100:00100000:0.0:1746066796.864736:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6740 00000100:00100000:0.0:1746066796.864742:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:1966:x1830882977057280:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066796.865346:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+9:31735:x1830882977056512:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 2367us (3398us total) trans 8589944116 rc 0/0 00000100:00100000:2.0:1746066796.865353:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4203 00000100:00100000:3.0:1746066796.884537:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882977054976:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24803us (26519us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066796.884548:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6733 00002000:00100000:3.0:1746066796.884558:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009ed09f80 x1830882977054976/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066796.884574:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed09f80 with x1830882977054976 ext(2097152->3145727) 00002000:00010000:3.0:1746066796.884580:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed09f80 00000100:00100000:2.0:1746066796.886133:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:fc98f875-2edf-4505-a13a-65f96879556b+29:1966:x1830882977056640:12345-192.168.202.57@tcp:4:cat.0 Request processed in 22709us (22792us total) trans 17179873658 rc 0/0 00000100:00100000:2.0:1746066796.886143:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2186 00002000:00100000:2.0:1746066796.886149:0:11692:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x38e:0x0] (81920->360447) req@ffff88009e93c380 x1830882977056640/t17179873658(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/448 e 0 to 0 dl 1746066807 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.886158:0:11692:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93c380 with x1830882977056640 ext(81920->360447) 00010000:00010000:2.0:1746066796.886165:0:11692:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 29 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:2.0:1746066796.886178:0:11692:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 29 pid: 4614 timeout: 858 lvb_type: 0 00002000:00010000:2.0:1746066796.886184:0:11692:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e93c380 00000100:00100000:0.0:1746066796.900053:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.900112:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977057408 00000100:00100000:2.0:1746066796.900118:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977057408 00010000:00010000:2.0:1746066796.900145:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 29 pid: 4614 timeout: 858 lvb_type: 0 00000100:00100000:2.0:1746066796.900172:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7625 00000100:00100000:2.0:1746066796.900177:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977057408:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066796.900185:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066796.900199:0:21351:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066794 -> 1746066796 00002000:00010000:2.0:1746066796.900201:0:21351:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066794 -> 1746066796 00010000:00010000:2.0:1746066796.900204:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 29 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:2.0:1746066796.900211:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 29 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:2.0:1746066796.900234:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e9dda00/0xfb36a14ee608c207 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 81920->360447) gid 0 flags: 0x44801000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecaf expref: 29 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:2.0:1746066796.900247:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.900249:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066796.900253:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->655359) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.900260:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->655359) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066796.900287:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->655359) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 35 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066796.900298:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976891520:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066796.900361:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066796.902919:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977055232:12345-192.168.202.57@tcp:3:cat.0 Request processed in 42239us (44585us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066796.902928:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6734 00002000:00100000:3.0:1746066796.902937:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009ed0b480 x1830882977055232/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066796.902944:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed0b480 with x1830882977055232 ext(3145728->4194303) 00002000:00010000:3.0:1746066796.902949:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed0b480 00000100:00100000:3.0:1746066796.910165:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977055488:12345-192.168.202.57@tcp:3:cat.0 Request processed in 48176us (51515us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066796.910175:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6735 00002000:00100000:3.0:1746066796.910185:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ed0bb80 x1830882977055488/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066796.910194:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed0bb80 with x1830882977055488 ext(2097152->3145727) 00002000:00010000:3.0:1746066796.910198:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed0bb80 00000100:00100000:2.0:1746066796.920477:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977055744:12345-192.168.202.57@tcp:3:cat.0 Request processed in 58445us (61009us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066796.920487:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6736 00002000:00100000:2.0:1746066796.920496:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009ed08700 x1830882977055744/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.920505:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed08700 with x1830882977055744 ext(3145728->4194303) 00002000:00010000:2.0:1746066796.920509:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed08700 00000100:00100000:0.0:1746066796.920843:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.920921:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977057664 00000100:00100000:2.0:1746066796.920927:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977057664 00002000:00100000:2.0:1746066796.920950:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x38e:0x0] (90112->94207) req@ffff88009e93f800 x1830882977057664/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.920956:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93f800 with x1830882977057664 ext(90112->94207) 00002000:00010000:2.0:1746066796.920959:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93f800 00000100:00100000:3.0:1746066796.921023:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976891520:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066796.921039:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066796.921058:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882977057408:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 20880us (21013us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066796.921065:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7625 00000100:00100000:2.0:1746066796.921120:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6741 00000100:00100000:2.0:1746066796.921126:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977057664:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066796.921228:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977057664:12345-192.168.202.57@tcp:3:cat.0 Request processed in 103us (386us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066796.921233:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6741 00002000:00100000:2.0:1746066796.921237:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x38e:0x0] (90112->94207) req@ffff88009e93f800 x1830882977057664/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/4536 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.921244:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93f800 with x1830882977057664 ext(90112->94207) 00002000:00010000:2.0:1746066796.921247:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93f800 00000100:00100000:1.0:1746066796.921666:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977056000:12345-192.168.202.57@tcp:3:cat.0 Request processed in 58473us (59752us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066796.921673:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6737 00002000:00100000:1.0:1746066796.921693:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009ed09880 x1830882977056000/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066796.921699:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed09880 with x1830882977056000 ext(2097152->3145727) 00002000:00010000:1.0:1746066796.921703:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed09880 00000100:00100000:0.0:1746066796.934421:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.934456:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977057920 00000100:00100000:0.0:1746066796.934462:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977057920 00002000:00100000:0.0:1746066796.934496:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e93fb80 x1830882977057920/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066796.934505:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93fb80 with x1830882977057920 ext(4194304->5091327) 00002000:00010000:0.0:1746066796.934509:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93fb80 00000100:00100000:0.0:1746066796.934537:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6742 00000100:00100000:0.0:1746066796.934544:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977057920:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066796.936269:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+22:1966:x1830882977057024:12345-192.168.202.57@tcp:3:cat.0 Request processed in 72038us (72095us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066796.936277:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6739 00002000:00100000:1.0:1746066796.936285:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009e637480 x1830882977057024/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066796.936292:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e637480 with x1830882977057024 ext(2097152->3145727) 00002000:00010000:1.0:1746066796.936296:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e637480 00000100:00100000:2.0:1746066796.936604:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+24:1966:x1830882977056256:12345-192.168.202.57@tcp:3:cat.0 Request processed in 72879us (72938us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066796.936610:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6738 00002000:00100000:2.0:1746066796.936615:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009e93e300 x1830882977056256/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.936622:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93e300 with x1830882977056256 ext(3145728->4194303) 00002000:00010000:2.0:1746066796.936625:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93e300 00000100:00100000:2.0:1746066796.939795:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977057280:12345-192.168.202.57@tcp:3:cat.0 Request processed in 75046us (75155us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066796.939805:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6740 00002000:00100000:2.0:1746066796.939814:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e93d880 x1830882977057280/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.939823:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93d880 with x1830882977057280 ext(3145728->4194303) 00002000:00010000:2.0:1746066796.939828:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93d880 00000100:00100000:2.0:1746066796.944440:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977057920:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9888us (10016us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066796.944451:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6742 00002000:00100000:2.0:1746066796.944462:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e93fb80 x1830882977057920/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.944470:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93fb80 with x1830882977057920 ext(4194304->5091327) 00002000:00010000:2.0:1746066796.944475:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93fb80 00000100:00100000:0.0:1746066796.950331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.950422:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977058176 00000100:00100000:2.0:1746066796.950430:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977058176 00002000:00100000:2.0:1746066796.950470:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (651264->655359) req@ffff88009e93c000 x1830882977058176/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.950479:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93c000 with x1830882977058176 ext(651264->655359) 00002000:00010000:2.0:1746066796.950484:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93c000 00000100:00100000:2.0:1746066796.950513:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6743 00000100:00100000:2.0:1746066796.950521:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977058176:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066796.950699:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977058176:12345-192.168.202.57@tcp:3:cat.0 Request processed in 156us (353us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066796.950705:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6743 00002000:00100000:2.0:1746066796.950710:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (651264->655359) req@ffff88009e93c000 x1830882977058176/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:202/0 lens 488/4536 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.950716:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93c000 with x1830882977058176 ext(651264->655359) 00002000:00010000:2.0:1746066796.950719:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93c000 00000100:00100000:0.0:1746066796.951762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.952215:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977058432 00000100:00100000:2.0:1746066796.952220:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977058432 00000100:00100000:2.0:1746066796.952258:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4204 00000100:00100000:2.0:1746066796.952264:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801350d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:31740:x1830882977058432:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066796.952425:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801350d0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31740:x1830882977058432:12345-192.168.202.57@tcp:35:cat.0 Request processed in 160us (664us total) trans 8589944117 rc 0/0 00000100:00100000:2.0:1746066796.952431:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4204 00000100:00100000:0.0:1746066796.955460:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066796.955799:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977058560 00000100:00100000:3.0:1746066796.955806:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977058560 00000100:00100000:3.0:1746066796.957586:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14842 00000100:00100000:3.0:1746066796.957597:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882977058560:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066796.957612:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066796.957626:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f094600/0xfb36a14ee608c215 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ecbd expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066796.957668:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976891648:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066796.957749:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066796.958276:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066796.958295:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977058816 00000100:00100000:0.0:1746066796.958299:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977058816 00000100:00100000:0.0:1746066796.958330:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4205 00000100:00100000:0.0:1746066796.958334:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31738:x1830882977058816:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:0.0:1746066796.958467:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31738:x1830882977058816:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 132us (191us total) trans 8589944118 rc 0/0 00000100:00100000:0.0:1746066796.958473:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4205 00002000:00010000:3.0:1746066796.963593:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime: 1746066792 -> 1746066796 00000100:00100000:3.0:1746066796.963618:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976891648:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066796.963644:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f094600/0xfb36a14ee608c215 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecbd expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066796.963661:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f094600/0xfb36a14ee608c215 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecbd expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066796.963999:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f094600, rc 0) 00000100:00100000:3.0:1746066796.964048:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882977058560:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6453us (8592us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066796.964057:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14842 00000100:00100000:0.0:1746066796.968115:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066796.968596:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977059072 00000100:00100000:2.0:1746066796.968604:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977059072 00002000:00100000:2.0:1746066796.968640:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e93ca80 x1830882977059072/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/0 e 0 to 0 dl 1746066807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.968649:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93ca80 with x1830882977059072 ext(4194304->5091327) 00002000:00010000:2.0:1746066796.968654:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93ca80 00000100:00100000:2.0:1746066796.968699:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6744 00000100:00100000:2.0:1746066796.968706:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977059072:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066796.981562:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977059072:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12847us (13444us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066796.981581:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6744 00002000:00100000:2.0:1746066796.981592:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e93ca80 x1830882977059072/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:202/0 lens 488/440 e 0 to 0 dl 1746066807 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066796.981601:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93ca80 with x1830882977059072 ext(4194304->5091327) 00002000:00010000:2.0:1746066796.981606:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93ca80 00000100:00100000:0.0:1746066796.987104:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066796.987189:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977059200 00000100:00100000:3.0:1746066796.987196:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977059200 00000100:00100000:3.0:1746066796.987243:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14843 00000100:00100000:3.0:1746066796.987250:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977059200:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066796.987264:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066796.987279:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c21c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ecc4 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066796.987322:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976891776:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066796.987411:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066796.988957:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976891776:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066796.988977:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c21c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecc4 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066796.988986:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c21c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecc4 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066796.989163:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f094800, rc 0) 00000100:00100000:3.0:1746066796.989203:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977059200:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1952us (2104us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066796.989238:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14843 00000100:00100000:0.0:1746066796.993298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066796.993398:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977059328 00000100:00100000:3.0:1746066796.993406:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977059328 00000100:00100000:3.0:1746066796.993448:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14844 00000100:00100000:3.0:1746066796.993455:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882977059328:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066796.993470:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066796.993483:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f094a00/0xfb36a14ee608c223 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eccb expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066796.993523:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976891904:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066796.993600:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066796.994856:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976891904:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066796.994874:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f094a00/0xfb36a14ee608c223 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eccb expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066796.994885:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f094a00/0xfb36a14ee608c223 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eccb expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066796.994949:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f094a00, rc 0) 00000100:00100000:3.0:1746066796.994984:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882977059328:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1528us (1693us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066796.994990:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14844 00000100:00100000:0.0:1746066796.998836:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066796.998908:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977059584 00000100:00100000:3.0:1746066796.998914:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977059584 00000100:00100000:3.0:1746066796.999004:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4206 00000100:00100000:3.0:1746066796.999011:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+9:31741:x1830882977059584:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:3.0:1746066797.000178:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:31741:x1830882977059584:12345-192.168.202.57@tcp:35:cat.0 Request processed in 1165us (1344us total) trans 8589944119 rc 0/0 00000100:00100000:3.0:1746066797.000185:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4206 00000100:00100000:0.0:1746066797.018992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.019277:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977059840 00000100:00100000:1.0:1746066797.019285:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977059840 00000100:00100000:1.0:1746066797.020697:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10050 00000100:00100000:1.0:1746066797.020706:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:31746:x1830882977059840:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066797.020729:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066797.020743:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457600/0xfb36a14ee608c22a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ecd2 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.020835:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457800/0xfb36a14ee608c231 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.020845:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457800/0xfb36a14ee608c231 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.020855:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457800/0xfb36a14ee608c231 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.020865:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457a00/0xfb36a14ee608c238 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.020870:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457a00/0xfb36a14ee608c238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.020874:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457a00/0xfb36a14ee608c238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.020958:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457c00/0xfb36a14ee608c23f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.020964:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457c00/0xfb36a14ee608c23f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.020969:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457c00/0xfb36a14ee608c23f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746066797.020977:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066797.021042:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457800/0xfb36a14ee608c231 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.021048:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457800/0xfb36a14ee608c231 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.021053:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457800/0xfb36a14ee608c231 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.021058:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c457800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066797.021061:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457800/0xfb36a14ee608c231 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.021066:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457800/0xfb36a14ee608c231 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.021074:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066797.021076:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066797.021080:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457800/0xfb36a14ee608c231 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.021084:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457800/0xfb36a14ee608c231 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.021113:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457a00/0xfb36a14ee608c238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.021117:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457a00/0xfb36a14ee608c238 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.021121:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457a00/0xfb36a14ee608c238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.021128:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c457a00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066797.021130:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457a00/0xfb36a14ee608c238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.021134:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457a00/0xfb36a14ee608c238 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.021140:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13f00) 00010000:00010000:1.0:1746066797.021141:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066797.021143:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457a00/0xfb36a14ee608c238 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.021147:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457a00/0xfb36a14ee608c238 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.021175:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457600/0xfb36a14ee608c22a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd2 expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.021185:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457c00/0xfb36a14ee608c23f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd2 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.021190:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066797.021192:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066797.021194:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c457c00, rc 0) 00000100:00100000:1.0:1746066797.021236:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:31746:x1830882977059840:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 532us (2251us total) trans 8589944120 rc 0/0 00000100:00100000:1.0:1746066797.021242:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10050 00000100:00080000:2.0:1746066797.021423:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066797.022110:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.022160:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977059968 00000100:00100000:2.0:1746066797.022166:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977059968 00000100:00080000:0.0:1746066797.022216:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066797.022238:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10051 00000100:00100000:2.0:1746066797.022244:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:31748:x1830882977059968:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066797.022254:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.022261:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c24d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ecd9 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.022289:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c254 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022295:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c254 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022301:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c254 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022308:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf600/0xfb36a14ee608c25b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022312:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf600/0xfb36a14ee608c25b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022316:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf600/0xfb36a14ee608c25b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022363:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf800/0xfb36a14ee608c262 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022369:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf800/0xfb36a14ee608c262 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022373:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf800/0xfb36a14ee608c262 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746066797.022390:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:2.0:1746066797.022393:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746066797.022402:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf800/0xfb36a14ee608c262 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022408:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf800/0xfb36a14ee608c262 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022413:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c254 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022417:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c254 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022421:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c254 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022425:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4aaf400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066797.022427:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c254 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022437:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c254 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022444:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066797.022446:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066797.022449:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c254 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022453:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c254 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022763:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf600/0xfb36a14ee608c25b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022768:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf600/0xfb36a14ee608c25b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022772:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf600/0xfb36a14ee608c25b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022776:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4aaf600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066797.022778:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf600/0xfb36a14ee608c25b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022782:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf600/0xfb36a14ee608c25b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022788:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebeb600) 00010000:00010000:2.0:1746066797.022790:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066797.022792:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf600/0xfb36a14ee608c25b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022796:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf600/0xfb36a14ee608c25b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.022815:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c24d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd9 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.022824:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf800/0xfb36a14ee608c262 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd9 expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.022829:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066797.022831:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066797.022832:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4aaf800, rc 0) 00000100:00100000:2.0:1746066797.023323:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31748:x1830882977059968:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1078us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.023330:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10051 00000100:00100000:0.0:1746066797.029054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.029109:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977060096 00000100:00100000:3.0:1746066797.029116:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977060096 00000100:00100000:3.0:1746066797.030907:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14845 00000100:00100000:3.0:1746066797.030918:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977060096:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066797.030937:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066797.030954:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608c269 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ece0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066797.031008:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976892032:192.168.202.57@tcp:106: 00000100:00080000:0.0:1746066797.032128:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066797.033638:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066797.037274:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976892032:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066797.037307:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608c269 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ece0 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.037320:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608c269 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ece0 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.037343:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f094c00, rc 0) 00000100:00100000:3.0:1746066797.037382:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977060096:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 6467us (8335us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066797.037390:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14845 00000100:00100000:0.0:1746066797.048599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.049785:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977060352 00000100:00100000:2.0:1746066797.049795:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977060352 00000100:00100000:2.0:1746066797.052943:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10052 00000100:00100000:2.0:1746066797.052961:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31748:x1830882977060352:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066797.052984:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.053003:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafa00/0xfb36a14ee608c270 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ece7 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.053099:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.053114:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457c00/0xfb36a14ee608c23f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd2 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.053120:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf800/0xfb36a14ee608c262 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd9 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.053125:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.053161:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf800/0xfb36a14ee608c262 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd9 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.053172:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf800/0xfb36a14ee608c262 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd9 expref: 8 pid: 14548 timeout: 858 lvb_type: 0 00000100:00100000:2.0:1746066797.053184:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976892160:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.053303:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457c00/0xfb36a14ee608c23f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd2 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.053310:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457c00/0xfb36a14ee608c23f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd2 expref: 11 pid: 14549 timeout: 858 lvb_type: 0 00000100:00100000:2.0:1746066797.053317:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976892288:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066797.053336:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dc000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066797.057180:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976892160:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066797.057197:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976892288:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.057222:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746066797.058185:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.058297:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.058376:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977060608 00000100:00100000:1.0:1746066797.058384:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977060608 00010000:00010000:1.0:1746066797.058418:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf800/0xfb36a14ee608c262 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd9 expref: 9 pid: 14548 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746066797.058446:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977060480 00000100:00100000:1.0:1746066797.058449:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977060480 00010000:00010000:1.0:1746066797.058462:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457c00/0xfb36a14ee608c23f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd2 expref: 12 pid: 14549 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746066797.058504:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7626 00000100:00100000:1.0:1746066797.058513:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977060608:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066797.058526:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066797.058531:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf800/0xfb36a14ee608c262 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd9 expref: 9 pid: 14548 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.058540:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf800/0xfb36a14ee608c262 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd9 expref: 9 pid: 14548 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.058559:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf800/0xfb36a14ee608c262 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd9 expref: 9 pid: 14548 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.058588:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066797.058593:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066797.058600:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066797.058605:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066797.058650:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977060608:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 137us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.058660:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7626 00000100:00100000:1.0:1746066797.058744:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7627 00000100:00100000:1.0:1746066797.058751:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882977060480:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066797.058760:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066797.058765:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457c00/0xfb36a14ee608c23f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd2 expref: 12 pid: 14549 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.058774:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457c00/0xfb36a14ee608c23f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd2 expref: 12 pid: 14549 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.058786:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457c00/0xfb36a14ee608c23f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecd2 expref: 12 pid: 14549 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.058795:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066797.058798:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066797.058804:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066797.058810:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066797.058830:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066797.058852:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977060480:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 101us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.058858:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7627 00010000:00010000:3.0:1746066797.059145:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066797.059152:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746066797.059169:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066797.059296:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafa00/0xfb36a14ee608c270 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ece7 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.059313:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ece7 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.059319:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066797.059321:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066797.059323:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4aafc00, rc 0) 00000100:00100000:3.0:1746066797.059357:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31748:x1830882977060352:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 6402us (10763us total) trans 8589944121 rc 0/0 00000100:00100000:3.0:1746066797.059364:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10052 00000100:00100000:0.0:1746066797.061890:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.062020:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977060736 00000100:00100000:3.0:1746066797.062026:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977060736 00000100:00100000:3.0:1746066797.062069:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10053 00000100:00100000:3.0:1746066797.062076:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31748:x1830882977060736:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066797.062095:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066797.062108:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095200/0xfb36a14ee608c285 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ecee expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.062164:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066797.062178:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ece7 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.062185:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066797.062207:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ece7 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.062216:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ece7 expref: 9 pid: 14548 timeout: 858 lvb_type: 0 00000100:00100000:3.0:1746066797.062225:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976892416:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066797.063474:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.065590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.065912:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976892416:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066797.065936:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746066797.068249:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977060864 00000100:00100000:1.0:1746066797.068261:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977060864 00010000:00010000:1.0:1746066797.068297:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ece7 expref: 10 pid: 14548 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746066797.068333:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7628 00000100:00100000:1.0:1746066797.068340:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977060864:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066797.068352:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066797.068356:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ece7 expref: 10 pid: 14548 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.068366:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ece7 expref: 10 pid: 14548 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.068384:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c277 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ece7 expref: 10 pid: 14548 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.068396:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066797.068400:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066797.068407:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066797.068413:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066797.068430:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066797.068483:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977060864:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 141us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.068490:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7628 00010000:00010000:2.0:1746066797.068735:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.068742:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746066797.068775:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:2.0:1746066797.068779:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746066797.068792:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.068816:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095200/0xfb36a14ee608c285 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecee expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.068831:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecee expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.068840:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066797.068842:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066797.068845:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f095400, rc 0) 00000100:00100000:2.0:1746066797.068868:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31748:x1830882977060736:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 6793us (6983us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.068873:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10053 00000100:00100000:0.0:1746066797.071733:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.071834:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977060992 00000100:00100000:3.0:1746066797.071840:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977060992 00000100:00100000:3.0:1746066797.071876:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14846 00000100:00100000:3.0:1746066797.071882:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977060992:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066797.071894:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066797.071906:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f095800/0xfb36a14ee608c293 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ecf5 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066797.071941:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976892544:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066797.072998:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066797.085716:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976892544:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066797.085747:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f095800/0xfb36a14ee608c293 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecf5 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.085759:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f095800/0xfb36a14ee608c293 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecf5 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.085786:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f095800, rc 0) 00000100:00100000:3.0:1746066797.085845:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977060992:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 13961us (14116us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066797.085852:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14846 00000100:00100000:0.0:1746066797.097320:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.097544:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977061248 00000100:00100000:2.0:1746066797.097551:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977061248 00000100:00100000:2.0:1746066797.097619:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10054 00000100:00100000:2.0:1746066797.097626:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31750:x1830882977061248:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066797.097646:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.097659:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c29a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ecfc expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.097761:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c2a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.097771:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c2a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.097779:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c2a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.097788:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c2a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.097792:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.097800:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.097873:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf000/0xfb36a14ee608c2af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.097879:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf000/0xfb36a14ee608c2af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.097884:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf000/0xfb36a14ee608c2af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746066797.097890:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066797.097946:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c2a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.097951:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c2a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.097956:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c2a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.097961:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4aafe00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066797.097964:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c2a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.097970:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c2a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.097978:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066797.097981:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066797.097984:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c2a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00000100:00080000:0.0:1746066797.098116:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746066797.098139:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c2a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.098150:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.098154:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c2a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.098158:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c2a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.098162:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4aaf200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066797.098164:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c2a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.098168:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c2a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.098174:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebebe00) 00010000:00010000:2.0:1746066797.098175:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066797.098177:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c2a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.098181:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c2a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.098206:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c29a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecfc expref: 256 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.098214:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf000/0xfb36a14ee608c2af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecfc expref: 255 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.098223:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066797.098225:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066797.098227:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4aaf000, rc 0) 00000100:00100000:2.0:1746066797.102067:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31750:x1830882977061248:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4433us (4747us total) trans 8589944122 rc 0/0 00000100:00100000:2.0:1746066797.102076:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10054 00000100:00100000:1.0:1746066797.102190:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.102239:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977061504 00000100:00100000:2.0:1746066797.102245:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977061504 00000100:00100000:2.0:1746066797.102265:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10055 00000100:00100000:2.0:1746066797.102270:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31748:x1830882977061504:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066797.102283:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.102295:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c2bd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed03 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.102358:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aae600/0xfb36a14ee608c2c4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.102368:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aae600/0xfb36a14ee608c2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.102377:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aae600/0xfb36a14ee608c2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.102386:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aae600/0xfb36a14ee608c2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.102391:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aae600/0xfb36a14ee608c2c4 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.102400:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aae600/0xfb36a14ee608c2c4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.102404:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4aae600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066797.102407:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aae600/0xfb36a14ee608c2c4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.102412:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aae600/0xfb36a14ee608c2c4 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.102421:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066797.102423:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066797.102426:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aae600/0xfb36a14ee608c2c4 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.102430:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aae600/0xfb36a14ee608c2c4 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.102452:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c2bd lrc: 1/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed03 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.102458:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c2bd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed03 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.102464:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4aaee00, rc 0) 00000100:00100000:2.0:1746066797.102493:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31748:x1830882977061504:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 223us (304us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066797.102498:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10055 00000100:00100000:0.0:1746066797.111769:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.111886:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977061760 00000100:00100000:3.0:1746066797.111894:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977061760 00000100:00100000:3.0:1746066797.111929:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4207 00000100:00100000:3.0:1746066797.111935:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31748:x1830882977061760:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:3.0:1746066797.112094:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31748:x1830882977061760:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 158us (330us total) trans 8589944123 rc 0/0 00000100:00100000:3.0:1746066797.112099:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4207 00000100:00100000:0.0:1746066797.135160:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.135292:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977062016 00000100:00100000:1.0:1746066797.135300:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977062016 00000100:00100000:1.0:1746066797.135369:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10056 00000100:00100000:1.0:1746066797.135378:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:31754:x1830882977062016:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066797.135403:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066797.135420:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457400/0xfb36a14ee608c2cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed0a expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.135522:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457200/0xfb36a14ee608c2d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135535:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457200/0xfb36a14ee608c2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135545:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457200/0xfb36a14ee608c2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135557:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457000/0xfb36a14ee608c2d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135575:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457000/0xfb36a14ee608c2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135584:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457000/0xfb36a14ee608c2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135739:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c456800/0xfb36a14ee608c2e0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135750:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c456800/0xfb36a14ee608c2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135756:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c456800/0xfb36a14ee608c2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746066797.135767:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066797.135851:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457200/0xfb36a14ee608c2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135859:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457200/0xfb36a14ee608c2d2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135864:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457200/0xfb36a14ee608c2d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135869:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c457200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066797.135872:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457200/0xfb36a14ee608c2d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135878:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457200/0xfb36a14ee608c2d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135889:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066797.135892:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066797.135896:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457200/0xfb36a14ee608c2d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135900:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457200/0xfb36a14ee608c2d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135945:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457000/0xfb36a14ee608c2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135952:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457000/0xfb36a14ee608c2d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135956:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457000/0xfb36a14ee608c2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135964:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c457000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066797.135966:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457000/0xfb36a14ee608c2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135971:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457000/0xfb36a14ee608c2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135978:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13d00) 00010000:00010000:1.0:1746066797.135980:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066797.135982:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457000/0xfb36a14ee608c2d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.135986:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457000/0xfb36a14ee608c2d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066797.136025:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c457400/0xfb36a14ee608c2cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed0a expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.136038:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c456800/0xfb36a14ee608c2e0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed0a expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.136044:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066797.136045:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066797.136048:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c456800, rc 0) 00000100:00100000:1.0:1746066797.136095:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:31754:x1830882977062016:12345-192.168.202.57@tcp:101:cat.0 Request processed in 716us (943us total) trans 8589944124 rc 0/0 00000100:00100000:1.0:1746066797.136102:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10056 00000100:00100000:0.0:1746066797.140811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.142898:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977062144 00000100:00100000:3.0:1746066797.142907:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977062144 00000100:00100000:3.0:1746066797.142965:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14847 00000100:00100000:3.0:1746066797.142972:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977062144:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066797.142986:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066797.143000:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f095a00/0xfb36a14ee608c2ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed11 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066797.143044:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976892672:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066797.143111:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3a80 going to sleep for 11 seconds 00000100:00080000:0.0:1746066797.143212:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066797.155593:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976892672:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066797.155619:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f095a00/0xfb36a14ee608c2ee lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed11 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.155630:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f095a00/0xfb36a14ee608c2ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed11 expref: 25 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.155652:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f095a00, rc 0) 00000100:00100000:3.0:1746066797.155715:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977062144:12345-192.168.202.57@tcp:101:cat.0 Request processed in 12742us (14909us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066797.155723:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14847 00000100:00100000:0.0:1746066797.165709:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.165815:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977062272 00000100:00100000:3.0:1746066797.165821:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977062272 00000100:00100000:3.0:1746066797.165862:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14848 00000100:00100000:3.0:1746066797.165868:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:31754:x1830882977062272:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066797.165883:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066797.165896:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f095c00/0xfb36a14ee608c2f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed18 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.165917:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->655359) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.165924:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066797.165925:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066797.165928:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f095c00/0xfb36a14ee608c2f5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed18 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.165949:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->655359) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.165958:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->655359) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 33 pid: 4614 timeout: 858 lvb_type: 0 00000100:00100000:3.0:1746066797.165967:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976892800:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066797.166020:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066797.171185:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976892800:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066797.171213:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f095c00/0xfb36a14ee608c2f5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed18 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.171229:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f095c00, rc 0) 00000100:00100000:3.0:1746066797.171267:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:31754:x1830882977062272:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5398us (5598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.171274:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14848 00000100:00100000:0.0:1746066797.172304:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.185544:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977062400 00000100:00100000:3.0:1746066797.185557:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977062400 00002000:00100000:3.0:1746066797.185643:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x38e:0x0] (90112->655359) req@ffff88012c22df80 x1830882977062400/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.185651:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22df80 with x1830882977062400 ext(90112->655359) 00010000:00010000:3.0:1746066797.185659:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->655359) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 34 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066797.185690:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->655359) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 34 pid: 4614 timeout: 858 lvb_type: 0 00002000:00010000:3.0:1746066797.185697:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c22df80 00000100:00100000:3.0:1746066797.185728:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2187 00000100:00100000:3.0:1746066797.185734:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882977062400:12345-192.168.202.57@tcp:4:cat.0 00000100:00080000:0.0:1746066797.186633:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066797.208853:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1965:x1830882977062400:12345-192.168.202.57@tcp:4:cat.0 Request processed in 23108us (36540us total) trans 17179873659 rc 0/0 00000100:00100000:3.0:1746066797.208864:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2187 00002000:00100000:3.0:1746066797.208877:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x38e:0x0] (90112->655359) req@ffff88012c22df80 x1830882977062400/t17179873659(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/448 e 0 to 0 dl 1746066808 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.208886:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22df80 with x1830882977062400 ext(90112->655359) 00010000:00010000:3.0:1746066797.208895:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->655359) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 36 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066797.208910:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->655359) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 36 pid: 4614 timeout: 858 lvb_type: 0 00002000:00010000:3.0:1746066797.208917:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c22df80 00000100:00100000:0.0:1746066797.209883:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.209940:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977062656 00000100:00100000:2.0:1746066797.209945:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977062656 00000100:00100000:2.0:1746066797.209976:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10057 00000100:00100000:2.0:1746066797.209981:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31757:x1830882977062656:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066797.209995:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.210008:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaea00/0xfb36a14ee608c2fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed1f expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.210070:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c303 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.210080:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c303 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066797.210088:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c303 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746066797.210096:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066797.210159:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaea00/0xfb36a14ee608c2fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed1f expref: 258 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.210184:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c303 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed1f expref: 257 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.210190:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066797.210192:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746066797.210194:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4aafc00, rc 0) 00000100:00100000:2.0:1746066797.210215:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:31757:x1830882977062656:12345-192.168.202.57@tcp:101:cat.0 Request processed in 234us (334us total) trans 8589944125 rc 0/0 00000100:00100000:2.0:1746066797.210219:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10057 00000100:00100000:1.0:1746066797.220781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.220826:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.221448:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977062784 00000100:00100000:3.0:1746066797.221455:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977062784 00010000:00010000:3.0:1746066797.221484:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 90112->655359) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 36 pid: 4614 timeout: 858 lvb_type: 0 00000100:00100000:3.0:1746066797.221523:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7629 00000100:00100000:3.0:1746066797.221529:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1966:x1830882977062784:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066797.221541:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066797.221559:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->655359) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 36 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066797.221579:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->655359) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 36 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066797.221599:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009acd3000/0xfb36a14ee608c20e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 90112->655359) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecb6 expref: 36 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066797.221615:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.221617:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.221622:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f095c00/0xfb36a14ee608c2f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed18 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.221629:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f095c00/0xfb36a14ee608c2f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed18 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.221657:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f095c00/0xfb36a14ee608c2f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed18 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066797.221668:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976892928:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066797.221772:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066797.227381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.227491:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977063168 00000100:00100000:0.0:1746066797.227501:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977063168 00002000:00100000:0.0:1746066797.227547:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e634e00 x1830882977063168/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066797.227557:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e634e00 with x1830882977063168 ext(0->1048575) 00002000:00010000:0.0:1746066797.227562:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e634e00 00000100:00100000:0.0:1746066797.227601:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6745 00000100:00100000:0.0:1746066797.227610:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977063168:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066797.229832:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977062912 00000100:00100000:2.0:1746066797.229839:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977062912 00000100:00100000:2.0:1746066797.229881:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14849 00000100:00100000:2.0:1746066797.229886:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1965:x1830882977062912:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066797.229899:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.229911:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4aae600/0xfb36a14ee608c311 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed26 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.229928:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066797.229929:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066797.229936:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4aae600/0xfb36a14ee608c311 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed26 expref: 37 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.229948:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4aae600/0xfb36a14ee608c311 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed26 expref: 37 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.229956:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4aae600, rc 0) 00000100:00100000:2.0:1746066797.229987:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1965:x1830882977062912:12345-192.168.202.57@tcp:101:cat.0 Request processed in 101us (9160us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.229991:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14849 00000100:00100000:2.0:1746066797.230029:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976892928:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066797.230042:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066797.230053:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1966:x1830882977062784:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8525us (9281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.230059:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7629 00010000:00010000:2.0:1746066797.234387:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066797.242980:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977063168:12345-192.168.202.57@tcp:3:cat.0 Request processed in 15364us (15601us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066797.242990:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6745 00002000:00100000:0.0:1746066797.243000:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e634e00 x1830882977063168/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066797.243008:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e634e00 with x1830882977063168 ext(0->1048575) 00002000:00010000:0.0:1746066797.243012:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e634e00 00000100:00100000:0.0:1746066797.244823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.245444:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977063424 00000100:00100000:2.0:1746066797.245451:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977063424 00002000:00100000:2.0:1746066797.245482:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88012c22d180 x1830882977063424/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066797.245495:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22d180 with x1830882977063424 ext(0->1048575) 00002000:00010000:2.0:1746066797.245498:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c22d180 00000100:00100000:2.0:1746066797.246179:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6746 00000100:00100000:2.0:1746066797.246186:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1966:x1830882977063424:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066797.268025:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1966:x1830882977063424:12345-192.168.202.57@tcp:3:cat.0 Request processed in 21832us (23198us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066797.268034:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6746 00002000:00100000:2.0:1746066797.268045:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88012c22d180 x1830882977063424/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066797.268052:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22d180 with x1830882977063424 ext(0->1048575) 00002000:00010000:2.0:1746066797.268056:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c22d180 00000100:00100000:0.0:1746066797.268220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.268321:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977063552 00000100:00100000:3.0:1746066797.268327:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977063552 00000100:00100000:3.0:1746066797.268358:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14850 00000100:00100000:3.0:1746066797.268363:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:31746:x1830882977063552:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066797.268374:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066797.268386:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed2d expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.268406:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bace00/0xfb36a14ee608c0cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec23 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.268413:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eccb600/0xfb36a14ee608c1cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec93 expref: 21 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.268420:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c190 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec62 expref: 23 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.268425:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.268426:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.268430:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3371008->4194303] (req 3371008->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.268452:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c190 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec62 expref: 23 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.268462:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c190 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec62 expref: 23 pid: 10402 timeout: 858 lvb_type: 1 00000100:00100000:3.0:1746066797.268476:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976893056:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066797.268538:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009eccb600/0xfb36a14ee608c1cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec93 expref: 21 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.268545:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009eccb600/0xfb36a14ee608c1cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec93 expref: 21 pid: 4614 timeout: 858 lvb_type: 1 00000100:00100000:3.0:1746066797.268552:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976893184:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066797.268585:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bace00/0xfb36a14ee608c0cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec23 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.268593:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bace00/0xfb36a14ee608c0cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec23 expref: 10 pid: 8112 timeout: 858 lvb_type: 1 00000100:00100000:3.0:1746066797.268600:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976893312:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066797.268613:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b30c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746066797.268949:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066797.277852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.277887:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.277967:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977063680 00000100:00100000:1.0:1746066797.277974:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977063680 00010000:00010000:1.0:1746066797.278010:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c190 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec62 expref: 24 pid: 10402 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746066797.278029:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977063808 00000100:00100000:1.0:1746066797.278030:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977063808 00010000:00010000:1.0:1746066797.278039:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bace00/0xfb36a14ee608c0cc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec23 expref: 11 pid: 8112 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746066797.278051:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7630 00000100:00100000:1.0:1746066797.278057:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1965:x1830882977063680:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066797.278067:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066797.278083:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c190 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec62 expref: 24 pid: 10402 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746066797.278092:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c190 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec62 expref: 24 pid: 10402 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746066797.278114:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066797.278146:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1965:x1830882977063680:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 89us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.278152:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7630 00000100:00100000:1.0:1746066797.278165:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7631 00000100:00100000:1.0:1746066797.278169:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977063808:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066797.278175:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066797.278182:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bace00/0xfb36a14ee608c0cc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec23 expref: 11 pid: 8112 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746066797.278188:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5bace00/0xfb36a14ee608c0cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec23 expref: 11 pid: 8112 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746066797.278199:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066797.278211:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977063808:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 42us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.278215:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7631 00010000:00010000:3.0:1746066797.278373:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c190 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec62 expref: 23 pid: 10402 timeout: 858 lvb_type: 1 00000100:00100000:3.0:1746066797.278389:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976893056:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066797.278397:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976893184:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066797.278403:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bace00/0xfb36a14ee608c0cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec23 expref: 10 pid: 8112 timeout: 858 lvb_type: 1 00000100:00100000:3.0:1746066797.278414:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976893312:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066797.278432:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3371008->4194303] (req 3371008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.278441:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed4400, rc 0) 00000100:00100000:3.0:1746066797.278460:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+21:31746:x1830882977063552:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 10097us (10242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.278466:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14850 00000100:00080000:0.0:1746066797.278697:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066797.279598:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.279663:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.279776:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977063936 00000100:00100000:2.0:1746066797.279782:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977063936 00010000:00010000:2.0:1746066797.279807:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eccb600/0xfb36a14ee608c1cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec93 expref: 21 pid: 4614 timeout: 858 lvb_type: 1 00000100:00100000:3.0:1746066797.279910:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977064064 00000100:00100000:3.0:1746066797.279916:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977064064 00000100:00100000:3.0:1746066797.279950:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14851 00000100:00100000:3.0:1746066797.279958:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:31754:x1830882977064064:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066797.279971:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066797.279983:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ed5000/0xfb36a14ee608c31f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed34 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.280001:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.280003:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.280011:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed5000/0xfb36a14ee608c31f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed34 expref: 23 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.280023:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ed5000/0xfb36a14ee608c31f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed34 expref: 23 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.280032:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed5000, rc 0) 00000100:00100000:3.0:1746066797.280068:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:31754:x1830882977064064:12345-192.168.202.57@tcp:101:cat.0 Request processed in 110us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.280073:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14851 00000100:00100000:2.0:1746066797.280140:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7632 00000100:00100000:2.0:1746066797.280148:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882977063936:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066797.280158:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066797.280174:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eccb600/0xfb36a14ee608c1cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec93 expref: 22 pid: 4614 timeout: 858 lvb_type: 1 00010000:00010000:2.0:1746066797.280184:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eccb600/0xfb36a14ee608c1cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec93 expref: 22 pid: 4614 timeout: 858 lvb_type: 1 00010000:00010000:2.0:1746066797.280198:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eccb600/0xfb36a14ee608c1cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec93 expref: 22 pid: 4614 timeout: 858 lvb_type: 1 00010000:00010000:2.0:1746066797.280214:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066797.280215:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066797.280220:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3371008->18446744073709551615] (req 3371008->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.280228:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3371008->18446744073709551615] (req 3371008->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.280257:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3371008->18446744073709551615] (req 3371008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066797.280270:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976893440:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066797.280314:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066797.283957:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976893440:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066797.283983:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066797.284144:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:1965:x1830882977063936:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3992us (4544us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.284154:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7632 00000100:00100000:0.0:1746066797.291040:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.291127:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977064320 00000100:00100000:2.0:1746066797.291135:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977064320 00002000:00100000:2.0:1746066797.291169:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ec2ea00 x1830882977064320/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066797.291184:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2ea00 with x1830882977064320 ext(2097152->3145727) 00002000:00010000:2.0:1746066797.291188:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2ea00 00000100:00100000:2.0:1746066797.291602:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6747 00000100:00100000:2.0:1746066797.291610:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1966:x1830882977064320:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066797.293259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.293329:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977064448 00000100:00100000:3.0:1746066797.293335:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977064448 00000100:00100000:3.0:1746066797.293363:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14852 00000100:00100000:3.0:1746066797.293368:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:31757:x1830882977064448:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066797.293379:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066797.293392:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ed4a00/0xfb36a14ee608c326 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed3b expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.293410:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.293412:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.293418:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed4a00/0xfb36a14ee608c326 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed3b expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.293429:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ed4a00/0xfb36a14ee608c326 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed3b expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.293437:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed4a00, rc 0) 00000100:00100000:3.0:1746066797.293487:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:31757:x1830882977064448:12345-192.168.202.57@tcp:101:cat.0 Request processed in 118us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.293492:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14852 00000100:00100000:0.0:1746066797.306387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.307028:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977064704 00000100:00100000:2.0:1746066797.307036:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977064704 00000100:00100000:0.0:1746066797.308059:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.308136:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14853 00000100:00100000:2.0:1746066797.308145:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:31746:x1830882977064704:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066797.308160:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.308174:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed42 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.308201:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608c0c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec1c expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.308209:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608c1c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec8c expref: 26 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.308217:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009acd2a00/0xfb36a14ee608c189 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec5b expref: 35 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.308223:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066797.308224:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066797.308227:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 6/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->4349951] (req 4194304->4349951) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.308256:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009acd2a00/0xfb36a14ee608c189 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec5b expref: 35 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.308267:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009acd2a00/0xfb36a14ee608c189 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec5b expref: 35 pid: 10402 timeout: 858 lvb_type: 1 00000100:00100000:2.0:1746066797.308276:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976893568:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.308345:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608c1c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec8c expref: 26 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.308352:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608c1c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec8c expref: 26 pid: 4614 timeout: 858 lvb_type: 1 00000100:00100000:2.0:1746066797.308359:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976893696:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.308381:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608c0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec1c expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.308388:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608c0c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec1c expref: 9 pid: 10402 timeout: 858 lvb_type: 1 00000100:00100000:2.0:1746066797.308394:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976893824:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066797.308409:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dca80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066797.308483:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977064832 00000100:00100000:1.0:1746066797.308487:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977064832 00002000:00100000:1.0:1746066797.308511:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ec2ca80 x1830882977064832/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066797.308519:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2ca80 with x1830882977064832 ext(2097152->3145727) 00002000:00010000:1.0:1746066797.308523:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2ca80 00000100:00100000:1.0:1746066797.308544:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6748 00000100:00100000:1.0:1746066797.308550:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1965:x1830882977064832:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066797.311824:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1966:x1830882977064320:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20207us (20784us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066797.311834:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6747 00002000:00100000:3.0:1746066797.311843:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ec2ea00 x1830882977064320/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.311851:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2ea00 with x1830882977064320 ext(2097152->3145727) 00002000:00010000:3.0:1746066797.311855:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2ea00 00000100:00100000:2.0:1746066797.324798:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976893568:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066797.325145:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.325743:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976893696:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066797.325752:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976893824:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.325779:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->4349951] (req 4194304->4349951) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.325793:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4aafe00, rc 0) 00000100:00100000:2.0:1746066797.325827:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+26:31746:x1830882977064704:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 17683us (19448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.325834:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14853 00000100:00100000:0.0:1746066797.326632:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1965:x1830882977064832:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18081us (18574us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066797.326640:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6748 00002000:00100000:0.0:1746066797.326647:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ec2ca80 x1830882977064832/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066797.326659:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2ca80 with x1830882977064832 ext(2097152->3145727) 00002000:00010000:0.0:1746066797.326664:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2ca80 00000100:00100000:3.0:1746066797.326983:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977064960 00000100:00100000:3.0:1746066797.326989:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977064960 00010000:00010000:3.0:1746066797.327012:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009acd2a00/0xfb36a14ee608c189 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec5b expref: 36 pid: 10402 timeout: 858 lvb_type: 1 00000100:00100000:3.0:1746066797.327042:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7633 00000100:00100000:3.0:1746066797.327048:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882977064960:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066797.327057:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066797.327073:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009acd2a00/0xfb36a14ee608c189 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec5b expref: 36 pid: 10402 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.327081:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009acd2a00/0xfb36a14ee608c189 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec5b expref: 36 pid: 10402 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.327097:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009acd2a00/0xfb36a14ee608c189 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec5b expref: 36 pid: 10402 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.327111:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066797.327142:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882977064960:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 94us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.327147:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7633 00000100:00100000:0.0:1746066797.328345:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.328372:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.328405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.328477:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977065088 00000100:00100000:3.0:1746066797.328481:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977065088 00010000:00010000:3.0:1746066797.328497:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608c1c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec8c expref: 26 pid: 4614 timeout: 858 lvb_type: 1 00000100:00100000:3.0:1746066797.328525:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977065216 00000100:00100000:3.0:1746066797.328528:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977065216 00010000:00010000:3.0:1746066797.328537:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608c0c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec1c expref: 10 pid: 10402 timeout: 858 lvb_type: 1 00000100:00100000:3.0:1746066797.328551:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7634 00000100:00100000:3.0:1746066797.328556:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977065088:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066797.328572:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066797.328584:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608c1c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec8c expref: 26 pid: 4614 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.328593:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608c1c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec8c expref: 26 pid: 4614 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.328605:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608c1c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec8c expref: 26 pid: 4614 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.328615:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066797.328637:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977065088:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 81us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.328643:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7634 00000100:00100000:3.0:1746066797.328653:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7635 00000100:00100000:3.0:1746066797.328658:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977065216:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066797.328664:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066797.328671:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608c0c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec1c expref: 10 pid: 10402 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.328698:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608c0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec1c expref: 10 pid: 10402 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.328708:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ff40200/0xfb36a14ee608c0c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec1c expref: 10 pid: 10402 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.328717:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.328719:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.328728:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.328736:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.328761:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066797.328770:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976893952:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066797.328817:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066797.329077:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977065344 00000100:00100000:2.0:1746066797.329080:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977065344 00000100:00100000:2.0:1746066797.329102:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14854 00000100:00100000:2.0:1746066797.329107:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:31750:x1830882977065344:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066797.329118:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.329129:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed49 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.329145:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092591c00/0xfb36a14ee608c0a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec07 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.329152:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c1b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec77 expref: 20 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.329158:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009acc1c00/0xfb36a14ee608c1a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec46 expref: 25 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.329166:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066797.329168:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066797.329170:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1695744->2097151] (req 1695744->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 25 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.329186:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009acc1c00/0xfb36a14ee608c1a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec46 expref: 25 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.329195:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009acc1c00/0xfb36a14ee608c1a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec46 expref: 25 pid: 4614 timeout: 858 lvb_type: 1 00000100:00100000:2.0:1746066797.329203:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976894080:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.329234:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c1b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec77 expref: 20 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.329241:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c1b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec77 expref: 20 pid: 21973 timeout: 858 lvb_type: 1 00000100:00100000:2.0:1746066797.329249:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976894208:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.329268:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092591c00/0xfb36a14ee608c0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec07 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.329275:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092591c00/0xfb36a14ee608c0a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec07 expref: 9 pid: 8451 timeout: 858 lvb_type: 1 00000100:00100000:2.0:1746066797.329287:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976894336:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066797.329302:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066797.330158:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.330212:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977065472 00000100:00100000:3.0:1746066797.330216:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977065472 00000100:00100000:3.0:1746066797.331024:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14855 00000100:00100000:3.0:1746066797.331032:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:31754:x1830882977065472:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066797.331042:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066797.331051:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ed5600/0xfb36a14ee608c33b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed50 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.331069:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.331075:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066797.331076:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066797.331079:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed5600/0xfb36a14ee608c33b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed50 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.331095:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 26 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.331102:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 26 pid: 4614 timeout: 858 lvb_type: 0 00000100:00100000:3.0:1746066797.331110:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976894464:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066797.331165:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.336506:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.336607:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976894080:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066797.336971:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976893952:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066797.336987:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066797.337029:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977065216:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8370us (8655us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.337038:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7635 00000100:00100000:1.0:1746066797.337269:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977065600 00000100:00100000:1.0:1746066797.337275:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977065600 00000100:00100000:1.0:1746066797.337306:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14856 00000100:00100000:1.0:1746066797.337311:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:31757:x1830882977065600:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066797.337325:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066797.337337:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801311a1400/0xfb36a14ee608c342 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed57 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.337362:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066797.337366:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801311a1400/0xfb36a14ee608c342 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed57 expref: 36 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.337380:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801311a1400/0xfb36a14ee608c342 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed57 expref: 36 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.337389:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801311a1400, rc 0) 00000100:00100000:1.0:1746066797.337419:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:31757:x1830882977065600:12345-192.168.202.57@tcp:101:cat.0 Request processed in 108us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.337423:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14856 00000100:00100000:1.0:1746066797.338385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.338397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.338496:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976894208:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066797.338504:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976894336:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.338524:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1695744->2097151] (req 1695744->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 25 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.338534:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4aaee00, rc 0) 00000100:00100000:2.0:1746066797.338556:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31750:x1830882977065344:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 9449us (10151us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.338561:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14854 00000100:00100000:1.0:1746066797.338985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.339596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.340250:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977065856 00000100:00100000:3.0:1746066797.340256:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977065856 00010000:00010000:3.0:1746066797.340276:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c1b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec77 expref: 21 pid: 21973 timeout: 858 lvb_type: 1 00000100:00100000:3.0:1746066797.340306:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977065728 00000100:00100000:3.0:1746066797.340308:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977065728 00010000:00010000:3.0:1746066797.340318:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009acc1c00/0xfb36a14ee608c1a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec46 expref: 25 pid: 4614 timeout: 858 lvb_type: 1 00000100:00100000:3.0:1746066797.340335:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977065984 00000100:00100000:3.0:1746066797.340338:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977065984 00010000:00010000:3.0:1746066797.340346:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092591c00/0xfb36a14ee608c0a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec07 expref: 10 pid: 8451 timeout: 858 lvb_type: 1 00000100:00100000:3.0:1746066797.340360:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7636 00000100:00100000:3.0:1746066797.340366:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977065856:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066797.340375:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066797.340391:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c1b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec77 expref: 21 pid: 21973 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.340400:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c1b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec77 expref: 21 pid: 21973 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.340417:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c1b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec77 expref: 21 pid: 21973 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.340427:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066797.340449:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977065856:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 85us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.340454:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7636 00000100:00100000:3.0:1746066797.340464:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7637 00000100:00100000:3.0:1746066797.340468:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977065728:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066797.340473:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066797.340479:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009acc1c00/0xfb36a14ee608c1a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec46 expref: 25 pid: 4614 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.340487:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009acc1c00/0xfb36a14ee608c1a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec46 expref: 25 pid: 4614 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.340497:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009acc1c00/0xfb36a14ee608c1a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec46 expref: 25 pid: 4614 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.340504:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066797.340514:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977065728:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 46us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.340519:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7637 00000100:00100000:3.0:1746066797.340526:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7638 00000100:00100000:3.0:1746066797.340531:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977065984:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066797.340536:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066797.340540:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092591c00/0xfb36a14ee608c0a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec07 expref: 10 pid: 8451 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.340547:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092591c00/0xfb36a14ee608c0a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec07 expref: 10 pid: 8451 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.340556:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092591c00/0xfb36a14ee608c0a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec07 expref: 10 pid: 8451 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.340577:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.340579:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.340584:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 23 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.340591:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 23 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.340614:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 23 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066797.340625:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976894592:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066797.340666:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066797.340708:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976894464:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066797.340720:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ed5600/0xfb36a14ee608c33b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed50 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.340728:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed5600, rc 0) 00000100:00100000:3.0:1746066797.340742:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+26:31754:x1830882977065472:12345-192.168.202.57@tcp:101:cat.0 Request processed in 9713us (10586us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.340747:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14855 00000100:00100000:0.0:1746066797.341209:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977066240 00000100:00100000:0.0:1746066797.341214:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977066240 00002000:00100000:0.0:1746066797.341238:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4345856->4349951) req@ffff88009e635f80 x1830882977066240/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066797.341246:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e635f80 with x1830882977066240 ext(4345856->4349951) 00010000:00010000:0.0:1746066797.341251:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 26 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746066797.341259:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 26 pid: 4614 timeout: 858 lvb_type: 0 00002000:00010000:0.0:1746066797.341265:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e635f80 00000100:00100000:0.0:1746066797.341287:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2188 00000100:00100000:0.0:1746066797.341291:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882977066240:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066797.341396:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882977066240:12345-192.168.202.57@tcp:3:cat.0 Request processed in 104us (1800us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066797.341401:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2188 00002000:00100000:0.0:1746066797.341405:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4345856->4349951) req@ffff88009e635f80 x1830882977066240/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/4536 e 0 to 0 dl 1746066808 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066797.341412:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e635f80 with x1830882977066240 ext(4345856->4349951) 00010000:00010000:0.0:1746066797.341416:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 26 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746066797.341425:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 26 pid: 4614 timeout: 858 lvb_type: 0 00002000:00010000:0.0:1746066797.341429:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e635f80 00000100:00100000:1.0:1746066797.345032:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.345136:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977066496 00000100:00100000:2.0:1746066797.345143:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977066496 00002000:00100000:2.0:1746066797.345176:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4349951) req@ffff88009e636680 x1830882977066496/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066797.345185:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e636680 with x1830882977066496 ext(4194304->4349951) 00010000:00010000:2.0:1746066797.345192:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 26 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:2.0:1746066797.345204:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 26 pid: 4614 timeout: 858 lvb_type: 0 00002000:00010000:2.0:1746066797.345215:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e636680 00000100:00100000:3.0:1746066797.345546:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976894592:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066797.345562:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066797.345608:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977065984:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5075us (6623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.345616:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7638 00000100:00100000:2.0:1746066797.345761:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2189 00000100:00100000:2.0:1746066797.345768:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882977066496:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066797.346405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.346469:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.346623:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977067008 00000100:00100000:1.0:1746066797.346628:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977067008 00002000:00100000:1.0:1746066797.346648:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1695744->1699839) req@ffff8800924d1880 x1830882977067008/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066797.346656:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d1880 with x1830882977067008 ext(1695744->1699839) 00002000:00010000:1.0:1746066797.346660:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d1880 00000100:00100000:1.0:1746066797.346690:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6749 00000100:00100000:1.0:1746066797.346696:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977067008:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066797.346806:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977067008:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 110us (337us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066797.346813:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6749 00002000:00100000:1.0:1746066797.346818:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1695744->1699839) req@ffff8800924d1880 x1830882977067008/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/4536 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066797.346824:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d1880 with x1830882977067008 ext(1695744->1699839) 00002000:00010000:1.0:1746066797.346827:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d1880 00000100:00100000:0.0:1746066797.346944:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977066752 00000100:00100000:0.0:1746066797.346947:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977066752 00000100:00100000:0.0:1746066797.346979:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4208 00000100:00100000:0.0:1746066797.346984:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:31746:x1830882977066752:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:0.0:1746066797.347145:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:31746:x1830882977066752:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 159us (739us total) trans 8589944126 rc 0/0 00000100:00100000:0.0:1746066797.347150:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4208 00000100:00100000:3.0:1746066797.349827:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976895104:0@lo:400:kworker.0 00000100:00100000:3.0:1746066797.349867:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066797.349890:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746066797.349894:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1830882976894976:0@lo:400:kworker.0 00000100:00100000:3.0:1746066797.349912:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066797.349932:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976895104 00000100:00100000:3.0:1746066797.349937:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976895104 00000100:00100000:3.0:1746066797.349969:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1746066797.349974:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3294:x1830882976895104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066797.350009:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3294:x1830882976895104:12345-0@lo:400:kworker.0 Request processed in 34us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.350014:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1746066797.350039:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976895104:0@lo:400:kworker.0 00000100:00100000:0.0:1746066797.350154:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:980aefe6-2860-4e29-9b4a-3d9c65563e6f:3295:1830882976894720:0@lo:400:kworker.0 00000100:00100000:0.0:1746066797.350177:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.350211:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976895232:0@lo:400:kworker.0 00000100:00100000:0.0:1746066797.350226:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.350238:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066797.350242:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1830882976894848:0@lo:400:kworker.0 00000100:00100000:0.0:1746066797.350254:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066797.350263:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830882976895360:0@lo:400:kworker.0 00000100:00100000:0.0:1746066797.350274:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746066797.350291:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066797.350336:0:14544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976894720 00000100:00100000:2.0:1746066797.350339:0:14544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976894720 00000100:00100000:2.0:1746066797.350358:0:14544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1746066797.350362:0:14544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980aefe6-2860-4e29-9b4a-3d9c65563e6f+18:3295:x1830882976894720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066797.350388:0:14544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980aefe6-2860-4e29-9b4a-3d9c65563e6f+18:3295:x1830882976894720:12345-0@lo:400:kworker.0 Request processed in 26us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.350393:0:14544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1746066797.350412:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976894976 00000100:00100000:2.0:1746066797.350415:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976894976 00000100:00100000:2.0:1746066797.350434:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976894848 00000100:00100000:2.0:1746066797.350436:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976894848 00000100:00100000:2.0:1746066797.350446:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976895360 00000100:00100000:2.0:1746066797.350448:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976895360 00000100:00100000:2.0:1746066797.350457:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1746066797.350461:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830882976894976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066797.350481:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830882976894976:12345-0@lo:400:kworker.0 Request processed in 20us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.350486:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1746066797.350493:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1746066797.350497:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830882976894848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066797.350511:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830882976894848:12345-0@lo:400:kworker.0 Request processed in 15us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.350519:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1746066797.350525:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1746066797.350528:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830882976895360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066797.350544:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830882976895360:12345-0@lo:400:kworker.0 Request processed in 16us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.350548:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1746066797.350572:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976895232 00000100:00100000:2.0:1746066797.350574:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976895232 00000100:00100000:2.0:1746066797.350589:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1746066797.350593:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3295:x1830882976895232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066797.350613:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3295:x1830882976895232:12345-0@lo:400:kworker.0 Request processed in 20us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.350618:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00080000:0.0:1746066797.350999:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746066797.351002:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066797.351015:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1830882976894848:0@lo:400:kworker.0 00000100:00100000:0.0:1746066797.351022:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830882976895360:0@lo:400:kworker.0 00000100:00100000:0.0:1746066797.351029:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:980aefe6-2860-4e29-9b4a-3d9c65563e6f:3295:1830882976894720:0@lo:400:kworker.0 00000100:00100000:0.0:1746066797.351037:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976895232:0@lo:400:kworker.0 00000100:00100000:3.0:1746066797.351101:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976895616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746066797.351121:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066797.351139:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1830882976894976:0@lo:400:kworker.0 00000100:00100000:3.0:1746066797.351147:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746066797.351151:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976895488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746066797.351164:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066797.351179:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976895616 00000100:00100000:3.0:1746066797.351181:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976895616 00000100:00100000:3.0:1746066797.351195:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976895488 00000100:00100000:3.0:1746066797.351197:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976895488 00000100:00100000:3.0:1746066797.351205:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1746066797.351209:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3294:x1830882976895616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746066797.351220:0:8454:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 560398336 pending 28966912 free 3852468224 avail 3850371072 00000100:00100000:3.0:1746066797.351243:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3294:x1830882976895616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.351248:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1746066797.351256:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1746066797.351260:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+45:3294:x1830882976895488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746066797.351278:0:8454:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 599719936 pending 18743296 free 3852468224 avail 3850371072 00000100:00100000:3.0:1746066797.351293:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+45:3294:x1830882976895488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.351298:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1746066797.351319:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976895488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746066797.351327:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976895616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746066797.352406:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882977066496:12345-192.168.202.57@tcp:4:cat.0 Request processed in 6636us (7381us total) trans 17179873660 rc 0/0 00000100:00100000:2.0:1746066797.352414:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2189 00002000:00100000:2.0:1746066797.352422:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4349951) req@ffff88009e636680 x1830882977066496/t17179873660(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/448 e 0 to 0 dl 1746066808 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066797.352430:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e636680 with x1830882977066496 ext(4194304->4349951) 00010000:00010000:2.0:1746066797.352437:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 28 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:2.0:1746066797.352448:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 28 pid: 4614 timeout: 858 lvb_type: 0 00002000:00010000:2.0:1746066797.352459:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e636680 00000100:00100000:0.0:1746066797.353644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.354177:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977067136 00000100:00100000:2.0:1746066797.354184:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977067136 00000100:00100000:2.0:1746066797.354548:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14857 00000100:00100000:2.0:1746066797.354558:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:31750:x1830882977067136:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066797.354585:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.354597:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed5e expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.354618:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e200/0xfb36a14ee608c0be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec0e expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.354626:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c1ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec7e expref: 19 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.354632:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608c17b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec4d expref: 25 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.354638:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066797.354640:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066797.354642:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->1413119] (req 1048576->1413119) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.354665:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608c17b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec4d expref: 25 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.354710:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608c17b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec4d expref: 25 pid: 8112 timeout: 858 lvb_type: 1 00000100:00100000:2.0:1746066797.354720:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976895744:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.354800:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c1ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec7e expref: 19 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.354808:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c1ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec7e expref: 19 pid: 21973 timeout: 858 lvb_type: 1 00000100:00100000:2.0:1746066797.354816:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976895872:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.354836:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e200/0xfb36a14ee608c0be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec0e expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.354843:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e200/0xfb36a14ee608c0be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec0e expref: 8 pid: 21203 timeout: 858 lvb_type: 1 00000100:00100000:2.0:1746066797.354850:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976896000:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066797.356203:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.357000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.357160:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976895744:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066797.357170:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976895872:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066797.357177:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976896000:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.357202:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->1413119] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.357219:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4aae800, rc 0) 00000100:00100000:2.0:1746066797.357259:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31750:x1830882977067136:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2702us (3618us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.357262:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977067264 00000100:00100000:2.0:1746066797.357265:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14857 00000100:00100000:3.0:1746066797.357267:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977067264 00010000:00010000:3.0:1746066797.357288:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 28 pid: 4614 timeout: 858 lvb_type: 0 00000100:00100000:3.0:1746066797.357320:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7639 00000100:00100000:3.0:1746066797.357326:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+28:1966:x1830882977067264:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066797.357337:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066797.357352:0:15727:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066795 -> 1746066797 00002000:00010000:3.0:1746066797.357355:0:15727:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066795 -> 1746066797 00010000:00010000:3.0:1746066797.357361:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 28 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066797.357371:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 28 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066797.357389:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4aafe00/0xfb36a14ee608c32d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed42 expref: 28 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066797.357402:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.357404:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.357408:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ed5600/0xfb36a14ee608c33b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed50 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.357416:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed5600/0xfb36a14ee608c33b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed50 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.357422:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.357423:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.358413:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801311a1400/0xfb36a14ee608c342 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed57 expref: 35 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.358422:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801311a1400/0xfb36a14ee608c342 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed57 expref: 35 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.358726:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801311a1400/0xfb36a14ee608c342 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed57 expref: 35 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066797.358741:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976896128:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066797.358952:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093ed5600/0xfb36a14ee608c33b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed50 expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066797.358964:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976896256:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066797.358999:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.359305:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.359361:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.359375:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977067392 00000100:00100000:0.0:1746066797.359378:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977067392 00010000:00010000:0.0:1746066797.359394:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e200/0xfb36a14ee608c0be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec0e expref: 9 pid: 21203 timeout: 858 lvb_type: 1 00000100:00100000:0.0:1746066797.359418:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977067520 00000100:00100000:0.0:1746066797.359420:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977067520 00010000:00010000:0.0:1746066797.359427:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c1ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec7e expref: 20 pid: 21973 timeout: 858 lvb_type: 1 00000100:00100000:0.0:1746066797.359436:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7640 00000100:00100000:0.0:1746066797.359440:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882977067392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066797.359441:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7641 00010000:00010000:0.0:1746066797.359447:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066797.359448:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977067520:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066797.359455:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066797.359460:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e200/0xfb36a14ee608c0be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec0e expref: 9 pid: 21203 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.359465:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c1ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec7e expref: 20 pid: 21973 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746066797.359472:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e200/0xfb36a14ee608c0be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec0e expref: 9 pid: 21203 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.359666:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c1ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec7e expref: 20 pid: 21973 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746066797.359698:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cb6e200/0xfb36a14ee608c0be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec0e expref: 9 pid: 21203 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.359703:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c1ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec7e expref: 20 pid: 21973 timeout: 858 lvb_type: 1 00010000:00010000:3.0:1746066797.359712:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066797.359722:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066797.359743:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1966:x1830882977067392:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 302us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.359744:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977067520:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 296us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.359748:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7640 00000100:00100000:3.0:1746066797.359751:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7641 00000100:00100000:2.0:1746066797.362134:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.362342:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977067648 00000100:00100000:0.0:1746066797.362349:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977067648 00010000:00010000:0.0:1746066797.362370:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608c17b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec4d expref: 25 pid: 8112 timeout: 858 lvb_type: 1 00000100:00100000:0.0:1746066797.362399:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7642 00000100:00100000:0.0:1746066797.362405:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977067648:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066797.362413:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066797.362427:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608c17b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec4d expref: 25 pid: 8112 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746066797.362436:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608c17b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec4d expref: 25 pid: 8112 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746066797.362451:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eea3e00/0xfb36a14ee608c17b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec4d expref: 25 pid: 8112 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746066797.362462:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.362464:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.362469:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.362475:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.362499:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.362508:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976896384:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066797.362573:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21f840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066797.363055:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976896128:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066797.363066:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976896256:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066797.363078:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066797.363109:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977067264:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5783us (6116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.363116:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7639 00000100:00100000:0.0:1746066797.364181:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.364357:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977067904 00000100:00100000:2.0:1746066797.364362:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977067904 00002000:00100000:2.0:1746066797.364389:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135e5e300 x1830882977067904/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066797.364397:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5e300 with x1830882977067904 ext(3145728->4194303) 00002000:00010000:2.0:1746066797.364400:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5e300 00000100:00100000:2.0:1746066797.364540:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6750 00000100:00100000:2.0:1746066797.364547:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1965:x1830882977067904:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066797.367834:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976896384:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066797.367849:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066797.367876:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977067648:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5470us (5746us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.367884:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7642 00000100:00100000:0.0:1746066797.367938:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.368440:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977068160 00000100:00100000:3.0:1746066797.368447:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977068160 00002000:00100000:3.0:1746066797.368478:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135e5ca80 x1830882977068160/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.368487:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ca80 with x1830882977068160 ext(3145728->4194303) 00002000:00010000:3.0:1746066797.368490:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5ca80 00000100:00100000:3.0:1746066797.368514:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6751 00000100:00100000:3.0:1746066797.368520:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977068160:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066797.371264:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.372168:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977068416 00000100:00100000:1.0:1746066797.372176:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977068416 00002000:00100000:1.0:1746066797.372209:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1409024->1413119) req@ffff88009ed72a00 x1830882977068416/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066797.372218:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed72a00 with x1830882977068416 ext(1409024->1413119) 00002000:00010000:1.0:1746066797.372222:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed72a00 00000100:00100000:1.0:1746066797.372247:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6752 00000100:00100000:1.0:1746066797.372254:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977068416:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066797.372392:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977068416:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 138us (1133us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066797.372397:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6752 00002000:00100000:1.0:1746066797.372402:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1409024->1413119) req@ffff88009ed72a00 x1830882977068416/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/4536 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066797.372408:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed72a00 with x1830882977068416 ext(1409024->1413119) 00002000:00010000:1.0:1746066797.372410:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed72a00 00000100:00100000:2.0:1746066797.374547:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1965:x1830882977067904:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 9994us (10362us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066797.374556:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6750 00002000:00100000:2.0:1746066797.374574:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135e5e300 x1830882977067904/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066797.374583:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5e300 with x1830882977067904 ext(3145728->4194303) 00002000:00010000:2.0:1746066797.374587:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5e300 00000100:00100000:3.0:1746066797.379748:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977068160:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11220us (11800us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066797.379759:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6751 00002000:00100000:3.0:1746066797.379769:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135e5ca80 x1830882977068160/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.379777:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ca80 with x1830882977068160 ext(3145728->4194303) 00002000:00010000:3.0:1746066797.379781:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5ca80 00000100:00100000:0.0:1746066797.381738:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.381991:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977068672 00000100:00100000:2.0:1746066797.382000:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977068672 00000100:00100000:2.0:1746066797.382045:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4209 00000100:00100000:2.0:1746066797.382052:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:31750:x1830882977068672:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066797.382230:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+258:31750:x1830882977068672:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 178us (497us total) trans 8589944127 rc 0/0 00000100:00100000:2.0:1746066797.382236:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4209 00000100:00100000:0.0:1746066797.387628:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.387744:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.387819:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977068800 00000100:00100000:1.0:1746066797.387826:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977068800 00000100:00100000:1.0:1746066797.387857:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977068928 00000100:00100000:1.0:1746066797.387859:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977068928 00000100:00100000:1.0:1746066797.387875:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14858 00000100:00100000:1.0:1746066797.387881:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:31754:x1830882977068800:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066797.387897:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066797.387911:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801311a0000/0xfb36a14ee608c350 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed65 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.387935:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3371008->18446744073709551615] (req 3371008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.387941:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066797.387943:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066797.387946:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801311a0000/0xfb36a14ee608c350 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed65 expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.387969:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3371008->18446744073709551615] (req 3371008->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.387978:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3371008->18446744073709551615] (req 3371008->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 20 pid: 8450 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746066797.387987:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e636d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976896512:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066797.388054:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066797.388070:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14859 00000100:00100000:1.0:1746066797.388075:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:31757:x1830882977068928:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066797.388080:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066797.388086:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801311a0600/0xfb36a14ee608c357 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed6c expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.388100:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066797.388103:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801311a0600/0xfb36a14ee608c357 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed6c expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.388110:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801311a0600/0xfb36a14ee608c357 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed6c expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.388117:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801311a0600, rc 0) 00000100:00100000:1.0:1746066797.388132:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31757:x1830882977068928:12345-192.168.202.57@tcp:101:cat.0 Request processed in 58us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.388137:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14859 00000100:00100000:0.0:1746066797.392267:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.392512:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977069056 00000100:00100000:3.0:1746066797.392520:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977069056 00002000:00100000:3.0:1746066797.392555:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3371008->4194303) req@ffff880135e5ed80 x1830882977069056/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.392603:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ed80 with x1830882977069056 ext(3371008->4194303) 00010000:00010000:3.0:1746066797.392611:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [3371008->18446744073709551615] (req 3371008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 21 pid: 8450 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066797.392625:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [3371008->18446744073709551615] (req 3371008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 21 pid: 8450 timeout: 858 lvb_type: 0 00002000:00010000:3.0:1746066797.392630:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135e5ed80 00000100:00100000:3.0:1746066797.392661:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2190 00000100:00100000:3.0:1746066797.392668:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977069056:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066797.393531:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e636d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976896512:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066797.393574:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801311a0000/0xfb36a14ee608c350 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed65 expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.393587:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801311a0000, rc 0) 00000100:00100000:1.0:1746066797.393612:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:31754:x1830882977068800:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5731us (5991us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.393618:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14858 00000100:00100000:3.0:1746066797.405788:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977069056:12345-192.168.202.57@tcp:4:cat.0 Request processed in 13112us (13520us total) trans 21474840972 rc 0/0 00000100:00100000:3.0:1746066797.405798:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2190 00002000:00100000:3.0:1746066797.405807:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3371008->4194303) req@ffff880135e5ed80 x1830882977069056/t21474840972(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/448 e 0 to 0 dl 1746066808 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.405815:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ed80 with x1830882977069056 ext(3371008->4194303) 00010000:00010000:3.0:1746066797.405823:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [3371008->18446744073709551615] (req 3371008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 22 pid: 8450 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066797.405837:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [3371008->18446744073709551615] (req 3371008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 22 pid: 8450 timeout: 858 lvb_type: 0 00002000:00010000:3.0:1746066797.405842:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135e5ed80 00000100:00100000:0.0:1746066797.417324:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.417578:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977069184 00000100:00100000:2.0:1746066797.417585:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977069184 00010000:00010000:2.0:1746066797.417616:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [3371008->18446744073709551615] (req 3371008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 22 pid: 8450 timeout: 858 lvb_type: 0 00000100:00100000:2.0:1746066797.417655:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7643 00000100:00100000:2.0:1746066797.417661:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977069184:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066797.417700:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066797.417716:0:9852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066795 -> 1746066797 00002000:00010000:2.0:1746066797.417718:0:9852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066792 -> 1746066797 00002000:00010000:2.0:1746066797.417720:0:9852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066795 -> 1746066797 00010000:00010000:2.0:1746066797.417725:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [3371008->18446744073709551615] (req 3371008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 22 pid: 8450 timeout: 858 lvb_type: 0 00010000:00010000:2.0:1746066797.417735:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [3371008->18446744073709551615] (req 3371008->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 22 pid: 8450 timeout: 858 lvb_type: 0 00010000:00010000:2.0:1746066797.417753:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c318 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [3371008->18446744073709551615] (req 3371008->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed2d expref: 22 pid: 8450 timeout: 858 lvb_type: 0 00010000:00010000:2.0:1746066797.417785:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066797.417787:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066797.417793:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801311a0000/0xfb36a14ee608c350 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed65 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.417800:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801311a0000/0xfb36a14ee608c350 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed65 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.417806:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066797.417807:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066797.417810:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801311a0600/0xfb36a14ee608c357 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed6c expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.417815:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801311a0600/0xfb36a14ee608c357 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed6c expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.417840:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801311a0600/0xfb36a14ee608c357 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed6c expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066797.417850:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976896640:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066797.417918:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801311a0000/0xfb36a14ee608c350 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed65 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066797.417925:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976896768:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066797.417941:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dc000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066797.420118:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976896640:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066797.420486:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976896768:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066797.420504:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066797.420545:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977069184:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2882us (3228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.420554:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7643 00000100:00100000:0.0:1746066797.425055:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.425093:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.425294:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977069440 00000100:00100000:3.0:1746066797.425302:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977069440 00002000:00100000:3.0:1746066797.425335:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135e5ea00 x1830882977069440/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.425345:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ea00 with x1830882977069440 ext(3145728->4194303) 00002000:00010000:3.0:1746066797.425349:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5ea00 00000100:00100000:3.0:1746066797.425363:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977069696 00000100:00100000:3.0:1746066797.425365:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977069696 00002000:00100000:3.0:1746066797.425377:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135e5f800 x1830882977069696/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.425382:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5f800 with x1830882977069696 ext(3145728->4194303) 00002000:00010000:3.0:1746066797.425385:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5f800 00000100:00100000:3.0:1746066797.425396:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6753 00000100:00100000:3.0:1746066797.425403:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977069440:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066797.426412:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6754 00000100:00100000:2.0:1746066797.426420:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977069696:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066797.438509:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977069696:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12085us (13409us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066797.438519:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6754 00002000:00100000:2.0:1746066797.438529:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135e5f800 x1830882977069696/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066797.438538:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5f800 with x1830882977069696 ext(3145728->4194303) 00000100:00100000:3.0:1746066797.438543:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977069440:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 13065us (13419us total) trans 0 rc 1048576/1048576 00002000:00010000:2.0:1746066797.438543:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5f800 00000100:00100000:3.0:1746066797.438551:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6753 00002000:00100000:3.0:1746066797.438557:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135e5ea00 x1830882977069440/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.438576:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ea00 with x1830882977069440 ext(3145728->4194303) 00002000:00010000:3.0:1746066797.438579:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5ea00 00000100:00100000:0.0:1746066797.445632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.445669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.445734:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.445816:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977070208 00000100:00100000:3.0:1746066797.445824:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977070208 00000100:00100000:1.0:1746066797.445829:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977069824 00000100:00100000:1.0:1746066797.445833:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977069824 00002000:00100000:3.0:1746066797.445860:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880135e5c380 x1830882977070208/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066797.445971:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977069952 00000100:00100000:1.0:1746066797.445974:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977069952 00002000:00100000:3.0:1746066797.445984:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5c380 with x1830882977070208 ext(4194304->5091327) 00002000:00010000:3.0:1746066797.445989:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5c380 00000100:00100000:1.0:1746066797.445992:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14860 00000100:00100000:1.0:1746066797.445998:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977069824:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066797.446003:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6755 00000100:00100000:3.0:1746066797.446009:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1965:x1830882977070208:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:1.0:1746066797.446017:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066797.446030:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131d77e00/0xfb36a14ee608c35e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed73 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066797.446068:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e636d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976896896:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066797.446125:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066797.446140:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14861 00000100:00100000:1.0:1746066797.446145:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882977069952:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066797.446151:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066797.446157:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131d77200/0xfb36a14ee608c365 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed7a expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066797.446175:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976897024:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066797.446191:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abcc0 going to sleep for 11 seconds 00002000:00010000:0.0:1746066797.448269:0:4614:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime: 1746066794 -> 1746066797 00002000:00010000:0.0:1746066797.448274:0:4614:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime: 1746066794 -> 1746066797 00002000:00010000:0.0:1746066797.448276:0:4614:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime: 1746066794 -> 1746066797 00000100:00100000:0.0:1746066797.448294:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e636d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976896896:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066797.448319:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131d77e00/0xfb36a14ee608c35e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed73 expref: 24 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.448330:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131d77e00/0xfb36a14ee608c35e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed73 expref: 24 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.448352:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131d77e00, rc 0) 00000100:00100000:0.0:1746066797.448377:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882977069824:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2379us (2753us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066797.448383:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14860 00002000:00010000:1.0:1746066797.448548:0:8451:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime: 1746066794 -> 1746066797 00002000:00010000:1.0:1746066797.448551:0:8451:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime: 1746066794 -> 1746066797 00002000:00010000:1.0:1746066797.448553:0:8451:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime: 1746066794 -> 1746066797 00000100:00100000:1.0:1746066797.448572:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976897024:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066797.448586:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131d77200/0xfb36a14ee608c365 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed7a expref: 22 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066797.448594:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131d77200/0xfb36a14ee608c365 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed7a expref: 22 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066797.448603:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131d77200, rc 0) 00000100:00100000:1.0:1746066797.448618:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977069952:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2473us (2949us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066797.448622:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14861 00000100:00100000:3.0:1746066797.453342:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1965:x1830882977070208:12345-192.168.202.57@tcp:3:cat.0 Request processed in 7325us (7599us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066797.453353:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6755 00002000:00100000:3.0:1746066797.453363:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880135e5c380 x1830882977070208/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.453372:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5c380 with x1830882977070208 ext(4194304->5091327) 00002000:00010000:3.0:1746066797.453377:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5c380 00000100:00100000:0.0:1746066797.453837:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.453968:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977070464 00000100:00100000:3.0:1746066797.453975:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977070464 00002000:00100000:3.0:1746066797.453999:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880135e5d500 x1830882977070464/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.454006:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5d500 with x1830882977070464 ext(4194304->5091327) 00002000:00010000:3.0:1746066797.454009:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5d500 00000100:00100000:3.0:1746066797.454032:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6756 00000100:00100000:3.0:1746066797.454038:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977070464:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066797.468464:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977070464:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14418us (14619us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066797.468474:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6756 00002000:00100000:3.0:1746066797.468484:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880135e5d500 x1830882977070464/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.468498:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5d500 with x1830882977070464 ext(4194304->5091327) 00002000:00010000:3.0:1746066797.468503:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5d500 00000100:00100000:0.0:1746066797.477753:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.477800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.478923:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977070720 00000100:00100000:1.0:1746066797.478931:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977070720 00000100:00100000:1.0:1746066797.478963:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977070592 00000100:00100000:1.0:1746066797.478965:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977070592 00000100:00100000:0.0:1746066797.478977:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14862 00000100:00100000:0.0:1746066797.478987:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977070720:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:2.0:1746066797.478994:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14863 00000100:00100000:2.0:1746066797.479001:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977070592:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066797.479001:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.479008:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.479015:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acd2600/0xfb36a14ee608c373 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed81 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.479015:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f77de00/0xfb36a14ee608c36c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed88 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066797.479055:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976897152:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066797.479055:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976897280:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066797.479112:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21f840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066797.479160:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dc000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066797.481949:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976897280:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066797.481974:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f77de00/0xfb36a14ee608c36c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed88 expref: 24 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.481985:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f77de00/0xfb36a14ee608c36c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed88 expref: 24 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.481999:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f77de00, rc 0) 00000100:00100000:2.0:1746066797.482045:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882977070720:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3059us (4298us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066797.482051:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14862 00000100:00100000:3.0:1746066797.482139:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976897152:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066797.482155:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acd2600/0xfb36a14ee608c373 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed81 expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.482163:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009acd2600/0xfb36a14ee608c373 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed81 expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.482174:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd2600, rc 0) 00000100:00100000:3.0:1746066797.482190:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977070592:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3190us (4390us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066797.482195:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14863 00000100:00100000:0.0:1746066797.484632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.484672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.484788:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977070848 00000100:00100000:3.0:1746066797.484795:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977070848 00000100:00100000:3.0:1746066797.484829:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977070976 00000100:00100000:3.0:1746066797.484831:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977070976 00000100:00100000:3.0:1746066797.484846:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14864 00000100:00100000:3.0:1746066797.484852:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1966:x1830882977070848:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066797.484866:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066797.484878:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c37a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed8f expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066797.484917:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976897408:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066797.484978:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066797.484994:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14865 00000100:00100000:3.0:1746066797.485000:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882977070976:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066797.485006:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066797.485012:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff41c00/0xfb36a14ee608c381 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed96 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066797.485029:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976897536:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066797.485058:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066797.486422:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976897408:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066797.486556:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976897536:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066797.486583:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff41c00/0xfb36a14ee608c381 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed96 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.486592:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff41c00/0xfb36a14ee608c381 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed96 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.486601:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff41c00, rc 0) 00000100:00100000:3.0:1746066797.486626:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882977070976:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1625us (1952us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066797.486632:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14865 00010000:00010000:2.0:1746066797.486688:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c37a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed8f expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.486696:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bac200/0xfb36a14ee608c37a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed8f expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.486702:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bac200, rc 0) 00000100:00100000:2.0:1746066797.486718:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:1966:x1830882977070848:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1866us (2092us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066797.486722:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14864 00000100:00100000:0.0:1746066797.490087:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.490331:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977071232 00000100:00100000:2.0:1746066797.490338:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977071232 00000100:00100000:2.0:1746066797.490372:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4210 00000100:00100000:2.0:1746066797.490378:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4a0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:31754:x1830882977071232:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066797.490548:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4a0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+15:31754:x1830882977071232:12345-192.168.202.57@tcp:35:cat.0 Request processed in 168us (467us total) trans 8589944128 rc 0/0 00000100:00100000:2.0:1746066797.490553:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4210 00000100:00100000:0.0:1746066797.512946:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.513122:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977071488 00000100:00100000:2.0:1746066797.513130:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977071488 00000100:00100000:2.0:1746066797.513178:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10058 00000100:00100000:2.0:1746066797.513185:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+258:31764:x1830882977071488:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066797.513205:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.513219:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c388 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ed9d expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.513289:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.513300:0:16018:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecee expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.513306:0:16018:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf000/0xfb36a14ee608c2af lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecfc expref: 259 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.513312:0:16018:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c456800/0xfb36a14ee608c2e0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed0a expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.513317:0:16018:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 6/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.513341:0:16018:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c456800/0xfb36a14ee608c2e0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed0a expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.513355:0:16018:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c456800/0xfb36a14ee608c2e0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed0a expref: 14 pid: 14549 timeout: 858 lvb_type: 0 00000100:00100000:2.0:1746066797.513365:0:16018:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882976897664:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.513437:0:16018:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf000/0xfb36a14ee608c2af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecfc expref: 259 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.513444:0:16018:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf000/0xfb36a14ee608c2af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecfc expref: 259 pid: 14548 timeout: 858 lvb_type: 0 00000100:00100000:2.0:1746066797.513451:0:16018:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882976897792:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.513470:0:16018:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecee expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.513477:0:16018:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecee expref: 8 pid: 14548 timeout: 858 lvb_type: 0 00000100:00100000:2.0:1746066797.513483:0:16018:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882976897920:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066797.513494:0:16018:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dc540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.517192:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.517220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.517245:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.517285:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977071744 00000100:00100000:0.0:1746066797.517291:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977071744 00000100:00100000:1.0:1746066797.517294:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977071616 00000100:00100000:1.0:1746066797.517298:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977071616 00010000:00010000:1.0:1746066797.517323:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c456800/0xfb36a14ee608c2e0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed0a expref: 15 pid: 14549 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746066797.517344:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977071872 00000100:00100000:1.0:1746066797.517346:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977071872 00010000:00010000:1.0:1746066797.517353:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecee expref: 9 pid: 14548 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746066797.517365:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7644 00000100:00100000:1.0:1746066797.517370:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977071616:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066797.517381:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066797.517385:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c456800/0xfb36a14ee608c2e0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed0a expref: 15 pid: 14549 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.517393:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c456800/0xfb36a14ee608c2e0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed0a expref: 15 pid: 14549 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.517410:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066797.517414:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.517424:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.517428:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066797.517453:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c456800/0xfb36a14ee608c2e0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed0a expref: 15 pid: 14549 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746066797.517461:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977071616:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 90us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.517466:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7644 00000100:00100000:2.0:1746066797.517470:0:16018:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882976897664:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066797.517478:0:16018:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882976897792:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066797.517478:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7645 00000100:00100000:1.0:1746066797.517482:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977071872:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066797.517484:0:16018:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882976897920:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066797.517488:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066797.517491:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecee expref: 9 pid: 14548 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.517497:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecee expref: 9 pid: 14548 timeout: 858 lvb_type: 0 00010000:00010000:2.0:1746066797.517504:0:16018:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.517506:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f095400/0xfb36a14ee608c28c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecee expref: 9 pid: 14548 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.517517:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066797.517519:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.517523:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.517527:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066797.517539:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977071872:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 57us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.517545:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7645 00010000:00010000:0.0:1746066797.518161:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf000/0xfb36a14ee608c2af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecfc expref: 260 pid: 14548 timeout: 858 lvb_type: 0 00000100:00100000:3.0:1746066797.518897:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7646 00000100:00100000:3.0:1746066797.518906:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:1966:x1830882977071744:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066797.518914:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066797.518919:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf000/0xfb36a14ee608c2af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecfc expref: 260 pid: 14548 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066797.518931:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf000/0xfb36a14ee608c2af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecfc expref: 260 pid: 14548 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066797.518942:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aaf000/0xfb36a14ee608c2af lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ecfc expref: 260 pid: 14548 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066797.519051:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066797.519055:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066797.519061:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066797.519067:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066797.519132:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066797.519174:0:16018:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.519181:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:2.0:1746066797.519194:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000100:00100000:3.0:1746066797.519246:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:1966:x1830882977071744:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 341us (2058us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.519251:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7646 00010000:00010000:2.0:1746066797.519500:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c388 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed9d expref: 260 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.519511:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed9d expref: 259 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.519516:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066797.519518:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066797.519520:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd2000, rc 0) 00000100:00100000:2.0:1746066797.519550:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:31764:x1830882977071488:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6366us (6610us total) trans 8589944129 rc 0/0 00000100:00100000:2.0:1746066797.519556:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10058 00000100:00100000:0.0:1746066797.575786:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.575849:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977072128 00000100:00100000:2.0:1746066797.575856:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977072128 00000100:00100000:2.0:1746066797.575901:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10059 00000100:00100000:2.0:1746066797.575907:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:31767:x1830882977072128:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066797.575928:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.575942:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41c00/0xfb36a14ee608c39d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eda4 expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.576031:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608c3a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576041:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608c3a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576049:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608c3a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576060:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608c3ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576065:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608c3ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576070:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608c3ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576157:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c3b2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576164:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576169:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:2.0:1746066797.576177:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066797.576243:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608c3a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576249:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608c3a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576257:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608c3a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576262:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ff40800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066797.576265:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608c3a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576270:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608c3a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576280:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066797.576282:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066797.576285:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608c3a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576290:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40800/0xfb36a14ee608c3a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576313:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608c3ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576317:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608c3ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576321:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608c3ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576325:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ff40a00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066797.576326:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608c3ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576330:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608c3ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576340:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebebe00) 00010000:00010000:2.0:1746066797.576341:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066797.576343:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608c3ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576347:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40a00/0xfb36a14ee608c3ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066797.576378:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41c00/0xfb36a14ee608c39d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eda4 expref: 17 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.576387:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eda4 expref: 16 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.576392:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066797.576394:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066797.576396:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd2200, rc 0) 00000100:00100000:2.0:1746066797.576442:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:31767:x1830882977072128:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 534us (663us total) trans 8589944130 rc 0/0 00000100:00100000:2.0:1746066797.576447:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10059 00000100:00100000:0.0:1746066797.594639:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.594979:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977072384 00000100:00100000:1.0:1746066797.594986:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977072384 00000100:00100000:1.0:1746066797.595023:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10060 00000100:00100000:1.0:1746066797.595030:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:31770:x1830882977072384:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066797.595050:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066797.595063:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76a00/0xfb36a14ee608c3c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97edab expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.595147:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76600/0xfb36a14ee608c3c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.595157:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76600/0xfb36a14ee608c3c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.595166:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76600/0xfb36a14ee608c3c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.595175:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c3ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.595180:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c3ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.595184:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c3ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.595256:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76200/0xfb36a14ee608c3d5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.595262:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76200/0xfb36a14ee608c3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.595267:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76200/0xfb36a14ee608c3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:1.0:1746066797.595274:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066797.596463:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76600/0xfb36a14ee608c3c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.596472:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76600/0xfb36a14ee608c3c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.596478:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76600/0xfb36a14ee608c3c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.596482:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131d76600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066797.596485:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76600/0xfb36a14ee608c3c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.596490:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76600/0xfb36a14ee608c3c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.596500:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066797.596503:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066797.596506:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76600/0xfb36a14ee608c3c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.596510:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76600/0xfb36a14ee608c3c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.596948:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c3ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.596953:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c3ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.596962:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c3ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.596966:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131d76400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066797.596968:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c3ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.596973:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c3ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.596979:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13f00) 00010000:00010000:1.0:1746066797.596981:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066797.596983:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c3ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.596987:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c3ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066797.597024:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76a00/0xfb36a14ee608c3c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edab expref: 262 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.597035:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76200/0xfb36a14ee608c3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edab expref: 261 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.597041:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066797.597043:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066797.597045:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131d76200, rc 0) 00000100:00100000:1.0:1746066797.597397:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:31770:x1830882977072384:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2365us (2762us total) trans 8589944131 rc 0/0 00000100:00100000:1.0:1746066797.597404:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10060 00000100:00100000:0.0:1746066797.601652:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.601715:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977072640 00000100:00100000:2.0:1746066797.601723:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977072640 00000100:00100000:2.0:1746066797.601776:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4211 00000100:00100000:2.0:1746066797.601785:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:31770:x1830882977072640:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066797.601962:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:31770:x1830882977072640:12345-192.168.202.57@tcp:35:cat.0 Request processed in 176us (316us total) trans 8589944132 rc 0/0 00000100:00100000:2.0:1746066797.601968:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4211 00000100:00100000:0.0:1746066797.612263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.612312:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.612387:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977072896 00000100:00100000:3.0:1746066797.612394:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977072896 00002000:00100000:3.0:1746066797.612431:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->1695743) req@ffff88009b7f9500 x1830882977072896/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.612441:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f9500 with x1830882977072896 ext(1048576->1695743) 00002000:00010000:3.0:1746066797.612445:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7f9500 00000100:00100000:3.0:1746066797.612470:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977073152 00000100:00100000:3.0:1746066797.612472:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977073152 00002000:00100000:3.0:1746066797.612483:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1413120->2097151) req@ffff88009b7fb800 x1830882977073152/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.612489:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fb800 with x1830882977073152 ext(1413120->2097151) 00002000:00010000:3.0:1746066797.612491:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7fb800 00000100:00100000:3.0:1746066797.612504:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6757 00000100:00100000:3.0:1746066797.612509:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977072896:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066797.613729:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6758 00000100:00100000:3.0:1746066797.613737:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977073152:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066797.624193:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977072896:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11675us (11929us total) trans 0 rc 647168/647168 00000100:00100000:3.0:1746066797.624203:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6757 00002000:00100000:3.0:1746066797.624213:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->1695743) req@ffff88009b7f9500 x1830882977072896/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 647168/647168 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.624222:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f9500 with x1830882977072896 ext(1048576->1695743) 00002000:00010000:3.0:1746066797.624227:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7f9500 00000100:00100000:3.0:1746066797.633823:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977073152:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20072us (21496us total) trans 0 rc 684032/684032 00000100:00100000:3.0:1746066797.633835:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6758 00002000:00100000:3.0:1746066797.633847:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1413120->2097151) req@ffff88009b7fb800 x1830882977073152/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 684032/684032 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.633856:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fb800 with x1830882977073152 ext(1413120->2097151) 00002000:00010000:3.0:1746066797.633861:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7fb800 00000100:00100000:0.0:1746066797.637855:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.637981:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977073280 00000100:00100000:2.0:1746066797.637989:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977073280 00000100:00100000:2.0:1746066797.638444:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14866 00000100:00100000:2.0:1746066797.638452:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:31767:x1830882977073280:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066797.638468:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.638483:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97edb2 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.638508:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.638515:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066797.638516:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066797.638519:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1732608->2097151] (req 1732608->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.638544:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.638554:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 24 pid: 4614 timeout: 858 lvb_type: 0 00000100:00100000:2.0:1746066797.638577:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976898048:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066797.640315:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dc180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.644034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.644073:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.644179:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977073536 00000100:00100000:3.0:1746066797.644187:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977073536 00002000:00100000:3.0:1746066797.644224:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009b7f9880 x1830882977073536/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.644233:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f9880 with x1830882977073536 ext(2097152->3145727) 00002000:00010000:3.0:1746066797.644238:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7f9880 00000100:00100000:3.0:1746066797.644250:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977073664 00000100:00100000:3.0:1746066797.644253:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977073664 00002000:00100000:3.0:1746066797.644263:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1695744->2097151) req@ffff88009b7f8380 x1830882977073664/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.644270:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f8380 with x1830882977073664 ext(1695744->2097151) 00010000:00010000:3.0:1746066797.644276:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 25 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:3.0:1746066797.644287:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 25 pid: 4614 timeout: 858 lvb_type: 0 00002000:00010000:3.0:1746066797.644292:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b7f8380 00000100:00100000:2.0:1746066797.644546:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976898048:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.644578:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1732608->2097151] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.644595:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009acd2400, rc 0) 00000100:00100000:2.0:1746066797.644631:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:31767:x1830882977073280:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6180us (6783us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.644637:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14866 00000100:00100000:3.0:1746066797.644812:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2191 00000100:00100000:3.0:1746066797.644819:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882977073664:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066797.645546:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6759 00000100:00100000:2.0:1746066797.645553:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882977073536:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066797.692879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.692906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.692937:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.692957:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.692974:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977073792 00000100:00100000:1.0:1746066797.692981:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977073792 00000100:00100000:1.0:1746066797.693011:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 221 00000100:00100000:1.0:1746066797.693018:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69ee3f12-76db-44fe-a8c9-a42ead582d61+15:1965:x1830882977073792:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1746066797.693063:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69ee3f12-76db-44fe-a8c9-a42ead582d61+15:1965:x1830882977073792:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 45us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.693069:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 221 00000100:00100000:1.0:1746066797.693101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.693115:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977073920 00000100:00100000:1.0:1746066797.693117:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977073920 00000100:00100000:1.0:1746066797.693132:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977074176 00000100:00100000:1.0:1746066797.693133:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977074176 00000100:00100000:1.0:1746066797.693143:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977074048 00000100:00100000:1.0:1746066797.693144:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977074048 00000100:00100000:1.0:1746066797.693156:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 360 00000100:00100000:1.0:1746066797.693161:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882977073920:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1746066797.693181:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882977073920:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 21us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.693186:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 360 00000100:00100000:1.0:1746066797.693194:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 361 00000100:00100000:1.0:1746066797.693198:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1965:x1830882977074176:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1746066797.693198:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977074432 00000100:00100000:0.0:1746066797.693203:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977074432 00000100:00100000:1.0:1746066797.693212:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1965:x1830882977074176:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 14us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.693217:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 361 00000100:00100000:1.0:1746066797.693223:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 362 00000100:00100000:1.0:1746066797.693227:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977074048:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1746066797.693231:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10061 00000100:00100000:0.0:1746066797.693236:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:31772:x1830882977074432:12345-192.168.202.57@tcp:101:multiop.0 00000100:00100000:1.0:1746066797.693241:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977074048:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 14us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.693246:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 362 00010000:00010000:0.0:1746066797.693253:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.693267:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c400/0xfb36a14ee608c3ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97edb9 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.693351:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d800/0xfb36a14ee608c3f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693362:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d800/0xfb36a14ee608c3f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693371:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d800/0xfb36a14ee608c3f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693381:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c200/0xfb36a14ee608c3f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693386:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c200/0xfb36a14ee608c3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693391:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c200/0xfb36a14ee608c3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693474:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c000/0xfb36a14ee608c3ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693481:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c000/0xfb36a14ee608c3ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693486:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c000/0xfb36a14ee608c3ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:0.0:1746066797.693492:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066797.693553:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d800/0xfb36a14ee608c3f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693573:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d800/0xfb36a14ee608c3f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693578:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d800/0xfb36a14ee608c3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693584:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f77d800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066797.693587:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d800/0xfb36a14ee608c3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693592:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d800/0xfb36a14ee608c3f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693601:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066797.693604:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066797.693609:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d800/0xfb36a14ee608c3f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693613:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d800/0xfb36a14ee608c3f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693627:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c200/0xfb36a14ee608c3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693631:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c200/0xfb36a14ee608c3f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693635:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c200/0xfb36a14ee608c3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693639:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f77c200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066797.693641:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c200/0xfb36a14ee608c3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693648:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c200/0xfb36a14ee608c3f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693653:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009d6bd100) 00010000:00010000:0.0:1746066797.693655:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066797.693657:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c200/0xfb36a14ee608c3f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693660:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c200/0xfb36a14ee608c3f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.693702:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c400/0xfb36a14ee608c3ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb9 expref: 265 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.693712:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c000/0xfb36a14ee608c3ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb9 expref: 264 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.693717:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066797.693718:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066797.693720:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f77c000, rc 0) 00000100:00100000:0.0:1746066797.693749:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:31772:x1830882977074432:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 512us (842us total) trans 8589944133 rc 0/0 00000100:00100000:0.0:1746066797.693754:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10061 00000100:00100000:0.0:1746066797.693785:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882977073536:12345-192.168.202.57@tcp:3:cat.0 Request processed in 48233us (49759us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066797.693791:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6759 00002000:00100000:0.0:1746066797.693798:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009b7f9880 x1830882977073536/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066797.693812:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f9880 with x1830882977073536 ext(2097152->3145727) 00002000:00010000:0.0:1746066797.693816:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7f9880 00000100:00100000:2.0:1746066797.695231:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882977073664:12345-192.168.202.57@tcp:4:cat.0 Request processed in 50410us (51155us total) trans 21474840973 rc 0/0 00000100:00100000:2.0:1746066797.695239:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2191 00002000:00100000:2.0:1746066797.695246:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1695744->2097151) req@ffff88009b7f8380 x1830882977073664/t21474840973(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/448 e 0 to 0 dl 1746066808 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066797.695253:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f8380 with x1830882977073664 ext(1695744->2097151) 00010000:00010000:2.0:1746066797.695260:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 27 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:2.0:1746066797.695272:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 27 pid: 4614 timeout: 858 lvb_type: 0 00002000:00010000:2.0:1746066797.695278:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b7f8380 00000100:00100000:0.0:1746066797.698383:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.698434:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.698459:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977074816 00000100:00100000:0.0:1746066797.698464:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977074816 00000100:00100000:0.0:1746066797.698509:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 717 00000100:00100000:0.0:1746066797.698519:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:1964:x1830882977074816:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066797.698530:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066797.698549:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c000/0xfb36a14ee608c3ff lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb9 expref: 264 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.698572:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066797.698576:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066797.698606:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:1964:x1830882977074816:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 90us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.698612:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 717 00000100:00100000:2.0:1746066797.698853:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977074688 00000100:00100000:2.0:1746066797.698857:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977074688 00000100:00100000:2.0:1746066797.698878:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4212 00000100:00100000:2.0:1746066797.698883:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:31772:x1830882977074688:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066797.699030:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:31772:x1830882977074688:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 146us (652us total) trans 8589944134 rc 0/0 00000100:00100000:2.0:1746066797.699035:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4212 00000100:00100000:0.0:1746066797.699793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.699848:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977074944 00000100:00100000:1.0:1746066797.699852:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977074944 00010000:00010000:1.0:1746066797.699870:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 27 pid: 4614 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746066797.699888:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7647 00000100:00100000:1.0:1746066797.699894:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882977074944:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066797.699902:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066797.699917:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 27 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.699926:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 27 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.699940:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaee00/0xfb36a14ee608c334 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed49 expref: 27 pid: 4614 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.699964:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066797.699966:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066797.699972:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.699979:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.700003:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066797.700013:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976898176:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066797.700066:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066797.708345:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed0a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976898176:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066797.708363:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066797.708399:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1965:x1830882977074944:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8503us (8605us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.708408:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7647 00000100:00100000:0.0:1746066797.709557:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.709622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.709708:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977075328 00000100:00100000:1.0:1746066797.709715:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977075328 00000100:00100000:1.0:1746066797.709742:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14867 00000100:00100000:1.0:1746066797.709748:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1966:x1830882977075328:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066797.709763:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066797.709776:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c40d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97edc0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066797.709812:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976898304:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066797.709866:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066797.709932:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977075200 00000100:00100000:2.0:1746066797.709936:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977075200 00002000:00100000:2.0:1746066797.709960:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1732608->1736703) req@ffff88009b7f8700 x1830882977075200/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066797.709969:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f8700 with x1830882977075200 ext(1732608->1736703) 00002000:00010000:2.0:1746066797.709972:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7f8700 00000100:00100000:2.0:1746066797.709985:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6760 00000100:00100000:2.0:1746066797.709990:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882977075200:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066797.710096:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882977075200:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 106us (543us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066797.710101:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6760 00002000:00100000:2.0:1746066797.710106:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1732608->1736703) req@ffff88009b7f8700 x1830882977075200/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/4536 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066797.710112:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f8700 with x1830882977075200 ext(1732608->1736703) 00002000:00010000:2.0:1746066797.710114:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7f8700 00000100:00100000:1.0:1746066797.714412:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976898304:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066797.714439:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c40d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc0 expref: 27 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066797.714450:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf400/0xfb36a14ee608c40d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc0 expref: 27 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066797.714475:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4aaf400, rc 0) 00000100:00100000:1.0:1746066797.714522:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1966:x1830882977075328:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4773us (4899us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066797.714529:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14867 00000100:00100000:0.0:1746066797.719451:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.719529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.719630:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977075456 00000100:00100000:1.0:1746066797.719638:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977075456 00000100:00100000:1.0:1746066797.719670:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977075584 00000100:00100000:1.0:1746066797.719671:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977075584 00000100:00100000:1.0:1746066797.719707:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14868 00000100:00100000:1.0:1746066797.719715:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:31767:x1830882977075456:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066797.719729:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066797.719744:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97edc7 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.719767:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.719773:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066797.719776:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066797.719779:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->1224703] (req 1048576->1224703) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 23 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.719808:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.719818:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 26 pid: 8450 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746066797.719828:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976898432:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066797.719894:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0abf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066797.719954:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14869 00000100:00100000:1.0:1746066797.719960:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1965:x1830882977075584:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066797.719966:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066797.719972:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaec00/0xfb36a14ee608c41b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97edce expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066797.719998:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976898560:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066797.720019:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0aba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066797.724356:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976898432:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066797.724383:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->1224703] (req 1048576->1224703) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 23 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.724396:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4aaf200, rc 0) 00000100:00100000:1.0:1746066797.724431:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:31767:x1830882977075456:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4716us (4989us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.724442:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14868 00000100:00100000:2.0:1746066797.724535:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976898560:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066797.724556:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaec00/0xfb36a14ee608c41b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edce expref: 27 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.724577:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaec00/0xfb36a14ee608c41b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edce expref: 27 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.724589:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4aaec00, rc 0) 00000100:00100000:2.0:1746066797.724607:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1965:x1830882977075584:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4647us (5078us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066797.724612:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14869 00000100:00100000:0.0:1746066797.728083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.728151:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977075712 00000100:00100000:1.0:1746066797.728158:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977075712 00002000:00100000:1.0:1746066797.728191:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1413119) req@ffff88009a4edf80 x1830882977075712/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066797.728200:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4edf80 with x1830882977075712 ext(1048576->1413119) 00010000:00010000:1.0:1746066797.728207:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 26 pid: 8450 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.728217:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 26 pid: 8450 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746066797.728222:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4edf80 00000100:00100000:1.0:1746066797.728243:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2192 00000100:00100000:1.0:1746066797.728249:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1965:x1830882977075712:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066797.734209:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977075712:12345-192.168.202.57@tcp:4:cat.0 Request processed in 5951us (6124us total) trans 21474840974 rc 0/0 00000100:00100000:1.0:1746066797.734219:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2192 00002000:00100000:1.0:1746066797.734229:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1413119) req@ffff88009a4edf80 x1830882977075712/t21474840974(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/448 e 0 to 0 dl 1746066808 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066797.734237:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4edf80 with x1830882977075712 ext(1048576->1413119) 00010000:00010000:1.0:1746066797.734245:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 28 pid: 8450 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.734263:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 28 pid: 8450 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746066797.734269:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4edf80 00000100:00100000:0.0:1746066797.742820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.742847:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977075968 00000100:00100000:0.0:1746066797.742854:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977075968 00000100:00100000:0.0:1746066797.742885:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10062 00000100:00100000:0.0:1746066797.742892:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:31775:x1830882977075968:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066797.742913:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.742926:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c800/0xfb36a14ee608c422 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97edd5 expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.743002:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77cc00/0xfb36a14ee608c429 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743014:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77cc00/0xfb36a14ee608c429 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743023:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77cc00/0xfb36a14ee608c429 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743033:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d200/0xfb36a14ee608c430 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743038:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d200/0xfb36a14ee608c430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743043:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d200/0xfb36a14ee608c430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743120:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d000/0xfb36a14ee608c437 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743127:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d000/0xfb36a14ee608c437 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743133:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d000/0xfb36a14ee608c437 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:0.0:1746066797.743144:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066797.743202:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77cc00/0xfb36a14ee608c429 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743207:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77cc00/0xfb36a14ee608c429 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743212:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77cc00/0xfb36a14ee608c429 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743217:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f77cc00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066797.743220:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77cc00/0xfb36a14ee608c429 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743225:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77cc00/0xfb36a14ee608c429 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743233:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066797.743235:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066797.743238:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77cc00/0xfb36a14ee608c429 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743242:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77cc00/0xfb36a14ee608c429 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743255:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d200/0xfb36a14ee608c430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743259:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d200/0xfb36a14ee608c430 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743262:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d200/0xfb36a14ee608c430 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743269:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f77d200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066797.743271:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d200/0xfb36a14ee608c430 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743275:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d200/0xfb36a14ee608c430 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743280:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093705600) 00010000:00010000:0.0:1746066797.743281:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066797.743283:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d200/0xfb36a14ee608c430 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743287:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d200/0xfb36a14ee608c430 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066797.743314:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77c800/0xfb36a14ee608c422 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edd5 expref: 19 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.743323:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d000/0xfb36a14ee608c437 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edd5 expref: 18 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.743327:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066797.743329:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066797.743331:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f77d000, rc 0) 00000100:00100000:0.0:1746066797.743364:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:31775:x1830882977075968:12345-192.168.202.57@tcp:101:cat.0 Request processed in 473us (552us total) trans 8589944135 rc 0/0 00000100:00100000:0.0:1746066797.743369:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10062 00000100:00100000:0.0:1746066797.745916:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.745968:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.745985:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977076096 00000100:00100000:0.0:1746066797.745990:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977076096 00000100:00100000:0.0:1746066797.746013:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977076224 00000100:00100000:0.0:1746066797.746014:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977076224 00000100:00100000:0.0:1746066797.746023:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14870 00000100:00100000:0.0:1746066797.746028:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1966:x1830882977076096:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066797.746040:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.746052:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f77c600/0xfb36a14ee608c445 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eddc expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.746086:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976898688:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066797.746133:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.746148:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14871 00000100:00100000:0.0:1746066797.746154:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1966:x1830882977076224:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066797.746159:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.746165:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f77c200/0xfb36a14ee608c44c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ede3 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.746184:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976898816:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066797.746200:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.751403:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976898688:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066797.751431:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f77c600/0xfb36a14ee608c445 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eddc expref: 31 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.751443:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f77c600/0xfb36a14ee608c445 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eddc expref: 31 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.751460:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f77c600, rc 0) 00000100:00100000:0.0:1746066797.751495:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1966:x1830882977076096:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5466us (5583us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066797.751503:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14870 00000100:00100000:0.0:1746066797.751589:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.751604:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.751620:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.751649:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976898816:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066797.751663:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f77c200/0xfb36a14ee608c44c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ede3 expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.751671:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f77c200/0xfb36a14ee608c44c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ede3 expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.751696:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f77c200, rc 0) 00000100:00100000:0.0:1746066797.751714:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882977076224:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5561us (5746us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066797.751719:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14871 00000100:00100000:0.0:1746066797.751730:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977076480 00000100:00100000:0.0:1746066797.751734:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977076480 00000100:00100000:0.0:1746066797.755489:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14872 00000100:00100000:0.0:1746066797.755500:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882977076480:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066797.755514:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.755526:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f77d800/0xfb36a14ee608c453 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97edea expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.755578:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976898944:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066797.755632:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.755650:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977076352 00000100:00100000:0.0:1746066797.755655:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977076352 00000100:00100000:0.0:1746066797.755688:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977076608 00000100:00100000:0.0:1746066797.755690:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977076608 00010000:00010000:0.0:1746066797.755698:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 28 pid: 8450 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746066797.755711:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7648 00000100:00100000:0.0:1746066797.755714:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882977076608:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066797.755720:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066797.755733:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 28 pid: 8450 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746066797.755742:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 28 pid: 8450 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746066797.755757:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.755758:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.755763:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.755770:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.755790:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.755796:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976899072:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066797.755819:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.755831:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 718 00000100:00100000:0.0:1746066797.755835:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977076352:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066797.755841:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066797.755852:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f77d000/0xfb36a14ee608c437 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edd5 expref: 18 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.755863:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066797.755866:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066797.755880:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977076352:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 45us (4292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.755885:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 718 00000100:00100000:0.0:1746066797.760307:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.760341:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977076736 00000100:00100000:0.0:1746066797.760349:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977076736 00000100:00100000:0.0:1746066797.760393:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10063 00000100:00100000:0.0:1746066797.760402:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31776:x1830882977076736:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066797.760424:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.760442:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcd400/0xfb36a14ee608c45a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97edf1 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.760507:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcde00/0xfb36a14ee608c461 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.760520:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcde00/0xfb36a14ee608c461 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.760530:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcde00/0xfb36a14ee608c461 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.760542:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcc600/0xfb36a14ee608c468 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.760548:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcc600/0xfb36a14ee608c468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.760554:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcc600/0xfb36a14ee608c468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.760669:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.760718:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed9d expref: 263 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.760726:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.760760:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed9d expref: 263 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.760771:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed9d expref: 263 pid: 16018 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746066797.760786:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976899200:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066797.760857:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3600 going to sleep for 11 seconds 00010000:00010000:1.0:1746066797.772336:0:8450:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.57@tcp) returned -22 from glimpse AST (req@ffff88009a4ece00 x1830882976898944) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 28 pid: 8450 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746066797.772372:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aae800/0xfb36a14ee608c349 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed5e expref: 28 pid: 8450 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746066797.772384:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976898944:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066797.772411:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f77d800/0xfb36a14ee608c453 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edea expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066797.772422:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f77d800/0xfb36a14ee608c453 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edea expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066797.772428:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f77d800, rc 0) 00000100:00100000:1.0:1746066797.772459:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882977076480:12345-192.168.202.57@tcp:101:cat.0 Request processed in 16960us (20853us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066797.772467:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14872 00000100:00100000:1.0:1746066797.772546:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976899072:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066797.772555:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066797.772584:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1966:x1830882977076608:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 16868us (20963us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066797.772590:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7648 00000100:00100000:1.0:1746066797.772643:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.772659:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977076992 00000100:00100000:1.0:1746066797.772664:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977076992 00002000:00100000:1.0:1746066797.772731:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1220608->1224703) req@ffff88009ed0a680 x1830882977076992/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066797.772739:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed0a680 with x1830882977076992 ext(1220608->1224703) 00002000:00010000:1.0:1746066797.772743:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed0a680 00000100:00100000:1.0:1746066797.772757:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6761 00000100:00100000:1.0:1746066797.772762:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882977076992:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066797.772876:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882977076992:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 114us (233us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066797.772881:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6761 00002000:00100000:1.0:1746066797.772885:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1220608->1224703) req@ffff88009ed0a680 x1830882977076992/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/4536 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066797.772891:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed0a680 with x1830882977076992 ext(1220608->1224703) 00002000:00010000:1.0:1746066797.772893:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed0a680 00000100:00100000:0.0:1746066797.780515:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.780536:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.780556:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977077120 00000100:00100000:0.0:1746066797.780573:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977077120 00010000:00010000:0.0:1746066797.780603:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed9d expref: 264 pid: 16018 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746066797.780626:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7649 00000100:00100000:0.0:1746066797.780633:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:1964:x1830882977077120:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066797.780644:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066797.780649:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed9d expref: 264 pid: 16018 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746066797.780658:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed9d expref: 264 pid: 16018 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746066797.780690:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066797.780694:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.780702:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.780707:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.780723:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066797.780753:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:1964:x1830882977077120:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 121us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.780758:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7649 00010000:00010000:0.0:1746066797.780856:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2000/0xfb36a14ee608c38f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed9d expref: 263 pid: 16018 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746066797.780867:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976899200:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066797.780881:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.780887:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.780891:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:0.0:1746066797.780924:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:0.0:1746066797.780927:0:809:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746066797.780939:0:809:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.780947:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.780954:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcde00/0xfb36a14ee608c461 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.780960:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcde00/0xfb36a14ee608c461 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.780964:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcde00/0xfb36a14ee608c461 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.780969:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092bcde00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066797.780973:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcde00/0xfb36a14ee608c461 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.780978:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcde00/0xfb36a14ee608c461 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.780985:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066797.780987:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066797.780989:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcde00/0xfb36a14ee608c461 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.780992:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcde00/0xfb36a14ee608c461 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.781001:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcc600/0xfb36a14ee608c468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.781004:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcc600/0xfb36a14ee608c468 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.781008:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcc600/0xfb36a14ee608c468 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.781011:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092bcc600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066797.781013:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcc600/0xfb36a14ee608c468 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.781017:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcc600/0xfb36a14ee608c468 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.781021:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093705a00) 00010000:00010000:0.0:1746066797.781023:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066797.781025:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcc600/0xfb36a14ee608c468 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.781028:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcc600/0xfb36a14ee608c468 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.781056:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcd400/0xfb36a14ee608c45a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf1 expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.781066:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf1 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.781072:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066797.781073:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066797.781075:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092bcce00, rc 0) 00000100:00100000:0.0:1746066797.781098:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31776:x1830882977076736:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 20699us (20801us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.781104:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10063 00000100:00100000:3.0:1746066797.789724:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977077376 00000100:00100000:3.0:1746066797.789734:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977077376 00000100:00100000:3.0:1746066797.789768:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4213 00000100:00100000:3.0:1746066797.789775:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+17:31767:x1830882977077376:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066797.789944:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:31767:x1830882977077376:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 167us (9403us total) trans 8589944136 rc 0/0 00000100:00100000:3.0:1746066797.789951:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4213 00000100:00100000:0.0:1746066797.793502:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.793524:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.793554:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.793577:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.793596:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.793615:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977077504 00000100:00100000:0.0:1746066797.793622:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977077504 00000100:00100000:0.0:1746066797.793649:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977077760 00000100:00100000:0.0:1746066797.793651:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977077760 00000100:00100000:0.0:1746066797.793662:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977078016 00000100:00100000:0.0:1746066797.793664:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977078016 00000100:00100000:0.0:1746066797.793672:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977077632 00000100:00100000:0.0:1746066797.793673:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977077632 00000100:00100000:0.0:1746066797.793705:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977077888 00000100:00100000:0.0:1746066797.793706:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977077888 00000100:00100000:0.0:1746066797.793718:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14873 00000100:00100000:0.0:1746066797.793724:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977077504:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066797.793738:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.793752:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608c476 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97edf8 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.793770:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.793772:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.793779:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608c476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf8 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.793791:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608c476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf8 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.793800:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e881c00, rc 0) 00000100:00100000:0.0:1746066797.793834:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977077504:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 110us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.793839:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14873 00000100:00100000:0.0:1746066797.793853:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14874 00000100:00100000:0.0:1746066797.793857:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977077760:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066797.793863:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.793872:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e881800/0xfb36a14ee608c47d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee06 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.793903:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976899328:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066797.793948:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.793963:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14875 00000100:00100000:0.0:1746066797.793967:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977078016:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066797.793973:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.793979:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131d77400/0xfb36a14ee608c484 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee14 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.793988:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.793989:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.793994:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131d77400/0xfb36a14ee608c484 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee14 expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.794002:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131d77400/0xfb36a14ee608c484 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee14 expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.794008:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131d77400, rc 0) 00000100:00100000:0.0:1746066797.794021:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1966:x1830882977078016:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 54us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.794025:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14875 00000100:00100000:0.0:1746066797.794035:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14876 00000100:00100000:0.0:1746066797.794040:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977077632:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066797.794044:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.794049:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131d77600/0xfb36a14ee608c48b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97edff expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.794070:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976899456:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066797.794095:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.794109:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14877 00000100:00100000:0.0:1746066797.794115:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977077888:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066797.794123:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.794131:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131d77000/0xfb36a14ee608c492 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee0d expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.794139:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.794140:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066797.794146:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131d77000/0xfb36a14ee608c492 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee0d expref: 11 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.794156:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131d77000/0xfb36a14ee608c492 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee0d expref: 11 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.794163:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131d77000, rc 0) 00000100:00100000:0.0:1746066797.794178:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977077888:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 63us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.794183:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14877 00000100:00100000:3.0:1746066797.802248:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.802271:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.802419:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977078272 00000100:00100000:3.0:1746066797.802426:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977078272 00002000:00100000:3.0:1746066797.802462:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->1732607) req@ffff8800924d3800 x1830882977078272/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.802471:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d3800 with x1830882977078272 ext(1048576->1732607) 00002000:00010000:3.0:1746066797.802475:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d3800 00000100:00100000:3.0:1746066797.802488:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977078528 00000100:00100000:3.0:1746066797.802490:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977078528 00002000:00100000:3.0:1746066797.802499:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1224704->2097151) req@ffff8800924d3480 x1830882977078528/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.802505:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d3480 with x1830882977078528 ext(1224704->2097151) 00002000:00010000:3.0:1746066797.802507:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d3480 00000100:00100000:3.0:1746066797.802516:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6762 00000100:00100000:3.0:1746066797.802521:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882977078272:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066797.803346:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6763 00000100:00100000:3.0:1746066797.803352:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882977078528:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066797.807016:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976899456:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066797.807050:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131d77600/0xfb36a14ee608c48b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edff expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.807065:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131d77600/0xfb36a14ee608c48b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edff expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066797.807082:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131d77600, rc 0) 00000100:00100000:3.0:1746066797.807124:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977077632:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 13081us (13543us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066797.807134:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14876 00000100:00100000:2.0:1746066797.814814:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976899328:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066797.814841:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e881800/0xfb36a14ee608c47d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee06 expref: 10 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.814853:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e881800/0xfb36a14ee608c47d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee06 expref: 10 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066797.814930:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e881800, rc 0) 00000100:00100000:2.0:1746066797.814972:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882977077760:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 21113us (21446us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066797.814980:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14874 00000100:00100000:3.0:1746066797.827040:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882977078272:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24509us (24788us total) trans 0 rc 684032/684032 00000100:00100000:3.0:1746066797.827052:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6762 00002000:00100000:3.0:1746066797.827063:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->1732607) req@ffff8800924d3800 x1830882977078272/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 684032/684032 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.827071:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d3800 with x1830882977078272 ext(1048576->1732607) 00002000:00010000:3.0:1746066797.827076:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d3800 00000100:00100000:3.0:1746066797.827140:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.827264:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882977078528:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23912us (24991us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746066797.827270:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6763 00002000:00100000:3.0:1746066797.827275:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1224704->2097151) req@ffff8800924d3480 x1830882977078528/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.827282:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d3480 with x1830882977078528 ext(1224704->2097151) 00002000:00010000:3.0:1746066797.827285:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d3480 00000100:00100000:0.0:1746066797.829209:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977078784 00000100:00100000:0.0:1746066797.829219:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977078784 00000100:00100000:0.0:1746066797.829251:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10064 00000100:00100000:0.0:1746066797.829257:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31776:x1830882977078784:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066797.829270:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.829283:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76600/0xfb36a14ee608c499 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee1b expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.829356:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.829367:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf1 expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.829373:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.829410:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf1 expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.829419:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf1 expref: 10 pid: 809 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746066797.829429:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976899584:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066797.829475:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.836755:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.836774:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977078912 00000100:00100000:0.0:1746066797.836779:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977078912 00010000:00010000:0.0:1746066797.836804:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf1 expref: 11 pid: 809 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746066797.836824:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7650 00000100:00100000:0.0:1746066797.836831:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977078912:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066797.836841:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066797.836847:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf1 expref: 11 pid: 809 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746066797.836861:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf1 expref: 11 pid: 809 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746066797.836880:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066797.836883:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.836890:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.837010:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.837025:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066797.837057:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977078912:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 226us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.837062:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7650 00010000:00010000:0.0:1746066797.837155:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092bcce00/0xfb36a14ee608c46f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf1 expref: 10 pid: 809 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746066797.837168:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976899584:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066797.837181:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.837187:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.837191:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:0.0:1746066797.837206:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066797.837305:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76600/0xfb36a14ee608c499 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee1b expref: 11 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.837316:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee1b expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.837321:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066797.837323:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066797.837325:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131d76400, rc 0) 00000100:00100000:0.0:1746066797.837346:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31776:x1830882977078784:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 8089us (10206us total) trans 8589944137 rc 0/0 00000100:00100000:0.0:1746066797.837352:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10064 00000100:00100000:0.0:1746066797.848270:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.848297:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977079040 00000100:00100000:0.0:1746066797.848304:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977079040 00000100:00100000:0.0:1746066797.848342:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10065 00000100:00100000:0.0:1746066797.848349:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31776:x1830882977079040:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066797.848368:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.848384:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76000/0xfb36a14ee608c4ae lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee22 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.848449:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.848461:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee1b expref: 11 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.848471:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.848495:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee1b expref: 11 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.848505:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee1b expref: 11 pid: 809 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746066797.848514:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976899712:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066797.848577:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.862092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.862222:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.862253:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977079424 00000100:00100000:0.0:1746066797.862261:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977079424 00010000:00010000:0.0:1746066797.862293:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee1b expref: 12 pid: 809 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746066797.862319:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7651 00000100:00100000:0.0:1746066797.862326:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1966:x1830882977079424:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066797.862337:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066797.862341:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee1b expref: 12 pid: 809 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746066797.862351:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee1b expref: 12 pid: 809 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746066797.862373:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066797.862377:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.862385:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.862391:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.862404:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066797.862435:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1966:x1830882977079424:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 110us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.862441:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7651 00010000:00010000:0.0:1746066797.862508:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76400/0xfb36a14ee608c4a0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee1b expref: 11 pid: 809 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746066797.862519:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976899712:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066797.862530:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.862536:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.862540:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:0.0:1746066797.862578:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:0.0:1746066797.862581:0:809:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746066797.862592:0:809:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.862614:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76000/0xfb36a14ee608c4ae lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee22 expref: 11 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.862623:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee22 expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.862629:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066797.862631:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066797.862633:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131d76800, rc 0) 00000100:00100000:0.0:1746066797.862651:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31776:x1830882977079040:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 14304us (14391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.862656:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10065 00000100:00100000:3.0:1746066797.864654:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977079296 00000100:00100000:3.0:1746066797.864661:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977079296 00002000:00100000:3.0:1746066797.864709:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800a5bb2a00 x1830882977079296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.864723:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb2a00 with x1830882977079296 ext(2097152->3145727) 00002000:00010000:3.0:1746066797.864727:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb2a00 00000100:00100000:3.0:1746066797.864744:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6764 00000100:00100000:3.0:1746066797.864750:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977079296:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066797.880412:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.880445:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.880839:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977079680 00000100:00100000:0.0:1746066797.880848:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977079680 00000100:00100000:0.0:1746066797.880887:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977079552 00000100:00100000:0.0:1746066797.880890:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977079552 00000100:00100000:0.0:1746066797.880911:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14878 00000100:00100000:0.0:1746066797.880919:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977079680:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066797.880936:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.880951:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb07600/0xfb36a14ee608c4bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee30 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.881003:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976899840:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066797.881087:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.881113:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14879 00000100:00100000:0.0:1746066797.881121:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977079552:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066797.881129:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.881137:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb07000/0xfb36a14ee608c4c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee29 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.881164:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976899968:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066797.881192:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.881839:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977079296:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17088us (19754us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066797.881847:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6764 00002000:00100000:0.0:1746066797.881855:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800a5bb2a00 x1830882977079296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066797.881862:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb2a00 with x1830882977079296 ext(2097152->3145727) 00002000:00010000:0.0:1746066797.881866:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb2a00 00000100:00100000:0.0:1746066797.895307:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976899840:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066797.895338:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eb07600/0xfb36a14ee608c4bc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee30 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.895353:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb07600/0xfb36a14ee608c4bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee30 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.895367:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb07600, rc 0) 00000100:00100000:0.0:1746066797.895405:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977079680:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 14486us (15001us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066797.895413:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14878 00000100:00100000:0.0:1746066797.895456:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976899968:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066797.895467:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eb07000/0xfb36a14ee608c4c3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee29 expref: 10 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.895475:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb07000/0xfb36a14ee608c4c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee29 expref: 10 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.895481:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb07000, rc 0) 00000100:00100000:0.0:1746066797.895495:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882977079552:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 14376us (15052us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066797.895500:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14879 00000100:00100000:1.0:1746066797.906297:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.910731:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.910765:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.910798:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977080192 00000100:00100000:0.0:1746066797.910805:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977080192 00000100:00100000:0.0:1746066797.910842:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977080448 00000100:00100000:0.0:1746066797.910845:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977080448 00000100:00100000:0.0:1746066797.910868:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10066 00000100:00100000:0.0:1746066797.910875:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31776:x1830882977080192:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066797.910890:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.910904:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06800/0xfb36a14ee608c4ca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee37 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.910971:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06000/0xfb36a14ee608c4d1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.910982:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06000/0xfb36a14ee608c4d1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.910993:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06000/0xfb36a14ee608c4d1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911002:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06000/0xfb36a14ee608c4d1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911006:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06000/0xfb36a14ee608c4d1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911011:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06000/0xfb36a14ee608c4d1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911016:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eb06000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066797.911018:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06000/0xfb36a14ee608c4d1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911023:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06000/0xfb36a14ee608c4d1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911030:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066797.911032:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066797.911034:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06000/0xfb36a14ee608c4d1 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911038:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06000/0xfb36a14ee608c4d1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911057:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06800/0xfb36a14ee608c4ca lrc: 1/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee37 expref: 11 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.911063:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06800/0xfb36a14ee608c4ca lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee37 expref: 11 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.911073:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb06800, rc 0) 00000100:00100000:0.0:1746066797.911103:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31776:x1830882977080192:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 229us (380us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066797.911109:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10066 00000100:00100000:0.0:1746066797.911121:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10067 00000100:00100000:0.0:1746066797.911125:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:31781:x1830882977080448:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066797.911133:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.911138:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb07800/0xfb36a14ee608c4d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee3e expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.911221:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06c00/0xfb36a14ee608c4df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911228:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06c00/0xfb36a14ee608c4df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911233:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06c00/0xfb36a14ee608c4df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911241:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb07400/0xfb36a14ee608c4e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911245:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb07400/0xfb36a14ee608c4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911249:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb07400/0xfb36a14ee608c4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911391:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130edd000/0xfb36a14ee608c4ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911400:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130edd000/0xfb36a14ee608c4ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911407:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130edd000/0xfb36a14ee608c4ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:0.0:1746066797.911415:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066797.911493:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06c00/0xfb36a14ee608c4df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911500:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06c00/0xfb36a14ee608c4df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911504:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06c00/0xfb36a14ee608c4df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911508:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eb06c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066797.911511:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06c00/0xfb36a14ee608c4df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911515:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06c00/0xfb36a14ee608c4df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911523:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066797.911525:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066797.911528:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06c00/0xfb36a14ee608c4df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911532:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb06c00/0xfb36a14ee608c4df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911541:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb07400/0xfb36a14ee608c4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911549:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb07400/0xfb36a14ee608c4e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911553:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb07400/0xfb36a14ee608c4e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911556:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eb07400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066797.911572:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb07400/0xfb36a14ee608c4e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911577:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb07400/0xfb36a14ee608c4e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911584:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093705400) 00010000:00010000:0.0:1746066797.911585:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066797.911588:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb07400/0xfb36a14ee608c4e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911592:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb07400/0xfb36a14ee608c4e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066797.911628:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb07800/0xfb36a14ee608c4d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee3e expref: 266 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.911639:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130edd000/0xfb36a14ee608c4ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee3e expref: 265 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.911644:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066797.911646:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066797.911648:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130edd000, rc 0) 00000100:00100000:0.0:1746066797.911714:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:31781:x1830882977080448:12345-192.168.202.57@tcp:101:cat.0 Request processed in 585us (946us total) trans 8589944138 rc 0/0 00000100:00100000:0.0:1746066797.911721:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10067 00000100:00100000:3.0:1746066797.913336:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977079936 00000100:00100000:3.0:1746066797.913342:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977079936 00000100:00100000:3.0:1746066797.913367:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4214 00000100:00100000:3.0:1746066797.913372:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:31775:x1830882977079936:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:3.0:1746066797.913498:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:31775:x1830882977079936:12345-192.168.202.57@tcp:35:cat.0 Request processed in 124us (7207us total) trans 8589944139 rc 0/0 00000100:00100000:3.0:1746066797.913505:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4214 00000100:00100000:0.0:1746066797.920115:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.920209:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.922912:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977080704 00000100:00100000:2.0:1746066797.922921:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977080704 00000100:00100000:2.0:1746066797.922948:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977080960 00000100:00100000:2.0:1746066797.922950:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977080960 00000100:00100000:2.0:1746066797.922963:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4215 00000100:00100000:2.0:1746066797.922970:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31776:x1830882977080704:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:2.0:1746066797.923113:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:31776:x1830882977080704:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 143us (3002us total) trans 8589944140 rc 0/0 00000100:00100000:2.0:1746066797.923119:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4215 00000100:00100000:2.0:1746066797.923131:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4216 00000100:00100000:2.0:1746066797.923135:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4a3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:31781:x1830882977080960:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066797.923183:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4a3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:31781:x1830882977080960:12345-192.168.202.57@tcp:35:cat.0 Request processed in 47us (2974us total) trans 8589944141 rc 0/0 00000100:00100000:2.0:1746066797.923188:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4216 00000100:00100000:0.0:1746066797.935456:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.935518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.935549:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977081088 00000100:00100000:0.0:1746066797.935567:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977081088 00000100:00100000:0.0:1746066797.935627:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977081216 00000100:00100000:0.0:1746066797.935632:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977081216 00000100:00100000:0.0:1746066797.935653:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14880 00000100:00100000:0.0:1746066797.935662:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977081088:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066797.935721:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.935740:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608c4fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee45 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.935795:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976900096:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066797.935887:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.935912:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14881 00000100:00100000:0.0:1746066797.935919:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977081216:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066797.935928:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.935937:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013510ba00/0xfb36a14ee608c502 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee4c expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.935966:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976900224:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066797.935994:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066797.942966:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976900096:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066797.942992:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608c4fb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee45 expref: 30 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.943003:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f318400/0xfb36a14ee608c4fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee45 expref: 30 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.943011:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f318400, rc 0) 00000100:00100000:0.0:1746066797.943041:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977081088:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7380us (7594us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066797.943047:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14880 00000100:00100000:0.0:1746066797.943080:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976900224:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066797.943090:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013510ba00/0xfb36a14ee608c502 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee4c expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.943097:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013510ba00/0xfb36a14ee608c502 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee4c expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066797.943102:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013510ba00, rc 0) 00000100:00100000:0.0:1746066797.943112:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977081216:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7195us (7597us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066797.943116:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14881 00000100:00100000:0.0:1746066797.954377:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066797.954414:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977081344 00000100:00100000:0.0:1746066797.954423:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977081344 00000100:00100000:0.0:1746066797.954464:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14882 00000100:00100000:0.0:1746066797.954474:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:31781:x1830882977081344:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066797.954491:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066797.954507:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013510ae00/0xfb36a14ee608c509 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee53 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.954534:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.954542:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066797.954543:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066797.954546:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013510ae00/0xfb36a14ee608c509 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee53 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.954587:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.954600:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 22 pid: 4614 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746066797.954611:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976900352:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066797.954835:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41910c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066797.962625:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.962699:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976900352:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066797.962726:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013510ae00/0xfb36a14ee608c509 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee53 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.962743:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013510ae00, rc 0) 00000100:00100000:2.0:1746066797.962786:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31781:x1830882977081344:12345-192.168.202.57@tcp:101:cat.0 Request processed in 8312us (8416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066797.962795:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14882 00000100:00100000:2.0:1746066797.963934:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977081472 00000100:00100000:2.0:1746066797.963941:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977081472 00002000:00100000:2.0:1746066797.963978:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1732608->2097151) req@ffff88009ed73480 x1830882977081472/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066797.963986:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73480 with x1830882977081472 ext(1732608->2097151) 00010000:00010000:2.0:1746066797.963993:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 23 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066797.964006:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 23 pid: 4614 timeout: 859 lvb_type: 0 00002000:00010000:2.0:1746066797.964017:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed73480 00000100:00100000:2.0:1746066797.964439:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2193 00000100:00100000:2.0:1746066797.964449:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882977081472:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066797.975073:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882977081472:12345-192.168.202.57@tcp:4:cat.0 Request processed in 10619us (12448us total) trans 21474840975 rc 0/0 00000100:00100000:3.0:1746066797.975084:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2193 00002000:00100000:3.0:1746066797.975099:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1732608->2097151) req@ffff88009ed73480 x1830882977081472/t21474840975(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/448 e 0 to 0 dl 1746066808 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.975107:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73480 with x1830882977081472 ext(1732608->2097151) 00010000:00010000:3.0:1746066797.975115:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 25 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066797.975127:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 25 pid: 4614 timeout: 859 lvb_type: 0 00002000:00010000:3.0:1746066797.975137:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed73480 00000100:00100000:3.0:1746066797.976367:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.976434:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977081600 00000100:00100000:2.0:1746066797.976441:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977081600 00000100:00100000:2.0:1746066797.976467:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14883 00000100:00100000:2.0:1746066797.976472:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31772:x1830882977081600:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066797.976483:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066797.976494:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee5a expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.976514:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.976521:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066797.976522:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066797.976525:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1400832->2097151] (req 1400832->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.976545:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066797.976552:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 24 pid: 4614 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066797.976579:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976900480:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066797.976619:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066797.981046:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066797.981100:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977081728 00000100:00100000:1.0:1746066797.981107:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977081728 00010000:00010000:1.0:1746066797.981134:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 25 pid: 4614 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746066797.981160:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7652 00000100:00100000:1.0:1746066797.981168:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882977081728:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066797.981179:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066797.981198:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 25 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746066797.981207:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 25 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746066797.981227:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009acd2400/0xfb36a14ee608c3e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edb2 expref: 25 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746066797.981237:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066797.981238:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066797.981244:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013510ae00/0xfb36a14ee608c509 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee53 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.981251:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013510ae00/0xfb36a14ee608c509 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee53 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066797.981278:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013510ae00/0xfb36a14ee608c509 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee53 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066797.981528:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976900480:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066797.981547:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1400832->2097151] (req 1400832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066797.981564:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf47400, rc 0) 00000100:00100000:0.0:1746066797.981602:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:31772:x1830882977081600:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 5129us (5237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066797.981608:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14883 00000100:00100000:1.0:1746066797.981927:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976900608:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066797.981969:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52decc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066797.982602:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.982617:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977081856 00000100:00100000:3.0:1746066797.982620:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977081856 00002000:00100000:3.0:1746066797.982643:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1224703) req@ffff8800924d3100 x1830882977081856/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.982651:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d3100 with x1830882977081856 ext(1048576->1224703) 00010000:00010000:3.0:1746066797.982657:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 25 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066797.982666:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 25 pid: 4614 timeout: 859 lvb_type: 0 00002000:00010000:3.0:1746066797.982671:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924d3100 00000100:00100000:3.0:1746066797.982700:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2194 00000100:00100000:3.0:1746066797.982707:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882977081856:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066797.987615:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976900608:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066797.987632:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066797.987665:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882977081728:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6497us (6623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066797.987694:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7652 00000100:00100000:2.0:1746066797.988468:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066797.988512:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977082112 00000100:00100000:2.0:1746066797.988518:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977082112 00002000:00100000:2.0:1746066797.988545:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009ed73100 x1830882977082112/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/0 e 0 to 0 dl 1746066808 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066797.988554:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73100 with x1830882977082112 ext(1048576->2097151) 00002000:00010000:2.0:1746066797.988567:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed73100 00000100:00100000:2.0:1746066797.988582:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6765 00000100:00100000:2.0:1746066797.988588:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977082112:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066797.988873:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882977081856:12345-192.168.202.57@tcp:4:cat.0 Request processed in 6167us (6271us total) trans 21474840976 rc 0/0 00000100:00100000:3.0:1746066797.988880:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2194 00002000:00100000:3.0:1746066797.988886:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1224703) req@ffff8800924d3100 x1830882977081856/t21474840976(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:203/0 lens 488/448 e 0 to 0 dl 1746066808 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066797.988892:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d3100 with x1830882977081856 ext(1048576->1224703) 00010000:00010000:3.0:1746066797.988899:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 26 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066797.988910:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 26 pid: 4614 timeout: 859 lvb_type: 0 00002000:00010000:3.0:1746066797.988916:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924d3100 00000001:00080000:2.0:1746066797.996129:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873657 is committed 00000001:00080000:2.0:1746066797.996148:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873599 is committed 00000001:00080000:2.0:1746066797.996154:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873598 is committed 00000001:00080000:2.0:1746066797.996172:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873639 is committed 00000001:00080000:2.0:1746066797.996177:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873638 is committed 00000001:00080000:2.0:1746066797.996188:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873611 is committed 00000001:00080000:2.0:1746066797.996199:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873660 is committed 00000001:00080000:2.0:1746066797.996250:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873659 is committed 00000100:00100000:2.0:1746066797.997910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066797.998016:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977082240 00000100:00100000:3.0:1746066797.998023:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977082240 00010000:00010000:3.0:1746066797.998052:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 26 pid: 4614 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066797.998075:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7653 00000100:00100000:3.0:1746066797.998081:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882977082240:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066797.998091:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066797.998108:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 26 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066797.998117:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 26 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066797.998139:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4aaf200/0xfb36a14ee608c414 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edc7 expref: 26 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066797.998148:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.998150:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066797.998155:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.998162:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066797.998185:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 30 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066797.998193:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976900736:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066797.998246:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066797.999375:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977082112:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 10785us (10906us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066797.999384:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6765 00002000:00100000:2.0:1746066797.999393:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009ed73100 x1830882977082112/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:203/0 lens 488/440 e 0 to 0 dl 1746066808 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066797.999401:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73100 with x1830882977082112 ext(1048576->2097151) 00002000:00010000:2.0:1746066797.999405:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed73100 00000100:00100000:3.0:1746066798.004352:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976900736:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066798.004371:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.004406:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882977082240:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6324us (6499us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.004416:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7653 00000100:00100000:3.0:1746066798.006656:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.006696:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977082496 00000100:00100000:3.0:1746066798.006702:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977082496 00002000:00100000:3.0:1746066798.006733:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1400832->1404927) req@ffff8800924d0a80 x1830882977082496/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066798.006747:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d0a80 with x1830882977082496 ext(1400832->1404927) 00002000:00010000:3.0:1746066798.006751:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d0a80 00000100:00100000:3.0:1746066798.006765:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6766 00000100:00100000:3.0:1746066798.006771:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977082496:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066798.006911:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977082496:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 139us (258us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066798.006916:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6766 00002000:00100000:3.0:1746066798.006921:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1400832->1404927) req@ffff8800924d0a80 x1830882977082496/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066798.006927:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d0a80 with x1830882977082496 ext(1400832->1404927) 00002000:00010000:3.0:1746066798.006930:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d0a80 00000100:00100000:3.0:1746066798.010136:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.010536:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977082752 00000100:00100000:0.0:1746066798.010545:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977082752 00002000:00100000:0.0:1746066798.010587:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800924d1f80 x1830882977082752/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 504/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.010596:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d1f80 with x1830882977082752 ext(1048576->2097151) 00002000:00010000:0.0:1746066798.010601:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d1f80 00000100:00100000:0.0:1746066798.010630:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6767 00000100:00100000:0.0:1746066798.010637:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977082752:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066798.021405:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977082752:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 10761us (11269us total) trans 0 rc 1044480/1044480 00000100:00100000:0.0:1746066798.021415:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6767 00002000:00100000:0.0:1746066798.021425:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800924d1f80 x1830882977082752/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 504/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.021434:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d1f80 with x1830882977082752 ext(1048576->2097151) 00002000:00010000:0.0:1746066798.021438:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d1f80 00000001:00080000:0.0:1746066798.026997:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840969 is committed 00000001:00080000:0.0:1746066798.027017:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840918 is committed 00000001:00080000:0.0:1746066798.027024:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840974 is committed 00000001:00080000:0.0:1746066798.027035:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840955 is committed 00000001:00080000:0.0:1746066798.027055:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840930 is committed 00000001:00080000:0.0:1746066798.027096:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840972 is committed 00000001:00080000:0.0:1746066798.027102:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840971 is committed 00000001:00080000:0.0:1746066798.027132:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840932 is committed 00000100:00100000:0.0:1746066798.033081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.033171:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977082880 00000100:00100000:2.0:1746066798.033180:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977082880 00000100:00100000:2.0:1746066798.033228:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14884 00000100:00100000:2.0:1746066798.033235:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:31772:x1830882977082880:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066798.033250:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.033263:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee61 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.033286:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac47800/0xfb36a14ee608c0b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec15 expref: 7 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.033294:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608c1c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec85 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.033298:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eea2e00/0xfb36a14ee608c182 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec54 expref: 21 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.033303:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.033305:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.033307:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1048576->1335295] (req 1048576->1335295) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.033331:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eea2e00/0xfb36a14ee608c182 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec54 expref: 21 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.033345:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eea2e00/0xfb36a14ee608c182 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec54 expref: 21 pid: 8112 timeout: 859 lvb_type: 1 00000100:00100000:2.0:1746066798.033355:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976900864:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.033818:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608c1c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec85 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.033826:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608c1c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec85 expref: 8 pid: 4614 timeout: 859 lvb_type: 1 00000100:00100000:2.0:1746066798.033834:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976900992:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.033873:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac47800/0xfb36a14ee608c0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec15 expref: 7 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.033881:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac47800/0xfb36a14ee608c0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec15 expref: 7 pid: 21203 timeout: 859 lvb_type: 1 00000100:00100000:2.0:1746066798.033887:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976901120:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.033903:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.036435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.036519:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977083136 00000100:00100000:2.0:1746066798.036526:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977083136 00000100:00100000:2.0:1746066798.036573:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10068 00000100:00100000:2.0:1746066798.036581:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:31785:x1830882977083136:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066798.036601:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.036614:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc800/0xfb36a14ee608c51e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee68 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.036753:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1200/0xfb36a14ee608c525 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.036764:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1200/0xfb36a14ee608c525 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.036773:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1200/0xfb36a14ee608c525 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.036783:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1000/0xfb36a14ee608c52c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.036788:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1000/0xfb36a14ee608c52c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.036793:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1000/0xfb36a14ee608c52c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.036871:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0e00/0xfb36a14ee608c533 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.036877:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0e00/0xfb36a14ee608c533 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.036882:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0e00/0xfb36a14ee608c533 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:2.0:1746066798.036889:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066798.036952:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1200/0xfb36a14ee608c525 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.036961:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1200/0xfb36a14ee608c525 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.036966:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1200/0xfb36a14ee608c525 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.036970:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f2b1200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066798.036973:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1200/0xfb36a14ee608c525 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.036979:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1200/0xfb36a14ee608c525 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.036988:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066798.036991:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066798.036994:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1200/0xfb36a14ee608c525 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.036999:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1200/0xfb36a14ee608c525 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.037579:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1000/0xfb36a14ee608c52c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.037586:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1000/0xfb36a14ee608c52c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.037590:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1000/0xfb36a14ee608c52c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.037594:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f2b1000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066798.037597:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1000/0xfb36a14ee608c52c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.037604:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1000/0xfb36a14ee608c52c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.037611:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebec300) 00010000:00010000:2.0:1746066798.037613:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066798.037615:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1000/0xfb36a14ee608c52c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.037619:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1000/0xfb36a14ee608c52c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.037650:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc800/0xfb36a14ee608c51e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee68 expref: 22 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.037658:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0e00/0xfb36a14ee608c533 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee68 expref: 21 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.037663:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066798.037665:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066798.037667:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b0e00, rc 0) 00000100:00100000:2.0:1746066798.037828:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:31785:x1830882977083136:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 1247us (1397us total) trans 8589944142 rc 0/0 00000100:00100000:2.0:1746066798.037835:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10068 00000100:00100000:2.0:1746066798.040454:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976900864:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.040464:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976900992:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.040470:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976901120:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.040496:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1048576->1335295] (req 1048576->1335295) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 21 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.040511:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eccd600, rc 0) 00000100:00100000:2.0:1746066798.040555:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:31772:x1830882977082880:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 7320us (7481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.040572:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14884 00000100:00100000:1.0:1746066798.044193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.044275:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.045060:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.045395:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977083264 00000100:00100000:3.0:1746066798.045403:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977083264 00010000:00010000:3.0:1746066798.045433:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eea2e00/0xfb36a14ee608c182 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec54 expref: 21 pid: 8112 timeout: 859 lvb_type: 1 00000100:00100000:3.0:1746066798.045469:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977083520 00000100:00100000:3.0:1746066798.045472:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977083520 00010000:00010000:3.0:1746066798.045481:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608c1c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec85 expref: 9 pid: 4614 timeout: 859 lvb_type: 1 00000100:00100000:3.0:1746066798.045492:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977083392 00000100:00100000:3.0:1746066798.045494:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977083392 00010000:00010000:3.0:1746066798.045502:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac47800/0xfb36a14ee608c0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec15 expref: 8 pid: 21203 timeout: 859 lvb_type: 1 00000100:00100000:3.0:1746066798.045514:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7654 00000100:00100000:3.0:1746066798.045520:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1965:x1830882977083264:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.045531:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.045550:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eea2e00/0xfb36a14ee608c182 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec54 expref: 21 pid: 8112 timeout: 859 lvb_type: 1 00010000:00010000:3.0:1746066798.045570:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eea2e00/0xfb36a14ee608c182 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec54 expref: 21 pid: 8112 timeout: 859 lvb_type: 1 00010000:00010000:3.0:1746066798.045591:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eea2e00/0xfb36a14ee608c182 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec54 expref: 21 pid: 8112 timeout: 859 lvb_type: 1 00010000:00010000:3.0:1746066798.045604:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.045649:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1965:x1830882977083264:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 128us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.045654:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7654 00000100:00100000:3.0:1746066798.045671:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7655 00000100:00100000:3.0:1746066798.045689:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+9:1965:x1830882977083520:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.045695:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.045702:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608c1c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec85 expref: 9 pid: 4614 timeout: 859 lvb_type: 1 00010000:00010000:3.0:1746066798.045709:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608c1c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec85 expref: 9 pid: 4614 timeout: 859 lvb_type: 1 00010000:00010000:3.0:1746066798.045723:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4bc00/0xfb36a14ee608c1c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec85 expref: 9 pid: 4614 timeout: 859 lvb_type: 1 00010000:00010000:3.0:1746066798.045729:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.045741:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+8:1965:x1830882977083520:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 67us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.045745:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7655 00000100:00100000:3.0:1746066798.045753:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7656 00000100:00100000:3.0:1746066798.045757:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977083392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.045763:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.045768:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac47800/0xfb36a14ee608c0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec15 expref: 8 pid: 21203 timeout: 859 lvb_type: 1 00010000:00010000:3.0:1746066798.045775:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac47800/0xfb36a14ee608c0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec15 expref: 8 pid: 21203 timeout: 859 lvb_type: 1 00010000:00010000:3.0:1746066798.045783:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac47800/0xfb36a14ee608c0b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec15 expref: 8 pid: 21203 timeout: 859 lvb_type: 1 00010000:00010000:3.0:1746066798.045790:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.045791:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.045796:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.045802:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.045826:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.045836:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976901248:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066798.045881:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.047881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.047934:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977083776 00000100:00100000:2.0:1746066798.047940:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977083776 00000100:00100000:2.0:1746066798.048133:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10069 00000100:00100000:2.0:1746066798.048141:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:31789:x1830882977083776:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066798.048159:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.048173:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1400/0xfb36a14ee608c541 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee6f expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.048242:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0600/0xfb36a14ee608c548 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.048253:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0600/0xfb36a14ee608c548 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.048261:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0600/0xfb36a14ee608c548 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:2.0:1746066798.048270:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066798.048362:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b1400/0xfb36a14ee608c541 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee6f expref: 24 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.049379:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0600/0xfb36a14ee608c548 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee6f expref: 23 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.049391:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066798.049394:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746066798.049396:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b0600, rc 0) 00000100:00100000:2.0:1746066798.049450:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:31789:x1830882977083776:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1310us (1574us total) trans 8589944143 rc 0/0 00000100:00100000:2.0:1746066798.049457:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10069 00000100:00100000:3.0:1746066798.049533:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976901248:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066798.049546:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.049579:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882977083392:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3821us (4519us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.049586:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7656 00000100:00100000:0.0:1746066798.051302:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.051331:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.051350:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977083904 00000100:00100000:2.0:1746066798.051356:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977083904 00000100:00100000:0.0:1746066798.051362:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.051380:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977084032 00000100:00100000:2.0:1746066798.051382:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977084032 00000100:00100000:2.0:1746066798.051391:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977084160 00000100:00100000:2.0:1746066798.051393:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977084160 00000100:00100000:0.0:1746066798.051586:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14885 00000100:00100000:0.0:1746066798.051593:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977083904:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066798.051608:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066798.051621:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a52d8e00/0xfb36a14ee608c556 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee76 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.051637:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.051639:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.051646:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a52d8e00/0xfb36a14ee608c556 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee76 expref: 13 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066798.051658:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a52d8e00/0xfb36a14ee608c556 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee76 expref: 13 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066798.051667:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a52d8e00, rc 0) 00000100:00100000:0.0:1746066798.051779:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977083904:12345-192.168.202.57@tcp:101:cat.0 Request processed in 186us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066798.051784:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14885 00000100:00100000:0.0:1746066798.051797:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14886 00000100:00100000:0.0:1746066798.051802:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977084032:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066798.051810:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066798.051817:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5800/0xfb36a14ee608c55d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee7d expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.051844:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976901376:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066798.051880:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42abcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066798.052052:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14887 00000100:00100000:3.0:1746066798.052060:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+8:1963:x1830882977084160:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.052067:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.052076:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5830000/0xfb36a14ee608c564 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee84 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.052099:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976901504:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066798.052124:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.054886:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.054929:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977084416 00000100:00100000:2.0:1746066798.054936:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977084416 00002000:00100000:2.0:1746066798.054968:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1331200->1335295) req@ffff88009e8c5880 x1830882977084416/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.054976:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c5880 with x1830882977084416 ext(1331200->1335295) 00002000:00010000:2.0:1746066798.054980:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c5880 00000100:00100000:2.0:1746066798.054996:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6768 00000100:00100000:2.0:1746066798.055002:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977084416:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066798.055174:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977084416:12345-192.168.202.57@tcp:3:cat.0 Request processed in 171us (297us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066798.055179:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6768 00002000:00100000:2.0:1746066798.055185:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1331200->1335295) req@ffff88009e8c5880 x1830882977084416/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.055197:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c5880 with x1830882977084416 ext(1331200->1335295) 00002000:00010000:2.0:1746066798.055200:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c5880 00000100:00100000:1.0:1746066798.055226:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976901376:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066798.055260:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5800/0xfb36a14ee608c55d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee7d expref: 13 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.055271:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5800/0xfb36a14ee608c55d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee7d expref: 13 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.055296:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecc5800, rc 0) 00000100:00100000:1.0:1746066798.055318:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977084032:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3516us (3987us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066798.055324:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14886 00002000:00010000:3.0:1746066798.055645:0:9776:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime: 1746066794 -> 1746066797 00002000:00010000:3.0:1746066798.055649:0:9776:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime: 1746066794 -> 1746066797 00002000:00010000:3.0:1746066798.055650:0:9776:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime: 1746066794 -> 1746066797 00000100:00100000:3.0:1746066798.055658:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976901504:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066798.055700:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5830000/0xfb36a14ee608c564 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee84 expref: 9 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.055711:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5830000/0xfb36a14ee608c564 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee84 expref: 9 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.055728:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5830000, rc 0) 00000100:00100000:3.0:1746066798.055746:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+8:1963:x1830882977084160:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3687us (4383us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066798.055751:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14887 00000100:00100000:1.0:1746066798.061238:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.061384:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977084672 00000100:00100000:2.0:1746066798.061392:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977084672 00000100:00100000:2.0:1746066798.061427:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4217 00000100:00100000:2.0:1746066798.061433:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:31772:x1830882977084672:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066798.061609:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:31772:x1830882977084672:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 175us (380us total) trans 8589944144 rc 0/0 00000100:00100000:2.0:1746066798.061616:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4217 00000100:00100000:0.0:1746066798.073188:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.074965:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977084928 00000100:00100000:2.0:1746066798.074976:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977084928 00002000:00100000:2.0:1746066798.075020:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e8c4700 x1830882977084928/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.075030:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c4700 with x1830882977084928 ext(1048576->2097151) 00002000:00010000:2.0:1746066798.075035:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c4700 00000100:00100000:2.0:1746066798.075228:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6769 00000100:00100000:2.0:1746066798.075236:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882977084928:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066798.091054:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882977084928:12345-192.168.202.57@tcp:3:cat.0 Request processed in 15810us (17866us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066798.091066:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6769 00002000:00100000:2.0:1746066798.091076:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e8c4700 x1830882977084928/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.091085:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c4700 with x1830882977084928 ext(1048576->2097151) 00002000:00010000:2.0:1746066798.091091:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c4700 00000100:00100000:0.0:1746066798.096152:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.096213:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977085056 00000100:00100000:3.0:1746066798.096221:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977085056 00000100:00100000:3.0:1746066798.096270:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14888 00000100:00100000:3.0:1746066798.096278:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+12:31789:x1830882977085056:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.096293:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.096308:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608c56b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee8b expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.096334:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.096341:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066798.096342:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066798.096345:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608c56b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee8b expref: 13 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.096370:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.096383:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.096393:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976901632:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066798.096478:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066798.108148:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.108228:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977085184 00000100:00100000:2.0:1746066798.108236:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977085184 00002000:00100000:2.0:1746066798.108273:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1400832->2097151) req@ffff88009a4ef100 x1830882977085184/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.108283:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ef100 with x1830882977085184 ext(1400832->2097151) 00010000:00010000:2.0:1746066798.108290:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 15 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.108302:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 15 pid: 8450 timeout: 859 lvb_type: 0 00002000:00010000:2.0:1746066798.108309:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4ef100 00000100:00100000:2.0:1746066798.108324:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2195 00000100:00100000:2.0:1746066798.108331:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1963:x1830882977085184:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066798.110298:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976901632:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066798.110323:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608c56b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee8b expref: 13 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.110337:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5831800, rc 0) 00000100:00100000:3.0:1746066798.110490:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+13:31789:x1830882977085056:12345-192.168.202.57@tcp:101:cat.0 Request processed in 14211us (14343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.110498:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14888 00000100:00100000:3.0:1746066798.119692:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1963:x1830882977085184:12345-192.168.202.57@tcp:4:cat.0 Request processed in 11336us (11527us total) trans 21474840977 rc 0/0 00000100:00100000:3.0:1746066798.119704:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2195 00002000:00100000:3.0:1746066798.119715:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1400832->2097151) req@ffff88009a4ef100 x1830882977085184/t21474840977(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/448 e 0 to 0 dl 1746066809 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066798.119724:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ef100 with x1830882977085184 ext(1400832->2097151) 00010000:00010000:3.0:1746066798.119734:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 17 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.119749:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 17 pid: 8450 timeout: 859 lvb_type: 0 00002000:00010000:3.0:1746066798.119757:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a4ef100 00000100:00100000:0.0:1746066798.128242:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.128628:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977085312 00000100:00100000:3.0:1746066798.128636:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977085312 00010000:00010000:3.0:1746066798.128670:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 17 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746066798.129666:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7657 00000100:00100000:0.0:1746066798.129696:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1965:x1830882977085312:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066798.129711:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066798.129733:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 17 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746066798.129744:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 17 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746066798.129764:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf47400/0xfb36a14ee608c510 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee5a expref: 17 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746066798.129790:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.129792:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.129798:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608c56b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee8b expref: 12 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.129811:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608c56b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee8b expref: 12 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.129839:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608c56b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee8b expref: 12 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.129849:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976901760:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066798.129931:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42abc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.139530:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.139762:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977085440 00000100:00100000:3.0:1746066798.139769:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977085440 00000100:00100000:3.0:1746066798.139861:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14889 00000100:00100000:3.0:1746066798.139870:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+8:31785:x1830882977085440:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066798.139885:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.139900:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee92 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.139922:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.139928:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066798.139929:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066798.139932:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1814528->2097151] (req 1814528->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 9 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.139958:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.139969:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 19 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.139980:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976901888:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066798.140247:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066798.142733:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976901760:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066798.142753:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.142789:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1965:x1830882977085312:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 13113us (14556us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.142798:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7657 00000100:00100000:0.0:1746066798.147300:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.151396:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.151442:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.151463:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977085824 00000100:00100000:1.0:1746066798.151469:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977085824 00002000:00100000:1.0:1746066798.151505:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009a4eed80 x1830882977085824/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.151514:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4eed80 with x1830882977085824 ext(1048576->2097151) 00002000:00010000:1.0:1746066798.151519:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4eed80 00000100:00100000:1.0:1746066798.151534:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977085952 00000100:00100000:1.0:1746066798.151537:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977085952 00002000:00100000:1.0:1746066798.151549:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->1335295) req@ffff88009a4ec380 x1830882977085952/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.151566:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ec380 with x1830882977085952 ext(1048576->1335295) 00010000:00010000:1.0:1746066798.151574:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 20 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746066798.151585:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 20 pid: 8450 timeout: 859 lvb_type: 0 00002000:00010000:1.0:1746066798.151590:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a4ec380 00000100:00100000:1.0:1746066798.151603:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2196 00000100:00100000:1.0:1746066798.151610:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1966:x1830882977085952:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066798.151880:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6770 00000100:00100000:1.0:1746066798.151886:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977085824:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066798.153664:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976901888:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.153710:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1814528->2097151] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 9 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.153724:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b0200, rc 0) 00000100:00100000:1.0:1746066798.153751:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+9:31785:x1830882977085440:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 13883us (14227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.153759:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14889 00000100:00100000:2.0:1746066798.154099:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977085568 00000100:00100000:2.0:1746066798.154105:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977085568 00000100:00100000:2.0:1746066798.154146:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10070 00000100:00100000:2.0:1746066798.154152:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:31791:x1830882977085568:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066798.154167:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.154183:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3600/0xfb36a14ee608c579 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ee99 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.154229:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2400/0xfb36a14ee608c580 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154239:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2400/0xfb36a14ee608c580 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154247:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2400/0xfb36a14ee608c580 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154258:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608c587 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154262:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608c587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154267:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608c587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154354:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831000/0xfb36a14ee608c58e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154362:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831000/0xfb36a14ee608c58e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154368:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831000/0xfb36a14ee608c58e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:2.0:1746066798.154392:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:2.0:1746066798.154395:0:14550:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746066798.154407:0:14550:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831000/0xfb36a14ee608c58e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154416:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831000/0xfb36a14ee608c58e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154423:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2400/0xfb36a14ee608c580 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154428:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2400/0xfb36a14ee608c580 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154433:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2400/0xfb36a14ee608c580 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154438:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800925a2400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066798.154441:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2400/0xfb36a14ee608c580 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154447:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2400/0xfb36a14ee608c580 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154455:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066798.154458:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066798.154461:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2400/0xfb36a14ee608c580 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154465:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2400/0xfb36a14ee608c580 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154492:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608c587 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154496:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608c587 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154501:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608c587 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154505:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800925a3000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066798.154507:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608c587 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154512:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608c587 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154518:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebeca00) 00010000:00010000:2.0:1746066798.154519:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066798.154521:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608c587 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154525:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608c587 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.154548:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3600/0xfb36a14ee608c579 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee99 expref: 13 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.154569:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831000/0xfb36a14ee608c58e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee99 expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.154575:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066798.154577:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066798.154579:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5831000, rc 0) 00000100:00100000:2.0:1746066798.154603:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31791:x1830882977085568:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 451us (7310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.154609:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10070 00000100:00100000:1.0:1746066798.164552:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977085824:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 12656us (13153us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066798.164572:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6770 00002000:00100000:1.0:1746066798.164583:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009a4eed80 x1830882977085824/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746066798.164590:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:1.0:1746066798.164597:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4eed80 with x1830882977085824 ext(1048576->2097151) 00002000:00010000:1.0:1746066798.164602:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4eed80 00000100:00100000:1.0:1746066798.164626:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977086080 00000100:00100000:1.0:1746066798.164631:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977086080 00000100:00100000:1.0:1746066798.164657:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14890 00000100:00100000:1.0:1746066798.164663:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882977086080:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066798.164692:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.164706:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608c595 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eea0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.164725:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.164727:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.164734:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608c595 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea0 expref: 7 pid: 9776 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066798.164829:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.164861:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.164874:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977086208 00000100:00100000:3.0:1746066798.164877:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977086208 00000100:00100000:2.0:1746066798.164882:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.164893:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977086336 00000100:00100000:3.0:1746066798.164895:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977086336 00000100:00100000:2.0:1746066798.164896:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14891 00000100:00100000:2.0:1746066798.164902:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977086208:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:3.0:1746066798.164906:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14892 00010000:00010000:2.0:1746066798.164909:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066798.164910:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977086336:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066798.164916:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.164916:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5830600/0xfb36a14ee608c59c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eea7 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.164924:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eeae expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.164925:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.164926:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.164930:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5830600/0xfb36a14ee608c59c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea7 expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.164939:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5830600/0xfb36a14ee608c59c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea7 expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.164947:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5830600, rc 0) 00000100:00100000:3.0:1746066798.164954:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976902016:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066798.164971:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977086208:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 69us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.164975:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14891 00000100:00100000:2.0:1746066798.164991:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977086464 00000100:00100000:2.0:1746066798.164993:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977086464 00000100:00100000:3.0:1746066798.164997:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066798.165015:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 719 00000100:00100000:2.0:1746066798.165019:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977086464:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.165027:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.165042:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5831000/0xfb36a14ee608c58e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee99 expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.165067:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066798.165071:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.165085:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1965:x1830882977086464:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 65us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.165090:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 719 00010000:00010000:1.0:1746066798.165188:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608c595 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea0 expref: 8 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.165197:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c3dc00, rc 0) 00000100:00100000:1.0:1746066798.165216:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977086080:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 553us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.165221:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14890 00000100:00100000:0.0:1746066798.166184:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977085952:12345-192.168.202.57@tcp:4:cat.0 Request processed in 14572us (14739us total) trans 17179873661 rc 0/0 00000100:00100000:0.0:1746066798.166192:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2196 00002000:00100000:0.0:1746066798.166198:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->1335295) req@ffff88009a4ec380 x1830882977085952/t17179873661(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/448 e 0 to 0 dl 1746066809 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.166206:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ec380 with x1830882977085952 ext(1048576->1335295) 00010000:00010000:0.0:1746066798.166211:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 22 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746066798.166221:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 22 pid: 8450 timeout: 859 lvb_type: 0 00002000:00010000:0.0:1746066798.166227:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a4ec380 00000100:00100000:0.0:1746066798.174115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.174155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.174275:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977086592 00000100:00100000:1.0:1746066798.174275:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977086720 00000100:00100000:2.0:1746066798.174282:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977086592 00000100:00100000:1.0:1746066798.174282:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977086720 00000100:00100000:0.0:1746066798.174653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.175425:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976902016:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066798.175449:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5a3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeae expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.175460:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeae expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.175481:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b0c00, rc 0) 00000100:00100000:3.0:1746066798.175515:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977086336:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 10603us (10631us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066798.175524:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14892 00000100:00100000:3.0:1746066798.175539:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14893 00000100:00100000:3.0:1746066798.175545:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1964:x1830882977086592:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.175565:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.175575:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608c5aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eeb5 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.175590:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.175591:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.175597:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608c5aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeb5 expref: 17 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.175608:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608c5aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeb5 expref: 17 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.175615:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b1c00, rc 0) 00000100:00100000:3.0:1746066798.175626:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1964:x1830882977086592:12345-192.168.202.57@tcp:101:cat.0 Request processed in 83us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.175630:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14893 00000100:00100000:3.0:1746066798.175639:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14894 00000100:00100000:3.0:1746066798.175642:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977086720:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.175648:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.175653:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1800/0xfb36a14ee608c5b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eebc expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.175694:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976902144:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066798.175738:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066798.175762:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977086848 00000100:00100000:3.0:1746066798.175765:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977086848 00010000:00010000:3.0:1746066798.175779:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 24 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.175796:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7658 00000100:00100000:3.0:1746066798.175801:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1966:x1830882977086848:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.175807:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.175815:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 24 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.175823:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 24 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.175835:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.175836:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.175840:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 8 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.175847:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 8 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.175862:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 8 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.175869:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976902272:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066798.175886:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.181302:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.181543:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977086976 00000100:00100000:3.0:1746066798.181551:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977086976 00000100:00100000:3.0:1746066798.181598:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14895 00000100:00100000:3.0:1746066798.181606:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:31789:x1830882977086976:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.181622:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.181637:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eec3 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.181662:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 10 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.181669:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066798.181671:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066798.181695:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5b8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eec3 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.181721:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 10 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.181732:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 10 pid: 9776 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.181743:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976902400:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066798.183255:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.192201:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.192881:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977087488 00000100:00100000:1.0:1746066798.192888:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977087488 00000100:00100000:2.0:1746066798.194008:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066798.194213:0:4614:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.57@tcp) returned -22 from glimpse AST (req@ffff8800924d0000 x1830882976902144) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 24 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.194249:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eccd600/0xfb36a14ee608c517 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee61 expref: 24 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.194274:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976902144:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066798.194303:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1800/0xfb36a14ee608c5b1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eebc expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.194315:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1800/0xfb36a14ee608c5b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eebc expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.194321:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b1800, rc 0) 00000100:00100000:3.0:1746066798.194358:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977086720:12345-192.168.202.57@tcp:101:cat.0 Request processed in 18714us (20203us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066798.194365:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14894 00000100:00100000:0.0:1746066798.194524:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.194540:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977087232 00000100:00100000:0.0:1746066798.194543:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977087232 00002000:00100000:0.0:1746066798.194578:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1814528->1818623) req@ffff88012c52bb80 x1830882977087232/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.194587:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52bb80 with x1830882977087232 ext(1814528->1818623) 00010000:00010000:0.0:1746066798.194592:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 11 pid: 9776 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746066798.194602:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 11 pid: 9776 timeout: 859 lvb_type: 0 00002000:00010000:0.0:1746066798.194608:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c52bb80 00000100:00100000:0.0:1746066798.194620:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2197 00000100:00100000:0.0:1746066798.194626:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977087232:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066798.194786:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977087232:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 161us (262us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066798.194792:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2197 00002000:00100000:0.0:1746066798.194796:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1814528->1818623) req@ffff88012c52bb80 x1830882977087232/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.194803:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52bb80 with x1830882977087232 ext(1814528->1818623) 00010000:00010000:0.0:1746066798.194808:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 11 pid: 9776 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746066798.194816:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 11 pid: 9776 timeout: 859 lvb_type: 0 00002000:00010000:0.0:1746066798.194821:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c52bb80 00000100:00100000:0.0:1746066798.194929:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976902400:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066798.194941:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5b8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eec3 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.194949:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b0c00, rc 0) 00000100:00100000:0.0:1746066798.194966:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+10:31789:x1830882977086976:12345-192.168.202.57@tcp:101:cat.0 Request processed in 13362us (13674us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066798.194971:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14895 00000100:00100000:3.0:1746066798.195055:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976902272:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066798.195063:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.195082:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1966:x1830882977086848:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 19281us (20429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.195089:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7658 00000100:00100000:2.0:1746066798.195221:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977087744 00000100:00100000:2.0:1746066798.195224:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977087744 00000100:00100000:2.0:1746066798.195246:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10071 00000100:00100000:2.0:1746066798.195251:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:31791:x1830882977087488:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066798.195261:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.195271:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2400/0xfb36a14ee608c5bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eeca expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.195339:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.195350:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee22 expref: 12 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.195356:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130edd000/0xfb36a14ee608c4ed lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee3e expref: 267 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.195362:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0e00/0xfb36a14ee608c533 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee68 expref: 22 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.195368:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.195389:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0e00/0xfb36a14ee608c533 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee68 expref: 22 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.195402:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0e00/0xfb36a14ee608c533 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee68 expref: 22 pid: 14550 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.195411:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976902528:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066798.196012:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10072 00000100:00100000:1.0:1746066798.196020:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:31796:x1830882977087744:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066798.196033:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.196039:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa21000/0xfb36a14ee608c5cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eed1 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.196073:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066798.196080:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066798.196085:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066798.196226:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130edd000/0xfb36a14ee608c4ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee3e expref: 268 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.196234:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130edd000/0xfb36a14ee608c4ed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee3e expref: 268 pid: 809 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.196241:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976902656:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.196928:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee22 expref: 12 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.196936:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee22 expref: 12 pid: 809 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.196944:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976902784:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.197536:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.199594:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.199610:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.199634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.199740:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976902528:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.199748:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976902656:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.199755:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976902784:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.199778:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:3.0:1746066798.199901:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977088000 00000100:00100000:3.0:1746066798.199907:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977088000 00010000:00010000:3.0:1746066798.199934:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130edd000/0xfb36a14ee608c4ed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee3e expref: 269 pid: 809 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.199964:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977087872 00000100:00100000:3.0:1746066798.199966:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977087872 00010000:00010000:3.0:1746066798.199974:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0e00/0xfb36a14ee608c533 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee68 expref: 23 pid: 14550 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.199983:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977088128 00000100:00100000:3.0:1746066798.199984:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977088128 00010000:00010000:3.0:1746066798.199990:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee22 expref: 13 pid: 809 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.200001:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7659 00000100:00100000:3.0:1746066798.200006:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+269:1965:x1830882977088000:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.200017:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.200021:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130edd000/0xfb36a14ee608c4ed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee3e expref: 269 pid: 809 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.200029:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130edd000/0xfb36a14ee608c4ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee3e expref: 269 pid: 809 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.200046:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130edd000/0xfb36a14ee608c4ed lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee3e expref: 269 pid: 809 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.200058:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066798.200061:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.200067:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.200074:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.200104:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:1965:x1830882977088000:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 98us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.200110:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7659 00000100:00100000:3.0:1746066798.200121:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7660 00000100:00100000:3.0:1746066798.200125:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882977087872:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.200131:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.200134:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0e00/0xfb36a14ee608c533 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee68 expref: 23 pid: 14550 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.200140:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0e00/0xfb36a14ee608c533 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee68 expref: 23 pid: 14550 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.200150:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0e00/0xfb36a14ee608c533 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee68 expref: 23 pid: 14550 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.200157:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066798.200160:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.200165:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.200169:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.200182:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882977087872:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 56us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.200183:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7661 00000100:00100000:3.0:1746066798.200186:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7660 00000100:00100000:2.0:1746066798.200189:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882977088128:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.200197:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.200201:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee22 expref: 13 pid: 809 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.200208:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee22 expref: 13 pid: 809 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.200218:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76800/0xfb36a14ee608c4b5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee22 expref: 13 pid: 809 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.200241:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066798.200244:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.200251:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.200256:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066798.200262:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066798.200268:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066798.200272:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066798.200289:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066798.200573:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066798.200579:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:1.0:1746066798.200594:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066798.200721:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa21000/0xfb36a14ee608c5cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed1 expref: 269 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.200734:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed1 expref: 268 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.200739:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066798.200741:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066798.200743:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa20200, rc 0) 00010000:00010000:3.0:1746066798.200834:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.200838:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:3.0:1746066798.200847:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000100:00100000:2.0:1746066798.200890:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882977088128:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 700us (1253us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066798.200895:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2400/0xfb36a14ee608c5bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeca expref: 14 pid: 14550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066798.200897:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7661 00010000:00010000:3.0:1746066798.200904:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeca expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.200908:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066798.200910:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066798.200912:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925a2200, rc 0) 00000100:00100000:1.0:1746066798.200957:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:31796:x1830882977087744:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4938us (6952us total) trans 8589944145 rc 0/0 00000100:00100000:1.0:1746066798.200963:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10072 00000100:00100000:3.0:1746066798.201052:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31791:x1830882977087488:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 5800us (8859us total) trans 8589944146 rc 0/0 00000100:00100000:3.0:1746066798.201056:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10071 00000100:00100000:1.0:1746066798.204482:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.205202:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977088384 00000100:00100000:2.0:1746066798.205209:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977088384 00000100:00100000:2.0:1746066798.205256:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14896 00000100:00100000:2.0:1746066798.205263:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+10:31785:x1830882977088384:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066798.205278:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.205292:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eed8 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.205317:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ed5600/0xfb36a14ee608c33b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed50 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.205324:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131d77000/0xfb36a14ee608c492 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee0d expref: 6 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.205330:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801311a1400/0xfb36a14ee608c342 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed57 expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.205336:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.205337:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.205340:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->2539519] (req 2097152->2539519) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.205366:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801311a1400/0xfb36a14ee608c342 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed57 expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.205374:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801311a1400/0xfb36a14ee608c342 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed57 expref: 20 pid: 8451 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.205383:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976902912:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.205468:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131d77000/0xfb36a14ee608c492 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee0d expref: 6 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.205477:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131d77000/0xfb36a14ee608c492 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee0d expref: 6 pid: 8452 timeout: 859 lvb_type: 1 00000100:00100000:2.0:1746066798.205484:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976903040:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.205514:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ed5600/0xfb36a14ee608c33b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed50 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.205520:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ed5600/0xfb36a14ee608c33b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed50 expref: 11 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.205527:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976903168:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.205542:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.210437:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.210490:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.210582:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977088768 00000100:00100000:3.0:1746066798.210589:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977088640 00000100:00100000:2.0:1746066798.210590:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977088768 00000100:00100000:3.0:1746066798.210594:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977088640 00000100:00100000:2.0:1746066798.210626:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14897 00000100:00100000:2.0:1746066798.210632:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:31796:x1830882977088768:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066798.210651:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.210666:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eee6 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.210711:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.210713:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.210717:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3440640->3559423] (req 3440640->3559423) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.210727:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3440640->3559423] (req 3440640->3559423) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 22 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.210731:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10073 00010000:00010000:2.0:1746066798.210736:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925a2400, rc 0) 00000100:00100000:3.0:1746066798.210738:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31791:x1830882977088640:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066798.210754:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.210764:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0600/0xfb36a14ee608c5f7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eedf expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.210821:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.210836:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeca expref: 13 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.210843:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed1 expref: 267 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.210847:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 5/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.210871:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed1 expref: 267 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.210879:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed1 expref: 267 pid: 809 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.210888:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976903296:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.211075:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31796:x1830882977088768:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 441us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.211081:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14897 00010000:00010000:3.0:1746066798.211716:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeca expref: 13 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.211730:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeca expref: 13 pid: 14550 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.211738:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976903424:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066798.211964:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.218045:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.218077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.218141:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977089024 00000100:00100000:1.0:1746066798.218150:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977089024 00000100:00100000:0.0:1746066798.218153:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066798.218180:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131d77000/0xfb36a14ee608c492 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee0d expref: 7 pid: 8452 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746066798.218209:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977088896 00000100:00100000:1.0:1746066798.218212:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977088896 00010000:00010000:1.0:1746066798.218222:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801311a1400/0xfb36a14ee608c342 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed57 expref: 22 pid: 8451 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746066798.218234:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977089152 00000100:00100000:1.0:1746066798.218236:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977089152 00010000:00010000:1.0:1746066798.218246:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed5600/0xfb36a14ee608c33b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed50 expref: 12 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746066798.218259:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7662 00000100:00100000:1.0:1746066798.218265:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1966:x1830882977089024:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066798.218275:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066798.218293:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131d77000/0xfb36a14ee608c492 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee0d expref: 7 pid: 8452 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746066798.218302:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131d77000/0xfb36a14ee608c492 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee0d expref: 7 pid: 8452 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746066798.218322:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066798.218357:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1966:x1830882977089024:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 92us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.218363:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7662 00000100:00100000:1.0:1746066798.218377:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7663 00000100:00100000:1.0:1746066798.218381:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977088896:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066798.218388:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066798.218394:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801311a1400/0xfb36a14ee608c342 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed57 expref: 22 pid: 8451 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746066798.218402:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801311a1400/0xfb36a14ee608c342 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed57 expref: 22 pid: 8451 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746066798.218424:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066798.218438:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977088896:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 57us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.218444:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7663 00000100:00100000:1.0:1746066798.218453:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7664 00000100:00100000:1.0:1746066798.218457:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882977089152:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066798.218463:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066798.218470:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ed5600/0xfb36a14ee608c33b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed50 expref: 12 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746066798.218477:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ed5600/0xfb36a14ee608c33b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed50 expref: 12 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746066798.218487:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.218490:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.218495:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.218501:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.218507:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.218508:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.218511:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3440640->18446744073709551615] (req 3440640->3559423) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.218517:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3440640->18446744073709551615] (req 3440640->3559423) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.218541:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3440640->18446744073709551615] (req 3440640->3559423) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066798.218551:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976903552:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066798.218613:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066798.218621:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976903680:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066798.218635:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066798.219463:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801311a1400/0xfb36a14ee608c342 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed57 expref: 21 pid: 8451 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.219492:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976902912:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.219502:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131d77000/0xfb36a14ee608c492 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee0d expref: 6 pid: 8452 timeout: 859 lvb_type: 1 00000100:00100000:2.0:1746066798.219509:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976903040:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.219517:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ed5600/0xfb36a14ee608c33b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed50 expref: 12 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.219527:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976903168:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.219548:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 11 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.219565:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099015400, rc 0) 00000100:00100000:2.0:1746066798.219592:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+11:31785:x1830882977088384:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 14329us (15117us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.219598:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14896 00000100:00100000:1.0:1746066798.227341:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.227363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.227416:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.227426:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977088512 00000100:00100000:2.0:1746066798.227434:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977088512 00002000:00100000:2.0:1746066798.227471:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1814528->2097151) req@ffff88009a4ee680 x1830882977088512/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.227481:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ee680 with x1830882977088512 ext(1814528->2097151) 00010000:00010000:2.0:1746066798.227489:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 11 pid: 9776 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.227501:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 11 pid: 9776 timeout: 859 lvb_type: 0 00002000:00010000:2.0:1746066798.227506:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a4ee680 00000100:00100000:2.0:1746066798.227521:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977089408 00000100:00100000:2.0:1746066798.227524:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977089408 00002000:00100000:2.0:1746066798.227535:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009a4ece00 x1830882977089408/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.227547:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ece00 with x1830882977089408 ext(1048576->2097151) 00002000:00010000:2.0:1746066798.227550:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4ece00 00000100:00100000:2.0:1746066798.227580:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2198 00000100:00100000:2.0:1746066798.227587:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882977088512:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066798.227922:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977089536 00000100:00100000:3.0:1746066798.227926:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977089536 00010000:00010000:3.0:1746066798.227942:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed1 expref: 268 pid: 809 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.227963:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7665 00000100:00100000:3.0:1746066798.227968:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:1966:x1830882977089536:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.227977:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.227981:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed1 expref: 268 pid: 809 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.227990:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed1 expref: 268 pid: 809 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.228008:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066798.228012:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.228019:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.228023:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.228027:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066798.228040:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6771 00000100:00100000:3.0:1746066798.228045:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:1966:x1830882977089536:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 77us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066798.228047:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1963:x1830882977089408:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066798.228050:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7665 00010000:00010000:3.0:1746066798.228083:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa20200/0xfb36a14ee608c5d4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed1 expref: 267 pid: 809 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.228097:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976903296:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066798.228108:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976903424:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066798.228124:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:1.0:1746066798.228354:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.228388:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977089664 00000100:00100000:3.0:1746066798.228396:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977089664 00010000:00010000:3.0:1746066798.228407:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeca expref: 14 pid: 14550 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.228432:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7666 00000100:00100000:3.0:1746066798.228436:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1965:x1830882977089664:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.228443:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.228446:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeca expref: 14 pid: 14550 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.228452:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeca expref: 14 pid: 14550 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.228462:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608c5c6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeca expref: 14 pid: 14550 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.228471:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066798.228473:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.228478:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.228484:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.228497:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.228511:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882977089664:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 75us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.228516:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7666 00010000:00010000:3.0:1746066798.228529:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.228534:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:3.0:1746066798.228574:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066798.228578:0:14550:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066798.228590:0:14550:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.228615:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0600/0xfb36a14ee608c5f7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eedf expref: 13 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.228625:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eedf expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.228630:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066798.228632:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066798.228634:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b1e00, rc 0) 00000100:00100000:3.0:1746066798.228666:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31791:x1830882977088640:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 17928us (18236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.228672:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10073 00000100:00100000:1.0:1746066798.235456:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976903552:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066798.237851:0:9851:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066798.240194:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977088512:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 12600us (12853us total) trans 17179873662 rc 0/0 00000100:00100000:0.0:1746066798.240206:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2198 00002000:00100000:0.0:1746066798.240217:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1814528->2097151) req@ffff88009a4ee680 x1830882977088512/t17179873662(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/448 e 0 to 0 dl 1746066809 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.240225:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ee680 with x1830882977088512 ext(1814528->2097151) 00010000:00010000:0.0:1746066798.240234:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 13 pid: 9776 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746066798.240247:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 13 pid: 9776 timeout: 859 lvb_type: 0 00002000:00010000:0.0:1746066798.240253:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a4ee680 00000100:00100000:0.0:1746066798.241336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.241785:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.241803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.241843:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977090304 00000100:00100000:3.0:1746066798.241851:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977090304 00000100:00100000:0.0:1746066798.241852:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.242153:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976903680:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066798.242179:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.242725:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977089920 00000100:00100000:2.0:1746066798.242729:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977089920 00002000:00100000:2.0:1746066798.242753:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3440640->3444735) req@ffff88012c528a80 x1830882977089920/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.242761:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c528a80 with x1830882977089920 ext(3440640->3444735) 00002000:00010000:2.0:1746066798.242765:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c528a80 00000100:00100000:2.0:1746066798.242778:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977090176 00000100:00100000:2.0:1746066798.242780:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977090176 00002000:00100000:2.0:1746066798.242790:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2535424->2539519) req@ffff88012c52a300 x1830882977090176/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.242795:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52a300 with x1830882977090176 ext(2535424->2539519) 00002000:00010000:2.0:1746066798.242797:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c52a300 00000100:00100000:2.0:1746066798.242814:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6772 00000100:00100000:2.0:1746066798.242819:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882977089920:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066798.243574:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977090432 00000100:00100000:3.0:1746066798.243579:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977090432 00000100:00100000:3.0:1746066798.243603:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14898 00000100:00100000:3.0:1746066798.243610:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977090304:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066798.243618:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.243631:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1000/0xfb36a14ee608c605 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eeed expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.243668:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976903808:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066798.243759:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1965:x1830882977089152:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 25299us (25604us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.243766:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7664 00000100:00100000:1.0:1746066798.243807:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14899 00000100:00100000:1.0:1746066798.243811:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977090432:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066798.243817:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.243823:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f60ee00/0xfb36a14ee608c60c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eef4 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066798.243843:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976903936:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066798.243895:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882977089920:12345-192.168.202.57@tcp:3:cat.0 Request processed in 1074us (2560us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066798.243901:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6772 00002000:00100000:2.0:1746066798.243906:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3440640->3444735) req@ffff88012c528a80 x1830882977089920/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.243919:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c528a80 with x1830882977089920 ext(3440640->3444735) 00002000:00010000:2.0:1746066798.243922:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c528a80 00000100:00100000:2.0:1746066798.243932:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6773 00000100:00100000:2.0:1746066798.243937:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977090176:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066798.244000:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977090176:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 63us (2215us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066798.244005:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6773 00002000:00100000:2.0:1746066798.244009:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (2535424->2539519) req@ffff88012c52a300 x1830882977090176/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746066798.244657:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066798.244666:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00002000:00100000:2.0:1746066798.246187:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52a300 with x1830882977090176 ext(2535424->2539519) 00002000:00010000:2.0:1746066798.246199:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c52a300 00000100:00100000:0.0:1746066798.246607:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.247144:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1963:x1830882977089408:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19095us (19777us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066798.247153:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6771 00002000:00100000:1.0:1746066798.247163:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009a4ece00 x1830882977089408/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.247171:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ece00 with x1830882977089408 ext(1048576->2097151) 00002000:00010000:1.0:1746066798.247222:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4ece00 00000100:00100000:2.0:1746066798.247624:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977090560 00000100:00100000:2.0:1746066798.247630:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977090560 00010000:00010000:2.0:1746066798.247652:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 12 pid: 9776 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.247691:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7667 00000100:00100000:2.0:1746066798.247696:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882977090560:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.247705:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.247720:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 12 pid: 9776 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.247729:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 12 pid: 9776 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.247747:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.247749:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.247754:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eec3 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.247765:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eec3 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.247788:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eec3 expref: 12 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066798.247796:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976904064:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066798.248185:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066798.248327:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.248485:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977090816 00000100:00100000:2.0:1746066798.248488:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977090816 00000100:00100000:2.0:1746066798.248510:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4218 00000100:00100000:2.0:1746066798.248515:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:31785:x1830882977090816:12345-192.168.202.57@tcp:35:multiop.0 00002000:00010000:1.0:1746066798.248620:0:8451:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime: 1746066793 -> 1746066797 00000100:00100000:1.0:1746066798.248632:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976903936:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066798.248654:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f60ee00/0xfb36a14ee608c60c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eef4 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.248664:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f60ee00/0xfb36a14ee608c60c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eef4 expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.248701:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f60ee00, rc 0) 00000100:00100000:1.0:1746066798.248723:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977090432:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 4911us (6871us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066798.248729:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14899 00000100:00100000:3.0:1746066798.248791:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.248997:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:31785:x1830882977090816:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 480us (670us total) trans 8589944147 rc 0/0 00000100:00100000:2.0:1746066798.249003:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4218 00010000:00010000:2.0:1746066798.249032:0:8450:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.57@tcp) returned -22 from glimpse AST (req@ffff8800924d0000 x1830882976903808) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 12 pid: 9776 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.249048:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0200/0xfb36a14ee608c572 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1814528->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee92 expref: 12 pid: 9776 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.249056:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976903808:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066798.249069:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1000/0xfb36a14ee608c605 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeed expref: 7 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.249075:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1000/0xfb36a14ee608c605 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeed expref: 7 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.249080:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b1000, rc 0) 00000100:00100000:2.0:1746066798.249096:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882977090304:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 5487us (7291us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066798.249101:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14898 00000100:00100000:1.0:1746066798.249351:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977091072 00000100:00100000:1.0:1746066798.249355:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977091072 00002000:00100000:1.0:1746066798.249376:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3555328->3559423) req@ffff8800924d0380 x1830882977091072/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.249384:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d0380 with x1830882977091072 ext(3555328->3559423) 00002000:00010000:1.0:1746066798.249387:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d0380 00000100:00100000:1.0:1746066798.249399:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6774 00000100:00100000:1.0:1746066798.249404:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977091072:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066798.249517:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977091072:12345-192.168.202.57@tcp:3:cat.0 Request processed in 112us (725us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066798.249523:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6774 00002000:00100000:1.0:1746066798.249528:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3555328->3559423) req@ffff8800924d0380 x1830882977091072/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.249535:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d0380 with x1830882977091072 ext(3555328->3559423) 00002000:00010000:1.0:1746066798.249537:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d0380 00000100:00100000:2.0:1746066798.251647:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976904064:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066798.251663:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.251880:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:1965:x1830882977090560:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4181us (5274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.251887:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7667 00000100:00100000:0.0:1746066798.254867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.254973:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977091200 00000100:00100000:2.0:1746066798.254980:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977091200 00000100:00100000:2.0:1746066798.255027:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14900 00000100:00100000:2.0:1746066798.255034:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:31794:x1830882977091200:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066798.255049:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.255063:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009edf7800/0xfb36a14ee608c613 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eefb expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.255087:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.255089:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.255096:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009edf7800/0xfb36a14ee608c613 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eefb expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.255107:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009edf7800/0xfb36a14ee608c613 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eefb expref: 22 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.255116:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009edf7800, rc 0) 00000100:00100000:2.0:1746066798.255163:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31794:x1830882977091200:12345-192.168.202.57@tcp:101:cat.0 Request processed in 129us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.255168:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14900 00000100:00100000:0.0:1746066798.261374:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.261471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.261550:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977091456 00000100:00100000:2.0:1746066798.261564:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977091456 00002000:00100000:2.0:1746066798.261597:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88012c52aa00 x1830882977091456/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.261605:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52aa00 with x1830882977091456 ext(1048576->2097151) 00002000:00010000:2.0:1746066798.261610:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c52aa00 00000100:00100000:2.0:1746066798.261637:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6775 00000100:00100000:2.0:1746066798.261643:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:1965:x1830882977091456:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066798.261977:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977091712 00000100:00100000:3.0:1746066798.261982:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977091712 00000100:00100000:3.0:1746066798.262005:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10074 00000100:00100000:3.0:1746066798.262010:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31791:x1830882977091712:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066798.262019:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.262034:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0200/0xfb36a14ee608c61a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef02 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.262099:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0600/0xfb36a14ee608c621 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.262110:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0600/0xfb36a14ee608c621 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.262118:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0600/0xfb36a14ee608c621 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.262126:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0600/0xfb36a14ee608c621 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.262131:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0600/0xfb36a14ee608c621 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.262136:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0600/0xfb36a14ee608c621 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.262141:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5b0600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066798.262144:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0600/0xfb36a14ee608c621 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.262150:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0600/0xfb36a14ee608c621 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.262157:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066798.262160:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066798.262163:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0600/0xfb36a14ee608c621 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.262167:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0600/0xfb36a14ee608c621 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066798.262191:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0200/0xfb36a14ee608c61a lrc: 1/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef02 expref: 13 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.262198:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b0200/0xfb36a14ee608c61a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef02 expref: 13 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.262204:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b0200, rc 0) 00000100:00100000:3.0:1746066798.262243:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31791:x1830882977091712:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 233us (772us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066798.262248:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10074 00000100:00100000:0.0:1746066798.262412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.262466:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977091968 00000100:00100000:2.0:1746066798.262469:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977091968 00000100:00100000:2.0:1746066798.262488:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4219 00000100:00100000:2.0:1746066798.262493:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:31796:x1830882977091968:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066798.263430:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:31796:x1830882977091968:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 934us (1016us total) trans 8589944148 rc 0/0 00000100:00100000:2.0:1746066798.263436:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4219 00000100:00100000:0.0:1746066798.264589:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.264659:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977092224 00000100:00100000:1.0:1746066798.264664:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977092224 00002000:00100000:1.0:1746066798.264704:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88012c528380 x1830882977092224/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.264713:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c528380 with x1830882977092224 ext(1048576->2097151) 00002000:00010000:1.0:1746066798.264717:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c528380 00000100:00100000:1.0:1746066798.264761:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6776 00000100:00100000:1.0:1746066798.264767:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977092224:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066798.267460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.267822:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977092480 00000100:00100000:3.0:1746066798.267829:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977092480 00000100:00100000:3.0:1746066798.267870:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4220 00000100:00100000:3.0:1746066798.267877:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31791:x1830882977092480:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:3.0:1746066798.268036:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:31791:x1830882977092480:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 159us (583us total) trans 8589944149 rc 0/0 00000100:00100000:3.0:1746066798.268042:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4220 00000100:00100000:1.0:1746066798.282415:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977092224:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17639us (17820us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066798.282427:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6776 00002000:00100000:1.0:1746066798.282436:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88012c528380 x1830882977092224/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.282446:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c528380 with x1830882977092224 ext(1048576->2097151) 00002000:00010000:1.0:1746066798.282451:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c528380 00000100:00100000:2.0:1746066798.287042:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:1965:x1830882977091456:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 25391us (25667us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066798.287054:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6775 00002000:00100000:2.0:1746066798.287062:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88012c52aa00 x1830882977091456/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.287071:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52aa00 with x1830882977091456 ext(1048576->2097151) 00002000:00010000:2.0:1746066798.287077:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c52aa00 00000100:00100000:0.0:1746066798.290931:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.291024:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977092608 00000100:00100000:1.0:1746066798.291032:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977092608 00000100:00100000:1.0:1746066798.291080:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14901 00000100:00100000:1.0:1746066798.291087:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31794:x1830882977092608:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066798.291102:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.291115:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f60f200/0xfb36a14ee608c628 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef09 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.291139:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.291151:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066798.291152:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066798.291155:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f60f200/0xfb36a14ee608c628 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef09 expref: 23 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.291179:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 10 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.291189:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 10 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746066798.291200:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976904192:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066798.292383:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066798.293462:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976904192:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.293484:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f60f200/0xfb36a14ee608c628 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef09 expref: 23 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.293498:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f60f200, rc 0) 00000100:00100000:1.0:1746066798.293568:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:31794:x1830882977092608:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2480us (2642us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.293575:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14901 00000100:00100000:0.0:1746066798.299840:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.299888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.300235:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977092864 00000100:00100000:1.0:1746066798.300243:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977092864 00000100:00100000:1.0:1746066798.300294:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14902 00000100:00100000:1.0:1746066798.300300:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:31789:x1830882977092864:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066798.300316:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.300329:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f60ea00/0xfb36a14ee608c62f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef10 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.300353:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066798.300358:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f60ea00/0xfb36a14ee608c62f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2539520->3145727] (req 2539520->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef10 expref: 12 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.300367:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f60ea00/0xfb36a14ee608c62f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2539520->3145727] (req 2539520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef10 expref: 12 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.300376:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f60ea00, rc 0) 00000100:00100000:1.0:1746066798.300411:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:31789:x1830882977092864:12345-192.168.202.57@tcp:101:cat.0 Request processed in 112us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.300417:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14902 00000100:00100000:2.0:1746066798.300471:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977092736 00000100:00100000:2.0:1746066798.300475:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977092736 00002000:00100000:2.0:1746066798.300495:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->2539519) req@ffff8801361f8e00 x1830882977092736/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.300503:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8e00 with x1830882977092736 ext(2097152->2539519) 00010000:00010000:2.0:1746066798.300508:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 12 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.300517:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 12 pid: 8450 timeout: 859 lvb_type: 0 00002000:00010000:2.0:1746066798.300522:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801361f8e00 00000100:00100000:2.0:1746066798.300542:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2199 00000100:00100000:2.0:1746066798.300547:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977092736:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:2.0:1746066798.308920:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977092736:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 8363us (9022us total) trans 17179873663 rc 0/0 00000100:00100000:2.0:1746066798.308930:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2199 00002000:00100000:2.0:1746066798.308942:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->2539519) req@ffff8801361f8e00 x1830882977092736/t17179873663(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/448 e 0 to 0 dl 1746066809 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.308951:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8e00 with x1830882977092736 ext(2097152->2539519) 00010000:00010000:2.0:1746066798.308959:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.308973:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00002000:00010000:2.0:1746066798.308980:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801361f8e00 00000100:00100000:0.0:1746066798.311603:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.311711:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977092992 00000100:00100000:2.0:1746066798.311717:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977092992 00010000:00010000:2.0:1746066798.311751:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.311777:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7668 00000100:00100000:2.0:1746066798.311783:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977092992:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.311793:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.311815:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.311825:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.311849:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099015400/0xfb36a14ee608c5e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->3440639] (req 2097152->2539519) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eed8 expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.311882:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.311883:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.311890:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f60f200/0xfb36a14ee608c628 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef09 expref: 22 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.311903:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f60f200/0xfb36a14ee608c628 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef09 expref: 22 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.311911:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.311912:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.311915:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f60ea00/0xfb36a14ee608c62f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2539520->3440639] (req 2539520->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef10 expref: 13 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.311921:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f60ea00/0xfb36a14ee608c62f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2539520->3440639] (req 2539520->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef10 expref: 13 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.311951:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f60ea00/0xfb36a14ee608c62f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2539520->3440639] (req 2539520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef10 expref: 13 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066798.311967:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976904320:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066798.312053:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f60f200/0xfb36a14ee608c628 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef09 expref: 22 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066798.312062:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976904448:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066798.313181:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066798.321732:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976904320:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066798.322059:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976904448:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066798.322080:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.322127:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977092992:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 10342us (10536us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.322137:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7668 00000100:00100000:1.0:1746066798.322148:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.322280:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977093248 00000100:00100000:2.0:1746066798.322286:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977093248 00002000:00100000:2.0:1746066798.322316:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009e93dc00 x1830882977093248/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.322325:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93dc00 with x1830882977093248 ext(2097152->3145727) 00002000:00010000:2.0:1746066798.322329:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93dc00 00000100:00100000:0.0:1746066798.322383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.322392:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977093504 00000100:00100000:2.0:1746066798.322395:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977093504 00002000:00100000:2.0:1746066798.322409:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2539520->3440639) req@ffff8801361f9880 x1830882977093504/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.322416:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f9880 with x1830882977093504 ext(2539520->3440639) 00002000:00010000:2.0:1746066798.322419:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361f9880 00000100:00100000:2.0:1746066798.322430:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6777 00000100:00100000:2.0:1746066798.322436:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882977093248:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066798.322440:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6778 00000100:00100000:0.0:1746066798.322447:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977093504:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066798.340003:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882977093248:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17559us (17848us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066798.340015:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6777 00002000:00100000:2.0:1746066798.340025:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009e93dc00 x1830882977093248/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.340032:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93dc00 with x1830882977093248 ext(2097152->3145727) 00002000:00010000:2.0:1746066798.340037:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93dc00 00000100:00100000:2.0:1746066798.345670:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977093504:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23215us (23278us total) trans 0 rc 901120/901120 00000100:00100000:2.0:1746066798.345695:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6778 00002000:00100000:2.0:1746066798.345707:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2539520->3440639) req@ffff8801361f9880 x1830882977093504/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 901120/901120 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.345716:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f9880 with x1830882977093504 ext(2539520->3440639) 00002000:00010000:2.0:1746066798.345722:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361f9880 00000100:00100000:0.0:1746066798.345941:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.346307:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977093632 00000100:00100000:1.0:1746066798.346315:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977093632 00000100:00100000:3.0:1746066798.347034:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14903 00000100:00100000:3.0:1746066798.347044:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:31794:x1830882977093632:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.347058:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.347072:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0e00/0xfb36a14ee608c636 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef17 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.347093:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3440640->18446744073709551615] (req 3440640->3559423) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.347100:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066798.347102:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066798.347105:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0e00/0xfb36a14ee608c636 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef17 expref: 24 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.347130:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3440640->18446744073709551615] (req 3440640->3559423) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 24 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.347140:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3440640->18446744073709551615] (req 3440640->3559423) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 24 pid: 4614 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.347149:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976904576:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066798.347450:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.349590:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.349645:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977093760 00000100:00100000:2.0:1746066798.349651:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977093760 00002000:00100000:2.0:1746066798.349700:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3440640->3559423) req@ffff8801361f8700 x1830882977093760/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066798.349701:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976904576:192.168.202.57@tcp:104: 00002000:00100000:2.0:1746066798.349708:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8700 with x1830882977093760 ext(3440640->3559423) 00010000:00010000:2.0:1746066798.349714:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3440640->18446744073709551615] (req 3440640->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 25 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.349724:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0e00/0xfb36a14ee608c636 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef17 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.349724:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3440640->18446744073709551615] (req 3440640->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 25 pid: 4614 timeout: 859 lvb_type: 0 00002000:00010000:2.0:1746066798.349730:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801361f8700 00010000:00010000:3.0:1746066798.349734:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b0e00, rc 0) 00000100:00100000:2.0:1746066798.349745:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2200 00000100:00100000:2.0:1746066798.349751:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1966:x1830882977093760:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066798.349856:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31794:x1830882977093632:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2814us (3915us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.349862:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14903 00000100:00100000:1.0:1746066798.351220:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.351953:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977093888 00000100:00100000:3.0:1746066798.351958:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977093888 00000100:00100000:3.0:1746066798.351982:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14904 00000100:00100000:3.0:1746066798.351987:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+13:31789:x1830882977093888:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.351998:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.352010:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0400/0xfb36a14ee608c63d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef1e expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.352031:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066798.352035:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0400/0xfb36a14ee608c63d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef1e expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.352044:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0400/0xfb36a14ee608c63d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef1e expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.352051:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b0400, rc 0) 00000100:00100000:3.0:1746066798.352086:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+14:31789:x1830882977093888:12345-192.168.202.57@tcp:101:cat.0 Request processed in 98us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.352091:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14904 00000100:00100000:2.0:1746066798.352654:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1966:x1830882977093760:12345-192.168.202.57@tcp:4:cat.0 Request processed in 2902us (3068us total) trans 17179873664 rc 0/0 00000100:00100000:2.0:1746066798.352661:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2200 00002000:00100000:2.0:1746066798.352668:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3440640->3559423) req@ffff8801361f8700 x1830882977093760/t17179873664(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/448 e 0 to 0 dl 1746066809 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.352694:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8700 with x1830882977093760 ext(3440640->3559423) 00010000:00010000:2.0:1746066798.352700:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3440640->18446744073709551615] (req 3440640->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 26 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.352710:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3440640->18446744073709551615] (req 3440640->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 26 pid: 4614 timeout: 859 lvb_type: 0 00002000:00010000:2.0:1746066798.352716:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801361f8700 00000100:00100000:0.0:1746066798.356660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.356771:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977094016 00000100:00100000:3.0:1746066798.356779:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977094016 00010000:00010000:3.0:1746066798.356807:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3440640->18446744073709551615] (req 3440640->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 26 pid: 4614 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.356830:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7669 00000100:00100000:3.0:1746066798.356837:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977094016:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.356849:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066798.356864:0:9852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066797 -> 1746066798 00010000:00010000:3.0:1746066798.356869:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3440640->18446744073709551615] (req 3440640->3559423) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 26 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.356880:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3440640->18446744073709551615] (req 3440640->3559423) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 26 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.356903:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800925a2400/0xfb36a14ee608c5f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3440640->18446744073709551615] (req 3440640->3559423) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eee6 expref: 26 pid: 4614 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.357639:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.357642:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.357650:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0e00/0xfb36a14ee608c636 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef17 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.357659:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0e00/0xfb36a14ee608c636 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef17 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.357667:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.357668:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.357671:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0400/0xfb36a14ee608c63d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef1e expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.357699:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0400/0xfb36a14ee608c63d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef1e expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.357727:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0400/0xfb36a14ee608c63d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef1e expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.357736:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976904704:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066798.358258:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0e00/0xfb36a14ee608c636 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef17 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.358394:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976904832:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066798.358420:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066798.361277:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976904704:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066798.363384:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.363434:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977094272 00000100:00100000:2.0:1746066798.363441:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977094272 00000100:00100000:0.0:1746066798.363456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:2.0:1746066798.363477:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3440640->4194303) req@ffff88009bfe2a00 x1830882977094272/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.363486:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2a00 with x1830882977094272 ext(3440640->4194303) 00002000:00010000:2.0:1746066798.363490:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2a00 00000100:00100000:2.0:1746066798.363502:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977094528 00000100:00100000:2.0:1746066798.363504:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977094528 00002000:00100000:2.0:1746066798.363518:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009bfe0380 x1830882977094528/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.363524:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0380 with x1830882977094528 ext(3145728->4194303) 00002000:00010000:2.0:1746066798.363526:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe0380 00000100:00100000:2.0:1746066798.363547:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6779 00000100:00100000:2.0:1746066798.363561:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977094272:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066798.363605:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6780 00000100:00100000:1.0:1746066798.363612:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1966:x1830882977094528:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066798.364432:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976904832:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066798.364450:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.364484:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977094016:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7648us (7832us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.364491:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7669 00000100:00100000:3.0:1746066798.378049:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977094272:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14487us (14661us total) trans 0 rc 753664/753664 00000100:00100000:3.0:1746066798.378060:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6779 00002000:00100000:3.0:1746066798.378070:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3440640->4194303) req@ffff88009bfe2a00 x1830882977094272/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066798.378080:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2a00 with x1830882977094272 ext(3440640->4194303) 00002000:00010000:3.0:1746066798.378084:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2a00 00000100:00100000:1.0:1746066798.379791:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1966:x1830882977094528:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16174us (16330us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066798.379800:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6780 00002000:00100000:1.0:1746066798.379808:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009bfe0380 x1830882977094528/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.379821:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0380 with x1830882977094528 ext(3145728->4194303) 00002000:00010000:1.0:1746066798.379825:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe0380 00000100:00100000:0.0:1746066798.387030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.387108:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.387424:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977095040 00000100:00100000:1.0:1746066798.387432:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977095040 00000100:00100000:1.0:1746066798.387481:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10075 00000100:00100000:1.0:1746066798.387489:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:31801:x1830882977095040:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066798.387509:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.387522:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094e00/0xfb36a14ee608c644 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef25 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.387609:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066798.387621:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eedf expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.387627:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066798.387654:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eedf expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.387664:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eedf expref: 12 pid: 14550 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.387760:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977094784 00000100:00100000:2.0:1746066798.387764:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977094784 00002000:00100000:2.0:1746066798.387787:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009bfe1500 x1830882977094784/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.387796:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1500 with x1830882977094784 ext(4194304->5091327) 00002000:00010000:2.0:1746066798.387800:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1500 00000100:00100000:2.0:1746066798.387814:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6781 00000100:00100000:2.0:1746066798.387820:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977094784:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066798.388706:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976904960:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066798.388778:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.389875:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.390183:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977095296 00000100:00100000:3.0:1746066798.390188:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977095296 00002000:00100000:3.0:1746066798.390214:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009bfe3480 x1830882977095296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066798.390222:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3480 with x1830882977095296 ext(4194304->5091327) 00002000:00010000:3.0:1746066798.390225:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3480 00000100:00100000:3.0:1746066798.390245:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6782 00000100:00100000:3.0:1746066798.390251:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977095296:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066798.391891:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976904960:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.391916:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:0.0:1746066798.392232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.394324:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977095424 00000100:00100000:3.0:1746066798.394332:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977095424 00010000:00010000:3.0:1746066798.394357:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eedf expref: 13 pid: 14550 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.394380:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7670 00000100:00100000:3.0:1746066798.394385:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882977095424:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.394394:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.394399:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eedf expref: 13 pid: 14550 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.394408:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eedf expref: 13 pid: 14550 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.394425:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c5fe lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eedf expref: 13 pid: 14550 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.394439:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066798.394444:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066798.394452:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066798.394457:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066798.394472:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.394492:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882977095424:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 107us (2260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.394501:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7670 00010000:00010000:2.0:1746066798.396380:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066798.396392:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:2.0:1746066798.396409:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066798.396530:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094e00/0xfb36a14ee608c644 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef25 expref: 26 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.396564:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef25 expref: 25 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.396572:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066798.396575:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066798.396577:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f094c00, rc 0) 00000100:00100000:2.0:1746066798.396615:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:31801:x1830882977095040:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 9128us (9507us total) trans 8589944150 rc 0/0 00000100:00100000:2.0:1746066798.396622:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10075 00000100:00100000:2.0:1746066798.400719:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977094784:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12891us (13687us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066798.400727:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6781 00002000:00100000:2.0:1746066798.400737:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009bfe1500 x1830882977094784/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.400745:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1500 with x1830882977094784 ext(4194304->5091327) 00002000:00010000:2.0:1746066798.400751:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1500 00000100:00100000:2.0:1746066798.411083:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977095296:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20823us (21202us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066798.411093:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6782 00002000:00100000:2.0:1746066798.411103:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009bfe3480 x1830882977095296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.411110:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3480 with x1830882977095296 ext(4194304->5091327) 00002000:00010000:2.0:1746066798.411115:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3480 00000100:00100000:0.0:1746066798.493531:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.493623:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977095680 00000100:00100000:2.0:1746066798.493630:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977095680 00000100:00100000:2.0:1746066798.493698:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10076 00000100:00100000:2.0:1746066798.493704:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:31805:x1830882977095680:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066798.493723:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.493737:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009025d000/0xfb36a14ee608c659 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef2c expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.493807:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c400/0xfb36a14ee608c660 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066798.493818:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c400/0xfb36a14ee608c660 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066798.493826:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c400/0xfb36a14ee608c660 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:2.0:1746066798.493833:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066798.493911:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009025d000/0xfb36a14ee608c659 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef2c expref: 271 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.493939:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c400/0xfb36a14ee608c660 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef2c expref: 270 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.493945:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066798.493948:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066798.493950:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025c400, rc 0) 00000100:00100000:2.0:1746066798.493983:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+270:31805:x1830882977095680:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 280us (460us total) trans 8589944151 rc 0/0 00000100:00100000:2.0:1746066798.493988:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10076 00000100:00100000:0.0:1746066798.520964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.521604:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977095808 00000100:00100000:1.0:1746066798.521613:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977095808 00000100:00100000:1.0:1746066798.524496:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14905 00000100:00100000:1.0:1746066798.524512:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31805:x1830882977095808:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066798.524528:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.524543:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef33 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.524577:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0e00/0xfb36a14ee608c636 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef17 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.524585:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0400/0xfb36a14ee608c63d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef1e expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.524591:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.524592:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.524595:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3698688->4079615] (req 3698688->4079615) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.524622:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0400/0xfb36a14ee608c63d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef1e expref: 13 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.524632:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0400/0xfb36a14ee608c63d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef1e expref: 13 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746066798.524647:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976905088:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.525501:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0e00/0xfb36a14ee608c636 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef17 expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.525510:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0e00/0xfb36a14ee608c636 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef17 expref: 26 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746066798.525518:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976905216:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066798.526731:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066798.529046:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976905088:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066798.532468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.532526:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977095936 00000100:00100000:2.0:1746066798.532533:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977095936 00010000:00010000:2.0:1746066798.532582:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0400/0xfb36a14ee608c63d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef1e expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.532865:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7671 00000100:00100000:2.0:1746066798.532872:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977095936:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.532883:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.532900:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0400/0xfb36a14ee608c63d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef1e expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.532910:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0400/0xfb36a14ee608c63d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef1e expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.532927:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0400/0xfb36a14ee608c63d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef1e expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.532946:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.532981:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977095936:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 110us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.532987:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7671 00000100:00100000:1.0:1746066798.533366:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976905216:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.533389:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3698688->4079615] (req 3698688->4079615) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.533398:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f094800, rc 0) 00000100:00100000:1.0:1746066798.533419:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31805:x1830882977095808:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 8915us (12463us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.533425:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14905 00000100:00100000:0.0:1746066798.536234:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.536334:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977096064 00000100:00100000:3.0:1746066798.536344:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977096064 00010000:00010000:3.0:1746066798.536376:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0e00/0xfb36a14ee608c636 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef17 expref: 26 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.536429:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7672 00000100:00100000:3.0:1746066798.536438:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1966:x1830882977096064:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.536453:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.536473:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0e00/0xfb36a14ee608c636 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef17 expref: 26 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.536484:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0e00/0xfb36a14ee608c636 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef17 expref: 26 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.536505:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0e00/0xfb36a14ee608c636 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef17 expref: 26 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.536544:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.536547:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.536585:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4079615) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.536595:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4079615) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.536632:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3698688->18446744073709551615] (req 3698688->4079615) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.537008:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976905344:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066798.537473:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066798.539727:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976905344:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066798.539743:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.539773:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1966:x1830882977096064:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3337us (3546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.539781:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7672 00000100:00100000:0.0:1746066798.541001:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.541623:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977096320 00000100:00100000:2.0:1746066798.541630:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977096320 00002000:00100000:2.0:1746066798.541663:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3698688->3702783) req@ffff88009bfe3b80 x1830882977096320/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.541671:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3b80 with x1830882977096320 ext(3698688->3702783) 00002000:00010000:2.0:1746066798.541801:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3b80 00000100:00100000:2.0:1746066798.541932:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6783 00000100:00100000:2.0:1746066798.541939:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977096320:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066798.542257:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977096320:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 317us (1258us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066798.542263:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6783 00002000:00100000:2.0:1746066798.542269:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3698688->3702783) req@ffff88009bfe3b80 x1830882977096320/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.542275:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3b80 with x1830882977096320 ext(3698688->3702783) 00002000:00010000:2.0:1746066798.542278:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3b80 00000100:00100000:0.0:1746066798.547388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.547538:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977096576 00000100:00100000:2.0:1746066798.547545:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977096576 00002000:00100000:2.0:1746066798.547588:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4075520->4079615) req@ffff88009bfe0000 x1830882977096576/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.547603:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0000 with x1830882977096576 ext(4075520->4079615) 00002000:00010000:2.0:1746066798.547607:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe0000 00000100:00100000:2.0:1746066798.547624:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6784 00000100:00100000:2.0:1746066798.547632:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977096576:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066798.547889:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977096576:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 256us (505us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066798.547895:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6784 00002000:00100000:2.0:1746066798.547900:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4075520->4079615) req@ffff88009bfe0000 x1830882977096576/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.547906:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0000 with x1830882977096576 ext(4075520->4079615) 00002000:00010000:2.0:1746066798.547909:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe0000 00000100:00100000:0.0:1746066798.598276:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.598409:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977096704 00000100:00100000:1.0:1746066798.598418:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977096704 00000100:00100000:1.0:1746066798.598464:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14906 00000100:00100000:1.0:1746066798.598950:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:31801:x1830882977096704:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066798.598965:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.598980:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef3a expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.599004:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f095c00/0xfb36a14ee608c2f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed18 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.599017:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608c476 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf8 expref: 5 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.599023:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4aae600/0xfb36a14ee608c311 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed26 expref: 24 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.599029:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.599031:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.599033:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [991232->1048575] (req 991232->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 14 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.599058:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4aae600/0xfb36a14ee608c311 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed26 expref: 24 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.599068:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4aae600/0xfb36a14ee608c311 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed26 expref: 24 pid: 4614 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746066798.599078:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976905472:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.600432:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608c476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf8 expref: 5 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.600444:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608c476 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf8 expref: 5 pid: 8450 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746066798.600454:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976905600:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.601251:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f095c00/0xfb36a14ee608c2f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed18 expref: 14 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.601261:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f095c00/0xfb36a14ee608c2f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed18 expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746066798.601270:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976905728:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066798.601291:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066798.606403:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976905472:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066798.607778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.608390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.609806:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976905600:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.609873:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977096960 00000100:00100000:2.0:1746066798.609878:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977096960 00010000:00010000:2.0:1746066798.609911:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608c476 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf8 expref: 6 pid: 8450 timeout: 859 lvb_type: 1 00000100:00100000:2.0:1746066798.609932:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977096832 00000100:00100000:2.0:1746066798.609933:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977096832 00010000:00010000:2.0:1746066798.609941:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4aae600/0xfb36a14ee608c311 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed26 expref: 25 pid: 4614 timeout: 859 lvb_type: 1 00000100:00100000:2.0:1746066798.609954:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7673 00000100:00100000:2.0:1746066798.609959:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882977096960:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.609971:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066798.609986:0:7109:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2013 -> 2017 00010000:00010000:2.0:1746066798.609991:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608c476 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf8 expref: 6 pid: 8450 timeout: 859 lvb_type: 1 00010000:00010000:2.0:1746066798.609999:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608c476 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf8 expref: 6 pid: 8450 timeout: 859 lvb_type: 1 00010000:00010000:2.0:1746066798.610015:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e881c00/0xfb36a14ee608c476 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edf8 expref: 6 pid: 8450 timeout: 859 lvb_type: 1 00010000:00010000:2.0:1746066798.610039:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.610070:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1963:x1830882977096960:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 110us (2296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.610075:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7673 00000100:00100000:2.0:1746066798.610086:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7674 00000100:00100000:2.0:1746066798.610089:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977096832:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.610095:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.610101:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4aae600/0xfb36a14ee608c311 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed26 expref: 25 pid: 4614 timeout: 859 lvb_type: 1 00010000:00010000:2.0:1746066798.610107:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4aae600/0xfb36a14ee608c311 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed26 expref: 25 pid: 4614 timeout: 859 lvb_type: 1 00010000:00010000:2.0:1746066798.610116:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4aae600/0xfb36a14ee608c311 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed26 expref: 25 pid: 4614 timeout: 859 lvb_type: 1 00010000:00010000:2.0:1746066798.610122:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.610132:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977096832:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 42us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.610136:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7674 00000100:00100000:1.0:1746066798.613711:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976905728:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.613741:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [991232->1048575] (req 991232->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 14 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.613755:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f094200, rc 0) 00000100:00100000:1.0:1746066798.613804:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+14:31801:x1830882977096704:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 14856us (15534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.613814:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14906 00000100:00100000:0.0:1746066798.613935:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.614056:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977097088 00000100:00100000:3.0:1746066798.614062:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977097088 00010000:00010000:3.0:1746066798.614083:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f095c00/0xfb36a14ee608c2f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed18 expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:3.0:1746066798.614101:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7675 00000100:00100000:3.0:1746066798.614107:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977097088:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.614117:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.614134:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f095c00/0xfb36a14ee608c2f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed18 expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.614144:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f095c00/0xfb36a14ee608c2f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed18 expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.614162:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f095c00/0xfb36a14ee608c2f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed18 expref: 14 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:3.0:1746066798.614189:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.614191:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.614196:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 13 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.614204:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 13 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.614228:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 13 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.614237:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976905856:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066798.614287:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066798.617934:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976905856:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066798.617953:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.617997:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977097088:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3889us (4062us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.618006:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7675 00000100:00100000:0.0:1746066798.618391:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.618510:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977097344 00000100:00100000:2.0:1746066798.618515:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977097344 00002000:00100000:2.0:1746066798.618547:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (991232->995327) req@ffff88009bfe1f80 x1830882977097344/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.618564:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1f80 with x1830882977097344 ext(991232->995327) 00002000:00010000:2.0:1746066798.618569:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1f80 00000100:00100000:2.0:1746066798.618583:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6785 00000100:00100000:2.0:1746066798.618590:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977097344:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066798.618745:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977097344:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 155us (354us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066798.618751:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6785 00002000:00100000:2.0:1746066798.618756:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (991232->995327) req@ffff88009bfe1f80 x1830882977097344/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.618763:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1f80 with x1830882977097344 ext(991232->995327) 00002000:00010000:2.0:1746066798.618765:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1f80 00000100:00100000:0.0:1746066798.622886:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.623122:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977097472 00000100:00100000:1.0:1746066798.623130:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977097472 00000100:00100000:1.0:1746066798.624257:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14907 00000100:00100000:1.0:1746066798.624268:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:31801:x1830882977097472:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066798.624286:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.624303:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef41 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.624329:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013510ae00/0xfb36a14ee608c509 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee53 expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.624336:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608c595 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea0 expref: 7 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.624343:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a52d8e00/0xfb36a14ee608c556 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee76 expref: 14 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.624349:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.624350:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.624354:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1048576->2019327] (req 1048576->2019327) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 14 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.624378:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a52d8e00/0xfb36a14ee608c556 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee76 expref: 14 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.624389:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a52d8e00/0xfb36a14ee608c556 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee76 expref: 14 pid: 8451 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746066798.624399:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976905984:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.624488:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608c595 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea0 expref: 7 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.624501:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608c595 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea0 expref: 7 pid: 9776 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746066798.624510:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976906112:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.624536:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013510ae00/0xfb36a14ee608c509 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee53 expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.624543:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013510ae00/0xfb36a14ee608c509 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee53 expref: 16 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746066798.624564:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976906240:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066798.624581:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.629950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.629981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.630020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.630087:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977097600 00000100:00100000:2.0:1746066798.630094:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977097600 00010000:00010000:2.0:1746066798.630126:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a52d8e00/0xfb36a14ee608c556 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee76 expref: 15 pid: 8451 timeout: 859 lvb_type: 1 00000100:00100000:2.0:1746066798.630149:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7676 00000100:00100000:2.0:1746066798.630154:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977097600:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.630167:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.630184:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a52d8e00/0xfb36a14ee608c556 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee76 expref: 15 pid: 8451 timeout: 859 lvb_type: 1 00010000:00010000:2.0:1746066798.630194:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a52d8e00/0xfb36a14ee608c556 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee76 expref: 15 pid: 8451 timeout: 859 lvb_type: 1 00010000:00010000:2.0:1746066798.630214:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.630247:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977097600:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 93us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.630253:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7676 00000100:00100000:2.0:1746066798.630265:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977097856 00000100:00100000:2.0:1746066798.630268:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977097856 00010000:00010000:2.0:1746066798.630275:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013510ae00/0xfb36a14ee608c509 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee53 expref: 17 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.630286:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977097728 00000100:00100000:2.0:1746066798.630288:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977097728 00010000:00010000:2.0:1746066798.630295:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608c595 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea0 expref: 8 pid: 9776 timeout: 859 lvb_type: 1 00000100:00100000:2.0:1746066798.630306:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7677 00000100:00100000:2.0:1746066798.630309:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1963:x1830882977097856:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.630314:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.630320:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013510ae00/0xfb36a14ee608c509 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee53 expref: 17 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.630331:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013510ae00/0xfb36a14ee608c509 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee53 expref: 17 pid: 8450 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.630341:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.630354:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1963:x1830882977097856:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 44us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.630358:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7677 00000100:00100000:2.0:1746066798.630366:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7678 00000100:00100000:2.0:1746066798.630370:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977097728:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.630376:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.630381:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608c595 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea0 expref: 8 pid: 9776 timeout: 859 lvb_type: 1 00010000:00010000:2.0:1746066798.630389:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608c595 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea0 expref: 8 pid: 9776 timeout: 859 lvb_type: 1 00010000:00010000:2.0:1746066798.630399:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.630401:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.630405:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 14 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.630412:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 14 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.630436:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 14 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066798.630445:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976906368:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066798.630491:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c180 going to sleep for 11 seconds 00010000:00010000:1.0:1746066798.630724:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a52d8e00/0xfb36a14ee608c556 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee76 expref: 14 pid: 8451 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746066798.630741:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976905984:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.630749:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608c595 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea0 expref: 8 pid: 9776 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746066798.630756:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976906112:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.630764:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013510ae00/0xfb36a14ee608c509 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee53 expref: 16 pid: 8450 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746066798.630775:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976906240:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.630795:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 13 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.630802:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f094400, rc 0) 00000100:00100000:1.0:1746066798.630823:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:31801:x1830882977097472:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6558us (7943us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.630829:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14907 00000100:00100000:2.0:1746066798.638079:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976906368:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066798.638099:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.639425:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977097728:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 9046us (9397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.639436:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7678 00000100:00100000:0.0:1746066798.648548:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.648614:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.648639:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.648673:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.648728:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977098240 00000100:00100000:0.0:1746066798.648735:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977098240 00000100:00100000:0.0:1746066798.648765:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977098368 00000100:00100000:0.0:1746066798.648767:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977098368 00000100:00100000:0.0:1746066798.648775:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977098496 00000100:00100000:0.0:1746066798.648777:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977098496 00000100:00100000:0.0:1746066798.648789:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14908 00000100:00100000:0.0:1746066798.648795:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977098240:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066798.648810:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066798.648825:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009aa21000/0xfb36a14ee608c683 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef48 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.648867:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976906496:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066798.648926:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42ab540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.649011:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14909 00000100:00100000:0.0:1746066798.649016:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1964:x1830882977098368:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066798.649022:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066798.649031:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50a6600/0xfb36a14ee608c68a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef4f expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.649053:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976906624:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066798.649073:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.649084:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14910 00000100:00100000:0.0:1746066798.649089:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977098496:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066798.649094:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066798.649100:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50a7c00/0xfb36a14ee608c691 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef56 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.649118:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976906752:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066798.649133:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42abb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066798.649614:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977098112 00000100:00100000:2.0:1746066798.649618:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977098112 00002000:00100000:2.0:1746066798.649639:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (2015232->2019327) req@ffff8800996dbb80 x1830882977098112/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.649647:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996dbb80 with x1830882977098112 ext(2015232->2019327) 00002000:00010000:2.0:1746066798.649651:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996dbb80 00000100:00100000:2.0:1746066798.649664:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6786 00000100:00100000:2.0:1746066798.649669:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:1965:x1830882977098112:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066798.649801:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:1965:x1830882977098112:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 131us (1261us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066798.649807:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6786 00002000:00100000:2.0:1746066798.649811:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (2015232->2019327) req@ffff8800996dbb80 x1830882977098112/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.649817:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996dbb80 with x1830882977098112 ext(2015232->2019327) 00002000:00010000:2.0:1746066798.649820:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996dbb80 00002000:00010000:1.0:1746066798.653637:0:4614:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime: 1746066796 -> 1746066798 00002000:00010000:1.0:1746066798.653645:0:4614:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime: 1746066796 -> 1746066798 00002000:00010000:1.0:1746066798.653646:0:4614:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime: 1746066796 -> 1746066798 00000100:00100000:1.0:1746066798.653667:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976906496:192.168.202.57@tcp:106: 00002000:00010000:0.0:1746066798.653807:0:10402:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime: 1746066797 -> 1746066798 00002000:00010000:0.0:1746066798.653809:0:10402:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime: 1746066797 -> 1746066798 00000100:00100000:0.0:1746066798.653818:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976906752:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066798.653842:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50a7c00/0xfb36a14ee608c691 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef56 expref: 27 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066798.653854:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50a7c00/0xfb36a14ee608c691 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef56 expref: 27 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.654107:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009aa21000/0xfb36a14ee608c683 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef48 expref: 26 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.654115:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009aa21000/0xfb36a14ee608c683 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef48 expref: 26 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.654125:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa21000, rc 0) 00000100:00100000:1.0:1746066798.654159:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977098240:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5364us (5545us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066798.654166:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14908 00002000:00010000:2.0:1746066798.654253:0:9776:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime: 1746066797 -> 1746066798 00002000:00010000:2.0:1746066798.654256:0:9776:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime: 1746066797 -> 1746066798 00002000:00010000:2.0:1746066798.654257:0:9776:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime: 1746066797 -> 1746066798 00000100:00100000:2.0:1746066798.654268:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976906624:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066798.654281:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50a6600/0xfb36a14ee608c68a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef4f expref: 17 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.654289:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50a6600/0xfb36a14ee608c68a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef4f expref: 17 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.654306:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50a6600, rc 0) 00000100:00100000:2.0:1746066798.654363:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1964:x1830882977098368:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5347us (5723us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066798.654367:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14909 00010000:00010000:0.0:1746066798.654424:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50a7c00, rc 0) 00000100:00100000:0.0:1746066798.654441:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977098496:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5352us (5767us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066798.654446:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14910 00000100:00100000:0.0:1746066798.661935:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.662078:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977098624 00000100:00100000:2.0:1746066798.662086:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977098624 00000100:00100000:2.0:1746066798.662137:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14911 00000100:00100000:2.0:1746066798.662144:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:31811:x1830882977098624:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066798.662159:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.662172:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009025d200/0xfb36a14ee608c698 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef5d expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.662195:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 12 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.662203:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066798.662205:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066798.662208:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009025d200/0xfb36a14ee608c698 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef5d expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.662232:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 12 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.662243:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 12 pid: 8451 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.662253:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976906880:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.664712:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.711872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.711937:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977098752 00000100:00100000:1.0:1746066798.711944:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977098752 00002000:00100000:1.0:1746066798.711981:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (991232->1048575) req@ffff8800996d8a80 x1830882977098752/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.711991:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8a80 with x1830882977098752 ext(991232->1048575) 00010000:00010000:1.0:1746066798.711998:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 13 pid: 8451 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746066798.712010:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 13 pid: 8451 timeout: 859 lvb_type: 0 00002000:00010000:1.0:1746066798.712017:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800996d8a80 00000100:00100000:1.0:1746066798.712033:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2201 00000100:00100000:1.0:1746066798.712040:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977098752:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066798.712241:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976906880:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066798.712262:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009025d200/0xfb36a14ee608c698 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef5d expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.712274:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025d200, rc 0) 00000100:00100000:3.0:1746066798.712295:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31811:x1830882977098624:12345-192.168.202.57@tcp:101:cat.0 Request processed in 50151us (50367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.712302:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14911 00000100:00100000:2.0:1746066798.714334:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977098752:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 2289us (2463us total) trans 17179873665 rc 0/0 00000100:00100000:2.0:1746066798.714343:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2201 00002000:00100000:2.0:1746066798.714351:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (991232->1048575) req@ffff8800996d8a80 x1830882977098752/t17179873665(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/448 e 0 to 0 dl 1746066809 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.714359:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8a80 with x1830882977098752 ext(991232->1048575) 00010000:00010000:2.0:1746066798.714366:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 15 pid: 8451 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.714378:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 15 pid: 8451 timeout: 859 lvb_type: 0 00002000:00010000:2.0:1746066798.714384:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800996d8a80 00000100:00100000:0.0:1746066798.716147:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.716225:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977098880 00000100:00100000:2.0:1746066798.716232:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977098880 00010000:00010000:2.0:1746066798.716256:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 15 pid: 8451 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.716288:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7679 00000100:00100000:2.0:1746066798.716294:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977098880:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.716306:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.716321:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 15 pid: 8451 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.716330:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 15 pid: 8451 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.716347:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f094200/0xfb36a14ee608c675 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 991232->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef3a expref: 15 pid: 8451 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.716361:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.716363:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.716368:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009025d200/0xfb36a14ee608c698 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef5d expref: 24 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.716375:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009025d200/0xfb36a14ee608c698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef5d expref: 24 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.716399:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009025d200/0xfb36a14ee608c698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef5d expref: 24 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066798.716408:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976907008:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066798.716476:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.722422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.722516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.722660:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977099136 00000100:00100000:1.0:1746066798.722667:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977099136 00000100:00100000:1.0:1746066798.722721:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977099264 00000100:00100000:1.0:1746066798.722723:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977099264 00000100:00100000:1.0:1746066798.722737:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14912 00000100:00100000:1.0:1746066798.722743:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977099136:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066798.722759:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.722771:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f094a00/0xfb36a14ee608c69f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef64 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.722789:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.722790:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.722797:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f094a00/0xfb36a14ee608c69f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef64 expref: 17 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.722813:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f094a00/0xfb36a14ee608c69f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef64 expref: 17 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.722822:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f094a00, rc 0) 00000100:00100000:1.0:1746066798.722859:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977099136:12345-192.168.202.57@tcp:101:cat.0 Request processed in 115us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.722864:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14912 00000100:00100000:1.0:1746066798.722877:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14913 00000100:00100000:1.0:1746066798.722881:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977099264:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066798.722886:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.722891:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f095600/0xfb36a14ee608c6a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef6b expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066798.722919:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976907136:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066798.722965:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066798.723172:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976907008:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066798.723186:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.724932:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977098880:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8630us (8783us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.724941:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7679 00000100:00100000:0.0:1746066798.725852:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.725928:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977099392 00000100:00100000:2.0:1746066798.725934:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977099392 00002000:00100000:2.0:1746066798.725963:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff8800996d8700 x1830882977099392/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.725972:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8700 with x1830882977099392 ext(0->1048575) 00002000:00010000:2.0:1746066798.725976:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800996d8700 00000100:00100000:2.0:1746066798.733776:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6787 00000100:00100000:2.0:1746066798.733790:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882977099392:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066798.734601:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976907136:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066798.734628:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f095600/0xfb36a14ee608c6a6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef6b expref: 16 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.734639:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f095600/0xfb36a14ee608c6a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef6b expref: 16 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.734664:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f095600, rc 0) 00000100:00100000:1.0:1746066798.734722:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977099264:12345-192.168.202.57@tcp:101:cat.0 Request processed in 11839us (12205us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066798.734730:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14913 00000100:00100000:0.0:1746066798.756331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.756381:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977099776 00000100:00100000:1.0:1746066798.756390:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977099776 00002000:00100000:1.0:1746066798.756422:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (2019328->2097151) req@ffff8800996d9180 x1830882977099776/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.756431:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d9180 with x1830882977099776 ext(2019328->2097151) 00002000:00010000:1.0:1746066798.756435:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996d9180 00000100:00100000:1.0:1746066798.756452:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6788 00000100:00100000:1.0:1746066798.756458:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977099776:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066798.756819:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.756850:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977099904 00000100:00100000:0.0:1746066798.756853:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977099904 00002000:00100000:0.0:1746066798.756869:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff8800996d9500 x1830882977099904/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.756876:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d9500 with x1830882977099904 ext(0->1048575) 00002000:00010000:0.0:1746066798.756879:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800996d9500 00000100:00100000:0.0:1746066798.756899:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6789 00000100:00100000:0.0:1746066798.756904:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977099904:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066798.758091:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882977099392:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24301us (32235us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066798.758099:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6787 00002000:00100000:3.0:1746066798.758106:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff8800996d8700 x1830882977099392/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066798.758114:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8700 with x1830882977099392 ext(0->1048575) 00002000:00010000:3.0:1746066798.758118:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800996d8700 00000100:00100000:2.0:1746066798.769546:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977099904:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12633us (12718us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066798.769570:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6789 00002000:00100000:2.0:1746066798.769581:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff8800996d9500 x1830882977099904/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.769589:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d9500 with x1830882977099904 ext(0->1048575) 00002000:00010000:2.0:1746066798.769594:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800996d9500 00000100:00100000:1.0:1746066798.769747:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977099776:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13288us (13422us total) trans 0 rc 77824/77824 00000100:00100000:1.0:1746066798.769754:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6788 00002000:00100000:1.0:1746066798.769758:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (2019328->2097151) req@ffff8800996d9180 x1830882977099776/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 77824/77824 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.769765:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d9180 with x1830882977099776 ext(2019328->2097151) 00002000:00010000:1.0:1746066798.769768:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996d9180 00000100:00100000:0.0:1746066798.779795:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.783640:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977100032 00000100:00100000:1.0:1746066798.783650:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977100032 00000100:00100000:1.0:1746066798.783738:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14914 00000100:00100000:1.0:1746066798.783745:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:31811:x1830882977100032:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066798.783760:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.783776:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608c6ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef72 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.783804:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 12 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.783811:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066798.783812:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066798.783815:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608c6ad lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef72 expref: 17 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.783840:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 12 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.783850:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 12 pid: 8451 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746066798.783860:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976907264:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066798.783958:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.788947:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.788983:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.789013:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977100288 00000100:00100000:0.0:1746066798.789019:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977100288 00002000:00100000:0.0:1746066798.789053:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2019327) req@ffff8800996dad80 x1830882977100288/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.789061:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996dad80 with x1830882977100288 ext(1048576->2019327) 00010000:00010000:0.0:1746066798.789068:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 13 pid: 8451 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746066798.789078:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 13 pid: 8451 timeout: 859 lvb_type: 0 00002000:00010000:0.0:1746066798.789084:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800996dad80 00000100:00100000:0.0:1746066798.789109:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2202 00000100:00100000:0.0:1746066798.789114:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:1966:x1830882977100288:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066798.790013:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976907264:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.790036:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608c6ad lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef72 expref: 17 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.790048:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f60f800, rc 0) 00000100:00100000:1.0:1746066798.790088:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:31811:x1830882977100032:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6343us (10300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.790095:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14914 00000100:00100000:1.0:1746066798.790111:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977100160 00000100:00100000:1.0:1746066798.790114:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977100160 00000100:00100000:1.0:1746066798.790130:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14915 00000100:00100000:1.0:1746066798.790134:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+15:31817:x1830882977100160:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066798.790142:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.790153:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608c6b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef79 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.790167:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.790168:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.790175:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608c6b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef79 expref: 16 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.790190:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608c6b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef79 expref: 16 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.790196:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f60fe00, rc 0) 00000100:00100000:1.0:1746066798.790214:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+16:31817:x1830882977100160:12345-192.168.202.57@tcp:101:cat.0 Request processed in 79us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.790219:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14915 00000100:00100000:0.0:1746066798.803703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.812311:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977100544 00000100:00100000:2.0:1746066798.812322:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977100544 00002000:00100000:2.0:1746066798.812357:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->2539519) req@ffff88009e851880 x1830882977100544/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.812372:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e851880 with x1830882977100544 ext(2097152->2539519) 00002000:00010000:2.0:1746066798.812376:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e851880 00000100:00100000:2.0:1746066798.812413:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6790 00000100:00100000:2.0:1746066798.812422:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977100544:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066798.819972:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882977100288:12345-192.168.202.57@tcp:4:cat.0 Request processed in 30848us (30978us total) trans 21474840978 rc 0/0 00000100:00100000:1.0:1746066798.819985:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2202 00002000:00100000:1.0:1746066798.819995:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2019327) req@ffff8800996dad80 x1830882977100288/t21474840978(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/448 e 0 to 0 dl 1746066809 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.820004:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996dad80 with x1830882977100288 ext(1048576->2019327) 00010000:00010000:1.0:1746066798.820013:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 15 pid: 8451 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746066798.820033:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 15 pid: 8451 timeout: 859 lvb_type: 0 00002000:00010000:1.0:1746066798.820039:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800996dad80 00000100:00100000:2.0:1746066798.821251:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977100544:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8822us (17548us total) trans 0 rc 442368/442368 00000100:00100000:2.0:1746066798.821260:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6790 00002000:00100000:2.0:1746066798.821268:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->2539519) req@ffff88009e851880 x1830882977100544/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 442368/442368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.821275:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e851880 with x1830882977100544 ext(2097152->2539519) 00002000:00010000:2.0:1746066798.821280:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e851880 00000100:00100000:0.0:1746066798.831391:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.831786:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977100672 00000100:00100000:2.0:1746066798.831796:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977100672 00010000:00010000:2.0:1746066798.831829:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 15 pid: 8451 timeout: 859 lvb_type: 0 00000100:00100000:2.0:1746066798.831865:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7680 00000100:00100000:2.0:1746066798.831873:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882977100672:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.831887:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.831908:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 15 pid: 8451 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.831921:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 15 pid: 8451 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.831945:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f094400/0xfb36a14ee608c67c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef41 expref: 15 pid: 8451 timeout: 859 lvb_type: 0 00010000:00010000:2.0:1746066798.831974:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.831977:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.831984:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608c6ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef72 expref: 16 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.831991:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608c6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef72 expref: 16 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.832021:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608c6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef72 expref: 16 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066798.832031:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976907392:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066798.832103:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.833321:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.834827:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976907392:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066798.834847:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.834885:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+14:1965:x1830882977100672:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3013us (3502us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.834894:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7680 00000100:00100000:2.0:1746066798.834969:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977100800 00000100:00100000:2.0:1746066798.834975:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977100800 00000100:00100000:2.0:1746066798.835014:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14916 00000100:00100000:2.0:1746066798.835021:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:31817:x1830882977100800:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066798.835034:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.835605:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57c7600/0xfb36a14ee608c6bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef80 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.835629:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3698688->18446744073709551615] (req 3698688->4079615) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.835640:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066798.835642:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066798.835644:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57c7600/0xfb36a14ee608c6bb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef80 expref: 17 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.835664:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3698688->18446744073709551615] (req 3698688->4079615) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.835673:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3698688->18446744073709551615] (req 3698688->4079615) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 24 pid: 8451 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066798.835746:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976907520:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.837827:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.838240:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.838328:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.838951:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977101184 00000100:00100000:3.0:1746066798.838953:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977101056 00000100:00100000:3.0:1746066798.838958:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977101056 00000100:00100000:1.0:1746066798.838958:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977101184 00002000:00100000:3.0:1746066798.838992:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e852d80 x1830882977101056/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066798.839005:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e852d80 with x1830882977101056 ext(1048576->2097151) 00002000:00010000:3.0:1746066798.839009:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e852d80 00000100:00100000:3.0:1746066798.839023:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6791 00000100:00100000:1.0:1746066798.839025:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14917 00000100:00100000:3.0:1746066798.839030:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1963:x1830882977101056:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066798.839030:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:31816:x1830882977101184:12345-192.168.202.57@tcp:101:multiop.0 00000100:00100000:2.0:1746066798.839654:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976907520:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.839692:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57c7600/0xfb36a14ee608c6bb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef80 expref: 17 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.839705:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57c7600, rc 0) 00000100:00100000:2.0:1746066798.839737:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:31817:x1830882977100800:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4717us (6419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.839743:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14916 00010000:00010000:1.0:1746066798.840848:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.840867:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef87 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.840890:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801311a0000/0xfb36a14ee608c350 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed65 expref: 13 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.840898:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131d77400/0xfb36a14ee608c484 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee14 expref: 6 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.840903:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801311a0600/0xfb36a14ee608c357 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed6c expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.840909:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.840910:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.840913:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [4100096->4194303] (req 4100096->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 20 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.840942:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801311a0600/0xfb36a14ee608c357 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed6c expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.840952:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801311a0600/0xfb36a14ee608c357 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed6c expref: 20 pid: 8451 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066798.840963:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976907648:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.841033:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131d77400/0xfb36a14ee608c484 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee14 expref: 6 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.841041:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131d77400/0xfb36a14ee608c484 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee14 expref: 6 pid: 8451 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746066798.841049:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976907776:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.841076:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801311a0000/0xfb36a14ee608c350 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed65 expref: 13 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.841084:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801311a0000/0xfb36a14ee608c350 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed65 expref: 13 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066798.841092:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976907904:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066798.841109:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.842139:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.842204:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977101312 00000100:00100000:1.0:1746066798.842211:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977101312 00002000:00100000:1.0:1746066798.842243:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3698688->4079615) req@ffff88009e851500 x1830882977101312/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.842252:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e851500 with x1830882977101312 ext(3698688->4079615) 00010000:00010000:1.0:1746066798.842260:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3698688->18446744073709551615] (req 3698688->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 25 pid: 8451 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066798.842268:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3698688->18446744073709551615] (req 3698688->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 25 pid: 8451 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746066798.842274:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e851500 00000100:00100000:1.0:1746066798.842290:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2203 00000100:00100000:1.0:1746066798.842297:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977101312:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:1.0:1746066798.850461:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976907776:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066798.850472:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976907904:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066798.851506:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1963:x1830882977101056:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12469us (13262us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066798.851519:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6791 00002000:00100000:3.0:1746066798.851529:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e852d80 x1830882977101056/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066798.851537:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e852d80 with x1830882977101056 ext(1048576->2097151) 00002000:00010000:3.0:1746066798.851541:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e852d80 00000100:00100000:1.0:1746066798.855101:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977101312:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 12797us (12958us total) trans 17179873666 rc 0/0 00000100:00100000:1.0:1746066798.855112:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2203 00002000:00100000:1.0:1746066798.855121:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3698688->4079615) req@ffff88009e851500 x1830882977101312/t17179873666(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/448 e 0 to 0 dl 1746066809 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.855130:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e851500 with x1830882977101312 ext(3698688->4079615) 00010000:00010000:1.0:1746066798.855139:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3698688->18446744073709551615] (req 3698688->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 27 pid: 8451 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066798.855150:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3698688->18446744073709551615] (req 3698688->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 27 pid: 8451 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746066798.855157:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e851500 00000100:00100000:2.0:1746066798.857984:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.858030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.858074:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.858094:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977101440 00000100:00100000:2.0:1746066798.858101:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977101440 00010000:00010000:2.0:1746066798.858128:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131d77400/0xfb36a14ee608c484 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee14 expref: 7 pid: 8451 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746066798.858149:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977101696 00000100:00100000:2.0:1746066798.858151:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977101696 00010000:00010000:2.0:1746066798.858160:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801311a0600/0xfb36a14ee608c357 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed6c expref: 19 pid: 8451 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066798.858172:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977101568 00000100:00100000:2.0:1746066798.858174:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977101568 00010000:00010000:2.0:1746066798.858183:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801311a0000/0xfb36a14ee608c350 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed65 expref: 14 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066798.858195:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7681 00000100:00100000:2.0:1746066798.858201:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977101440:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.858212:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.858230:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131d77400/0xfb36a14ee608c484 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee14 expref: 7 pid: 8451 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066798.858239:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131d77400/0xfb36a14ee608c484 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee14 expref: 7 pid: 8451 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066798.858256:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131d77400/0xfb36a14ee608c484 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee14 expref: 7 pid: 8451 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066798.858271:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.858296:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882977101440:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 95us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.858302:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7681 00000100:00100000:2.0:1746066798.858313:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7682 00000100:00100000:2.0:1746066798.858317:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1964:x1830882977101696:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.858322:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.858327:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801311a0600/0xfb36a14ee608c357 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed6c expref: 19 pid: 8451 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.858334:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801311a0600/0xfb36a14ee608c357 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed6c expref: 19 pid: 8451 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.858342:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.858354:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1964:x1830882977101696:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 36us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.858359:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7682 00000100:00100000:2.0:1746066798.858368:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7683 00000100:00100000:2.0:1746066798.858372:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977101568:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.858377:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.858383:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801311a0000/0xfb36a14ee608c350 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed65 expref: 14 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.858391:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801311a0000/0xfb36a14ee608c350 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed65 expref: 14 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.858401:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801311a0000/0xfb36a14ee608c350 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed65 expref: 14 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.858414:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.858417:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.858422:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 18 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.858429:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 18 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.858455:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 18 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066798.858465:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976908032:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066798.858507:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c480 going to sleep for 11 seconds 00010000:00010000:1.0:1746066798.859252:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801311a0600/0xfb36a14ee608c357 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed6c expref: 18 pid: 8451 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066798.859275:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976907648:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066798.859302:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 17 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.859311:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50a7e00, rc 0) 00000100:00100000:1.0:1746066798.859343:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:31816:x1830882977101184:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 20312us (21015us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.859349:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14917 00000100:00100000:0.0:1746066798.863305:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.863793:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.863947:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977101824 00000100:00100000:1.0:1746066798.863956:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977101824 00000100:00100000:1.0:1746066798.863999:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977101952 00000100:00100000:1.0:1746066798.864000:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977101952 00000100:00100000:1.0:1746066798.864020:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14918 00000100:00100000:1.0:1746066798.864026:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+17:31819:x1830882977101824:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066798.864040:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.864055:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef8e expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.864078:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eec3 expref: 18 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.864090:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009edf7800/0xfb36a14ee608c613 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eefb expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.864096:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.864097:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066798.864100:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 18 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.864124:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009edf7800/0xfb36a14ee608c613 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eefb expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.864134:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009edf7800/0xfb36a14ee608c613 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eefb expref: 27 pid: 8450 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066798.864144:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976908160:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066798.864229:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14919 00000100:00100000:3.0:1746066798.864236:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:31811:x1830882977101952:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.864243:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.864249:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ac3c00/0xfb36a14ee608c6d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef95 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.864260:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066798.864263:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ac3c00/0xfb36a14ee608c6d0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef95 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.864271:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ac3c00/0xfb36a14ee608c6d0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef95 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.864280:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ac3c00, rc 0) 00010000:00010000:1.0:1746066798.864607:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eec3 expref: 18 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.864615:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eec3 expref: 18 pid: 8450 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066798.864622:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976908288:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066798.864761:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31811:x1830882977101952:12345-192.168.202.57@tcp:101:cat.0 Request processed in 526us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.864767:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14919 00000100:00100000:1.0:1746066798.864941:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066798.865083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.865131:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977102080 00000100:00100000:3.0:1746066798.865134:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977102080 00010000:00010000:3.0:1746066798.865150:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3698688->18446744073709551615] (req 3698688->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 28 pid: 8451 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066798.865172:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7684 00000100:00100000:3.0:1746066798.865177:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977102080:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.865184:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.865202:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3698688->18446744073709551615] (req 3698688->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 28 pid: 8451 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066798.865210:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3698688->18446744073709551615] (req 3698688->4079615) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 28 pid: 8451 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066798.865227:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f094800/0xfb36a14ee608c66e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3698688->18446744073709551615] (req 3698688->4079615) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef33 expref: 28 pid: 8451 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066798.865240:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.865241:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.865246:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57c7600/0xfb36a14ee608c6bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef80 expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.865253:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57c7600/0xfb36a14ee608c6bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef80 expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.865259:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.865260:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.865263:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ac3c00/0xfb36a14ee608c6d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef95 expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.865273:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ac3c00/0xfb36a14ee608c6d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef95 expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.865292:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ac3c00/0xfb36a14ee608c6d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef95 expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.865300:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976908416:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066798.865324:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57c7600/0xfb36a14ee608c6bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef80 expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.865331:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976908544:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066798.865340:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.865394:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976908032:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066798.865408:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066798.865423:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977101568:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7051us (7348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066798.865429:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7683 00000100:00100000:0.0:1746066798.880523:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.880637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.880673:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977102336 00000100:00100000:0.0:1746066798.880699:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977102336 00002000:00100000:0.0:1746066798.880738:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (4100096->4104191) req@ffff88009e850380 x1830882977102336/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.880747:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e850380 with x1830882977102336 ext(4100096->4104191) 00002000:00010000:0.0:1746066798.880751:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e850380 00000100:00100000:0.0:1746066798.880764:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977102592 00000100:00100000:0.0:1746066798.880766:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977102592 00002000:00100000:0.0:1746066798.880777:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009244df80 x1830882977102592/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.880783:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244df80 with x1830882977102592 ext(3145728->4194303) 00002000:00010000:0.0:1746066798.880785:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244df80 00000100:00100000:0.0:1746066798.880795:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6792 00000100:00100000:0.0:1746066798.880801:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1964:x1830882977102336:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066798.880951:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1964:x1830882977102336:12345-192.168.202.57@tcp:3:cat.0 Request processed in 150us (434us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066798.880960:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6792 00002000:00100000:0.0:1746066798.880968:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (4100096->4104191) req@ffff88009e850380 x1830882977102336/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.880979:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e850380 with x1830882977102336 ext(4100096->4104191) 00002000:00010000:0.0:1746066798.880982:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e850380 00000100:00100000:0.0:1746066798.880997:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6793 00000100:00100000:0.0:1746066798.881005:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977102592:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066798.881433:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976908160:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.881441:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976908288:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.881462:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 18 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.881474:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef92200, rc 0) 00000100:00100000:2.0:1746066798.881500:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+18:31819:x1830882977101824:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 17474us (18203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.881506:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14918 00000100:00100000:3.0:1746066798.881669:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976908416:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066798.881690:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976908544:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066798.881702:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.881720:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977102080:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 16544us (16638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.881726:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7684 00000100:00100000:3.0:1746066798.883199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.883223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.883267:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.883283:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977103104 00000100:00100000:3.0:1746066798.883287:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977103104 00002000:00100000:3.0:1746066798.883305:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3440640->4194303) req@ffff88009ed08a80 x1830882977103104/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066798.883314:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed08a80 with x1830882977103104 ext(3440640->4194303) 00002000:00010000:3.0:1746066798.883317:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed08a80 00000100:00100000:3.0:1746066798.883326:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6794 00000100:00100000:3.0:1746066798.883331:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977103104:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066798.883547:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977102848 00000100:00100000:2.0:1746066798.883558:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977102848 00010000:00010000:2.0:1746066798.883573:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eec3 expref: 19 pid: 8450 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066798.883590:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977102720 00000100:00100000:2.0:1746066798.883592:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977102720 00010000:00010000:2.0:1746066798.883600:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009edf7800/0xfb36a14ee608c613 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eefb expref: 28 pid: 8450 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066798.883611:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7685 00000100:00100000:2.0:1746066798.883616:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977102848:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.883622:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.883635:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eec3 expref: 19 pid: 8450 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.883642:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eec3 expref: 19 pid: 8450 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.883661:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0c00/0xfb36a14ee608c5b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eec3 expref: 19 pid: 8450 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.883688:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066798.883918:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7686 00000100:00100000:0.0:1746066798.883925:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977102720:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066798.883932:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066798.883940:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009edf7800/0xfb36a14ee608c613 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eefb expref: 28 pid: 8450 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066798.883949:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009edf7800/0xfb36a14ee608c613 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eefb expref: 28 pid: 8450 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066798.883960:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009edf7800/0xfb36a14ee608c613 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eefb expref: 28 pid: 8450 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066798.883976:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.883977:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.883983:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 18 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.883990:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 18 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.884015:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 18 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.884025:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976908672:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066798.884375:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977102848:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 757us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.884381:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7685 00000100:00100000:0.0:1746066798.884450:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42ab240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066798.890494:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976908672:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066798.890518:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066798.890557:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977102720:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6622us (7322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.890567:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7686 00000100:00100000:3.0:1746066798.894623:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977103104:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 11284us (11348us total) trans 0 rc 753664/753664 00000100:00100000:3.0:1746066798.894633:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6794 00002000:00100000:3.0:1746066798.894643:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3440640->4194303) req@ffff88009ed08a80 x1830882977103104/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 753664/753664 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066798.894650:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed08a80 with x1830882977103104 ext(3440640->4194303) 00002000:00010000:3.0:1746066798.894655:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed08a80 00000100:00100000:1.0:1746066798.900632:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977102592:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19621us (19987us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066798.900643:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6793 00002000:00100000:1.0:1746066798.900653:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009244df80 x1830882977102592/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.900661:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244df80 with x1830882977102592 ext(3145728->4194303) 00002000:00010000:1.0:1746066798.900666:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244df80 00000100:00100000:0.0:1746066798.901586:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.901642:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.901715:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977103232 00000100:00100000:2.0:1746066798.901722:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977103232 00000100:00100000:2.0:1746066798.901761:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977103360 00000100:00100000:2.0:1746066798.901763:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977103360 00000100:00100000:2.0:1746066798.901778:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14920 00000100:00100000:2.0:1746066798.901784:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+13:31817:x1830882977103232:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066798.901797:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.901810:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e83400/0xfb36a14ee608c6d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ef9c expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.901832:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 16 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.901839:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066798.901840:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066798.901843:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e83400/0xfb36a14ee608c6d7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef9c expref: 14 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.901866:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 16 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.901876:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 16 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066798.901886:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976908800:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.901936:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066798.901953:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14921 00000100:00100000:2.0:1746066798.901958:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:31819:x1830882977103360:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066798.901969:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.901976:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97efa3 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.901992:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57c7600/0xfb36a14ee608c6bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef80 expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.901999:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ac3c00/0xfb36a14ee608c6d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef95 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.902005:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f60f200/0xfb36a14ee608c628 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef09 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.902011:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608c6b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef79 expref: 18 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.902017:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f60ea00/0xfb36a14ee608c62f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2539520->3440639] (req 2539520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef10 expref: 18 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.902022:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746066798.902023:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746066798.902025:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 8/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->2543615] (req 2097152->2543615) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.902040:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f60ea00/0xfb36a14ee608c62f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2539520->3440639] (req 2539520->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef10 expref: 18 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.902048:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f60ea00/0xfb36a14ee608c62f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2539520->3440639] (req 2539520->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef10 expref: 18 pid: 8451 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066798.902061:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976908928:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.902084:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608c6b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef79 expref: 18 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.902092:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608c6b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef79 expref: 18 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066798.902099:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976909056:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.902119:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f60f200/0xfb36a14ee608c628 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef09 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.902127:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f60f200/0xfb36a14ee608c628 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef09 expref: 25 pid: 8451 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066798.902134:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976909184:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.902154:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ac3c00/0xfb36a14ee608c6d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef95 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.902161:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ac3c00/0xfb36a14ee608c6d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef95 expref: 25 pid: 10402 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066798.902168:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976909312:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.902188:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57c7600/0xfb36a14ee608c6bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef80 expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.902194:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57c7600/0xfb36a14ee608c6bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef80 expref: 18 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066798.902201:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976909440:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.902215:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066798.905343:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976908928:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.905355:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976909056:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.905362:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976909184:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066798.905648:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976908800:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066798.905697:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e83400/0xfb36a14ee608c6d7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef9c expref: 14 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.905712:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e83400, rc 0) 00000100:00100000:3.0:1746066798.905759:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+14:31817:x1830882977103232:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3975us (4174us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.905766:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14920 00000100:00100000:0.0:1746066798.905913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.905975:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977103872 00000100:00100000:1.0:1746066798.905982:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977103872 00002000:00100000:1.0:1746066798.906011:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (4100096->4194303) req@ffff88009244ed80 x1830882977103872/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.906020:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244ed80 with x1830882977103872 ext(4100096->4194303) 00010000:00010000:1.0:1746066798.906026:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 17 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066798.906035:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 17 pid: 9776 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746066798.906040:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009244ed80 00000100:00100000:1.0:1746066798.906055:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2204 00000100:00100000:1.0:1746066798.906061:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1966:x1830882977103872:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066798.906368:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976909312:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.906375:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976909440:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.906399:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->2543615] (req 2097152->2543615) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.906408:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e82000, rc 0) 00000100:00100000:2.0:1746066798.906422:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:31819:x1830882977103360:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4465us (4781us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.906427:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14921 00000100:00100000:0.0:1746066798.907879:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.907912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.907986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.908137:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977103488 00000100:00100000:3.0:1746066798.908144:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977103488 00010000:00010000:3.0:1746066798.908168:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f60ea00/0xfb36a14ee608c62f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2539520->3440639] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef10 expref: 18 pid: 8451 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066798.908192:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977103744 00000100:00100000:3.0:1746066798.908194:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977103744 00010000:00010000:3.0:1746066798.908203:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f60f200/0xfb36a14ee608c628 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef09 expref: 26 pid: 8451 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066798.908214:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977103616 00000100:00100000:3.0:1746066798.908216:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977103616 00010000:00010000:3.0:1746066798.908222:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608c6b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef79 expref: 19 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066798.908233:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7687 00000100:00100000:3.0:1746066798.908239:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977103488:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.908249:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.908264:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f60ea00/0xfb36a14ee608c62f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [2539520->3440639] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef10 expref: 19 pid: 8451 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066798.908272:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f60ea00/0xfb36a14ee608c62f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [2539520->3440639] (req 2539520->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef10 expref: 19 pid: 8451 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066798.908291:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f60ea00/0xfb36a14ee608c62f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [2539520->3440639] (req 2539520->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef10 expref: 19 pid: 8451 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066798.908305:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.908329:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977103488:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 91us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.908335:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7687 00000100:00100000:3.0:1746066798.908347:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7688 00000100:00100000:3.0:1746066798.908351:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977103744:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.908356:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.908362:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f60f200/0xfb36a14ee608c628 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef09 expref: 26 pid: 8451 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066798.908369:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f60f200/0xfb36a14ee608c628 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef09 expref: 26 pid: 8451 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066798.908379:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f60f200/0xfb36a14ee608c628 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef09 expref: 26 pid: 8451 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066798.908386:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.908398:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977103744:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 47us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.908403:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7688 00000100:00100000:3.0:1746066798.908411:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7689 00000100:00100000:3.0:1746066798.908415:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977103616:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066798.908420:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066798.908426:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608c6b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef79 expref: 17 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066798.908433:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608c6b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef79 expref: 17 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066798.908442:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f60fe00/0xfb36a14ee608c6b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef79 expref: 17 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066798.908450:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.908462:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977103616:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 46us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.908467:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7689 00000100:00100000:2.0:1746066798.913939:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.914204:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.914249:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977104128 00000100:00100000:1.0:1746066798.914256:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977104128 00010000:00010000:1.0:1746066798.914285:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57c7600/0xfb36a14ee608c6bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef80 expref: 16 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066798.914321:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7690 00000100:00100000:1.0:1746066798.914327:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882977104128:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066798.914338:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066798.914353:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57c7600/0xfb36a14ee608c6bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef80 expref: 16 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066798.914363:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57c7600/0xfb36a14ee608c6bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef80 expref: 16 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066798.914382:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57c7600/0xfb36a14ee608c6bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef80 expref: 16 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066798.914404:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.914425:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977104000 00000100:00100000:3.0:1746066798.914430:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977104000 00000100:00100000:1.0:1746066798.914439:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882977104128:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 111us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066798.914444:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7690 00000100:00100000:3.0:1746066798.914455:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14922 00000100:00100000:3.0:1746066798.914460:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:31811:x1830882977104000:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.914472:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.914482:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608c6e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97efaa expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.914498:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066798.914502:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608c6e5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efaa expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.914511:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608c6e5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efaa expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.914519:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a1800, rc 0) 00000100:00100000:3.0:1746066798.914542:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:31811:x1830882977104000:12345-192.168.202.57@tcp:101:cat.0 Request processed in 82us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.914547:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14922 00000100:00100000:0.0:1746066798.915390:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1966:x1830882977103872:12345-192.168.202.57@tcp:4:cat.0 Request processed in 9327us (9476us total) trans 21474840979 rc 0/0 00000100:00100000:0.0:1746066798.915397:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2204 00002000:00100000:0.0:1746066798.915405:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (4100096->4194303) req@ffff88009244ed80 x1830882977103872/t21474840979(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/448 e 0 to 0 dl 1746066809 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.915412:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244ed80 with x1830882977103872 ext(4100096->4194303) 00010000:00010000:0.0:1746066798.915418:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 20 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066798.915426:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 20 pid: 9776 timeout: 860 lvb_type: 0 00002000:00010000:0.0:1746066798.915431:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009244ed80 00000100:00100000:2.0:1746066798.917812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.917851:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.917864:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977104256 00000100:00100000:3.0:1746066798.917865:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977104384 00000100:00100000:3.0:1746066798.917870:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977104384 00000100:00100000:2.0:1746066798.917870:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977104256 00010000:00010000:2.0:1746066798.917889:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ac3c00/0xfb36a14ee608c6d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef95 expref: 26 pid: 10402 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066798.917899:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14923 00000100:00100000:3.0:1746066798.917906:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31816:x1830882977104384:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066798.917918:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.917928:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97efb1 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.917947:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.917950:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.917953:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->4837375] (req 4194304->4837375) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 27 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.917963:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->4837375] (req 4194304->4837375) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 27 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.917971:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3a1a00, rc 0) 00000100:00100000:3.0:1746066798.918314:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:31816:x1830882977104384:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 407us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.918320:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14923 00000100:00100000:2.0:1746066798.918355:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7691 00000100:00100000:2.0:1746066798.918362:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977104256:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.918370:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.918388:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ac3c00/0xfb36a14ee608c6d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef95 expref: 26 pid: 10402 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.918397:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5ac3c00/0xfb36a14ee608c6d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef95 expref: 26 pid: 10402 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.918411:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ac3c00/0xfb36a14ee608c6d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef95 expref: 26 pid: 10402 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.918424:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.918425:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.918430:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2543615) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 14 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.918437:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2543615) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 14 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.918443:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.918444:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.918447:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4837375) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 25 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.918457:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4837375) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 25 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.918478:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4837375) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 25 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066798.918488:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976909568:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066798.918688:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.918778:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977104512 00000100:00100000:0.0:1746066798.918782:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977104512 00010000:00010000:0.0:1746066798.918794:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 20 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746066798.918809:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7692 00000100:00100000:0.0:1746066798.918814:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977104512:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066798.918820:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746066798.918829:0:21351:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066797 -> 1746066798 00002000:00010000:0.0:1746066798.918831:0:21351:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066797 -> 1746066798 00010000:00010000:0.0:1746066798.918834:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 20 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066798.918843:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 20 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066798.918854:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c6c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [4100096->18446744073709551615] (req 4100096->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef87 expref: 20 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066798.918866:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.918868:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.918872:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e83400/0xfb36a14ee608c6d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef9c expref: 13 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.918879:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e83400/0xfb36a14ee608c6d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef9c expref: 13 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.918885:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.918886:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066798.918888:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608c6e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efaa expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.918894:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608c6e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efaa expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.918909:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608c6e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efaa expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.918917:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976909696:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066798.919328:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2543615) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 14 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066798.919336:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976909824:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066798.919558:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0cd80 going to sleep for 11 seconds 00010000:00010000:0.0:1746066798.919857:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130e83400/0xfb36a14ee608c6d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef9c expref: 13 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066798.919866:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976909952:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066798.920088:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42ab540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.924512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.924541:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.924580:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977104768 00000100:00100000:0.0:1746066798.924586:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977104768 00002000:00100000:0.0:1746066798.924626:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009244e300 x1830882977104768/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.924634:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244e300 with x1830882977104768 ext(3145728->4194303) 00002000:00010000:0.0:1746066798.924639:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009244e300 00000100:00100000:0.0:1746066798.924652:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977105024 00000100:00100000:0.0:1746066798.924655:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977105024 00002000:00100000:0.0:1746066798.924667:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2539520->2543615) req@ffff88009244f480 x1830882977105024/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066798.924673:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244f480 with x1830882977105024 ext(2539520->2543615) 00002000:00010000:0.0:1746066798.924693:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244f480 00000100:00100000:0.0:1746066798.924705:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6795 00000100:00100000:0.0:1746066798.924711:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977104768:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066798.925640:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6796 00000100:00100000:3.0:1746066798.925648:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882977105024:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066798.925737:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976909696:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066798.925745:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976909952:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066798.925762:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066798.925778:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882977105024:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 131us (1235us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066798.925780:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1964:x1830882977104512:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6967us (7107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.925784:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6796 00000100:00100000:1.0:1746066798.925786:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7692 00002000:00100000:3.0:1746066798.925788:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2539520->2543615) req@ffff88009244f480 x1830882977105024/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066798.925794:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244f480 with x1830882977105024 ext(2539520->2543615) 00002000:00010000:3.0:1746066798.925798:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244f480 00000100:00100000:2.0:1746066798.925929:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976909568:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066798.925938:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976909824:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066798.925950:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.925972:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977104256:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7611us (8121us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.925977:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7691 00000100:00100000:1.0:1746066798.926882:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.926920:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977105280 00000100:00100000:2.0:1746066798.926924:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977105280 00002000:00100000:2.0:1746066798.926940:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e93ea00 x1830882977105280/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.926947:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93ea00 with x1830882977105280 ext(3145728->4194303) 00002000:00010000:2.0:1746066798.926950:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93ea00 00000100:00100000:2.0:1746066798.926960:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6797 00000100:00100000:2.0:1746066798.926965:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1964:x1830882977105280:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066798.929279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066798.929493:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977105536 00000100:00100000:1.0:1746066798.929499:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977105536 00002000:00100000:1.0:1746066798.929530:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4833280->4837375) req@ffff88009244ea00 x1830882977105536/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.929540:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244ea00 with x1830882977105536 ext(4833280->4837375) 00002000:00010000:1.0:1746066798.929544:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244ea00 00000100:00100000:1.0:1746066798.929587:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6798 00000100:00100000:1.0:1746066798.929594:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882977105536:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066798.929872:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1965:x1830882977105536:12345-192.168.202.57@tcp:3:cat.0 Request processed in 277us (599us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066798.929879:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6798 00002000:00100000:1.0:1746066798.929884:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4833280->4837375) req@ffff88009244ea00 x1830882977105536/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066798.929892:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244ea00 with x1830882977105536 ext(4833280->4837375) 00002000:00010000:1.0:1746066798.929895:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244ea00 00000100:00100000:2.0:1746066798.933947:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1964:x1830882977105280:12345-192.168.202.57@tcp:3:cat.0 Request processed in 6973us (7058us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066798.933958:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6797 00002000:00100000:2.0:1746066798.934144:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e93ea00 x1830882977105280/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.934203:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93ea00 with x1830882977105280 ext(3145728->4194303) 00002000:00010000:2.0:1746066798.934208:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93ea00 00000100:00100000:2.0:1746066798.937271:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977104768:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 12554us (12758us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066798.937282:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6795 00002000:00100000:2.0:1746066798.937291:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009244e300 x1830882977104768/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.937300:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244e300 with x1830882977104768 ext(3145728->4194303) 00002000:00010000:2.0:1746066798.937304:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009244e300 00000100:00100000:0.0:1746066798.941283:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.941390:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.941464:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977105664 00000100:00100000:3.0:1746066798.941472:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977105664 00000100:00100000:3.0:1746066798.941515:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977105792 00000100:00100000:3.0:1746066798.941517:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977105792 00000100:00100000:3.0:1746066798.941531:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14924 00000100:00100000:3.0:1746066798.941538:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977105664:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.941561:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.941575:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093630c00/0xfb36a14ee608c6f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97efb8 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.941617:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976910080:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066798.941703:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066798.941721:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14925 00000100:00100000:3.0:1746066798.941726:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977105792:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.941732:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.941738:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093631c00/0xfb36a14ee608c6fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97efbf expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.942124:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976910208:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066798.942528:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.944404:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.945114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00010000:3.0:1746066798.945250:0:4614:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime: 1746066797 -> 1746066798 00002000:00010000:3.0:1746066798.945254:0:4614:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime: 1746066797 -> 1746066798 00002000:00010000:3.0:1746066798.945256:0:4614:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime: 1746066797 -> 1746066798 00000100:00100000:3.0:1746066798.945272:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976910080:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066798.945296:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093630c00/0xfb36a14ee608c6f3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb8 expref: 28 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.945309:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093630c00/0xfb36a14ee608c6f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb8 expref: 28 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.945321:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093630c00, rc 0) 00000100:00100000:3.0:1746066798.945357:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977105664:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3818us (4081us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066798.945364:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14924 00000100:00100000:3.0:1746066798.945384:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977106048 00000100:00100000:3.0:1746066798.945388:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977106048 00000100:00100000:3.0:1746066798.945406:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977105920 00000100:00100000:3.0:1746066798.945408:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977105920 00000100:00100000:3.0:1746066798.945418:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14926 00000100:00100000:3.0:1746066798.945423:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882977106048:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.945434:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.945444:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093630000/0xfb36a14ee608c701 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97efcd expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.945480:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976910336:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066798.945523:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066798.945539:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14927 00000100:00100000:3.0:1746066798.945544:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+14:1966:x1830882977105920:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.945561:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.945569:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012daa7600/0xfb36a14ee608c708 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97efc6 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.945584:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.945587:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066798.945594:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012daa7600/0xfb36a14ee608c708 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efc6 expref: 15 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.945604:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012daa7600/0xfb36a14ee608c708 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efc6 expref: 15 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.945611:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012daa7600, rc 0) 00000100:00100000:3.0:1746066798.945630:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882977105920:12345-192.168.202.57@tcp:101:cat.0 Request processed in 87us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066798.945634:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14927 00000100:00100000:3.0:1746066798.945666:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976910208:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066798.945695:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093631c00/0xfb36a14ee608c6fa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efbf expref: 26 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.945702:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093631c00/0xfb36a14ee608c6fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efbf expref: 26 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.945708:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093631c00, rc 0) 00000100:00100000:3.0:1746066798.945724:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977105792:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3998us (4334us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066798.945728:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14925 00000100:00100000:3.0:1746066798.949327:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976910336:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066798.949355:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093630000/0xfb36a14ee608c701 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efcd expref: 16 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.949368:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093630000/0xfb36a14ee608c701 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efcd expref: 16 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.949381:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093630000, rc 0) 00000100:00100000:3.0:1746066798.949776:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882977106048:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4350us (5375us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066798.949784:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14926 00000100:00100000:1.0:1746066798.950773:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.951167:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977106304 00000100:00100000:3.0:1746066798.951173:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977106304 00002000:00100000:3.0:1746066798.951202:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4837376->5091327) req@ffff88009e93f100 x1830882977106304/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066798.951210:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93f100 with x1830882977106304 ext(4837376->5091327) 00002000:00010000:3.0:1746066798.951214:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93f100 00000100:00100000:3.0:1746066798.951236:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6799 00000100:00100000:3.0:1746066798.951242:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977106304:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066798.953726:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.953760:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977106304:12345-192.168.202.57@tcp:3:cat.0 Request processed in 2517us (2987us total) trans 0 rc 253952/253952 00000100:00100000:3.0:1746066798.953768:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6799 00002000:00100000:3.0:1746066798.953777:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4837376->5091327) req@ffff88009e93f100 x1830882977106304/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 253952/253952 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066798.953785:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93f100 with x1830882977106304 ext(4837376->5091327) 00002000:00010000:3.0:1746066798.953790:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93f100 00000100:00100000:2.0:1746066798.953857:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977106432 00000100:00100000:2.0:1746066798.953863:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977106432 00000100:00100000:2.0:1746066798.953902:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14928 00000100:00100000:2.0:1746066798.953908:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:31817:x1830882977106432:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066798.953920:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.953934:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb08e00/0xfb36a14ee608c70f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97efd4 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.953964:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4837375) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 24 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.953972:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066798.953973:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066798.953976:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb08e00/0xfb36a14ee608c70f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->5091327] (req 4194304->5091327) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efd4 expref: 16 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.953998:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4837375) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 24 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.954006:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4837375) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 24 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066798.954016:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976910464:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066798.954073:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.957044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.957236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.958542:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977106688 00000100:00100000:3.0:1746066798.958561:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977106688 00000100:00100000:3.0:1746066798.958601:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977106560 00000100:00100000:3.0:1746066798.958603:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977106560 00000100:00100000:3.0:1746066798.958630:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14929 00000100:00100000:3.0:1746066798.958637:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977106688:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.958652:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.958667:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093630000/0xfb36a14ee608c716 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97efe2 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066798.958691:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14930 00000100:00100000:2.0:1746066798.958699:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977106560:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066798.958707:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066798.958714:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb09800/0xfb36a14ee608c71d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97efdb expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.958726:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976910592:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066798.958937:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976910720:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066798.959099:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066798.959102:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.959204:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.959212:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976910464:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066798.959228:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb08e00/0xfb36a14ee608c70f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->5091327] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efd4 expref: 16 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.959238:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb08e00, rc 0) 00000100:00100000:2.0:1746066798.959275:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:31817:x1830882977106432:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5366us (5554us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.959281:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14928 00000100:00100000:3.0:1746066798.959470:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977106816 00000100:00100000:3.0:1746066798.959474:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977106816 00002000:00100000:3.0:1746066798.959494:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4837375) req@ffff88009bb2ca80 x1830882977106816/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066798.959503:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ca80 with x1830882977106816 ext(4194304->4837375) 00010000:00010000:3.0:1746066798.959508:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4837375) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 29 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066798.959519:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4837375) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 29 pid: 9776 timeout: 860 lvb_type: 0 00002000:00010000:3.0:1746066798.959525:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2ca80 00000100:00100000:3.0:1746066798.959558:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2205 00000100:00100000:3.0:1746066798.959564:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1965:x1830882977106816:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066798.960834:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976910720:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066798.960853:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb09800/0xfb36a14ee608c71d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efdb expref: 29 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.960864:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb09800/0xfb36a14ee608c71d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efdb expref: 29 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.960888:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb09800, rc 0) 00000100:00100000:2.0:1746066798.960924:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977106560:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2226us (3687us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066798.960930:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14930 00000100:00100000:2.0:1746066798.960959:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976910592:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066798.960973:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093630000/0xfb36a14ee608c716 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efe2 expref: 27 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.960980:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093630000/0xfb36a14ee608c716 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efe2 expref: 27 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066798.960990:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093630000, rc 0) 00000100:00100000:2.0:1746066798.961005:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977106688:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2369us (3967us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066798.961009:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14929 00000100:00100000:2.0:1746066798.963295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.963346:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977106944 00000100:00100000:0.0:1746066798.963352:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977106944 00000100:00100000:0.0:1746066798.963378:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14931 00000100:00100000:0.0:1746066798.963384:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:31811:x1830882977106944:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066798.963397:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066798.963409:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ed4000/0xfb36a14ee608c724 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97efe9 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.963427:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066798.963429:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066798.963432:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed4000/0xfb36a14ee608c724 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [5087232->5242879] (req 5087232->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efe9 expref: 28 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.963442:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ed4000/0xfb36a14ee608c724 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [5087232->5242879] (req 5087232->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efe9 expref: 28 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066798.963449:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed4000, rc 0) 00000100:00100000:0.0:1746066798.963629:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31811:x1830882977106944:12345-192.168.202.57@tcp:101:cat.0 Request processed in 245us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066798.963634:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14931 00000100:00100000:2.0:1746066798.976672:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977106816:12345-192.168.202.57@tcp:4:cat.0 Request processed in 17100us (17460us total) trans 17179873667 rc 0/0 00000100:00100000:2.0:1746066798.976699:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2205 00002000:00100000:2.0:1746066798.976709:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4837375) req@ffff88009bb2ca80 x1830882977106816/t17179873667(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/448 e 0 to 0 dl 1746066809 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.976717:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ca80 with x1830882977106816 ext(4194304->4837375) 00010000:00010000:2.0:1746066798.976726:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4837375) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 28 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.976740:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4837375) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 28 pid: 9776 timeout: 860 lvb_type: 0 00002000:00010000:2.0:1746066798.976746:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2ca80 00000100:00100000:1.0:1746066798.979820:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.979865:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977107072 00000100:00100000:2.0:1746066798.979873:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977107072 00010000:00010000:2.0:1746066798.979902:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4837375) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 28 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066798.979929:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7693 00000100:00100000:2.0:1746066798.979936:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977107072:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066798.979947:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066798.979964:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4837375) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 28 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.979973:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4837375) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 28 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.979990:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3a1a00/0xfb36a14ee608c6ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4837375) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efb1 expref: 28 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066798.980011:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.980013:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.980019:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb08e00/0xfb36a14ee608c70f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efd4 expref: 15 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.980024:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb08e00/0xfb36a14ee608c70f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efd4 expref: 15 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.980029:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.980030:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066798.980031:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ed4000/0xfb36a14ee608c724 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [5087232->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efe9 expref: 27 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.980035:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed4000/0xfb36a14ee608c724 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [5087232->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efe9 expref: 27 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066798.980055:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093ed4000/0xfb36a14ee608c724 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [5087232->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efe9 expref: 27 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066798.980064:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976910848:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066798.980134:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb08e00/0xfb36a14ee608c70f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efd4 expref: 15 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066798.980142:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976910976:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066798.980158:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066798.982327:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066798.982355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.982467:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976910848:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066798.982475:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976910976:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066798.982493:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066798.982523:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977107072:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2587us (2709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066798.982532:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7693 00000100:00100000:3.0:1746066798.982638:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977107200 00000100:00100000:3.0:1746066798.982644:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977107200 00000100:00100000:3.0:1746066798.982669:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977107328 00000100:00100000:3.0:1746066798.982671:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977107328 00000100:00100000:3.0:1746066798.982701:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14932 00000100:00100000:3.0:1746066798.982707:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977107200:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.982721:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.982734:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cad1e00/0xfb36a14ee608c72b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eff0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066798.982768:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976911104:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066798.982807:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066798.982875:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14933 00000100:00100000:1.0:1746066798.982882:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977107328:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066798.982888:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066798.982895:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef93c00/0xfb36a14ee608c732 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97eff7 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066798.982910:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef93c00/0xfb36a14ee608c732 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eff7 expref: 30 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.982918:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef93c00/0xfb36a14ee608c732 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eff7 expref: 30 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066798.982930:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef93c00, rc 0) 00000100:00100000:1.0:1746066798.982945:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977107328:12345-192.168.202.57@tcp:101:cat.0 Request processed in 65us (590us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066798.982950:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14933 00000100:00100000:0.0:1746066798.984824:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.984927:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977107584 00000100:00100000:2.0:1746066798.984933:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977107584 00002000:00100000:2.0:1746066798.984962:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009bb2ce00 x1830882977107584/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.984970:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ce00 with x1830882977107584 ext(4194304->5091327) 00002000:00010000:2.0:1746066798.984975:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2ce00 00000100:00100000:2.0:1746066798.985000:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6800 00000100:00100000:2.0:1746066798.985007:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977107584:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066798.986003:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976911104:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066798.986025:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cad1e00/0xfb36a14ee608c72b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eff0 expref: 28 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.986035:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cad1e00/0xfb36a14ee608c72b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eff0 expref: 28 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.986045:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cad1e00, rc 0) 00000100:00100000:3.0:1746066798.986072:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977107200:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3365us (3750us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066798.986077:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14932 00000100:00100000:0.0:1746066798.991036:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066798.991588:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977107840 00000100:00100000:2.0:1746066798.991596:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977107840 00002000:00100000:2.0:1746066798.991635:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (5087232->5091327) req@ffff88009bb2e680 x1830882977107840/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1746066809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.991645:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2e680 with x1830882977107840 ext(5087232->5091327) 00002000:00010000:2.0:1746066798.991649:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2e680 00000100:00100000:2.0:1746066798.991710:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6801 00000100:00100000:2.0:1746066798.991717:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1966:x1830882977107840:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066798.991843:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1966:x1830882977107840:12345-192.168.202.57@tcp:3:cat.0 Request processed in 126us (813us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066798.991850:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6801 00002000:00100000:2.0:1746066798.991855:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (5087232->5091327) req@ffff88009bb2e680 x1830882977107840/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:204/0 lens 488/4536 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.991862:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2e680 with x1830882977107840 ext(5087232->5091327) 00002000:00010000:2.0:1746066798.991864:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2e680 00000100:00100000:2.0:1746066798.993989:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977107584:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8976us (9163us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066798.993997:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6800 00002000:00100000:2.0:1746066798.994005:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009bb2ce00 x1830882977107584/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:204/0 lens 488/440 e 0 to 0 dl 1746066809 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066798.994013:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ce00 with x1830882977107584 ext(4194304->5091327) 00002000:00010000:2.0:1746066798.994017:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2ce00 00000100:00100000:0.0:1746066798.997594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066798.997775:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977107968 00000100:00100000:3.0:1746066798.997782:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977107968 00000100:00100000:3.0:1746066798.997822:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14934 00000100:00100000:3.0:1746066798.997828:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977107968:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066798.997843:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066798.997856:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608c739 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97effe expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066798.997880:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608c739 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97effe expref: 17 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.997888:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608c739 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97effe expref: 17 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066798.997898:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cad1c00, rc 0) 00000100:00100000:3.0:1746066798.998152:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977107968:12345-192.168.202.57@tcp:101:cat.0 Request processed in 322us (562us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066798.998157:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14934 00000100:00100000:0.0:1746066799.006135:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.006197:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977108096 00000100:00100000:3.0:1746066799.006204:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977108096 00000100:00080000:0.0:1746066799.006568:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066799.007145:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14935 00000100:00100000:3.0:1746066799.007154:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882977108096:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066799.007169:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.007183:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cad0a00/0xfb36a14ee608c740 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f005 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.007209:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cad0a00/0xfb36a14ee608c740 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f005 expref: 17 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.007218:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cad0a00/0xfb36a14ee608c740 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f005 expref: 17 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.007234:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cad0a00, rc 0) 00000100:00100000:3.0:1746066799.007284:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882977108096:12345-192.168.202.57@tcp:101:cat.0 Request processed in 132us (1157us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066799.007289:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14935 00000100:00100000:0.0:1746066799.031227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.031300:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977108224 00000100:00100000:2.0:1746066799.031308:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977108224 00000100:00100000:2.0:1746066799.031361:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10077 00000100:00100000:2.0:1746066799.031368:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31824:x1830882977108224:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066799.031386:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.031401:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c747 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f00c expref: -99 pid: 809 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746066799.031576:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746066799.031625:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c74e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.031635:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c74e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.031645:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c74e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.031655:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130770400/0xfb36a14ee608c755 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.031660:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130770400/0xfb36a14ee608c755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.031664:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130770400/0xfb36a14ee608c755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.031850:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.031860:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef25 expref: 24 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.031867:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c400/0xfb36a14ee608c660 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef2c expref: 269 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.031871:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 5/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.031900:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c400/0xfb36a14ee608c660 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef2c expref: 269 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.031910:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c400/0xfb36a14ee608c660 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef2c expref: 269 pid: 809 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.031919:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976911232:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.033227:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef25 expref: 24 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.033238:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef25 expref: 24 pid: 809 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.033246:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976911360:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.033275:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.040037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.040097:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977108480 00000100:00100000:3.0:1746066799.040104:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977108480 00000100:00100000:2.0:1746066799.040134:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976911232:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.040142:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976911360:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066799.040144:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4221 00000100:00100000:3.0:1746066799.040151:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+270:27281:x1830882977108480:12345-192.168.202.57@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1746066799.040159:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00080000:0.0:1746066799.040229:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066799.040672:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+271:27281:x1830882977108480:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 519us (639us total) trans 8589944152 rc 0/0 00000100:00100000:3.0:1746066799.040700:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4221 00000100:00100000:0.0:1746066799.044148:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.044277:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977108736 00000100:00100000:3.0:1746066799.044285:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977108736 00000100:00100000:3.0:1746066799.044322:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4222 00000100:00100000:3.0:1746066799.044329:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+25:23712:x1830882977108736:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746066799.044492:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+26:23712:x1830882977108736:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 163us (350us total) trans 8589944153 rc 0/0 00000100:00100000:3.0:1746066799.044498:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4222 00000100:00080000:0.0:1746066799.045111:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066799.045147:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.045415:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977108864 00000100:00100000:0.0:1746066799.045419:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977108864 00010000:00010000:0.0:1746066799.045438:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c400/0xfb36a14ee608c660 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef2c expref: 271 pid: 809 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746066799.045630:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7694 00000100:00100000:0.0:1746066799.045636:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+271:1963:x1830882977108864:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066799.045644:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.045649:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c400/0xfb36a14ee608c660 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef2c expref: 271 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066799.045658:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c400/0xfb36a14ee608c660 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef2c expref: 271 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066799.045673:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c400/0xfb36a14ee608c660 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef2c expref: 271 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066799.045709:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066799.045713:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066799.045721:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066799.045725:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066799.045729:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.045752:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+270:1963:x1830882977108864:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 117us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.045757:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7694 00000100:00100000:0.0:1746066799.050732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.051030:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977108992 00000100:00100000:1.0:1746066799.051039:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977108992 00010000:00010000:1.0:1746066799.051065:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef25 expref: 26 pid: 809 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.051089:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7695 00000100:00100000:1.0:1746066799.051095:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977108992:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.051106:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.051111:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef25 expref: 26 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.051121:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef25 expref: 26 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.051139:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094c00/0xfb36a14ee608c64b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef25 expref: 26 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.051171:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066799.051176:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.051183:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.051188:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.051206:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.051239:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977108992:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 144us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.051245:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7695 00010000:00010000:2.0:1746066799.051746:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051755:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:2.0:1746066799.051798:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:2.0:1746066799.051801:0:809:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746066799.051815:0:809:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051824:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051832:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c74e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051837:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c74e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051843:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c74e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051848:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130771e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066799.051852:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c74e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051857:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c74e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051865:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066799.051868:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066799.051871:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c74e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051875:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c74e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051891:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130770400/0xfb36a14ee608c755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051896:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130770400/0xfb36a14ee608c755 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051900:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130770400/0xfb36a14ee608c755 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051904:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130770400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066799.051906:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130770400/0xfb36a14ee608c755 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051910:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130770400/0xfb36a14ee608c755 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051915:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebec300) 00010000:00010000:2.0:1746066799.051917:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066799.051919:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130770400/0xfb36a14ee608c755 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051923:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130770400/0xfb36a14ee608c755 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.051949:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c747 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f00c expref: 14 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.051958:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f00c expref: 13 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.051964:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066799.051966:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066799.051967:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130770200, rc 0) 00000100:00100000:2.0:1746066799.051994:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:31824:x1830882977108224:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 20627us (20776us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.052000:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10077 00000100:00100000:0.0:1746066799.054832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.054858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.054885:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.055201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.055732:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977109120 00000100:00100000:2.0:1746066799.055739:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977109120 00000100:00100000:0.0:1746066799.055760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066799.055882:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066799.055915:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977109376 00000100:00100000:3.0:1746066799.055920:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977109376 00000100:00100000:3.0:1746066799.055942:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977109632 00000100:00100000:3.0:1746066799.055945:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977109632 00000100:00100000:3.0:1746066799.055961:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977109248 00000100:00100000:3.0:1746066799.055963:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977109248 00000100:00100000:3.0:1746066799.055972:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977109504 00000100:00100000:3.0:1746066799.055974:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977109504 00000100:00100000:3.0:1746066799.055987:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14936 00000100:00100000:3.0:1746066799.055993:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882977109120:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066799.056008:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.056021:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cad0e00/0xfb36a14ee608c763 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f013 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.056040:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.056042:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.056049:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cad0e00/0xfb36a14ee608c763 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f013 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.056062:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cad0e00/0xfb36a14ee608c763 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f013 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.056071:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cad0e00, rc 0) 00000100:00100000:3.0:1746066799.056104:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977109120:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 112us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.056109:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14936 00000100:00100000:3.0:1746066799.056124:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14937 00000100:00100000:3.0:1746066799.056128:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882977109376:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066799.056133:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.056139:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd200/0xfb36a14ee608c76a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f021 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.056167:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976911488:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066799.056200:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14938 00000100:00100000:3.0:1746066799.056203:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066799.056207:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882977109632:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066799.056215:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066799.056219:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14939 00010000:00010000:2.0:1746066799.056223:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130771a00/0xfb36a14ee608c771 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f02f expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.056224:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882977109248:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066799.056230:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.056235:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.056236:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58dc000/0xfb36a14ee608c778 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f01a expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.056236:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.056241:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130771a00/0xfb36a14ee608c771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f02f expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.056245:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.056246:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.056250:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58dc000/0xfb36a14ee608c778 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f01a expref: 9 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.056251:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130771a00/0xfb36a14ee608c771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f02f expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.056257:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130771a00, rc 0) 00010000:00010000:3.0:1746066799.056258:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58dc000/0xfb36a14ee608c778 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f01a expref: 9 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.056264:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58dc000, rc 0) 00000100:00100000:2.0:1746066799.056275:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1965:x1830882977109632:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 68us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.056280:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1965:x1830882977109248:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 56us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.056280:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14938 00000100:00100000:3.0:1746066799.056285:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14939 00000100:00100000:2.0:1746066799.056292:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14940 00000100:00100000:2.0:1746066799.056297:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977109504:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066799.056302:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.056313:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130771200/0xfb36a14ee608c77f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f028 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.056331:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130771200/0xfb36a14ee608c77f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f028 expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.056338:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130771200/0xfb36a14ee608c77f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f028 expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.056346:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130771200, rc 0) 00000100:00100000:2.0:1746066799.056360:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977109504:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 63us (603us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066799.056365:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14940 00000100:00080000:0.0:1746066799.057040:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746066799.059224:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976911488:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066799.059250:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd200/0xfb36a14ee608c76a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f021 expref: 7 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.059262:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd200/0xfb36a14ee608c76a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f021 expref: 7 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.059294:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58dd200, rc 0) 00000100:00100000:3.0:1746066799.059327:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1965:x1830882977109376:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 3198us (4467us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066799.059335:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14937 00000100:00100000:1.0:1746066799.063052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.063092:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977109888 00000100:00100000:2.0:1746066799.063100:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977109888 00000100:00100000:2.0:1746066799.063144:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10078 00000100:00100000:2.0:1746066799.063150:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:31824:x1830882977109888:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066799.063167:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.063181:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130770800/0xfb36a14ee608c786 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f036 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.063254:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.063265:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f00c expref: 14 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.063271:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.063299:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f00c expref: 14 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.063308:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f00c expref: 14 pid: 809 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.063318:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976911616:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.063389:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.065337:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.065421:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976911616:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.065437:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:1.0:1746066799.065496:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977110016 00000100:00100000:1.0:1746066799.065500:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977110016 00010000:00010000:1.0:1746066799.065521:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f00c expref: 15 pid: 809 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.065541:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7696 00000100:00100000:1.0:1746066799.065555:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1964:x1830882977110016:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.065565:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.065570:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f00c expref: 15 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.065578:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f00c expref: 15 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.065600:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130770200/0xfb36a14ee608c75c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f00c expref: 15 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.065858:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066799.065862:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.065869:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.065874:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.065887:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066799.065893:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.065899:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:2.0:1746066799.065912:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000100:00100000:1.0:1746066799.065928:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882977110016:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 381us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.065933:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7696 00010000:00010000:2.0:1746066799.066017:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130770800/0xfb36a14ee608c786 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f036 expref: 15 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.066028:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f036 expref: 14 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.066034:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066799.066036:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066799.066038:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130770a00, rc 0) 00000100:00100000:2.0:1746066799.066061:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:31824:x1830882977109888:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2911us (3015us total) trans 8589944154 rc 0/0 00000100:00100000:2.0:1746066799.066066:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10078 00000100:00100000:0.0:1746066799.068566:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.068624:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977110144 00000100:00100000:2.0:1746066799.068636:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977110144 00000100:00100000:2.0:1746066799.068719:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10079 00000100:00100000:2.0:1746066799.068727:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:31824:x1830882977110144:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066799.068747:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.068761:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130770400/0xfb36a14ee608c79b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f03d expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.068824:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c7a2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.068836:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f036 expref: 15 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.068843:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c7a2 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.068865:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f036 expref: 15 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.068875:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f036 expref: 15 pid: 809 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.068884:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976911744:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.068953:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066799.071022:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976911744:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.071043:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c7a2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:0.0:1746066799.071521:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.071706:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977110272 00000100:00100000:1.0:1746066799.071712:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977110272 00010000:00010000:1.0:1746066799.071736:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f036 expref: 16 pid: 809 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.071766:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7697 00000100:00100000:1.0:1746066799.071773:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1963:x1830882977110272:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.071783:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.071788:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f036 expref: 16 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.071801:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f036 expref: 16 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.071819:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130770a00/0xfb36a14ee608c78d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f036 expref: 16 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.071831:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066799.071835:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c7a2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.071842:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.071848:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c7a2 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.071874:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.071904:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1963:x1830882977110272:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 132us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.071910:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7697 00010000:00010000:3.0:1746066799.072090:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066799.072097:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:3.0:1746066799.072129:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066799.072133:0:809:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066799.072145:0:809:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066799.072169:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130770400/0xfb36a14ee608c79b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f03d expref: 15 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.072183:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c7a2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f03d expref: 14 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.072190:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066799.072192:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066799.072194:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130771e00, rc 0) 00000100:00100000:3.0:1746066799.072217:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:31824:x1830882977110144:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 3492us (3670us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.072223:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10079 00000100:00100000:0.0:1746066799.075052:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.075091:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.075313:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977110400 00000100:00100000:1.0:1746066799.075320:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977110400 00000100:00100000:1.0:1746066799.075348:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977110528 00000100:00100000:1.0:1746066799.075350:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977110528 00000100:00100000:1.0:1746066799.075541:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14941 00000100:00100000:1.0:1746066799.075558:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977110400:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066799.075573:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066799.075587:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ef93200/0xfb36a14ee608c7a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f044 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.075631:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976911872:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066799.075709:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dee40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066799.075771:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14942 00000100:00100000:3.0:1746066799.075778:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977110528:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066799.075784:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.075791:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd200/0xfb36a14ee608c7b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f04b expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.075807:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd200/0xfb36a14ee608c7b0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f04b expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.075816:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd200/0xfb36a14ee608c7b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f04b expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.075824:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58dd200, rc 0) 00000100:00100000:3.0:1746066799.075844:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977110528:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 67us (753us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066799.075849:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14942 00000100:00100000:1.0:1746066799.077273:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976911872:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066799.077291:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ef93200/0xfb36a14ee608c7a9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f044 expref: 7 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066799.077300:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef93200/0xfb36a14ee608c7a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f044 expref: 7 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066799.077308:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef93200, rc 0) 00000100:00100000:1.0:1746066799.077327:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882977110400:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1779us (2281us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066799.077332:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14941 00000100:00100000:0.0:1746066799.079315:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.079358:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977110784 00000100:00100000:2.0:1746066799.079364:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977110784 00000100:00100000:2.0:1746066799.079405:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10080 00000100:00100000:2.0:1746066799.079412:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:31824:x1830882977110784:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066799.079425:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.079526:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130771200/0xfb36a14ee608c7b7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f052 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.079610:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130770e00/0xfb36a14ee608c7be lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.079621:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130770e00/0xfb36a14ee608c7be lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.079634:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130770e00/0xfb36a14ee608c7be lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:2.0:1746066799.079644:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066799.079757:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130771200/0xfb36a14ee608c7b7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f052 expref: 17 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.079769:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130770e00/0xfb36a14ee608c7be lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f052 expref: 16 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.079776:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066799.079778:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066799.079780:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130770e00, rc 0) 00000100:00100000:2.0:1746066799.079825:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:31824:x1830882977110784:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 413us (514us total) trans 8589944155 rc 0/0 00000100:00100000:2.0:1746066799.079830:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10080 00000100:00100000:0.0:1746066799.081831:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.081857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.082056:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.082058:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977111040 00000100:00100000:1.0:1746066799.082065:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977111040 00000100:00100000:0.0:1746066799.082084:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.082255:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977111296 00000100:00100000:1.0:1746066799.082258:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977111296 00000100:00100000:0.0:1746066799.082270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.082404:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.082503:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977110912 00000100:00100000:3.0:1746066799.082504:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977111552 00000100:00100000:3.0:1746066799.082506:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977111552 00000100:00100000:1.0:1746066799.082506:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977110912 00000100:00100000:1.0:1746066799.082519:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977111168 00000100:00100000:1.0:1746066799.082521:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977111168 00000100:00100000:2.0:1746066799.082601:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14943 00000100:00100000:2.0:1746066799.082609:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977111040:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066799.082641:0:9776:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130770200/0xfb36a14ee608c7cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.082656:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608c6ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef72 expref: 18 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.082663:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58dc000/0xfb36a14ee608c778 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f01a expref: 10 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.082669:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012daa7600/0xfb36a14ee608c708 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efc6 expref: 14 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.082688:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.082690:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.082692:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130770200/0xfb36a14ee608c7cc lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.082717:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012daa7600/0xfb36a14ee608c708 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efc6 expref: 14 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.082726:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012daa7600/0xfb36a14ee608c708 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efc6 expref: 14 pid: 8450 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746066799.082741:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976912000:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.082789:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58dc000/0xfb36a14ee608c778 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f01a expref: 10 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.082796:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a58dc000/0xfb36a14ee608c778 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f01a expref: 10 pid: 21973 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746066799.082802:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976912128:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.082817:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608c6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef72 expref: 18 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.082823:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608c6ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef72 expref: 18 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.082829:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976912256:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.082838:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066799.083758:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977111424 00000100:00100000:3.0:1746066799.083762:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977111424 00000100:00100000:3.0:1746066799.083779:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14944 00000100:00100000:3.0:1746066799.083783:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977111296:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066799.083802:0:20532:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd800/0xfb36a14ee608c7d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.083811:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 15 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.083816:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066799.083817:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066799.083819:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd800/0xfb36a14ee608c7d3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.083837:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 15 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.083844:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 15 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.083852:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976912384:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066799.083881:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066799.083893:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14945 00000100:00100000:3.0:1746066799.083897:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977110912:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066799.083908:0:8112:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608c7da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.083916:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009025d200/0xfb36a14ee608c698 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef5d expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.083921:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cad0e00/0xfb36a14ee608c763 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f013 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.083927:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f094a00/0xfb36a14ee608c69f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef64 expref: 15 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.083931:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.083932:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.083933:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608c7da lrc: 6/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.083944:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f094a00/0xfb36a14ee608c69f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef64 expref: 15 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.083950:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f094a00/0xfb36a14ee608c69f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef64 expref: 15 pid: 9776 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746066799.083956:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976912512:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.083974:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cad0e00/0xfb36a14ee608c763 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f013 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.083980:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cad0e00/0xfb36a14ee608c763 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f013 expref: 8 pid: 8450 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746066799.083986:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c528000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976912640:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.083999:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009025d200/0xfb36a14ee608c698 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef5d expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084005:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009025d200/0xfb36a14ee608c698 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef5d expref: 26 pid: 10402 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.084010:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c529500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976912768:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066799.084019:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066799.084031:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14946 00000100:00100000:3.0:1746066799.084035:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977111552:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066799.084050:0:8452:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608c7e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084063:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ed5000/0xfb36a14ee608c31f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed34 expref: 14 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084069:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e83400/0xfb36a14ee608c6d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef9c expref: 14 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084076:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130771a00/0xfb36a14ee608c771 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f02f expref: 10 pid: 4614 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066799.084076:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14947 00010000:00010000:3.0:1746066799.084082:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608c6e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efaa expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066799.084082:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977111168:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066799.084088:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ed4a00/0xfb36a14ee608c326 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed3b expref: 18 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084093:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746066799.084094:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746066799.084094:0:4614:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cad1200/0xfb36a14ee608c7e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084096:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608c7e1 lrc: 8/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.084102:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608c56b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee8b expref: 14 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084109:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ed4a00/0xfb36a14ee608c326 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed3b expref: 18 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.084113:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608c5aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeb5 expref: 18 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.084116:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ed4a00/0xfb36a14ee608c326 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed3b expref: 18 pid: 8450 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.084119:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5830600/0xfb36a14ee608c59c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea7 expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.084125:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.084125:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066799.084127:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976912896:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.084127:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cad1200/0xfb36a14ee608c7e8 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.084139:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5830600/0xfb36a14ee608c59c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea7 expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.084146:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5830600/0xfb36a14ee608c59c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea7 expref: 10 pid: 10402 timeout: 860 lvb_type: 1 00010000:00010000:3.0:1746066799.084151:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608c6e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efaa expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066799.084152:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976913024:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.084157:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608c6e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efaa expref: 18 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.084164:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c529880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976913152:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.084170:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608c5aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeb5 expref: 18 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.084176:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608c5aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeb5 expref: 18 pid: 4614 timeout: 860 lvb_type: 1 00010000:00010000:3.0:1746066799.084179:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130771a00/0xfb36a14ee608c771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f02f expref: 10 pid: 4614 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066799.084183:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976913280:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.084186:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130771a00/0xfb36a14ee608c771 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f02f expref: 10 pid: 4614 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746066799.084192:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c529c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976913408:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.084199:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608c56b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee8b expref: 14 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084206:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e83400/0xfb36a14ee608c6d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef9c expref: 14 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.084206:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608c56b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee8b expref: 14 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.084212:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976913536:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.084213:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e83400/0xfb36a14ee608c6d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef9c expref: 14 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.084219:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976913664:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.084221:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746066799.084232:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ed5000/0xfb36a14ee608c31f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed34 expref: 14 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084239:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ed5000/0xfb36a14ee608c31f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed34 expref: 14 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.084246:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976913792:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066799.084257:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066799.084271:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14948 00000100:00100000:3.0:1746066799.084276:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977111424:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066799.084288:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8000/0xfb36a14ee608c7ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084296:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->2543615) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 15 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084302:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb08e00/0xfb36a14ee608c70f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efd4 expref: 15 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084307:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ed4000/0xfb36a14ee608c724 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [5087232->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efe9 expref: 26 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084312:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746066799.084313:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746066799.084314:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8000/0xfb36a14ee608c7ef lrc: 6/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084326:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ed4000/0xfb36a14ee608c724 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [5087232->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efe9 expref: 26 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084333:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ed4000/0xfb36a14ee608c724 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [5087232->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efe9 expref: 26 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.084339:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976913920:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.084358:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb08e00/0xfb36a14ee608c70f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efd4 expref: 15 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084364:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eb08e00/0xfb36a14ee608c70f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efd4 expref: 15 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.084370:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976914048:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.084384:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->2543615) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 15 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.084390:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->2543615) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 15 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.084396:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976914176:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066799.084406:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21f8900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066799.085925:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976912000:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.085934:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976912128:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.085940:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976912256:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.085961:0:9776:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130770200/0xfb36a14ee608c7cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.092940:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.092973:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.093109:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977111808 00000100:00100000:1.0:1746066799.093115:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977111808 00000100:00100000:0.0:1746066799.093124:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976913920:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066799.093145:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58dc000/0xfb36a14ee608c778 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f01a expref: 11 pid: 21973 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746066799.093152:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976914048:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066799.093166:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977111680 00000100:00100000:1.0:1746066799.093168:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977111680 00000100:00100000:0.0:1746066799.093171:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976914176:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066799.093182:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012daa7600/0xfb36a14ee608c708 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efc6 expref: 15 pid: 8450 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746066799.093191:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8000/0xfb36a14ee608c7ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.093195:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7698 00000100:00100000:1.0:1746066799.093200:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977111808:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00080000:0.0:1746066799.093208:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746066799.093209:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.093225:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58dc000/0xfb36a14ee608c778 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f01a expref: 11 pid: 21973 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746066799.093225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066799.093235:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58dc000/0xfb36a14ee608c778 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f01a expref: 11 pid: 21973 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746066799.093252:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58dc000/0xfb36a14ee608c778 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f01a expref: 11 pid: 21973 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746066799.093253:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066799.093265:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.093294:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977111808:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 93us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.093299:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7698 00000100:00100000:1.0:1746066799.093310:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977112832 00000100:00100000:2.0:1746066799.093311:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977112960 00000100:00100000:1.0:1746066799.093312:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977112832 00000100:00100000:2.0:1746066799.093314:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977112960 00010000:00010000:1.0:1746066799.093319:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130771a00/0xfb36a14ee608c771 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f02f expref: 10 pid: 4614 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.093324:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608c56b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee8b expref: 16 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.093328:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7699 00000100:00100000:1.0:1746066799.093333:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977111680:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066799.093334:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7700 00000100:00100000:2.0:1746066799.093338:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977112832:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.093340:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.093342:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.093346:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012daa7600/0xfb36a14ee608c708 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efc6 expref: 16 pid: 8450 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.093350:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130771a00/0xfb36a14ee608c771 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f02f expref: 10 pid: 4614 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746066799.093353:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012daa7600/0xfb36a14ee608c708 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efc6 expref: 16 pid: 8450 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.093361:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130771a00/0xfb36a14ee608c771 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f02f expref: 10 pid: 4614 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746066799.093363:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012daa7600/0xfb36a14ee608c708 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efc6 expref: 16 pid: 8450 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746066799.093370:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066799.093371:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.093381:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977111680:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 49us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.093382:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977112832:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 44us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.093386:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7699 00000100:00100000:2.0:1746066799.093827:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7700 00000100:00100000:1.0:1746066799.093831:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7701 00000100:00100000:1.0:1746066799.093837:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:1966:x1830882977112960:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.093843:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.093850:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608c56b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee8b expref: 14 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.093857:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608c56b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee8b expref: 14 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.093867:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066799.093872:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976913024:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.093879:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976913280:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066799.093879:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:1966:x1830882977112960:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 42us (625us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066799.093886:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608c56b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee8b expref: 14 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.093886:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7701 00000100:00100000:2.0:1746066799.093893:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976913536:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.093907:0:4614:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012cad1200/0xfb36a14ee608c7e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.095699:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.095744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.095764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.095868:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977111936 00000100:00100000:1.0:1746066799.095873:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977111936 00010000:00010000:1.0:1746066799.095904:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608c6ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef72 expref: 19 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.095921:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977112320 00000100:00100000:1.0:1746066799.095923:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977112320 00010000:00010000:1.0:1746066799.095934:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009025d200/0xfb36a14ee608c698 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef5d expref: 27 pid: 10402 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.095948:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7702 00000100:00100000:1.0:1746066799.095954:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1963:x1830882977111936:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.095962:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.095973:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608c6ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef72 expref: 19 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.095981:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608c6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef72 expref: 19 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.095995:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7703 00010000:00010000:1.0:1746066799.095995:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f60f800/0xfb36a14ee608c6ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef72 expref: 19 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.096002:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977112320:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.096004:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066799.096006:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.096008:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.096009:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130770200/0xfb36a14ee608c7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.096020:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009025d200/0xfb36a14ee608c698 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef5d expref: 27 pid: 10402 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.096025:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130770200/0xfb36a14ee608c7cc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.096028:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009025d200/0xfb36a14ee608c698 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef5d expref: 27 pid: 10402 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.096040:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066799.096042:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066799.096285:0:9776:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130770200/0xfb36a14ee608c7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.096294:0:9776:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130770200/0xfb36a14ee608c7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.096313:0:9776:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130770200/0xfb36a14ee608c7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.096324:0:9776:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130770200/0xfb36a14ee608c7cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.096330:0:9776:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130770200/0xfb36a14ee608c7cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.096335:0:9776:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130770200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066799.096339:0:9776:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130770200/0xfb36a14ee608c7cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.096345:0:9776:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130770200/0xfb36a14ee608c7cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.096353:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977112320:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 351us (587us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066799.096354:0:9776:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130770200/0xfb36a14ee608c7cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.096359:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7703 00010000:00010000:2.0:1746066799.096359:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130770200/0xfb36a14ee608c7cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.096538:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976912512:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066799.096562:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c528000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976912640:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.096570:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009025d200/0xfb36a14ee608c698 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef5d expref: 26 pid: 10402 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.096583:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c529500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976912768:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.096599:0:8112:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608c7da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.096618:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976912896:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066799.096626:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c529880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976913152:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.096636:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130771a00/0xfb36a14ee608c771 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f02f expref: 9 pid: 4614 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746066799.096643:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c529c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976913408:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066799.096650:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976913664:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066799.096658:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976913792:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.096673:0:8452:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608c7e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.096708:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976912384:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066799.096950:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1963:x1830882977111936:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 995us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.096955:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7702 00000100:00100000:2.0:1746066799.096965:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977111040:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 14356us (15140us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.096973:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14943 00000100:00100000:2.0:1746066799.096991:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977112064 00000100:00100000:2.0:1746066799.096994:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977112064 00002000:00100000:2.0:1746066799.097016:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (2031616->2097151) req@ffff88009ef5d500 x1830882977112064/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.097029:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5d500 with x1830882977112064 ext(2031616->2097151) 00010000:00010000:2.0:1746066799.097034:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 16 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.097043:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 16 pid: 9776 timeout: 860 lvb_type: 0 00002000:00010000:2.0:1746066799.097048:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef5d500 00000100:00100000:2.0:1746066799.097061:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2206 00000100:00100000:2.0:1746066799.097066:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977112064:12345-192.168.202.57@tcp:4:cat.0 00010000:00010000:3.0:1746066799.097126:0:20532:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd800/0xfb36a14ee608c7d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.097364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:0.0:1746066799.097375:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746066799.097377:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066799.097395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.097405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.097413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.097423:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.097433:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.097458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.097493:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977112192 00000100:00100000:3.0:1746066799.097496:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977112192 00010000:00010000:3.0:1746066799.097508:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cad0e00/0xfb36a14ee608c763 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f013 expref: 9 pid: 8450 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746066799.097512:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977112576 00000100:00100000:2.0:1746066799.097516:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977112576 00000100:00100000:3.0:1746066799.097518:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977112448 00000100:00100000:3.0:1746066799.097520:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977112448 00010000:00010000:3.0:1746066799.097528:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f094a00/0xfb36a14ee608c69f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef64 expref: 18 pid: 9776 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.097528:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5830600/0xfb36a14ee608c59c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea7 expref: 8 pid: 10402 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746066799.097535:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977113088 00000100:00100000:3.0:1746066799.097537:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977113088 00000100:00100000:2.0:1746066799.097538:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977112704 00000100:00100000:2.0:1746066799.097540:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977112704 00010000:00010000:3.0:1746066799.097543:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608c6e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efaa expref: 19 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.097559:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed4a00/0xfb36a14ee608c326 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed3b expref: 19 pid: 8450 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.097560:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977113344 00000100:00100000:3.0:1746066799.097562:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977113344 00000100:00100000:2.0:1746066799.097569:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7704 00010000:00010000:3.0:1746066799.097571:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed4000/0xfb36a14ee608c724 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [5087232->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efe9 expref: 26 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.097574:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977112192:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.097580:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066799.097584:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7705 00000100:00100000:3.0:1746066799.097589:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977112448:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.097590:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cad0e00/0xfb36a14ee608c763 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f013 expref: 9 pid: 8450 timeout: 860 lvb_type: 1 00010000:00010000:3.0:1746066799.097595:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.097601:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cad0e00/0xfb36a14ee608c763 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f013 expref: 9 pid: 8450 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.097615:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cad0e00/0xfb36a14ee608c763 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f013 expref: 9 pid: 8450 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.097623:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066799.097640:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977112192:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 67us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.097645:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7704 00000100:00100000:2.0:1746066799.097655:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7706 00000100:00100000:2.0:1746066799.097659:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977112576:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.097665:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.097673:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5830600/0xfb36a14ee608c59c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea7 expref: 8 pid: 10402 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.097695:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5830600/0xfb36a14ee608c59c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea7 expref: 8 pid: 10402 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746066799.097696:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7707 00000100:00100000:1.0:1746066799.097702:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1964:x1830882977113088:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.097704:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5830600/0xfb36a14ee608c59c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eea7 expref: 8 pid: 10402 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746066799.097709:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.097711:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066799.097719:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608c6e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efaa expref: 19 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.097722:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977112576:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 62us (316us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066799.097727:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608c6e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efaa expref: 19 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.097729:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7706 00000100:00100000:2.0:1746066799.097737:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7708 00010000:00010000:1.0:1746066799.097738:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3a1800/0xfb36a14ee608c6e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efaa expref: 19 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.097742:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1963:x1830882977112704:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.097746:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.097746:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066799.097752:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093ed4a00/0xfb36a14ee608c326 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed3b expref: 18 pid: 8450 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.097759:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093ed4a00/0xfb36a14ee608c326 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed3b expref: 18 pid: 8450 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.097760:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1964:x1830882977113088:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 59us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.097765:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7707 00010000:00010000:2.0:1746066799.097767:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ed4a00/0xfb36a14ee608c326 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed3b expref: 18 pid: 8450 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.097773:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.097775:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7709 00000100:00100000:1.0:1746066799.097779:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977113344:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066799.097783:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1963:x1830882977112704:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 42us (350us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066799.097785:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066799.097788:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7708 00010000:00010000:1.0:1746066799.097793:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ed4000/0xfb36a14ee608c724 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [5087232->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efe9 expref: 26 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.097800:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ed4000/0xfb36a14ee608c724 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [5087232->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efe9 expref: 26 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.097810:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ed4000/0xfb36a14ee608c724 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [5087232->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efe9 expref: 26 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.097819:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.097831:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977113344:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 53us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.097836:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7709 00000100:00100000:1.0:1746066799.097855:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977113472 00000100:00100000:1.0:1746066799.097858:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977113472 00002000:00100000:1.0:1746066799.097870:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->2543615) req@ffff88009ef5dc00 x1830882977113472/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.097876:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5dc00 with x1830882977113472 ext(2097152->2543615) 00010000:00010000:1.0:1746066799.097881:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 19 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.097888:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 19 pid: 4614 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746066799.097893:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef5dc00 00000100:00100000:1.0:1746066799.097912:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2207 00000100:00100000:1.0:1746066799.097917:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977113472:12345-192.168.202.57@tcp:4:cat.0 00010000:00010000:3.0:1746066799.098263:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f094a00/0xfb36a14ee608c69f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef64 expref: 19 pid: 9776 timeout: 860 lvb_type: 1 00010000:00010000:3.0:1746066799.098272:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f094a00/0xfb36a14ee608c69f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef64 expref: 19 pid: 9776 timeout: 860 lvb_type: 1 00010000:00010000:3.0:1746066799.098282:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f094a00/0xfb36a14ee608c69f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef64 expref: 19 pid: 9776 timeout: 860 lvb_type: 1 00010000:00010000:3.0:1746066799.098291:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.098292:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.098295:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608c7da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.098301:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608c7da lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.098314:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066799.098331:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977112448:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 741us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.098335:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7705 00010000:00010000:3.0:1746066799.098365:0:8112:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608c7da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.098376:0:8112:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608c7da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.098388:0:8112:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608c7da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.098394:0:8112:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608c7da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.098399:0:8112:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608c7da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.098404:0:8112:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb96200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066799.098406:0:8112:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608c7da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.098412:0:8112:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608c7da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.098420:0:8112:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608c7da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.098425:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608c7da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.098451:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977110912:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 14554us (16367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.098458:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14945 00000100:00100000:2.0:1746066799.098731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.098751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.098773:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.099109:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977113216 00000100:00100000:0.0:1746066799.099113:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977113216 00010000:00010000:0.0:1746066799.099127:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed5000/0xfb36a14ee608c31f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed34 expref: 13 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746066799.099141:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977113728 00000100:00100000:0.0:1746066799.099142:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977113728 00010000:00010000:0.0:1746066799.099150:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608c5aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeb5 expref: 16 pid: 4614 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746066799.099160:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977113600 00000100:00100000:0.0:1746066799.099162:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977113600 00000100:00100000:1.0:1746066799.099169:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7710 00010000:00010000:0.0:1746066799.099171:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb08e00/0xfb36a14ee608c70f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efd4 expref: 19 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.099174:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977113216:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.099181:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066799.099181:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7711 00000100:00100000:0.0:1746066799.099185:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1964:x1830882977113728:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.099190:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093ed5000/0xfb36a14ee608c31f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed34 expref: 13 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066799.099190:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.099195:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608c5aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeb5 expref: 16 pid: 4614 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746066799.099198:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093ed5000/0xfb36a14ee608c31f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed34 expref: 13 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066799.099202:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608c5aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeb5 expref: 16 pid: 4614 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746066799.099208:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ed5000/0xfb36a14ee608c31f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed34 expref: 13 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066799.099211:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608c5aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eeb5 expref: 16 pid: 4614 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746066799.099215:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066799.099220:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.099221:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.099224:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cad1200/0xfb36a14ee608c7e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.099230:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cad1200/0xfb36a14ee608c7e8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.099232:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977113216:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 59us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.099237:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7710 00010000:00010000:0.0:1746066799.099243:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.099248:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7712 00000100:00100000:1.0:1746066799.099252:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977113600:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066799.099254:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1964:x1830882977113728:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 69us (503us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066799.099257:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066799.099259:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7711 00010000:00010000:1.0:1746066799.099263:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eb08e00/0xfb36a14ee608c70f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efd4 expref: 19 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.099270:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eb08e00/0xfb36a14ee608c70f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efd4 expref: 19 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.099280:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb08e00/0xfb36a14ee608c70f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efd4 expref: 19 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.099288:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.099300:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977113600:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 48us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.099304:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7712 00010000:00010000:2.0:1746066799.099307:0:4614:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012cad1200/0xfb36a14ee608c7e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.099314:0:4614:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cad1200/0xfb36a14ee608c7e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.099418:0:4614:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cad1200/0xfb36a14ee608c7e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.099891:0:4614:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cad1200/0xfb36a14ee608c7e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.099897:0:4614:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cad1200/0xfb36a14ee608c7e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.099902:0:4614:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cad1200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066799.099904:0:4614:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cad1200/0xfb36a14ee608c7e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.099910:0:4614:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cad1200/0xfb36a14ee608c7e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.099917:0:4614:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cad1200/0xfb36a14ee608c7e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.099922:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cad1200/0xfb36a14ee608c7e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066799.099952:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882977111168:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 15871us (17681us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.099957:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14947 00000100:00100000:2.0:1746066799.100131:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.100516:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977113856 00000100:00100000:3.0:1746066799.100521:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977113856 00010000:00010000:3.0:1746066799.100537:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e83400/0xfb36a14ee608c6d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef9c expref: 12 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.100573:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7713 00000100:00100000:3.0:1746066799.100578:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882977113856:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066799.100586:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066799.100596:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e83400/0xfb36a14ee608c6d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef9c expref: 12 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.100604:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e83400/0xfb36a14ee608c6d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef9c expref: 12 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.100615:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e83400/0xfb36a14ee608c6d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef9c expref: 12 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.100625:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.100626:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.100629:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608c7e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.100635:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608c7e1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.100649:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066799.100660:0:8452:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608c7e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.100666:0:8452:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608c7e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.100693:0:8452:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608c7e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.100699:0:8452:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608c7e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.100704:0:8452:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608c7e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.100708:0:8452:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a489ec00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066799.100711:0:8452:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608c7e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.100716:0:8452:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608c7e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.100723:0:8452:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608c7e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.100729:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608c7e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.100762:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1964:x1830882977111552:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 16725us (18706us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.100767:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14946 00000100:00100000:3.0:1746066799.100792:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+11:1965:x1830882977113856:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 214us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.100797:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7713 00000100:00100000:3.0:1746066799.102309:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977112064:12345-192.168.202.57@tcp:4:cat.0 Request processed in 5238us (6608us total) trans 17179873668 rc 0/0 00000100:00100000:3.0:1746066799.102318:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2206 00002000:00100000:3.0:1746066799.102327:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (2031616->2097151) req@ffff88009ef5d500 x1830882977112064/t17179873668(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/448 e 0 to 0 dl 1746066810 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066799.102335:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5d500 with x1830882977112064 ext(2031616->2097151) 00010000:00010000:3.0:1746066799.102343:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 18 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.102353:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 18 pid: 9776 timeout: 860 lvb_type: 0 00002000:00010000:3.0:1746066799.102359:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef5d500 00000100:00100000:2.0:1746066799.105187:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.105356:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977113984 00000100:00100000:1.0:1746066799.105364:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977113984 00010000:00010000:1.0:1746066799.105391:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 18 pid: 9776 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.105423:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7714 00000100:00100000:1.0:1746066799.105430:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977113984:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.105441:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.106016:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 18 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.106027:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 18 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.106046:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef92200/0xfb36a14ee608c6c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ef8e expref: 18 pid: 9776 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.106057:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066799.106059:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066799.106062:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd800/0xfb36a14ee608c7d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.106068:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd800/0xfb36a14ee608c7d3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.106100:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.106138:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977113984:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 709us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.106144:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7714 00010000:00010000:3.0:1746066799.106249:0:20532:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd800/0xfb36a14ee608c7d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.106259:0:20532:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd800/0xfb36a14ee608c7d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.106286:0:20532:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd800/0xfb36a14ee608c7d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.106293:0:20532:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd800/0xfb36a14ee608c7d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.106299:0:20532:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd800/0xfb36a14ee608c7d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.106305:0:20532:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58dd800 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066799.106308:0:20532:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd800/0xfb36a14ee608c7d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.106314:0:20532:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd800/0xfb36a14ee608c7d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.106324:0:20532:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd800/0xfb36a14ee608c7d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.106330:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58dd800/0xfb36a14ee608c7d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.106379:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882977111296:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 22594us (24520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.106387:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14944 00000100:00100000:1.0:1746066799.107314:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977113472:12345-192.168.202.57@tcp:4:cat.0 Request processed in 9395us (9948us total) trans 17179873669 rc 0/0 00000100:00100000:1.0:1746066799.107321:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2207 00002000:00100000:1.0:1746066799.107328:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2097152->2543615) req@ffff88009ef5dc00 x1830882977113472/t17179873669(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/448 e 0 to 0 dl 1746066810 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.107336:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5dc00 with x1830882977113472 ext(2097152->2543615) 00010000:00010000:1.0:1746066799.107342:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 2097152->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 17 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.107353:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 2097152->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 17 pid: 4614 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746066799.107358:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef5dc00 00000100:00100000:0.0:1746066799.112327:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.112441:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977114112 00000100:00100000:1.0:1746066799.112450:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977114112 00010000:00010000:1.0:1746066799.112479:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 2097152->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 17 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.112988:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7715 00000100:00100000:3.0:1746066799.112998:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977114112:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066799.113010:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066799.113030:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2543615) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 17 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.113040:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2543615) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 17 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.113059:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e82000/0xfb36a14ee608c6de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2543615) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97efa3 expref: 17 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.113070:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.113072:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.113075:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8000/0xfb36a14ee608c7ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.113081:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8000/0xfb36a14ee608c7ef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.113110:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066799.113153:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882977114112:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 156us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.113158:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7715 00010000:00010000:0.0:1746066799.113239:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8000/0xfb36a14ee608c7ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.113247:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8000/0xfb36a14ee608c7ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.113263:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8000/0xfb36a14ee608c7ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.113269:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8000/0xfb36a14ee608c7ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.113275:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8000/0xfb36a14ee608c7ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.113280:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b4b8000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066799.113284:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8000/0xfb36a14ee608c7ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.113290:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8000/0xfb36a14ee608c7ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.113299:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8000/0xfb36a14ee608c7ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.113304:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b4b8000/0xfb36a14ee608c7ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.113344:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1964:x1830882977111424:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 29068us (30939us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.113350:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14948 00000100:00100000:0.0:1746066799.115463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.115672:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977114368 00000100:00100000:2.0:1746066799.115703:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977114368 00000100:00100000:2.0:1746066799.115736:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10081 00000100:00100000:2.0:1746066799.115742:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:31824:x1830882977114368:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:2.0:1746066799.115782:0:809:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.115801:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130771e00/0xfb36a14ee608c7a2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f03d expref: 16 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.115957:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066799.115961:0:809:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066799.115984:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.115994:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec3f expref: 24 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.116001:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec9a expref: 269 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.116006:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608c200 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca8 expref: 24 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.116012:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c303 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed1f expref: 269 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.116016:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0600/0xfb36a14ee608c548 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee6f expref: 24 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.116026:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c3b2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eda4 expref: 24 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.116031:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76200/0xfb36a14ee608c3d5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edab expref: 269 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.116036:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 10/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.116060:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76200/0xfb36a14ee608c3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edab expref: 269 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.116069:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76200/0xfb36a14ee608c3d5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edab expref: 269 pid: 16018 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.116080:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976914304:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.116887:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eda4 expref: 24 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.116896:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c3b2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eda4 expref: 24 pid: 16018 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.116904:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8695180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976914432:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.117518:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0600/0xfb36a14ee608c548 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee6f expref: 24 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.117527:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0600/0xfb36a14ee608c548 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee6f expref: 24 pid: 14550 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.117535:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8697b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976914560:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.118293:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c303 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed1f expref: 269 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.118302:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c303 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed1f expref: 269 pid: 14548 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.118310:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976914688:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.118337:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608c200 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca8 expref: 24 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.118343:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608c200 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca8 expref: 24 pid: 14550 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.118350:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976914816:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.118369:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec9a expref: 269 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.118376:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec9a expref: 269 pid: 14550 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.118382:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976914944:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.118399:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec3f expref: 24 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.118408:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec3f expref: 24 pid: 14549 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.118415:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976915072:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.118426:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092a0c480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066799.119396:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976914304:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066799.119414:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.119465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.119644:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8695180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976914432:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066799.120820:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977114496 00000100:00100000:1.0:1746066799.120827:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977114496 00010000:00010000:1.0:1746066799.120862:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76200/0xfb36a14ee608c3d5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edab expref: 270 pid: 16018 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.120894:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977114624 00000100:00100000:1.0:1746066799.120897:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977114624 00010000:00010000:1.0:1746066799.120907:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c3b2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eda4 expref: 25 pid: 16018 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.120928:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7716 00000100:00100000:1.0:1746066799.120934:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+270:1963:x1830882977114496:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.120945:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.120950:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76200/0xfb36a14ee608c3d5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edab expref: 270 pid: 16018 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.120959:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76200/0xfb36a14ee608c3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edab expref: 270 pid: 16018 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.120977:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131d76200/0xfb36a14ee608c3d5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97edab expref: 270 pid: 16018 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.120992:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066799.120996:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.121005:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.121036:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+269:1963:x1830882977114496:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 101us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.121042:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7716 00000100:00100000:1.0:1746066799.121055:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7717 00000100:00100000:1.0:1746066799.121060:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977114624:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.121066:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.121069:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c3b2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eda4 expref: 25 pid: 16018 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.121076:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eda4 expref: 25 pid: 16018 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.121086:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2200/0xfb36a14ee608c3b2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eda4 expref: 25 pid: 16018 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.121095:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066799.121098:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.121102:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.121115:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882977114624:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 55us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.121120:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7717 00000100:00100000:0.0:1746066799.123137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.123315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.125513:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8697b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976914560:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066799.125520:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.125525:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976914688:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.125532:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976914816:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066799.125537:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.125540:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976914944:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.125546:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976915072:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066799.125583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066799.125594:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:1.0:1746066799.125604:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977115136 00000100:00100000:1.0:1746066799.125610:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977115136 00010000:00010000:1.0:1746066799.125633:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608c200 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca8 expref: 24 pid: 14550 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.125652:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977115520 00000100:00100000:1.0:1746066799.125654:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977115520 00010000:00010000:1.0:1746066799.125661:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec3f expref: 25 pid: 14549 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.125670:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977115392 00000100:00100000:1.0:1746066799.125672:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977115392 00010000:00010000:1.0:1746066799.125699:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec9a expref: 269 pid: 14550 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.125713:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7718 00000100:00100000:1.0:1746066799.125718:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977115136:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.125729:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.125734:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608c200 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca8 expref: 25 pid: 14550 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.125742:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608c200 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca8 expref: 25 pid: 14550 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746066799.125748:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7719 00000100:00100000:0.0:1746066799.125755:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:1966:x1830882977115520:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.125760:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608c200 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97eca8 expref: 25 pid: 14550 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066799.125763:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.125769:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec3f expref: 24 pid: 14549 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.125771:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066799.125775:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.125781:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066799.125787:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec3f expref: 24 pid: 14549 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066799.125799:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009acd2e00/0xfb36a14ee608c19e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec3f expref: 24 pid: 14549 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746066799.125810:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066799.125814:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:1.0:1746066799.125815:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882977115136:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 97us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.125820:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7718 00010000:00010000:0.0:1746066799.125820:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.125833:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7720 00000100:00100000:1.0:1746066799.125837:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+269:1964:x1830882977115392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066799.125837:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:1966:x1830882977115520:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 83us (299us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066799.125843:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066799.125843:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7719 00010000:00010000:1.0:1746066799.125846:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec9a expref: 269 pid: 14550 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.125852:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec9a expref: 269 pid: 14550 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.125861:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecca600/0xfb36a14ee608c1f9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ec9a expref: 269 pid: 14550 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.125869:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066799.125871:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.125881:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.125895:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:1964:x1830882977115392:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 58us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.125899:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7720 00000100:00100000:3.0:1746066799.126176:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977114880 00000100:00100000:3.0:1746066799.126181:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977114880 00000100:00100000:3.0:1746066799.126209:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977115264 00000100:00100000:3.0:1746066799.126211:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977115264 00000100:00100000:3.0:1746066799.126224:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4223 00000100:00100000:3.0:1746066799.126229:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:27281:x1830882977114880:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066799.126237:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4224 00000100:00100000:2.0:1746066799.126243:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:23712:x1830882977115264:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066799.127325:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+269:23712:x1830882977115264:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 1078us (4006us total) trans 8589944156 rc 0/0 00000100:00100000:2.0:1746066799.127333:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4224 00000100:00100000:2.0:1746066799.127406:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:27281:x1830882977114880:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 1176us (4274us total) trans 8589944157 rc 0/0 00000100:00100000:2.0:1746066799.127414:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4223 00000100:00100000:0.0:1746066799.129587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.131269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.131364:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977115648 00000100:00100000:2.0:1746066799.131372:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977115648 00010000:00010000:2.0:1746066799.131403:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c303 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed1f expref: 269 pid: 14548 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.131429:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7721 00000100:00100000:2.0:1746066799.131435:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+269:1963:x1830882977115648:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.131445:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.131449:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c303 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed1f expref: 269 pid: 14548 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.131451:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977115776 00000100:00100000:1.0:1746066799.131455:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977115776 00010000:00010000:2.0:1746066799.131458:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c303 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed1f expref: 269 pid: 14548 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.131470:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0600/0xfb36a14ee608c548 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee6f expref: 23 pid: 14550 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.131476:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4aafc00/0xfb36a14ee608c303 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ed1f expref: 269 pid: 14548 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.131488:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066799.131492:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:1.0:1746066799.131493:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7722 00010000:00010000:2.0:1746066799.131498:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.131498:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882977115776:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.131505:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.131510:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0600/0xfb36a14ee608c548 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee6f expref: 23 pid: 14550 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.131517:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0600/0xfb36a14ee608c548 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee6f expref: 23 pid: 14550 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.131528:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2b0600/0xfb36a14ee608c548 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ee6f expref: 23 pid: 14550 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.131530:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:1963:x1830882977115648:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 95us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.131535:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7721 00010000:00010000:1.0:1746066799.131536:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066799.131539:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.131545:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.131562:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066799.131580:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066799.131591:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066799.131598:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:1.0:1746066799.131598:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977115776:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 99us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.131602:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7722 00000040:00080000:2.0:1746066799.132343:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3143, 88 off265840 00000004:00080000:2.0:1746066799.132350:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760309673847ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.132399:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3154, 88 off266720 00000004:00080000:2.0:1746066799.132404:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760309727690ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.133089:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3155, 88 off266808 00000004:00080000:2.0:1746066799.133094:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760310418080ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.133104:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3144, 88 off265928 00000004:00080000:2.0:1746066799.133109:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760310432759ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.133131:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3145, 88 off266016 00000004:00080000:2.0:1746066799.133134:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760310457970ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.133141:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3156, 88 off266896 00000004:00080000:2.0:1746066799.133143:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760310466829ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.133148:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3157, 88 off266984 00000004:00080000:2.0:1746066799.133150:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760310474477ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.133156:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3158, 88 off267072 00000004:00080000:2.0:1746066799.133158:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760310482172ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.133164:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3146, 88 off266104 00000004:00080000:2.0:1746066799.133166:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760310489954ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.133171:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3159, 88 off267160 00000004:00080000:2.0:1746066799.133173:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760310496913ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.133178:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3147, 88 off266192 00000004:00080000:2.0:1746066799.133180:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760310503663ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.133184:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3160, 88 off267248 00000004:00080000:2.0:1746066799.133187:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760310511260ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.133192:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3148, 88 off266280 00000004:00080000:2.0:1746066799.133194:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760310518199ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.133199:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3149, 88 off266368 00000004:00080000:2.0:1746066799.133201:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760310525345ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.133206:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3150, 88 off266456 00000004:00080000:2.0:1746066799.133208:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760310531979ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.133213:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3151, 88 off266544 00000004:00080000:2.0:1746066799.133214:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760310538555ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.133219:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3161, 88 off267336 00000004:00080000:2.0:1746066799.133221:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760310545074ns, next at 749511475809ns, rc = 0 00000004:00010000:1.0:1746066799.165601:0:809:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ef5ce00 reply state ffff88008d0ce400 transno 8589944158 ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:1.0:1746066799.165614:0:809:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746066799.165717:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:31824:x1830882977114368:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 49971us (50254us total) trans 8589944158 rc 0/0 00000100:00100000:1.0:1746066799.165726:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10081 00000001:00080000:1.0:1746066799.165753:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944138 is committed 00000001:00080000:1.0:1746066799.165762:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944137 is committed 00000001:00080000:1.0:1746066799.165766:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944135 is committed 00000001:00080000:1.0:1746066799.165777:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944145 is committed 00000001:00080000:1.0:1746066799.166513:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944158 is committed 00000004:00080000:1.0:1746066799.166519:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2435 committed 00000004:00080000:1.0:1746066799.166958:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2424 committed 00000004:00080000:1.0:1746066799.166963:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2423 committed 00000004:00080000:1.0:1746066799.166964:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2422 committed 00000004:00080000:1.0:1746066799.166966:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2421 committed 00000004:00080000:1.0:1746066799.166967:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2434 committed 00000004:00080000:1.0:1746066799.166968:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2420 committed 00000004:00080000:1.0:1746066799.166970:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2433 committed 00000004:00080000:1.0:1746066799.166971:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2419 committed 00000004:00080000:1.0:1746066799.166972:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2432 committed 00000004:00080000:1.0:1746066799.166973:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2431 committed 00000004:00080000:1.0:1746066799.166974:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2430 committed 00000004:00080000:1.0:1746066799.166975:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2418 committed 00000004:00080000:1.0:1746066799.166977:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2417 committed 00000004:00080000:1.0:1746066799.166978:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2429 committed 00000004:00080000:1.0:1746066799.166979:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2428 committed 00000004:00080000:1.0:1746066799.166981:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2416 committed 00000001:00080000:1.0:1746066799.166986:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944156 is committed 00000001:00080000:1.0:1746066799.166994:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944150 is committed 00000001:00080000:1.0:1746066799.167024:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944157 is committed 00000100:00100000:1.0:1746066799.167237:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976915200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.167274:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066799.167300:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976915712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.167311:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066799.167323:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746066799.167326:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976915328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.167336:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066799.167342:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976915840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.167351:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066799.167364:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976915456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.167375:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066799.167382:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976915968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.167390:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066799.167397:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746066799.167400:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009244f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976915584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.167410:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066799.167417:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976916096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.167425:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066799.167439:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976915200 00000100:00100000:1.0:1746066799.167444:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976915200 00010000:00010000:3.0:1746066799.167517:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066799.167526:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066799.167532:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066799.167536:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094238000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066799.167539:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066799.167544:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066799.167565:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066799.167567:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066799.167570:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066799.167575:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094238000/0xfb36a14ee608c7f6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00000100:00100000:3.0:1746066799.167593:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976915712 00000100:00100000:3.0:1746066799.167596:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976915712 00000100:00100000:0.0:1746066799.168944:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976916352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.168975:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.168990:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976916864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.169000:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.169010:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746066799.169013:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976916224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.169023:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.169028:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976916736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.169037:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.169048:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976915328 00000100:00100000:0.0:1746066799.169051:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976915328 00000100:00100000:2.0:1746066799.169099:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976916608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066799.169117:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066799.169128:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976917120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066799.169137:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066799.169143:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746066799.169146:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976916480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066799.169155:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066799.169160:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976916992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066799.169168:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066799.170231:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976915840 00000100:00100000:2.0:1746066799.170236:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976915840 00000100:00100000:1.0:1746066799.170564:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976915456 00000100:00100000:1.0:1746066799.170567:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976915456 00000100:00100000:3.0:1746066799.170615:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976915968 00000100:00100000:3.0:1746066799.170618:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976915968 00000100:00100000:3.0:1746066799.170626:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976915584 00000100:00100000:3.0:1746066799.170628:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976915584 00000100:00100000:3.0:1746066799.170634:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976916096 00000100:00100000:3.0:1746066799.170635:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976916096 00000100:00100000:3.0:1746066799.170641:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976916352 00000100:00100000:3.0:1746066799.170642:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976916352 00000100:00100000:3.0:1746066799.170653:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976916864 00000100:00100000:3.0:1746066799.170654:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976916864 00000100:00100000:3.0:1746066799.170659:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976916224 00000100:00100000:3.0:1746066799.170661:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976916224 00000100:00100000:3.0:1746066799.170665:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976916736 00000100:00100000:3.0:1746066799.170666:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976916736 00000100:00100000:3.0:1746066799.170670:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976916608 00000100:00100000:3.0:1746066799.170671:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976916608 00000100:00100000:3.0:1746066799.170687:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976917120 00000100:00100000:3.0:1746066799.170689:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976917120 00000100:00100000:3.0:1746066799.170693:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976916480 00000100:00100000:3.0:1746066799.170694:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976916480 00000100:00100000:3.0:1746066799.170699:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976916992 00000100:00100000:3.0:1746066799.170700:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976916992 00000100:00100000:3.0:1746066799.170709:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14949 00000100:00100000:3.0:1746066799.170715:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1830882976915200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066799.170897:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830882976915200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (3622us total) trans 17179873670 rc 0/0 00000100:00100000:3.0:1746066799.170902:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14949 00000100:00100000:3.0:1746066799.170916:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14950 00000100:00100000:3.0:1746066799.170921:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1830882976915712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066799.171011:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830882976915712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (3698us total) trans 17179873671 rc 0/0 00000100:00100000:3.0:1746066799.171016:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14950 00000100:00100000:3.0:1746066799.171029:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14951 00000100:00100000:3.0:1746066799.171033:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3293:x1830882976915968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066799.171097:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746066799.171099:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746066799.171101:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066799.171103:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746066799.171105:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746066799.171122:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3293:x1830882976915968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (3730us total) trans 17179873672 rc 0/0 00000100:00100000:3.0:1746066799.171127:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14951 00000100:00100000:3.0:1746066799.171137:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14952 00000100:00100000:3.0:1746066799.171141:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3293:x1830882976915584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066799.171208:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3293:x1830882976915584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (3797us total) trans 17179873673 rc 0/0 00000100:00100000:3.0:1746066799.171213:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14952 00000100:00100000:3.0:1746066799.171222:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14953 00000100:00100000:3.0:1746066799.171226:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3293:x1830882976916096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066799.171295:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3293:x1830882976916096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (3868us total) trans 17179873674 rc 0/0 00000100:00100000:3.0:1746066799.171300:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14953 00000100:00100000:3.0:1746066799.171309:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14954 00000100:00100000:3.0:1746066799.171313:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3296:x1830882976916352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.171408:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3296:x1830882976916352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (2432us total) trans 21474840980 rc 0/0 00000100:00100000:3.0:1746066799.171413:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14954 00000100:00100000:3.0:1746066799.171440:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840971 gen 2 00000004:00080000:3.0:1746066799.171444:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801361fa680, transno 21474840922 00000004:00080000:3.0:1746066799.171450:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16d500, transno 21474840923 00000004:00080000:3.0:1746066799.171452:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16ce00, transno 21474840924 00000004:00080000:3.0:1746066799.171454:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801361f9180, transno 21474840925 00000004:00080000:3.0:1746066799.171457:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16c380, transno 21474840926 00000004:00080000:3.0:1746066799.171459:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801361fad80, transno 21474840927 00000004:00080000:3.0:1746066799.171461:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009244d500, transno 21474840928 00000004:00080000:3.0:1746066799.171462:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16ed80, transno 21474840929 00000004:00080000:3.0:1746066799.171464:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef59880, transno 21474840933 00000004:00080000:3.0:1746066799.171466:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef58700, transno 21474840934 00000004:00080000:3.0:1746066799.171467:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009244dc00, transno 21474840935 00000004:00080000:3.0:1746066799.171469:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5ad80, transno 21474840936 00000004:00080000:3.0:1746066799.171471:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef58e00, transno 21474840937 00000004:00080000:3.0:1746066799.171473:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5aa00, transno 21474840938 00000004:00080000:3.0:1746066799.171475:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009244e680, transno 21474840939 00000004:00080000:3.0:1746066799.171477:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5bb80, transno 21474840940 00000004:00080000:3.0:1746066799.171479:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801361f9c00, transno 21474840941 00000004:00080000:3.0:1746066799.171481:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929cfb80, transno 21474840942 00000004:00080000:3.0:1746066799.171482:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801361fb800, transno 21474840943 00000004:00080000:3.0:1746066799.171484:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094128000, transno 21474840944 00000004:00080000:3.0:1746066799.171486:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929cf800, transno 21474840945 00000004:00080000:3.0:1746066799.171487:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801361f9500, transno 21474840946 00000004:00080000:3.0:1746066799.171489:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef58000, transno 21474840947 00000004:00080000:3.0:1746066799.171490:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef58a80, transno 21474840948 00000004:00080000:3.0:1746066799.171492:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135df8000, transno 21474840956 00000004:00080000:3.0:1746066799.171494:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135df9f80, transno 21474840957 00000004:00080000:3.0:1746066799.171495:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135df9180, transno 21474840958 00000004:00080000:3.0:1746066799.171497:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135df9c00, transno 21474840959 00000004:00080000:3.0:1746066799.171498:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135dfb480, transno 21474840960 00000004:00080000:3.0:1746066799.171500:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135dfb100, transno 21474840961 00000004:00080000:3.0:1746066799.171501:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135dfaa00, transno 21474840962 00000004:00080000:3.0:1746066799.171503:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135dfa300, transno 21474840963 00000004:00080000:3.0:1746066799.171505:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e58a80, transno 21474840964 00000004:00080000:3.0:1746066799.171506:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800931d3100, transno 21474840965 00000004:00080000:3.0:1746066799.171508:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e58000, transno 21474840966 00000004:00080000:3.0:1746066799.171510:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921c2d80, transno 21474840967 00000004:00080000:3.0:1746066799.171513:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e58380, transno 21474840968 00000004:00080000:3.0:1746066799.171515:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921c1880, transno 21474840969 00000004:00080000:3.0:1746066799.171516:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e59180, transno 21474840970 00000004:00080000:3.0:1746066799.171518:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921c0e00, transno 21474840971 00000100:00100000:3.0:1746066799.171523:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009ef5f100 x1830882976916352/t21474840980(21474840980) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066815 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746066799.171531:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef5f100/2, rc 0, transno 21474840980 00000100:00100000:3.0:1746066799.171534:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976916352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.171561:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14955 00000100:00100000:3.0:1746066799.171566:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3296:x1830882976916864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.171645:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3296:x1830882976916864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (2643us total) trans 21474840981 rc 0/0 00000100:00100000:3.0:1746066799.171651:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14955 00000100:00100000:3.0:1746066799.171659:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14956 00000100:00100000:3.0:1746066799.171663:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3296:x1830882976916224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.171751:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3296:x1830882976916224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (2725us total) trans 21474840982 rc 0/0 00000100:00100000:3.0:1746066799.171755:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14956 00000100:00100000:3.0:1746066799.171763:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14957 00000100:00100000:3.0:1746066799.171767:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3296:x1830882976916736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.171830:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3296:x1830882976916736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (2792us total) trans 21474840983 rc 0/0 00000100:00100000:3.0:1746066799.171835:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14957 00000100:00100000:3.0:1746066799.171842:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14958 00000100:00100000:3.0:1746066799.171846:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830882976916608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.171928:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830882976916608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (2810us total) trans 21474840984 rc 0/0 00000100:00100000:3.0:1746066799.171933:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14958 00000100:00100000:3.0:1746066799.171941:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14959 00000100:00100000:3.0:1746066799.171945:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830882976917120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.172017:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830882976917120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (2878us total) trans 21474840985 rc 0/0 00000100:00100000:3.0:1746066799.172023:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14959 00000100:00100000:3.0:1746066799.172030:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14960 00000100:00100000:3.0:1746066799.172034:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830882976916480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.172106:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830882976916480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (2949us total) trans 21474840986 rc 0/0 00000100:00100000:3.0:1746066799.172112:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14960 00000100:00100000:3.0:1746066799.172122:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14961 00000100:00100000:3.0:1746066799.172126:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3294:x1830882976916992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.172192:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3294:x1830882976916992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (3022us total) trans 21474840987 rc 0/0 00000100:00100000:3.0:1746066799.172196:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14961 00000004:00080000:3.0:1746066799.172216:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef5c380/2, rc 0, transno 21474840982 00000100:00100000:3.0:1746066799.172220:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976916224:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066799.172226:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef5ed80/2, rc 0, transno 21474840983 00000100:00100000:3.0:1746066799.172229:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976916736:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066799.172234:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef5fb80/2, rc 0, transno 21474840981 00000100:00100000:3.0:1746066799.172236:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976916864:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066799.172456:0:14588:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 40 done 00000100:00100000:1.0:1746066799.173299:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14962 00000100:00100000:1.0:1746066799.173307:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830882976915328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.173411:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3295:x1830882976915328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (6073us total) trans 17179873675 rc 0/0 00000100:00100000:1.0:1746066799.173415:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14962 00000100:00100000:1.0:1746066799.173424:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14963 00000100:00100000:1.0:1746066799.173427:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830882976915840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.173488:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3295:x1830882976915840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (6136us total) trans 17179873676 rc 0/0 00000100:00100000:1.0:1746066799.173495:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14963 00000100:00100000:1.0:1746066799.173504:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14964 00000100:00100000:1.0:1746066799.173507:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3293:x1830882976915456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.173577:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3293:x1830882976915456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (6201us total) trans 17179873677 rc 0/0 00000100:00100000:1.0:1746066799.173581:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14964 00000100:00080000:1.0:1746066799.173688:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746066799.173691:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1746066799.174067:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef5c700/2, rc 0, transno 21474840986 00000100:00100000:2.0:1746066799.174072:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976916480:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066799.174080:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef5c000/2, rc 0, transno 21474840987 00000100:00100000:2.0:1746066799.174082:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976916992:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066799.174090:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef5d880/2, rc 0, transno 21474840984 00000100:00100000:2.0:1746066799.174092:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976916608:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066799.174098:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef5ea00/2, rc 0, transno 21474840985 00000100:00100000:2.0:1746066799.174101:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976917120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.174497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.174537:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873657 gen 2 00000004:00080000:0.0:1746066799.174541:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0fdc00, transno 17179873600 00000004:00080000:0.0:1746066799.174555:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009270a680, transno 17179873601 00000004:00080000:0.0:1746066799.174557:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092708a80, transno 17179873602 00000004:00080000:0.0:1746066799.174559:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092709500, transno 17179873603 00000004:00080000:0.0:1746066799.174561:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009270ad80, transno 17179873604 00000004:00080000:0.0:1746066799.174562:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009270b480, transno 17179873605 00000004:00080000:0.0:1746066799.174564:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009270b100, transno 17179873606 00000004:00080000:0.0:1746066799.174567:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092708700, transno 17179873607 00000004:00080000:0.0:1746066799.174569:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092709880, transno 17179873608 00000004:00080000:0.0:1746066799.174570:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0fca80, transno 17179873612 00000004:00080000:0.0:1746066799.174572:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0fed80, transno 17179873613 00000004:00080000:0.0:1746066799.174574:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ec2d500, transno 17179873614 00000004:00080000:0.0:1746066799.174576:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f619f80, transno 17179873615 00000004:00080000:0.0:1746066799.174578:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f618a80, transno 17179873616 00000004:00080000:0.0:1746066799.174580:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed70e00, transno 17179873617 00000004:00080000:0.0:1746066799.174582:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0ffb80, transno 17179873618 00000004:00080000:0.0:1746066799.174584:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f61b800, transno 17179873619 00000004:00080000:0.0:1746066799.174586:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed08e00, transno 17179873620 00000004:00080000:0.0:1746066799.174588:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed09c00, transno 17179873621 00000004:00080000:0.0:1746066799.174590:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b472300, transno 17179873622 00000004:00080000:0.0:1746066799.174591:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed08380, transno 17179873623 00000004:00080000:0.0:1746066799.174593:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed0ad80, transno 17179873624 00000004:00080000:0.0:1746066799.174595:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135e5fb80, transno 17179873625 00000004:00080000:0.0:1746066799.174597:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed0b800, transno 17179873626 00000004:00080000:0.0:1746066799.174599:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b7f8e00, transno 17179873627 00000004:00080000:0.0:1746066799.174601:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5bb1180, transno 17179873628 00000004:00080000:0.0:1746066799.174603:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c529180, transno 17179873629 00000004:00080000:0.0:1746066799.174605:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590d180, transno 17179873640 00000004:00080000:0.0:1746066799.174607:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590ea00, transno 17179873641 00000004:00080000:0.0:1746066799.174609:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590d500, transno 17179873642 00000004:00080000:0.0:1746066799.174611:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590f480, transno 17179873643 00000004:00080000:0.0:1746066799.174612:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590f800, transno 17179873644 00000004:00080000:0.0:1746066799.174614:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590ca80, transno 17179873645 00000004:00080000:0.0:1746066799.174616:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590c380, transno 17179873646 00000004:00080000:0.0:1746066799.174617:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590e680, transno 17179873647 00000004:00080000:0.0:1746066799.174619:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a590fb80, transno 17179873648 00000004:00080000:0.0:1746066799.174621:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929ced80, transno 17179873649 00000004:00080000:0.0:1746066799.174624:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092848a80, transno 17179873650 00000004:00080000:0.0:1746066799.174625:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929cc700, transno 17179873651 00000004:00080000:0.0:1746066799.174627:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092849880, transno 17179873652 00000004:00080000:0.0:1746066799.174629:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929cdf80, transno 17179873653 00000004:00080000:0.0:1746066799.174631:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284b800, transno 17179873654 00000004:00080000:0.0:1746066799.174632:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e636300, transno 17179873655 00000004:00080000:0.0:1746066799.174634:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929cca80, transno 17179873656 00000004:00080000:0.0:1746066799.174636:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284bb80, transno 17179873657 00000100:00100000:0.0:1746066799.174641:0:3293:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009244f800 x1830882976915584/t17179873673(17179873673) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066815 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746066799.174649:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009244f800/2, rc 0, transno 17179873673 00000100:00100000:0.0:1746066799.174652:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976915584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066799.174662:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e851180/2, rc 0, transno 17179873674 00000100:00100000:0.0:1746066799.174664:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976916096:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066799.174670:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009244c700/2, rc 0, transno 17179873677 00000100:00100000:0.0:1746066799.174673:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976915456:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066799.174701:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e852680/2, rc 0, transno 17179873672 00000100:00100000:0.0:1746066799.174704:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976915968:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066799.174719:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e93d180/2, rc 0, transno 17179873675 00000100:00100000:0.0:1746066799.174722:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976915328:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066799.174727:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e851c00/2, rc 0, transno 17179873676 00000100:00100000:0.0:1746066799.174730:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976915840:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066799.174737:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e93f480/2, rc 0, transno 17179873670 00000100:00100000:0.0:1746066799.174739:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976915200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066799.174746:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009244d180/2, rc 0, transno 17179873671 00000100:00100000:0.0:1746066799.174748:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009244d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976915712:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066799.175010:0:14590:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 45 done 00000100:00100000:1.0:1746066799.175047:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977115904 00000100:00100000:1.0:1746066799.175051:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977115904 00000100:00100000:1.0:1746066799.175073:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10082 00000100:00100000:1.0:1746066799.175078:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31824:x1830882977115904:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066799.175092:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066799.175105:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46000/0xfb36a14ee608c7fd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f059 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.175146:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46000/0xfb36a14ee608c7fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f059 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.175156:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46000/0xfb36a14ee608c7fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f059 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.175169:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:1.0:1746066799.175171:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066799.175174:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac46000, rc 0) 00000100:00100000:1.0:1746066799.175201:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31824:x1830882977115904:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 123us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.175206:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10082 00000100:00100000:0.0:1746066799.175695:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976917248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.175721:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066799.176046:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976917248 00000100:00100000:1.0:1746066799.176050:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976917248 00000100:00100000:1.0:1746066799.177045:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14965 00000100:00100000:1.0:1746066799.177053:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830882976917248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.177243:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3295:x1830882976917248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 191us (1520us total) trans 17179873678 rc 0/0 00000100:00100000:1.0:1746066799.177249:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14965 00000004:00080000:0.0:1746066799.177510:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136b41f80/2, rc 0, transno 17179873678 00000100:00100000:0.0:1746066799.177515:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976917248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.181164:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.181269:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977116032 00000100:00100000:0.0:1746066799.181281:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977116032 00000100:00100000:0.0:1746066799.181616:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10083 00000100:00100000:0.0:1746066799.181623:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31824:x1830882977116032:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066799.181638:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.181651:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ed5600/0xfb36a14ee608c804 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f060 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.181726:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ed5e00/0xfb36a14ee608c80b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.181736:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093ed5e00/0xfb36a14ee608c80b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.181745:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093ed5e00/0xfb36a14ee608c80b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:0.0:1746066799.181766:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:0.0:1746066799.181769:0:14550:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746066799.181780:0:14550:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093ed5e00/0xfb36a14ee608c80b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.181798:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ed5600/0xfb36a14ee608c804 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f060 expref: 10 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.181813:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093ed5e00/0xfb36a14ee608c80b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f060 expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.181819:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:0.0:1746066799.181821:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066799.181824:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed5e00, rc 0) 00000100:00100000:0.0:1746066799.182276:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31824:x1830882977116032:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 653us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.182282:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10083 00000100:00100000:0.0:1746066799.186158:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.186189:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.186209:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.186222:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.186243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.186261:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.186281:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977116160 00000100:00100000:0.0:1746066799.186287:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977116160 00000100:00100000:0.0:1746066799.186318:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977116288 00000100:00100000:0.0:1746066799.186320:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977116288 00000100:00100000:0.0:1746066799.186329:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977116544 00000100:00100000:0.0:1746066799.186331:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977116544 00000100:00100000:0.0:1746066799.186341:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14966 00000100:00100000:0.0:1746066799.186347:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882977116160:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066799.186362:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.186378:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ed5c00/0xfb36a14ee608c812 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f067 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066799.186402:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd6e, atime: 0x6812dd6c, ctime: 0x6812dd6e, blocks: 0x7e1 00010000:00010000:0.0:1746066799.186417:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.186419:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.186427:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed5c00/0xfb36a14ee608c812 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f067 expref: 7 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.186440:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ed5c00/0xfb36a14ee608c812 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f067 expref: 7 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.186449:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed5c00, rc 0) 00000100:00100000:0.0:1746066799.186482:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977116160:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 135us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.186487:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14966 00000100:00100000:0.0:1746066799.186498:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977116800 00000100:00100000:0.0:1746066799.186501:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977116800 00000100:00100000:0.0:1746066799.186509:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977116416 00000100:00100000:0.0:1746066799.186511:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977116416 00000100:00100000:0.0:1746066799.186516:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977116672 00000100:00100000:0.0:1746066799.186517:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977116672 00000100:00100000:0.0:1746066799.186525:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14967 00000100:00100000:0.0:1746066799.186528:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977116288:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066799.186535:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.186544:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ed4800/0xfb36a14ee608c819 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f06e expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066799.186568:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38d:0x0] initial LVB size: 2097152, mtime: 0x6812dd6e, atime: 0x6812dd6e, ctime: 0x6812dd6e, blocks: 0x81f 00010000:00010000:0.0:1746066799.186579:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.186581:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.186585:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed4800/0xfb36a14ee608c819 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f06e expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.186593:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ed4800/0xfb36a14ee608c819 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f06e expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.186599:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed4800, rc 0) 00000100:00100000:0.0:1746066799.186614:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977116288:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 85us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.186619:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14967 00000100:00100000:0.0:1746066799.186628:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14968 00000100:00100000:0.0:1746066799.186632:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977116544:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066799.186638:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.186643:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608c820 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f07c expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066799.186653:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 2097152, mtime: 0x6812dd6e, atime: 0x6812dd6d, ctime: 0x6812dd6e, blocks: 0x821 00010000:00010000:0.0:1746066799.186659:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.186660:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.186664:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608c820 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f07c expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.186671:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608c820 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f07c expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.186707:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed4600, rc 0) 00000100:00100000:0.0:1746066799.186723:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977116544:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 90us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.186728:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14968 00000100:00100000:0.0:1746066799.186737:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14969 00000100:00100000:0.0:1746066799.186742:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977116800:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066799.186747:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.186753:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ed5a00/0xfb36a14ee608c827 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f08a expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066799.186762:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38f:0x0] initial LVB size: 4194304, mtime: 0x6812dd6e, atime: 0x6812dd6d, ctime: 0x6812dd6e, blocks: 0x102b 00010000:00010000:0.0:1746066799.186769:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.186770:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.186773:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed5a00/0xfb36a14ee608c827 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f08a expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.186781:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ed5a00/0xfb36a14ee608c827 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f08a expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.186787:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed5a00, rc 0) 00000100:00100000:0.0:1746066799.186800:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977116800:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 58us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.186805:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14969 00000100:00100000:0.0:1746066799.186812:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14970 00000100:00100000:0.0:1746066799.186817:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977116416:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066799.186822:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.186829:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c82e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f075 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066799.186837:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd6d, atime: 0x6812dd6d, ctime: 0x6812dd6d, blocks: 0x81d 00010000:00010000:0.0:1746066799.186842:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.186843:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.186847:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c82e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f075 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.186854:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c82e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f075 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.186860:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed4400, rc 0) 00000100:00100000:0.0:1746066799.186872:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977116416:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 56us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.186877:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14970 00000100:00100000:0.0:1746066799.186885:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14971 00000100:00100000:0.0:1746066799.186889:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977116672:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066799.186894:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.186900:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ed4c00/0xfb36a14ee608c835 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f083 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066799.186910:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 5090560, mtime: 0x6812dd6e, atime: 0x6812dd6e, ctime: 0x6812dd6e, blocks: 0x1721 00010000:00010000:0.0:1746066799.186916:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.186917:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.186920:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed4c00/0xfb36a14ee608c835 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f083 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.186927:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ed4c00/0xfb36a14ee608c835 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f083 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.186933:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed4c00, rc 0) 00000100:00100000:0.0:1746066799.186946:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977116672:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 56us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.186950:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14971 00000100:00100000:2.0:1746066799.195334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.195368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.196428:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977117184 00000100:00100000:0.0:1746066799.196437:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977117184 00000100:00100000:0.0:1746066799.196488:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977117312 00000100:00100000:0.0:1746066799.196491:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977117312 00000100:00100000:0.0:1746066799.196510:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6802 00000100:00100000:0.0:1746066799.196517:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977117184:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:0.0:1746066799.196555:0:8456:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093ed4e00/0xfb36a14ee608c83c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.196567:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.196568:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.196572:0:8456:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed4e00/0xfb36a14ee608c83c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.196583:0:8456:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ed4e00/0xfb36a14ee608c83c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066799.197621:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6803 00000100:00100000:2.0:1746066799.197629:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977117312:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:2.0:1746066799.197648:0:21550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608c843 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.197656:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.197658:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.197660:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608c843 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.197667:0:21550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608c843 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.198579:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.199321:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.199643:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977117568 00000100:00100000:3.0:1746066799.199650:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977117568 00000100:00100000:3.0:1746066799.199697:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977117824 00000100:00100000:3.0:1746066799.199699:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977117824 00000100:00100000:3.0:1746066799.199713:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6804 00000100:00100000:3.0:1746066799.199719:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977117568:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:3.0:1746066799.199742:0:21552:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608c84a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.199752:0:21552:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.199754:0:21552:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.199758:0:21552:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608c84a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.199768:0:21552:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608c84a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.200667:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6805 00000100:00100000:3.0:1746066799.200691:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977117824:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:3.0:1746066799.200709:0:1992:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608c851 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.200716:0:1992:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.200717:0:1992:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.200720:0:1992:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608c851 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.200731:0:1992:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608c851 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.205019:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.205037:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.205049:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.205060:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.205183:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977118080 00000100:00100000:0.0:1746066799.205190:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977118080 00000100:00100000:0.0:1746066799.205228:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977118336 00000100:00100000:0.0:1746066799.205230:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977118336 00000100:00100000:0.0:1746066799.205253:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977118848 00000100:00100000:0.0:1746066799.205255:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977118848 00000100:00100000:0.0:1746066799.205265:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977118592 00000100:00100000:0.0:1746066799.205267:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977118592 00000100:00100000:0.0:1746066799.205277:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6806 00000100:00100000:0.0:1746066799.205284:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882977118080:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:0.0:1746066799.205310:0:21551:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cad1200/0xfb36a14ee608c858 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.205321:0:21551:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.205323:0:21551:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.205327:0:21551:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cad1200/0xfb36a14ee608c858 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.205342:0:21551:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cad1200/0xfb36a14ee608c858 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.206715:0:8456:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093ed4e00/0xfb36a14ee608c83c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.206726:0:8456:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed4e00/0xfb36a14ee608c83c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.206732:0:8456:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093ed4e00/0xfb36a14ee608c83c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.206738:0:8456:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093ed4e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066799.206741:0:8456:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093ed4e00/0xfb36a14ee608c83c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.206747:0:8456:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093ed4e00/0xfb36a14ee608c83c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.206761:0:8456:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093ed4e00/0xfb36a14ee608c83c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.206766:0:8456:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ed4e00/0xfb36a14ee608c83c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.206810:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977117184:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 10292us (11482us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066799.206817:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6802 00000100:00100000:0.0:1746066799.206837:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6807 00000100:00100000:0.0:1746066799.206844:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977118336:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:0.0:1746066799.206866:0:8456:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093ed5400/0xfb36a14ee608c85f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.206875:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.206876:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.206879:0:8456:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed5400/0xfb36a14ee608c85f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.206886:0:8456:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ed5400/0xfb36a14ee608c85f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.209114:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6808 00000100:00100000:1.0:1746066799.209125:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977118848:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:1.0:1746066799.209153:0:31368:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bf44c00/0xfb36a14ee608c866 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.209164:0:31368:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066799.209166:0:31368:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066799.209170:0:31368:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf44c00/0xfb36a14ee608c866 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.209179:0:31368:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf44c00/0xfb36a14ee608c866 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.210197:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6809 00000100:00100000:1.0:1746066799.210205:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882977118592:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:1.0:1746066799.210224:0:1993:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009bf45000/0xfb36a14ee608c86d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.210232:0:1993:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066799.210233:0:1993:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066799.210236:0:1993:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf45000/0xfb36a14ee608c86d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.210245:0:1993:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf45000/0xfb36a14ee608c86d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.218822:0:21552:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608c84a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.218837:0:21552:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608c84a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.218844:0:21552:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608c84a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.218849:0:21552:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b19a000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066799.218853:0:21552:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608c84a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.218860:0:21552:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608c84a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.218875:0:21552:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608c84a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.218880:0:21552:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608c84a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.218939:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977117568:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 19217us (20360us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066799.218952:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6804 00010000:00010000:3.0:1746066799.227212:0:1992:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608c851 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.227228:0:1992:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608c851 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.227235:0:1992:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608c851 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.227241:0:1992:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b19b600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066799.227244:0:1992:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608c851 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.227251:0:1992:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608c851 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.227266:0:1992:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608c851 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.227272:0:1992:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608c851 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.227392:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882977117824:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 26714us (28068us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066799.227403:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6805 00010000:00010000:2.0:1746066799.232231:0:21550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608c843 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.232246:0:21550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608c843 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.232253:0:21550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608c843 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.232262:0:21550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cad1c00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066799.232265:0:21550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608c843 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.232272:0:21550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608c843 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.232287:0:21550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608c843 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.232291:0:21550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608c843 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066799.234826:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977117312:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 37190us (39449us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066799.234837:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6803 00010000:00010000:1.0:1746066799.241229:0:9849:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746066799.241841:0:21551:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cad1200/0xfb36a14ee608c858 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.241853:0:21551:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cad1200/0xfb36a14ee608c858 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.241860:0:21551:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cad1200/0xfb36a14ee608c858 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.241865:0:21551:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cad1200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066799.241868:0:21551:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cad1200/0xfb36a14ee608c858 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.241878:0:21551:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cad1200/0xfb36a14ee608c858 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.241893:0:21551:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cad1200/0xfb36a14ee608c858 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.241898:0:21551:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cad1200/0xfb36a14ee608c858 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.243946:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977118080:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 38655us (38926us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066799.243956:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6806 00010000:00010000:0.0:1746066799.247590:0:8456:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093ed5400/0xfb36a14ee608c85f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.247606:0:8456:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed5400/0xfb36a14ee608c85f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.247614:0:8456:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093ed5400/0xfb36a14ee608c85f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.247619:0:8456:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093ed5400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066799.247622:0:8456:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093ed5400/0xfb36a14ee608c85f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.247629:0:8456:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093ed5400/0xfb36a14ee608c85f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.247643:0:8456:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093ed5400/0xfb36a14ee608c85f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.247648:0:8456:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ed5400/0xfb36a14ee608c85f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.250059:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977118336:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 43209us (45013us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066799.250069:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6807 00010000:00010000:1.0:1746066799.254010:0:31368:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bf44c00/0xfb36a14ee608c866 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.254026:0:31368:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf44c00/0xfb36a14ee608c866 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.254033:0:31368:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bf44c00/0xfb36a14ee608c866 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.254039:0:31368:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf44c00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066799.254043:0:31368:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bf44c00/0xfb36a14ee608c866 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.254050:0:31368:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bf44c00/0xfb36a14ee608c866 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.254066:0:31368:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bf44c00/0xfb36a14ee608c866 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.254072:0:31368:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf44c00/0xfb36a14ee608c866 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.254154:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977118848:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 45027us (49097us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066799.254163:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6808 00010000:00010000:1.0:1746066799.259339:0:1993:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009bf45000/0xfb36a14ee608c86d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.259353:0:1993:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf45000/0xfb36a14ee608c86d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.259360:0:1993:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bf45000/0xfb36a14ee608c86d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.259365:0:1993:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf45000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066799.259369:0:1993:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bf45000/0xfb36a14ee608c86d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.259376:0:1993:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bf45000/0xfb36a14ee608c86d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.259391:0:1993:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bf45000/0xfb36a14ee608c86d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.259401:0:1993:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf45000/0xfb36a14ee608c86d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.260206:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977118592:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 49996us (55138us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066799.260219:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6809 00000100:00100000:0.0:1746066799.266353:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.266458:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977119104 00000100:00100000:2.0:1746066799.266465:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977119104 00000100:00100000:2.0:1746066799.266516:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10084 00000100:00100000:2.0:1746066799.266524:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31824:x1830882977119104:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:2.0:1746066799.266591:0:14550:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.266613:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093ed5e00/0xfb36a14ee608c80b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f060 expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.266638:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066799.266642:0:14550:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066799.266671:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608c874 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.266699:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608c874 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.266707:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608c874 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00010000:2.0:1746066799.266836:0:14550:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009e86aa00 reply state ffff88009af8d000 transno 8589944159 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608c874 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:2.0:1746066799.266842:0:14550:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746066799.266895:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31824:x1830882977119104:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 372us (548us total) trans 8589944159 rc 0/0 00000100:00100000:2.0:1746066799.266901:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10084 00000100:00100000:0.0:1746066799.272162:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066799.272770:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608c874 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066799.273129:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066799.273992:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608c874 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.274002:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608c874 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.274007:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b46e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066799.274010:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608c874 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.274016:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608c874 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.274030:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:2.0:1746066799.274032:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066799.274036:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608c874 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.274041:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608c874 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066799.274327:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.274741:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977119232 00000100:00100000:0.0:1746066799.274749:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.274750:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977119232 00000100:00100000:0.0:1746066799.274777:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.274833:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977119360 00000100:00100000:1.0:1746066799.274834:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977119488 00000100:00100000:3.0:1746066799.274835:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977119360 00000100:00100000:1.0:1746066799.274842:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977119488 00000100:00100000:0.0:1746066799.274852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.274863:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977119744 00000100:00100000:3.0:1746066799.274865:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977119744 00000100:00100000:1.0:1746066799.274868:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977119616 00000100:00100000:0.0:1746066799.274869:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977119872 00000100:00100000:1.0:1746066799.274870:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977119616 00000100:00100000:0.0:1746066799.274871:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977119872 00000100:00100000:3.0:1746066799.274878:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14972 00000100:00100000:3.0:1746066799.274884:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977119360:12345-192.168.202.57@tcp:2:lfs.0 00000100:00100000:1.0:1746066799.274888:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14973 00000100:00100000:0.0:1746066799.274892:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14974 00000100:00100000:1.0:1746066799.274894:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977119488:12345-192.168.202.57@tcp:2:lfs.0 00000100:00100000:0.0:1746066799.274896:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977119744:12345-192.168.202.57@tcp:2:lfs.0 00000100:00100000:3.0:1746066799.274935:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14975 00000100:00100000:3.0:1746066799.274939:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977119616:12345-192.168.202.57@tcp:2:lfs.0 00000100:00100000:1.0:1746066799.275008:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14976 00000100:00100000:1.0:1746066799.275014:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977119872:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:3.0:1746066799.275019:0:8452:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066799.275019:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:3.0:1746066799.275021:0:8452:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066799.275021:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.275023:0:8452:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066799.275023:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.275025:0:8452:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066799.275025:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.275027:0:8452:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:0.0:1746066799.275027:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5921 -> 5921 00000100:00100000:0.0:1746066799.275060:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977119744:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 162us (310us total) trans 17179873679 rc 0/0 00000100:00100000:0.0:1746066799.275065:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14974 00002000:00010000:1.0:1746066799.275078:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746066799.275080:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:1.0:1746066799.275082:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066797 -> 1746066798 00002000:00010000:1.0:1746066799.275084:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:1.0:1746066799.275085:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746066799.275993:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977119360:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 1107us (2863us total) trans 21474840988 rc 0/0 00000100:00100000:1.0:1746066799.275998:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977119872:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 982us (1143us total) trans 21474840990 rc 0/0 00000100:00100000:3.0:1746066799.275999:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14972 00000100:00100000:1.0:1746066799.276004:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14976 00000100:00100000:1.0:1746066799.276026:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14977 00000100:00100000:1.0:1746066799.276032:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977119232:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:1.0:1746066799.276372:0:4614:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066799.276375:0:4614:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:1.0:1746066799.276377:0:4614:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066796 -> 1746066798 00002000:00010000:1.0:1746066799.276378:0:4614:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:1.0:1746066799.276380:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2017 -> 2017 00000100:00100000:1.0:1746066799.276413:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977119232:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 381us (4340us total) trans 17179873680 rc 0/0 00000100:00100000:1.0:1746066799.276419:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14977 00002000:00010000:1.0:1746066799.276454:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066799.276456:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066797 -> 1746066798 00002000:00010000:1.0:1746066799.276458:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066797 -> 1746066798 00002000:00010000:1.0:1746066799.276459:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066797 -> 1746066798 00002000:00010000:1.0:1746066799.276461:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746066799.276474:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977119488:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 1581us (2149us total) trans 21474840989 rc 0/0 00000100:00100000:1.0:1746066799.276478:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14973 00002000:00010000:2.0:1746066799.276594:0:9776:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066799.276597:0:9776:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:2.0:1746066799.276599:0:9776:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066797 -> 1746066798 00002000:00010000:2.0:1746066799.276601:0:9776:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:2.0:1746066799.276602:0:9776:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746066799.276624:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977119616:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 1684us (1846us total) trans 17179873681 rc 0/0 00000100:00100000:2.0:1746066799.276630:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14975 00000100:00100000:2.0:1746066799.285838:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.285895:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977120128 00000100:00100000:0.0:1746066799.285903:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977120128 00000100:00100000:0.0:1746066799.285951:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4225 00000100:00100000:0.0:1746066799.285958:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31824:x1830882977120128:12345-192.168.202.57@tcp:35:lfs.0 00000004:00010000:0.0:1746066799.286005:0:14551:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x318:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130770e00/0xfb36a14ee608c7be lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f052 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.286049:0:14551:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14551 initiator: MDT0 00010000:00010000:0.0:1746066799.286058:0:14551:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46000/0xfb36a14ee608c7fd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f059 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.286068:0:14551:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 4/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14551 initiator: MDT0 00010000:00010000:0.0:1746066799.286091:0:14551:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46000/0xfb36a14ee608c7fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f059 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.286100:0:14551:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46000/0xfb36a14ee608c7fd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f059 expref: 9 pid: 809 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746066799.286110:0:14551:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135f83100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14551:1830882976917376:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066799.286179:0:14551:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1daba80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066799.289563:0:14551:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135f83100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14551:1830882976917376:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.289585:0:14551:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14551 initiator: MDT0 00000100:00100000:0.0:1746066799.290779:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.290861:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977120256 00000100:00100000:3.0:1746066799.290868:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977120256 00010000:00010000:3.0:1746066799.290897:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46000/0xfb36a14ee608c7fd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f059 expref: 10 pid: 809 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.290934:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7723 00000100:00100000:3.0:1746066799.290942:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977120256:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066799.290952:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066799.290957:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46000/0xfb36a14ee608c7fd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f059 expref: 10 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.290971:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46000/0xfb36a14ee608c7fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f059 expref: 10 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.290995:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac46000/0xfb36a14ee608c7fd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f059 expref: 10 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.291019:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066799.291024:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14551 initiator: MDT0 00010000:00010000:3.0:1746066799.291031:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14551 initiator: MDT0 00010000:00010000:3.0:1746066799.291037:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14551 initiator: MDT0 00010000:00010000:3.0:1746066799.293266:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066799.293334:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977120256:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2388us (2555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.293344:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7723 00010000:00010000:2.0:1746066799.293623:0:14551:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14551 initiator: MDT0 00010000:00010000:2.0:1746066799.293631:0:14551:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14551 initiator: MDT0 00000040:00080000:2.0:1746066799.294147:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3152, 88 off266632 00000004:00080000:2.0:1746066799.294153:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760471476397ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.294179:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3162, 88 off267424 00000004:00080000:2.0:1746066799.294182:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760471506162ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.294410:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3163, 88 off267512 00000004:00080000:2.0:1746066799.294415:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760471739292ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.294423:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3153, 88 off266720 00000004:00080000:2.0:1746066799.294425:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760471749164ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.294625:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3154, 88 off266808 00000004:00080000:2.0:1746066799.294628:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760471952042ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.294635:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3164, 88 off267600 00000004:00080000:2.0:1746066799.294638:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760471961597ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.294643:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3165, 88 off267688 00000004:00080000:2.0:1746066799.294646:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760471969708ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.294651:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3166, 88 off267776 00000004:00080000:2.0:1746066799.294653:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760471977510ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.294659:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3155, 88 off266896 00000004:00080000:2.0:1746066799.294661:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760471985217ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.294667:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3167, 88 off267864 00000004:00080000:2.0:1746066799.294669:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760471992743ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.294921:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3156, 88 off266984 00000004:00080000:2.0:1746066799.294925:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760472249533ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.294967:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3168, 88 off267952 00000004:00080000:2.0:1746066799.294970:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760472294078ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.294986:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3157, 88 off267072 00000004:00080000:2.0:1746066799.294988:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760472312230ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.294994:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3158, 88 off267160 00000004:00080000:2.0:1746066799.294997:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760472320758ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.295002:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3159, 88 off267248 00000004:00080000:2.0:1746066799.295005:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760472328648ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.295010:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3160, 88 off267336 00000004:00080000:2.0:1746066799.295012:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760472336258ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.295018:0:14551:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3169, 88 off268040 00000004:00080000:2.0:1746066799.295021:0:14551:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760472345507ns, next at 749511475809ns, rc = 0 00000004:00010000:3.0:1746066799.318223:0:14551:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ed70e00 reply state ffff88009ee75000 transno 8589944160 ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14551 initiator: MDT0 00000100:00100000:3.0:1746066799.318236:0:14551:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746066799.318245:0:14551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066799.318248:0:14551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066799.318256:0:14551:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130770e00/0xfb36a14ee608c7be lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f052 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746066799.318486:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944160 is committed 00000004:00080000:1.0:1746066799.318491:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2443 committed 00000004:00080000:1.0:1746066799.318506:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2433 committed 00000004:00080000:1.0:1746066799.318512:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2432 committed 00000004:00080000:1.0:1746066799.318513:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2431 committed 00000004:00080000:1.0:1746066799.318515:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2430 committed 00000004:00080000:1.0:1746066799.318516:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2442 committed 00000004:00080000:1.0:1746066799.318517:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2429 committed 00000004:00080000:1.0:1746066799.318519:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2441 committed 00000004:00080000:1.0:1746066799.318521:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2428 committed 00000004:00080000:1.0:1746066799.318523:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2440 committed 00000004:00080000:1.0:1746066799.318525:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2439 committed 00000004:00080000:1.0:1746066799.318526:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2438 committed 00000004:00080000:1.0:1746066799.318528:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2427 committed 00000004:00080000:1.0:1746066799.318529:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2426 committed 00000004:00080000:1.0:1746066799.318531:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2437 committed 00000004:00080000:1.0:1746066799.318532:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2436 committed 00000004:00080000:1.0:1746066799.318533:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2425 committed 00000100:00100000:0.0:1746066799.318782:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976917888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.318828:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.318848:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976918400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.318863:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066799.318925:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976917504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066799.318949:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976917760:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1746066799.319169:0:14551:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746066799.319180:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31824:x1830882977120128:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 33221us (33349us total) trans 8589944160 rc 0/0 00000100:00100000:3.0:1746066799.319189:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4225 00010000:00010000:3.0:1746066799.319216:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14551 initiator: MDT0 00010000:00010000:3.0:1746066799.319224:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14551 initiator: MDT0 00010000:00010000:3.0:1746066799.319230:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14551 initiator: MDT0 00010000:00010000:3.0:1746066799.319235:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092490c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066799.319238:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14551 initiator: MDT0 00010000:00010000:3.0:1746066799.319243:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14551 initiator: MDT0 00010000:00010000:3.0:1746066799.319253:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88009ebeb500) 00010000:00010000:3.0:1746066799.319255:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066799.319258:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14551 initiator: MDT0 00010000:00010000:3.0:1746066799.319262:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608c87b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14551 initiator: MDT0 00000100:00100000:0.0:1746066799.319384:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135f80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976918912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.319400:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.319595:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976919424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.319611:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066799.319644:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976917888 00000100:00100000:2.0:1746066799.319649:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976917888 00000100:00100000:2.0:1746066799.319707:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976918400 00000100:00100000:2.0:1746066799.319709:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976918400 00000100:00100000:2.0:1746066799.319719:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976918912 00000100:00100000:2.0:1746066799.319720:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976918912 00000100:00100000:2.0:1746066799.319731:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14978 00000100:00100000:2.0:1746066799.319736:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3295:x1830882976917888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066799.319859:0:9776:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066799.319862:0:9776:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:2.0:1746066799.319863:0:9776:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:2.0:1746066799.319865:0:9776:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:2.0:1746066799.319867:0:9776:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746066799.319885:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3295:x1830882976917888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (1058us total) trans 17179873682 rc 0/0 00000100:00100000:2.0:1746066799.319890:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14978 00000100:00100000:2.0:1746066799.319898:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14979 00000100:00100000:2.0:1746066799.319901:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3295:x1830882976918400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066799.319959:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3295:x1830882976918400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (1095us total) trans 17179873683 rc 0/0 00000100:00100000:2.0:1746066799.319964:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14979 00000100:00100000:2.0:1746066799.319971:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14980 00000100:00100000:2.0:1746066799.319976:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1830882976918912:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066799.321202:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136b43800/2, rc 0, transno 17179873682 00000100:00100000:0.0:1746066799.321217:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136b43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976917888:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066799.321226:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e852a00/2, rc 0, transno 17179873683 00000100:00100000:0.0:1746066799.321229:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976918400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.321244:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976917632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.321266:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.321278:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976918144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.321288:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.321297:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976918656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.321309:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.321334:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976919168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.321347:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.321447:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976919424 00000100:00100000:0.0:1746066799.321450:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976919424 00000100:00100000:0.0:1746066799.321466:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976917632 00000100:00100000:0.0:1746066799.321467:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976917632 00000100:00100000:0.0:1746066799.321473:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976918144 00000100:00100000:0.0:1746066799.321475:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976918144 00000100:00100000:0.0:1746066799.321481:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976918656 00000100:00100000:0.0:1746066799.321482:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976918656 00000100:00100000:0.0:1746066799.321488:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976919168 00000100:00100000:0.0:1746066799.321489:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976919168 00000100:00100000:0.0:1746066799.321497:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14981 00000100:00100000:0.0:1746066799.321502:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3295:x1830882976919424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.321574:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14982 00000100:00100000:0.0:1746066799.321579:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3293:x1830882976917632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.321615:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14983 00000100:00100000:0.0:1746066799.321619:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3293:x1830882976918144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.321725:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3293:x1830882976918144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (434us total) trans 17179873684 rc 0/0 00000100:00100000:0.0:1746066799.321732:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14983 00000100:00100000:0.0:1746066799.321742:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14984 00000100:00100000:0.0:1746066799.321746:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3293:x1830882976918656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.321811:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3293:x1830882976918656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (501us total) trans 17179873685 rc 0/0 00000100:00100000:0.0:1746066799.321816:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14984 00000100:00100000:0.0:1746066799.321824:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14985 00000100:00100000:0.0:1746066799.321828:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3293:x1830882976919168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.321861:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.321875:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976918272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.321891:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.321898:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976918784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.321909:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.321916:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976919296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.321927:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066799.321948:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136b40a80/2, rc 0, transno 17179873684 00000100:00100000:0.0:1746066799.321951:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136b40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976918144:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066799.321957:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ef5e680/2, rc 0, transno 17179873685 00000100:00100000:0.0:1746066799.321960:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976918656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.321969:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.321980:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976918016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066799.321991:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976917760 00000100:00100000:0.0:1746066799.321994:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066799.321995:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976917760 00000100:00100000:0.0:1746066799.322001:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976918528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066799.322009:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976918272 00000100:00100000:3.0:1746066799.322011:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976918272 00000100:00100000:0.0:1746066799.322013:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066799.322018:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976918784 00000100:00100000:0.0:1746066799.322019:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976919040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.322020:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976918784 00000100:00100000:3.0:1746066799.322026:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976919296 00000100:00100000:3.0:1746066799.322028:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976919296 00000100:00100000:0.0:1746066799.322031:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066799.322034:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976917504 00000100:00100000:3.0:1746066799.322035:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976917504 00000100:00100000:3.0:1746066799.322040:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976918016 00000100:00100000:3.0:1746066799.322041:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976918016 00000100:00100000:3.0:1746066799.322048:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976918528 00000100:00100000:3.0:1746066799.322050:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976918528 00000100:00100000:3.0:1746066799.322055:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976919040 00000100:00100000:3.0:1746066799.322056:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976919040 00000100:00100000:3.0:1746066799.322063:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14986 00000100:00100000:3.0:1746066799.322068:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3294:x1830882976917760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066799.322147:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746066799.322150:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.322152:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.322153:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.322155:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2017 -> 2017 00000100:00100000:2.0:1746066799.322159:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3295:x1830882976918912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2181us (2756us total) trans 21474840991 rc 0/0 00000100:00100000:2.0:1746066799.322165:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14980 00000100:00100000:2.0:1746066799.322176:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14987 00000100:00100000:2.0:1746066799.322180:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3294:x1830882976918272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066799.322181:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3294:x1830882976917760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (319us total) trans 17179873686 rc 0/0 00000100:00100000:3.0:1746066799.322186:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14986 00000100:00100000:3.0:1746066799.322196:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14988 00000100:00100000:3.0:1746066799.322200:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3294:x1830882976918784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066799.322251:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3294:x1830882976918272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (359us total) trans 17179873687 rc 0/0 00000100:00100000:2.0:1746066799.322256:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14987 00002000:00010000:3.0:1746066799.322264:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:2.0:1746066799.322265:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14989 00002000:00010000:3.0:1746066799.322266:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.322267:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.322269:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00000100:00100000:2.0:1746066799.322269:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3294:x1830882976919296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066799.322270:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746066799.322288:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3294:x1830882976918784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (378us total) trans 21474840992 rc 0/0 00000100:00100000:3.0:1746066799.322296:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14988 00000100:00100000:3.0:1746066799.322304:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14990 00000100:00100000:3.0:1746066799.322308:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3296:x1830882976917504:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066799.322323:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136b42d80/2, rc 0, transno 17179873686 00000100:00100000:3.0:1746066799.322326:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976917760:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066799.322333:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136b43100/2, rc 0, transno 17179873687 00000100:00100000:3.0:1746066799.322335:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136b43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976918272:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066799.322341:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135f83480/2, rc 0, transno 21474840992 00000100:00100000:2.0:1746066799.322343:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3294:x1830882976919296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (414us total) trans 21474840993 rc 0/0 00000100:00100000:3.0:1746066799.322344:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135f83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976918784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066799.322348:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14989 00000004:00080000:3.0:1746066799.322350:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135f82a00/2, rc 0, transno 21474840993 00000100:00100000:3.0:1746066799.322353:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135f82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976919296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066799.322357:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14991 00000100:00100000:2.0:1746066799.322361:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830882976918016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066799.322423:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066799.322423:0:9776:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:3.0:1746066799.322425:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:2.0:1746066799.322425:0:9776:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.322427:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:2.0:1746066799.322427:0:9776:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.322429:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:2.0:1746066799.322429:0:9776:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.322430:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:2.0:1746066799.322431:0:9776:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5921 -> 5921 00000100:00100000:3.0:1746066799.322454:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3296:x1830882976917504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (483us total) trans 21474840994 rc 0/0 00000100:00100000:2.0:1746066799.322454:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3296:x1830882976918016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (459us total) trans 17179873688 rc 0/0 00000100:00100000:3.0:1746066799.322459:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14990 00000100:00100000:2.0:1746066799.322469:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14991 00000100:00100000:0.0:1746066799.323564:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3295:x1830882976919424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2059us (3950us total) trans 21474840995 rc 0/0 00000100:00100000:3.0:1746066799.323920:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14992 00000100:00100000:3.0:1746066799.323928:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3296:x1830882976918528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066799.324010:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746066799.324012:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746066799.324015:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066799.324016:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746066799.324018:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746066799.324040:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3296:x1830882976918528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (2025us total) trans 17179873689 rc 0/0 00000100:00100000:3.0:1746066799.324046:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14992 00000100:00100000:3.0:1746066799.324059:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14993 00000100:00100000:3.0:1746066799.324064:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3296:x1830882976919040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.325712:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14981 00000100:00100000:3.0:1746066799.325762:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3296:x1830882976919040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1697us (3728us total) trans 21474840996 rc 0/0 00000100:00100000:3.0:1746066799.325769:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14993 00002000:00010000:0.0:1746066799.325841:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066799.325844:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066799.325846:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066799.325847:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:0.0:1746066799.325849:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746066799.325873:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882976917632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4294us (4606us total) trans 21474840997 rc 0/0 00000100:00100000:0.0:1746066799.325878:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14982 00000004:00080000:0.0:1746066799.325983:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135f81c00/2, rc 0, transno 21474840997 00000100:00100000:0.0:1746066799.325988:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135f81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976917632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066799.326165:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.326189:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977120384 00000100:00100000:1.0:1746066799.326193:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977120384 00000100:00100000:1.0:1746066799.326221:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10085 00000100:00100000:1.0:1746066799.326226:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31824:x1830882977120384:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066799.326240:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066799.326253:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d369c00/0xfb36a14ee608c882 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f091 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.326292:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d369c00/0xfb36a14ee608c882 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f091 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746066799.326299:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135f83800/2, rc 0, transno 21474840994 00000100:00100000:3.0:1746066799.326303:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135f83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976917504:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746066799.326303:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d369c00/0xfb36a14ee608c882 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f091 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746066799.326313:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136b41c00/2, rc 0, transno 17179873688 00000100:00100000:3.0:1746066799.326317:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976918016:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746066799.326317:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:1.0:1746066799.326319:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066799.326322:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d369c00, rc 0) 00000004:00080000:3.0:1746066799.326324:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e850700/2, rc 0, transno 17179873689 00000100:00100000:3.0:1746066799.326326:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976918528:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066799.326332:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135f80a80/2, rc 0, transno 21474840996 00000100:00100000:3.0:1746066799.326334:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135f80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976919040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066799.326348:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31824:x1830882977120384:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 121us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.326353:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10085 00000100:00100000:0.0:1746066799.326423:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882976919168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4594us (5074us total) trans 21474840998 rc 0/0 00000100:00100000:0.0:1746066799.326428:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14985 00000100:00100000:3.0:1746066799.326713:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976919552:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066799.326740:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066799.326761:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976919552 00000100:00100000:2.0:1746066799.326765:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976919552 00000100:00100000:2.0:1746066799.326794:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14994 00000100:00100000:2.0:1746066799.326799:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3296:x1830882976919552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066799.326931:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3296:x1830882976919552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 132us (189us total) trans 17179873690 rc 0/0 00000100:00100000:2.0:1746066799.326936:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14994 00000004:00080000:0.0:1746066799.327001:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135f81180/2, rc 0, transno 21474840998 00000100:00100000:0.0:1746066799.327005:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976919168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066799.327020:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135f80000/2, rc 0, transno 21474840991 00000100:00100000:0.0:1746066799.327023:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135f80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976918912:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066799.327029:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135f82d80/2, rc 0, transno 21474840995 00000100:00100000:0.0:1746066799.327032:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976919424:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066799.327087:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a4ec000/2, rc 0, transno 17179873690 00000100:00100000:3.0:1746066799.327090:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976919552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066799.334601:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.334670:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977120640 00000100:00100000:3.0:1746066799.334699:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977120640 00000100:00100000:3.0:1746066799.334734:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4226 00000100:00100000:3.0:1746066799.334742:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31824:x1830882977120640:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:3.0:1746066799.334958:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31824:x1830882977120640:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 216us (361us total) trans 8589944161 rc 0/0 00000100:00100000:3.0:1746066799.334965:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4226 00000100:00100000:0.0:1746066799.363160:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.363833:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.364056:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977120896 00000100:00100000:1.0:1746066799.364064:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977120896 00000100:00100000:1.0:1746066799.364096:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977121152 00000100:00100000:1.0:1746066799.364097:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977121152 00000100:00100000:1.0:1746066799.364113:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10086 00000100:00100000:1.0:1746066799.364120:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+6:31836:x1830882977120896:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066799.364139:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066799.364153:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff05600/0xfb36a14ee608c889 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f098 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.364239:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608c890 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364248:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608c890 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364257:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608c890 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364267:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9600/0xfb36a14ee608c897 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364271:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9600/0xfb36a14ee608c897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364276:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9600/0xfb36a14ee608c897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364353:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608c89e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364358:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608c89e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364363:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608c89e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:1.0:1746066799.364370:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066799.364437:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608c890 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364442:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608c890 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364447:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608c890 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364453:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ff04e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066799.364456:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608c890 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364462:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608c890 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364470:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066799.364473:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066799.364476:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608c890 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364481:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608c890 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364494:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9600/0xfb36a14ee608c897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364498:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9600/0xfb36a14ee608c897 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364501:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9600/0xfb36a14ee608c897 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364508:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099ac9600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066799.364510:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9600/0xfb36a14ee608c897 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364514:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9600/0xfb36a14ee608c897 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364519:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13900) 00010000:00010000:1.0:1746066799.364521:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066799.364523:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9600/0xfb36a14ee608c897 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364527:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9600/0xfb36a14ee608c897 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.364564:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff05600/0xfb36a14ee608c889 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f098 expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.364576:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608c89e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f098 expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.364581:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:1.0:1746066799.364583:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066799.364585:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ac8a00, rc 0) 00000100:00100000:0.0:1746066799.364691:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10087 00000100:00100000:0.0:1746066799.364698:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+250:31832:x1830882977121152:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066799.364707:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.364713:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1400/0xfb36a14ee608c8ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f09f expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.364747:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0600/0xfb36a14ee608c8b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.364753:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0600/0xfb36a14ee608c8b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.364759:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0600/0xfb36a14ee608c8b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.364767:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1600/0xfb36a14ee608c8ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.364772:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1600/0xfb36a14ee608c8ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.364777:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1600/0xfb36a14ee608c8ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.364820:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1c00/0xfb36a14ee608c8c1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.364826:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1c00/0xfb36a14ee608c8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.364831:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1c00/0xfb36a14ee608c8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746066799.364837:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066799.364870:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0600/0xfb36a14ee608c8b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.364875:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0600/0xfb36a14ee608c8b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.364879:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0600/0xfb36a14ee608c8b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.364883:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008deb0600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066799.364885:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0600/0xfb36a14ee608c8b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.364889:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0600/0xfb36a14ee608c8b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.364895:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066799.364897:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066799.364899:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0600/0xfb36a14ee608c8b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.364903:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0600/0xfb36a14ee608c8b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746066799.365965:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:31836:x1830882977120896:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1842us (2808us total) trans 8589944162 rc 0/0 00000100:00100000:1.0:1746066799.365972:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10086 00010000:00010000:0.0:1746066799.366024:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1600/0xfb36a14ee608c8ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.366031:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1600/0xfb36a14ee608c8ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.366035:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1600/0xfb36a14ee608c8ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.366043:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008deb1600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066799.366045:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1600/0xfb36a14ee608c8ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.366050:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1600/0xfb36a14ee608c8ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.366057:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009d6bdd00) 00010000:00010000:0.0:1746066799.366059:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066799.366061:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1600/0xfb36a14ee608c8ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.366066:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1600/0xfb36a14ee608c8ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066799.366096:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1400/0xfb36a14ee608c8ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f09f expref: 253 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.366105:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1c00/0xfb36a14ee608c8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f09f expref: 252 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.366110:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:0.0:1746066799.366112:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066799.366114:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008deb1c00, rc 0) 00000100:00100000:0.0:1746066799.366137:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31832:x1830882977121152:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1441us (2306us total) trans 8589944163 rc 0/0 00000100:00100000:0.0:1746066799.366143:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10087 00000100:00100000:0.0:1746066799.369947:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.369977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.370008:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977121792 00000100:00100000:1.0:1746066799.370015:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977121792 00000100:00100000:1.0:1746066799.370050:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10088 00000100:00100000:1.0:1746066799.370058:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31835:x1830882977121792:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066799.370077:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066799.370090:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8e00/0xfb36a14ee608c8cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f0bb expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.370159:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066799.370170:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608c89e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f098 expref: 7 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.370176:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1c00/0xfb36a14ee608c8c1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f09f expref: 253 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.370181:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066799.370205:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1c00/0xfb36a14ee608c8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f09f expref: 253 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.370216:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1c00/0xfb36a14ee608c8c1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f09f expref: 253 pid: 14549 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.370226:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976919680:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066799.370303:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608c89e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f098 expref: 7 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.370310:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608c89e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f098 expref: 7 pid: 14550 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.370317:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976919808:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066799.370335:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.370654:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.370721:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.371004:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977121920 00000100:00100000:1.0:1746066799.371008:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977121920 00000100:00100000:1.0:1746066799.371039:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10089 00000100:00100000:1.0:1746066799.371044:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+8:31834:x1830882977121920:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066799.371054:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066799.371061:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608c8dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f0b4 expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.371097:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066799.371104:0:16018:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066799.371110:0:16018:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000100:00100000:3.0:1746066799.371464:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977121280 00000100:00100000:3.0:1746066799.371468:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977121280 00000100:00100000:3.0:1746066799.371493:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977121408 00000100:00100000:3.0:1746066799.371494:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977121408 00000100:00100000:3.0:1746066799.371510:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14995 00000100:00100000:3.0:1746066799.371514:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31832:x1830882977121280:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066799.371522:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.371530:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009354c800/0xfb36a14ee608c8eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f0a6 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.371542:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.371544:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.371558:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009354c800/0xfb36a14ee608c8eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0a6 expref: 26 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.371569:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009354c800/0xfb36a14ee608c8eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0a6 expref: 26 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.371576:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009354c800, rc 0) 00000100:00100000:3.0:1746066799.371597:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31832:x1830882977121280:12345-192.168.202.57@tcp:101:cat.0 Request processed in 82us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.371602:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14995 00000100:00100000:3.0:1746066799.371613:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14996 00000100:00100000:3.0:1746066799.371616:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+16:31836:x1830882977121408:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066799.372204:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.372210:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608c8f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f0ad expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.372222:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.372223:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.372226:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608c8f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ad expref: 17 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.372234:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608c8f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ad expref: 17 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.372239:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009354c000, rc 0) 00000100:00100000:3.0:1746066799.372260:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:31836:x1830882977121408:12345-192.168.202.57@tcp:101:cat.0 Request processed in 643us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.372264:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14996 00000100:00100000:1.0:1746066799.374049:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976919680:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066799.374058:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4eea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976919808:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066799.374075:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066799.374985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.375209:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.375276:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.375295:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977122304 00000100:00100000:0.0:1746066799.375301:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977122304 00000100:00100000:0.0:1746066799.375340:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10090 00000100:00100000:0.0:1746066799.375347:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:31832:x1830882977122304:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066799.375364:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.375377:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0e00/0xfb36a14ee608c8f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f0c2 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.375485:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977122048 00000100:00100000:1.0:1746066799.375488:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977122048 00010000:00010000:1.0:1746066799.375503:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608c89e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f098 expref: 10 pid: 14550 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.375521:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977122176 00000100:00100000:1.0:1746066799.375523:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977122176 00010000:00010000:1.0:1746066799.375529:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1c00/0xfb36a14ee608c8c1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f09f expref: 256 pid: 14549 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746066799.375539:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7724 00000100:00100000:1.0:1746066799.375543:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b473b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882977122048:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.375563:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.375567:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608c89e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f098 expref: 10 pid: 14550 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.375575:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608c89e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f098 expref: 10 pid: 14550 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.375591:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8a00/0xfb36a14ee608c89e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f098 expref: 10 pid: 14550 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.375605:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:1.0:1746066799.375609:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066799.375615:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066799.375619:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.375645:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b473b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+9:1964:x1830882977122048:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 101us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.375651:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7724 00000100:00100000:1.0:1746066799.375663:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7725 00000100:00100000:1.0:1746066799.375667:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:1964:x1830882977122176:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.375673:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.375698:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1c00/0xfb36a14ee608c8c1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f09f expref: 256 pid: 14549 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.375705:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1c00/0xfb36a14ee608c8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f09f expref: 256 pid: 14549 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.375715:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb1c00/0xfb36a14ee608c8c1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f09f expref: 256 pid: 14549 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.375725:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:1.0:1746066799.375729:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066799.375735:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066799.375740:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066799.375746:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066799.375750:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066799.375755:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066799.375770:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.375785:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:1964:x1830882977122176:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 117us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.375790:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7725 00010000:00010000:1.0:1746066799.375807:0:16018:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066799.375812:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:1.0:1746066799.375824:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066799.375930:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608c8dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0b4 expref: 10 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.375940:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0b4 expref: 9 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.375946:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:1.0:1746066799.375948:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066799.375950:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cad1e00, rc 0) 00000100:00100000:1.0:1746066799.375970:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+9:31834:x1830882977121920:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4926us (5316us total) trans 8589944164 rc 0/0 00000100:00100000:1.0:1746066799.375974:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10089 00010000:00010000:1.0:1746066799.375989:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066799.375993:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746066799.376001:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066799.376046:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac8e00/0xfb36a14ee608c8cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0bb expref: 256 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.376059:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0bb expref: 255 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.376063:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:1.0:1746066799.376065:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066799.376067:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099ac9e00, rc 0) 00000100:00100000:1.0:1746066799.376082:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31835:x1830882977121792:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6025us (6140us total) trans 8589944165 rc 0/0 00000100:00100000:1.0:1746066799.376087:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10088 00010000:00010000:0.0:1746066799.376422:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0e00/0xfb36a14ee608c8f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0c2 expref: 254 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.376431:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0e00/0xfb36a14ee608c8f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0c2 expref: 254 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.376444:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:0.0:1746066799.376446:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066799.376447:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008deb0e00, rc 0) 00000100:00100000:0.0:1746066799.376467:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:31832:x1830882977122304:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1121us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.376472:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10090 00000100:00100000:0.0:1746066799.379741:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.379810:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.380003:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977122688 00000100:00100000:1.0:1746066799.380011:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977122688 00002000:00100000:1.0:1746066799.380046:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009b471880 x1830882977122688/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.380054:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b471880 with x1830882977122688 ext(0->1048575) 00002000:00010000:1.0:1746066799.380059:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b471880 00000100:00100000:1.0:1746066799.380085:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6810 00000100:00100000:1.0:1746066799.380092:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977122688:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066799.380560:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977122432 00000100:00100000:2.0:1746066799.380564:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977122432 00000100:00100000:2.0:1746066799.380587:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10091 00000100:00100000:2.0:1746066799.380591:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+9:31836:x1830882977122432:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066799.380600:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.380613:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46800/0xfb36a14ee608c90e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f0c9 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.380652:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46800/0xfb36a14ee608c90e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0c9 expref: 10 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.380661:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46800/0xfb36a14ee608c90e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0c9 expref: 10 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.380695:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066799.380698:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066799.380700:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b46800, rc 0) 00000100:00100000:2.0:1746066799.380742:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:31836:x1830882977122432:12345-192.168.202.57@tcp:101:cat.0 Request processed in 150us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.380747:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10091 00000100:00100000:0.0:1746066799.390827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.390885:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977122944 00000100:00100000:2.0:1746066799.390893:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977122944 00002000:00100000:2.0:1746066799.390930:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009b470380 x1830882977122944/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.390938:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470380 with x1830882977122944 ext(0->1048575) 00002000:00010000:2.0:1746066799.390942:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b470380 00000100:00100000:2.0:1746066799.390969:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6811 00000100:00100000:2.0:1746066799.390975:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977122944:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066799.395976:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977122688:12345-192.168.202.57@tcp:3:cat.0 Request processed in 15876us (16157us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066799.395987:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6810 00002000:00100000:1.0:1746066799.395997:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009b471880 x1830882977122688/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.396004:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b471880 with x1830882977122688 ext(0->1048575) 00002000:00010000:1.0:1746066799.396010:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b471880 00000100:00100000:2.0:1746066799.398172:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977122944:12345-192.168.202.57@tcp:3:cat.0 Request processed in 7190us (7344us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066799.398181:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6811 00002000:00100000:2.0:1746066799.398190:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009b470380 x1830882977122944/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.398198:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470380 with x1830882977122944 ext(0->1048575) 00002000:00010000:2.0:1746066799.398202:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b470380 00000100:00100000:0.0:1746066799.404839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.404927:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977123072 00000100:00100000:3.0:1746066799.404935:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977123072 00000100:00100000:3.0:1746066799.405027:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14997 00000100:00100000:3.0:1746066799.405035:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:31832:x1830882977123072:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066799.405049:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.405063:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9600/0xfb36a14ee608c915 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f0d0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.405082:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.405084:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.405090:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9600/0xfb36a14ee608c915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d0 expref: 16 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.405101:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9600/0xfb36a14ee608c915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d0 expref: 16 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.405110:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5e9600, rc 0) 00000100:00100000:3.0:1746066799.405157:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:31832:x1830882977123072:12345-192.168.202.57@tcp:101:cat.0 Request processed in 123us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.405162:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14997 00000100:00100000:0.0:1746066799.409793:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.409852:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977123200 00000100:00100000:2.0:1746066799.409860:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977123200 00000100:00100000:2.0:1746066799.409908:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14998 00000100:00100000:2.0:1746066799.409915:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+11:31836:x1830882977123200:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066799.409930:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.409945:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b47c00/0xfb36a14ee608c91c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f0d7 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.409966:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.409967:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.409974:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b47c00/0xfb36a14ee608c91c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d7 expref: 12 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.409987:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b47c00/0xfb36a14ee608c91c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d7 expref: 12 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.409997:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b47c00, rc 0) 00000100:00100000:2.0:1746066799.410047:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:31836:x1830882977123200:12345-192.168.202.57@tcp:101:cat.0 Request processed in 132us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.410053:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14998 00000100:00100000:0.0:1746066799.418907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.418948:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.418973:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977123456 00000100:00100000:2.0:1746066799.418981:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977123456 00000100:00100000:1.0:1746066799.419004:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977123712 00000100:00100000:1.0:1746066799.419009:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977123712 00002000:00100000:2.0:1746066799.419017:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009b470000 x1830882977123456/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.419027:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470000 with x1830882977123456 ext(1048576->2097151) 00002000:00100000:1.0:1746066799.419027:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009b471c00 x1830882977123712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746066799.419031:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b470000 00002000:00100000:1.0:1746066799.419034:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b471c00 with x1830882977123712 ext(1048576->2097151) 00002000:00010000:1.0:1746066799.419037:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b471c00 00000100:00100000:2.0:1746066799.419049:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6812 00000100:00100000:1.0:1746066799.419053:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6813 00000100:00100000:2.0:1746066799.419055:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1964:x1830882977123456:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066799.419059:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882977123712:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066799.433155:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1964:x1830882977123456:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14090us (14244us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066799.433165:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6812 00002000:00100000:2.0:1746066799.433175:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009b470000 x1830882977123456/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.433183:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470000 with x1830882977123456 ext(1048576->2097151) 00002000:00010000:2.0:1746066799.433189:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b470000 00000100:00100000:1.0:1746066799.443920:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882977123712:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24851us (24961us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066799.443931:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6813 00002000:00100000:1.0:1746066799.443940:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009b471c00 x1830882977123712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.443949:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b471c00 with x1830882977123712 ext(1048576->2097151) 00002000:00010000:1.0:1746066799.443954:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b471c00 00000100:00100000:0.0:1746066799.451825:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.451889:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977123840 00000100:00100000:3.0:1746066799.451897:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977123840 00000100:00100000:3.0:1746066799.451945:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 14999 00000100:00100000:3.0:1746066799.451952:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:31832:x1830882977123840:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066799.451966:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.451981:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8800/0xfb36a14ee608c923 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f0de expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.452002:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.452003:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.452009:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8800/0xfb36a14ee608c923 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0de expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.452021:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8800/0xfb36a14ee608c923 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0de expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.452030:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5e8800, rc 0) 00000100:00100000:3.0:1746066799.452074:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:31832:x1830882977123840:12345-192.168.202.57@tcp:101:cat.0 Request processed in 123us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.452080:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 14999 00000100:00100000:0.0:1746066799.459050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.459128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.459331:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977124224 00000100:00100000:3.0:1746066799.459338:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977124224 00000100:00100000:3.0:1746066799.459382:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15000 00000100:00100000:3.0:1746066799.459388:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+12:31836:x1830882977124224:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066799.459402:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.459416:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9200/0xfb36a14ee608c92a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f0e5 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.459433:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.459434:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.459439:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9200/0xfb36a14ee608c92a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0e5 expref: 13 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.459450:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9200/0xfb36a14ee608c92a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0e5 expref: 13 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.459458:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5e9200, rc 0) 00000100:00100000:3.0:1746066799.459493:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+13:31836:x1830882977124224:12345-192.168.202.57@tcp:101:cat.0 Request processed in 105us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.459498:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15000 00000100:00100000:1.0:1746066799.459706:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977124096 00000100:00100000:1.0:1746066799.459711:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977124096 00002000:00100000:1.0:1746066799.459740:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009b470e00 x1830882977124096/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.459753:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470e00 with x1830882977124096 ext(1048576->2097151) 00002000:00010000:1.0:1746066799.459757:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b470e00 00000100:00100000:1.0:1746066799.459784:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6814 00000100:00100000:1.0:1746066799.459790:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1964:x1830882977124096:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066799.467751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.467863:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977124480 00000100:00100000:3.0:1746066799.467870:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977124480 00002000:00100000:3.0:1746066799.467905:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009b471180 x1830882977124480/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066799.467919:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b471180 with x1830882977124480 ext(1048576->2097151) 00002000:00010000:3.0:1746066799.467924:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b471180 00000100:00100000:3.0:1746066799.467941:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6815 00000100:00100000:3.0:1746066799.467948:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+13:1965:x1830882977124480:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066799.482968:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1964:x1830882977124096:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23171us (23916us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066799.482981:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6814 00002000:00100000:1.0:1746066799.482992:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009b470e00 x1830882977124096/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.483001:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470e00 with x1830882977124096 ext(1048576->2097151) 00002000:00010000:1.0:1746066799.483006:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b470e00 00000100:00100000:3.0:1746066799.491078:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+13:1965:x1830882977124480:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23119us (23322us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066799.491090:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6815 00002000:00100000:3.0:1746066799.491103:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009b471180 x1830882977124480/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066799.491113:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b471180 with x1830882977124480 ext(1048576->2097151) 00002000:00010000:3.0:1746066799.491118:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b471180 00000100:00100000:0.0:1746066799.491430:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.491628:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977124608 00000100:00100000:3.0:1746066799.491634:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977124608 00000100:00100000:3.0:1746066799.491664:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15001 00000100:00100000:3.0:1746066799.491669:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31832:x1830882977124608:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066799.491697:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.491713:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9c00/0xfb36a14ee608c931 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f0ec expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.491732:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.491734:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.491739:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9c00/0xfb36a14ee608c931 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ec expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.491753:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9c00/0xfb36a14ee608c931 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ec expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.491763:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5e9c00, rc 0) 00000100:00100000:3.0:1746066799.491964:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:31832:x1830882977124608:12345-192.168.202.57@tcp:101:cat.0 Request processed in 293us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.491970:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15001 00000100:00100000:0.0:1746066799.506522:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.506584:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.506701:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977124992 00000100:00100000:2.0:1746066799.506711:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977124992 00000100:00100000:2.0:1746066799.506749:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15002 00000100:00100000:2.0:1746066799.506756:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:31836:x1830882977124992:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066799.506772:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.506788:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b47e00/0xfb36a14ee608c938 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f0f3 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.506809:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.506810:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.506817:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b47e00/0xfb36a14ee608c938 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0f3 expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.506828:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b47e00/0xfb36a14ee608c938 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0f3 expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.506837:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b47e00, rc 0) 00000100:00100000:2.0:1746066799.506874:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:31836:x1830882977124992:12345-192.168.202.57@tcp:101:cat.0 Request processed in 118us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.506880:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15002 00000100:00100000:3.0:1746066799.507118:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977124864 00000100:00100000:3.0:1746066799.507122:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977124864 00002000:00100000:3.0:1746066799.507147:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009b473800 x1830882977124864/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066799.507155:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b473800 with x1830882977124864 ext(1048576->2097151) 00002000:00010000:3.0:1746066799.507159:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b473800 00000100:00100000:3.0:1746066799.507185:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6816 00000100:00100000:3.0:1746066799.507190:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977124864:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066799.517026:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.517121:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977125248 00000100:00100000:1.0:1746066799.517129:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977125248 00002000:00100000:1.0:1746066799.517166:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009b473100 x1830882977125248/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.517174:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b473100 with x1830882977125248 ext(1048576->2097151) 00002000:00010000:1.0:1746066799.517179:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b473100 00000100:00100000:1.0:1746066799.517198:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6817 00000100:00100000:1.0:1746066799.517204:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977125248:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066799.529079:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977124864:12345-192.168.202.57@tcp:3:cat.0 Request processed in 21880us (22555us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066799.529090:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6816 00002000:00100000:3.0:1746066799.529099:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009b473800 x1830882977124864/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066799.529108:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b473800 with x1830882977124864 ext(1048576->2097151) 00002000:00010000:3.0:1746066799.529113:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b473800 00000100:00100000:0.0:1746066799.536780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.537721:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977125504 00000100:00100000:2.0:1746066799.537729:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977125504 00000100:00100000:2.0:1746066799.538029:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10092 00000100:00100000:2.0:1746066799.538037:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:31834:x1830882977125504:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066799.538059:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.538062:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746066799.538084:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46800/0xfb36a14ee608c90e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0c9 expref: 10 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.538335:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066799.538340:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066799.538351:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318200/0xfb36a14ee608c93f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f0fa expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.538391:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066799.538401:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d369c00/0xfb36a14ee608c882 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f091 expref: 7 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.538408:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0e00/0xfb36a14ee608c8f9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0c2 expref: 253 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.538413:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066799.538437:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0e00/0xfb36a14ee608c8f9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0c2 expref: 253 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.538447:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0e00/0xfb36a14ee608c8f9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0c2 expref: 253 pid: 14550 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.538457:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976919936:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.540735:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d369c00/0xfb36a14ee608c882 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f091 expref: 7 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.540746:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d369c00/0xfb36a14ee608c882 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f091 expref: 7 pid: 809 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.540758:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976920064:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.540804:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066799.543636:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977125248:12345-192.168.202.57@tcp:3:cat.0 Request processed in 26423us (26609us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066799.543646:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6817 00002000:00100000:1.0:1746066799.543656:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009b473100 x1830882977125248/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.543664:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b473100 with x1830882977125248 ext(1048576->2097151) 00002000:00010000:1.0:1746066799.543669:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b473100 00000100:00100000:0.0:1746066799.545194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.545283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.545314:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977125632 00000100:00100000:0.0:1746066799.545321:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977125632 00000100:00100000:0.0:1746066799.545348:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977125760 00000100:00100000:0.0:1746066799.545350:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977125760 00000100:00100000:0.0:1746066799.545364:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15003 00000100:00100000:0.0:1746066799.545369:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977125632:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066799.545383:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.545396:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130edcc00/0xfb36a14ee608c94d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f101 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.545413:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.545415:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.545422:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130edcc00/0xfb36a14ee608c94d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f101 expref: 28 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.545439:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130edcc00/0xfb36a14ee608c94d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f101 expref: 28 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.545448:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130edcc00, rc 0) 00000100:00100000:0.0:1746066799.545473:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977125632:12345-192.168.202.57@tcp:101:cat.0 Request processed in 104us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.545478:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15003 00000100:00100000:0.0:1746066799.545489:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15004 00000100:00100000:0.0:1746066799.545494:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1963:x1830882977125760:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066799.545500:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.545507:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608c954 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f108 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.545517:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.545519:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.545523:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608c954 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f108 expref: 18 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.545531:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608c954 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f108 expref: 18 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066799.545538:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130edd600, rc 0) 00000100:00100000:0.0:1746066799.545563:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1963:x1830882977125760:12345-192.168.202.57@tcp:101:cat.0 Request processed in 69us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.545568:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15004 00000100:00100000:0.0:1746066799.548077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.548112:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.548161:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977125888 00000100:00100000:2.0:1746066799.548168:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977125888 00010000:00010000:2.0:1746066799.548194:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0e00/0xfb36a14ee608c8f9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0c2 expref: 254 pid: 14550 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.548220:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977126016 00000100:00100000:2.0:1746066799.548222:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977126016 00010000:00010000:2.0:1746066799.548230:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d369c00/0xfb36a14ee608c882 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f091 expref: 8 pid: 809 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.548244:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7726 00000100:00100000:2.0:1746066799.548249:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:1965:x1830882977125888:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.548260:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.548264:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0e00/0xfb36a14ee608c8f9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0c2 expref: 254 pid: 14550 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.548273:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0e00/0xfb36a14ee608c8f9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0c2 expref: 254 pid: 14550 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.548292:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066799.548296:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066799.548302:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066799.548309:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066799.548338:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:1965:x1830882977125888:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 89us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.548344:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7726 00000100:00100000:2.0:1746066799.548355:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7727 00000100:00100000:2.0:1746066799.548360:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977126016:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.548366:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.548370:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d369c00/0xfb36a14ee608c882 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f091 expref: 8 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.548377:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d369c00/0xfb36a14ee608c882 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f091 expref: 8 pid: 809 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.548385:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066799.548388:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066799.548393:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066799.548399:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066799.548409:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066799.548419:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977126016:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 59us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.548423:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7727 00010000:00010000:2.0:1746066799.548448:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008deb0e00/0xfb36a14ee608c8f9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0c2 expref: 253 pid: 14550 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.548463:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976919936:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.548470:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d369c00/0xfb36a14ee608c882 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f091 expref: 7 pid: 809 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.548478:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976920064:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.548493:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066799.548499:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066799.548504:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000040:00080000:2.0:1746066799.549004:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3161, 88 off267424 00000004:00080000:2.0:1746066799.549009:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760726332908ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.549042:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3170, 88 off268128 00000004:00080000:2.0:1746066799.549044:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760726368143ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.549053:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3171, 88 off268216 00000004:00080000:2.0:1746066799.549055:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760726379019ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.549061:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3162, 88 off267512 00000004:00080000:2.0:1746066799.549063:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760726386803ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.549068:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3163, 88 off267600 00000004:00080000:2.0:1746066799.549070:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760726393796ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.549075:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3172, 88 off268304 00000004:00080000:2.0:1746066799.549076:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760726400500ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.549081:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3173, 88 off268392 00000004:00080000:2.0:1746066799.549083:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760726407605ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.549089:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3174, 88 off268480 00000004:00080000:2.0:1746066799.549091:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760726414825ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.549096:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3164, 88 off267688 00000004:00080000:2.0:1746066799.549097:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760726421606ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.549102:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3175, 88 off268568 00000004:00080000:2.0:1746066799.549104:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760726427985ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.549109:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3165, 88 off267776 00000004:00080000:2.0:1746066799.549110:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760726434545ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.549115:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3176, 88 off268656 00000004:00080000:2.0:1746066799.549117:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760726440933ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066799.549122:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3166, 88 off267864 00000004:00080000:2.0:1746066799.549123:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760726447406ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.549128:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3167, 88 off267952 00000004:00080000:2.0:1746066799.549130:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760726453693ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.549134:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3168, 88 off268040 00000004:00080000:2.0:1746066799.549136:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760726460199ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.549141:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3169, 88 off268128 00000004:00080000:2.0:1746066799.549143:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 760726466659ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066799.549147:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3177, 88 off268744 00000004:00080000:2.0:1746066799.549150:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 760726473665ns, next at 749511475809ns, rc = 0 00000100:00100000:1.0:1746066799.554693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.554717:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977126144 00000100:00100000:1.0:1746066799.554724:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977126144 00000100:00100000:1.0:1746066799.554756:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10093 00000100:00100000:1.0:1746066799.554762:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:31836:x1830882977126144:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066799.554777:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066799.554791:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f10f expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.554835:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066799.554843:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 4/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 13 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.554858:0:14550:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066799.554869:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 13 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.554879:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:1.0:1746066799.554881:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066799.554884:0:14550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 13 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.554890:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50a7e00, rc 0) 00000100:00100000:1.0:1746066799.554927:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:31836:x1830882977126144:12345-192.168.202.57@tcp:101:cat.0 Request processed in 165us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.554933:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10093 00000100:00100000:0.0:1746066799.555968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.556016:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977126272 00000100:00100000:0.0:1746066799.556020:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977126272 00000100:00100000:0.0:1746066799.556058:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10094 00000100:00100000:0.0:1746066799.556067:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31832:x1830882977126272:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066799.556079:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.556088:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608c962 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f116 expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.556116:0:16018:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608c962 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f116 expref: 254 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.556124:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608c962 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f116 expref: 254 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.556132:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:0.0:1746066799.556134:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066799.556136:0:16018:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.556142:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5e8600, rc 0) 00000100:00100000:0.0:1746066799.556165:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:31832:x1830882977126272:12345-192.168.202.57@tcp:101:cat.0 Request processed in 99us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.556171:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10094 00000001:00080000:1.0:1746066799.594859:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944163 is committed 00000001:00080000:1.0:1746066799.594871:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944165 is committed 00000001:00080000:1.0:1746066799.594878:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944164 is committed 00000001:00080000:1.0:1746066799.594884:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944166 is committed 00000004:00080000:1.0:1746066799.594888:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2451 committed 00000004:00080000:1.0:1746066799.594895:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2442 committed 00000004:00080000:1.0:1746066799.594900:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2441 committed 00000004:00080000:1.0:1746066799.594901:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2440 committed 00000004:00080000:1.0:1746066799.594902:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2439 committed 00000004:00080000:1.0:1746066799.594904:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2450 committed 00000004:00080000:1.0:1746066799.594905:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2438 committed 00000004:00080000:1.0:1746066799.594906:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2449 committed 00000004:00080000:1.0:1746066799.594907:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2437 committed 00000004:00080000:1.0:1746066799.594908:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2448 committed 00000004:00080000:1.0:1746066799.594910:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2447 committed 00000004:00080000:1.0:1746066799.594911:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2446 committed 00000004:00080000:1.0:1746066799.594912:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2436 committed 00000004:00080000:1.0:1746066799.594913:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2435 committed 00000004:00080000:1.0:1746066799.594914:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2445 committed 00000004:00080000:1.0:1746066799.594915:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2444 committed 00000004:00080000:1.0:1746066799.594917:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2434 committed 00000100:00100000:0.0:1746066799.595138:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976920192:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066799.595146:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0fa expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.595157:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066799.595159:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746066799.595163:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 10 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.595172:0:14549:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 10 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.595178:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 10 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.595185:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608c962 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f116 expref: 251 pid: 16018 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.595186:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746066799.595191:0:14549:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608c962 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f116 expref: 251 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.595196:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608c962 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f116 expref: 251 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.595215:0:14549:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608c962 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f116 expref: 251 pid: 16018 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066799.595219:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976920704:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066799.595223:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976921216:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066799.595233:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066799.595267:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976920320:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066799.595269:0:14549:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 10 pid: 14550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066799.595275:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976921344:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066799.595315:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976920448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.595331:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.595343:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976920960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.595355:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.595367:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066799.595371:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976920576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.595383:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.595391:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976921088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.595400:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1746066799.595656:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944161 is committed 00000100:00100000:3.0:1746066799.595711:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066799.595732:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976920832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066799.595743:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976920192 00000100:00100000:3.0:1746066799.595749:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066799.595749:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976920192 00000100:00100000:3.0:1746066799.595773:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976920704 00000100:00100000:1.0:1746066799.595773:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976920448 00000100:00100000:1.0:1746066799.595774:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976920448 00000100:00100000:3.0:1746066799.595776:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976920704 00000100:00100000:1.0:1746066799.595784:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976920960 00000100:00100000:1.0:1746066799.595786:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976920960 00000100:00100000:3.0:1746066799.595792:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976920576 00000100:00100000:1.0:1746066799.595793:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976921088 00000100:00100000:3.0:1746066799.595794:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976920576 00000100:00100000:1.0:1746066799.595795:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976921088 00000100:00100000:3.0:1746066799.595802:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976920832 00000100:00100000:1.0:1746066799.595802:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976920320 00000100:00100000:1.0:1746066799.595803:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976920320 00000100:00100000:3.0:1746066799.595804:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976920832 00000100:00100000:1.0:1746066799.595812:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15005 00000100:00100000:1.0:1746066799.595818:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3293:x1830882976920192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.595923:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15006 00000100:00100000:3.0:1746066799.595930:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3295:x1830882976920448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.595942:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15007 00000100:00100000:3.0:1746066799.595945:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3293:x1830882976920704:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066799.595961:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066799.595964:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:1.0:1746066799.595966:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:1.0:1746066799.595968:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:1.0:1746066799.595969:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746066799.595995:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3293:x1830882976920192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 177us (809us total) trans 21474840999 rc 0/0 00000100:00100000:1.0:1746066799.596001:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15005 00000100:00100000:2.0:1746066799.596009:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15008 00000100:00100000:2.0:1746066799.596016:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3295:x1830882976920960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066799.596016:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15009 00000100:00100000:1.0:1746066799.596020:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3295:x1830882976920576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.596032:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3293:x1830882976920704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (797us total) trans 21474841000 rc 0/0 00000100:00100000:3.0:1746066799.596037:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15007 00000100:00100000:3.0:1746066799.596049:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15010 00000100:00100000:3.0:1746066799.596052:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3295:x1830882976921088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066799.596078:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15011 00000100:00100000:1.0:1746066799.596083:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3294:x1830882976920320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066799.596099:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3295:x1830882976920960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (741us total) trans 21474841001 rc 0/0 00000100:00100000:2.0:1746066799.596105:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15008 00000100:00100000:2.0:1746066799.596116:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15012 00000100:00100000:2.0:1746066799.596120:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3294:x1830882976920832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.596131:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3295:x1830882976921088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (728us total) trans 21474841003 rc 0/0 00000100:00100000:3.0:1746066799.596136:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15010 00002000:00010000:1.0:1746066799.596143:0:4614:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066799.596145:0:4614:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:1.0:1746066799.596147:0:4614:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:1.0:1746066799.596148:0:4614:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:1.0:1746066799.596150:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746066799.596153:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976921856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.596169:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3294:x1830882976920320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (458us total) trans 21474841004 rc 0/0 00000100:00100000:3.0:1746066799.596172:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066799.596174:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15011 00000100:00100000:1.0:1746066799.596183:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976921856 00000100:00100000:2.0:1746066799.596184:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3294:x1830882976920832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (433us total) trans 21474841005 rc 0/0 00000100:00100000:3.0:1746066799.596185:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976922368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.596185:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976921856 00000100:00100000:2.0:1746066799.596189:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15012 00000100:00100000:3.0:1746066799.596198:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066799.596198:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15013 00000100:00100000:1.0:1746066799.596202:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3296:x1830882976921856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066799.596207:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746066799.596207:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976922368 00000100:00100000:2.0:1746066799.596209:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976922368 00000100:00100000:3.0:1746066799.596211:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976921728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066799.596220:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15014 00000100:00100000:2.0:1746066799.596224:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3296:x1830882976922368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066799.596284:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066799.596300:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3296:x1830882976921856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (127us total) trans 17179873691 rc 0/0 00000100:00100000:1.0:1746066799.596305:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15013 00000100:00100000:2.0:1746066799.596353:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3296:x1830882976922368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (154us total) trans 17179873692 rc 0/0 00000100:00100000:2.0:1746066799.596358:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15014 00000100:00100000:0.0:1746066799.598458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.598477:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed70000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976921216:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066799.598532:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000004:00080000:0.0:1746066799.598577:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e841c00/2, rc 0, transno 21474841003 00000100:00100000:0.0:1746066799.598583:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976921088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066799.598592:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e842680/2, rc 0, transno 21474841001 00000100:00100000:0.0:1746066799.598595:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976920960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066799.598610:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976921472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.598627:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977126400 00000100:00100000:1.0:1746066799.598632:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977126400 00000100:00100000:1.0:1746066799.598660:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4227 00000100:00100000:1.0:1746066799.598666:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31832:x1830882977126400:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:3.0:1746066799.598707:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066799.598733:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976922240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066799.598751:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066799.598754:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31832:x1830882977126400:12345-192.168.202.57@tcp:49:cat.0 Request processed in 88us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.598760:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4227 00000004:00080000:3.0:1746066799.598769:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8696680/2, rc 0, transno 17179873691 00000100:00100000:3.0:1746066799.598776:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976921856:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066799.598783:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8696d80/2, rc 0, transno 17179873692 00000100:00100000:3.0:1746066799.598786:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976922368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066799.598799:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976921728 00000100:00100000:3.0:1746066799.598802:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976921728 00000100:00100000:3.0:1746066799.598818:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976922240 00000100:00100000:3.0:1746066799.598820:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976922240 00000100:00100000:3.0:1746066799.598831:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15015 00000100:00100000:3.0:1746066799.598836:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3296:x1830882976921728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066799.598964:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:3.0:1746066799.598968:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.598970:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.598971:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.598973:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5921 -> 5921 00000100:00100000:3.0:1746066799.598996:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3296:x1830882976921728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (2772us total) trans 17179873693 rc 0/0 00000100:00100000:3.0:1746066799.599001:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15015 00000100:00100000:3.0:1746066799.599012:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15016 00000100:00100000:3.0:1746066799.599016:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3296:x1830882976922240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066799.599073:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746066799.599075:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746066799.599076:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066799.599078:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746066799.599080:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746066799.599096:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3296:x1830882976922240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (345us total) trans 17179873694 rc 0/0 00000100:00100000:3.0:1746066799.599100:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15016 00002000:00010000:3.0:1746066799.599189:0:8452:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066799.599192:0:8452:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.599193:0:8452:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.599195:0:8452:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.599196:0:8452:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746066799.599218:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3295:x1830882976920448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3289us (3885us total) trans 21474841006 rc 0/0 00000100:00100000:3.0:1746066799.599223:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15006 00000004:00080000:3.0:1746066799.599245:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e843100/2, rc 0, transno 21474841006 00000100:00100000:3.0:1746066799.599248:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976920448:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066799.599259:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed73800/2, rc 0, transno 17179873693 00000100:00100000:3.0:1746066799.599262:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976921728:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066799.599267:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8694e00/2, rc 0, transno 17179873694 00000100:00100000:3.0:1746066799.599269:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976922240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066799.599281:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976921600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066799.599299:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066799.599311:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976922112:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066799.599314:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977126528 00000100:00100000:2.0:1746066799.599318:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977126528 00000100:00100000:3.0:1746066799.599321:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746066799.599334:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e841500/2, rc 0, transno 21474841004 00000100:00100000:3.0:1746066799.599338:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976920320:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066799.599338:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10095 00000100:00100000:2.0:1746066799.599343:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31835:x1830882977126528:12345-192.168.202.57@tcp:101:multiop.0 00000004:00080000:3.0:1746066799.599344:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e840700/2, rc 0, transno 21474841005 00000100:00100000:3.0:1746066799.599347:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976920832:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066799.599351:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066799.599357:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976921600 00000100:00100000:3.0:1746066799.599360:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976921600 00010000:00010000:2.0:1746066799.599363:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318a00/0xfb36a14ee608c969 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f11d expref: -99 pid: 809 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.599371:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976922112 00000100:00100000:3.0:1746066799.599373:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976922112 00000100:00100000:3.0:1746066799.599382:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15017 00000100:00100000:3.0:1746066799.599385:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3294:x1830882976921600:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746066799.599393:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318a00/0xfb36a14ee608c969 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f11d expref: 253 pid: 809 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.599397:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15018 00000100:00100000:1.0:1746066799.599403:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3294:x1830882976922112:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746066799.599407:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318a00/0xfb36a14ee608c969 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f11d expref: 253 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.599418:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066799.599421:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066799.599424:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f318a00, rc 0) 00000100:00100000:2.0:1746066799.599438:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31835:x1830882977126528:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 95us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.599443:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10095 00002000:00010000:3.0:1746066799.599454:0:8452:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066799.599457:0:8452:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.599459:0:8452:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.599460:0:8452:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:3.0:1746066799.599462:0:8452:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746066799.599722:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066799.599738:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976921984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.599753:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066799.599784:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e840e00/2, rc 0, transno 21474840999 00000100:00100000:0.0:1746066799.599788:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976920192:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066799.599795:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e840380/2, rc 0, transno 21474841000 00000100:00100000:2.0:1746066799.599796:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976921472 00000100:00100000:0.0:1746066799.599798:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976920704:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066799.599800:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976921472 00000100:00100000:0.0:1746066799.599804:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976922496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066799.599815:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976921984 00000100:00100000:2.0:1746066799.599817:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976921984 00000100:00100000:0.0:1746066799.599820:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066799.599823:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976922496 00000100:00100000:2.0:1746066799.599825:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976922496 00000100:00100000:2.0:1746066799.599833:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15019 00000100:00100000:2.0:1746066799.599837:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3293:x1830882976921472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.599838:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15020 00000100:00100000:0.0:1746066799.599844:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3293:x1830882976921984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066799.599916:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746066799.599919:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066798 -> 1746066798 00002000:00010000:2.0:1746066799.599921:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066798 -> 1746066798 00002000:00010000:2.0:1746066799.599922:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066798 -> 1746066798 00002000:00010000:2.0:1746066799.599924:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2017 -> 2017 00000100:00100000:2.0:1746066799.599944:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3293:x1830882976921472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (223us total) trans 17179873697 rc 0/0 00000100:00100000:2.0:1746066799.599949:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15019 00000100:00100000:2.0:1746066799.599958:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15021 00000100:00100000:2.0:1746066799.599961:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3293:x1830882976922496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066799.599996:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3293:x1830882976921984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 152us (240us total) trans 17179873698 rc 0/0 00000100:00100000:0.0:1746066799.600001:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15020 00000100:00100000:2.0:1746066799.600031:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3293:x1830882976922496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (210us total) trans 17179873699 rc 0/0 00000100:00100000:2.0:1746066799.600035:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15021 00000004:00080000:2.0:1746066799.600055:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8696a00/2, rc 0, transno 17179873699 00000100:00100000:2.0:1746066799.600058:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976922496:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066799.600064:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed71880/2, rc 0, transno 17179873697 00000100:00100000:2.0:1746066799.600066:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976921472:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066799.600072:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8694700/2, rc 0, transno 17179873698 00000100:00100000:2.0:1746066799.600074:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976921984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066799.600466:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3294:x1830882976922112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1062us (1142us total) trans 17179873696 rc 0/0 00000100:00100000:1.0:1746066799.600472:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15018 00000100:00100000:1.0:1746066799.600534:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3295:x1830882976920576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4513us (5150us total) trans 21474841002 rc 0/0 00000100:00100000:1.0:1746066799.600539:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15009 00000004:00080000:1.0:1746066799.600575:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e842300/2, rc 0, transno 21474841002 00000100:00100000:1.0:1746066799.600579:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976920576:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066799.600585:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3294:x1830882976921600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (184us total) trans 17179873695 rc 0/0 00000100:00100000:3.0:1746066799.600593:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15017 00000004:00080000:3.0:1746066799.600621:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ed71f80/2, rc 0, transno 17179873695 00000100:00100000:3.0:1746066799.600624:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976921600:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066799.600630:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8697480/2, rc 0, transno 17179873696 00000100:00100000:3.0:1746066799.600632:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976922112:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066799.601620:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976921344:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066799.601650:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318200/0xfb36a14ee608c93f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0fa expref: 10 pid: 14549 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746066799.601663:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0fa expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.601700:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f318000, rc 0) 00000100:00100000:2.0:1746066799.601725:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+9:31834:x1830882977125504:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 63689us (64954us total) trans 8589944166 rc 0/0 00000100:00100000:2.0:1746066799.601730:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10092 00000100:00100000:0.0:1746066799.602594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.602740:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977126656 00000100:00100000:1.0:1746066799.602746:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977126656 00000100:00100000:1.0:1746066799.602781:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4228 00000100:00100000:1.0:1746066799.602788:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:31836:x1830882977126656:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:1.0:1746066799.602851:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+9:31836:x1830882977126656:12345-192.168.202.57@tcp:49:cat.0 Request processed in 63us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.602859:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4228 00000100:00100000:0.0:1746066799.609432:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.609646:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977126784 00000100:00100000:2.0:1746066799.609653:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977126784 00000100:00100000:2.0:1746066799.609731:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 720 00000100:00100000:2.0:1746066799.609738:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:1964:x1830882977126784:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.609750:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.609767:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318a00/0xfb36a14ee608c969 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f11d expref: 253 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.609781:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066799.609784:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066799.609826:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:1964:x1830882977126784:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 88us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.609831:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 720 00000100:00100000:2.0:1746066799.614214:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.614255:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977126912 00000100:00100000:3.0:1746066799.614262:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977126912 00000100:00100000:3.0:1746066799.614296:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15022 00000100:00100000:3.0:1746066799.614302:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:31835:x1830882977126912:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066799.614315:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.614329:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f124 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.614356:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c82e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f075 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.614364:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9200/0xfb36a14ee608c92a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0e5 expref: 12 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.614370:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8800/0xfb36a14ee608c923 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0de expref: 19 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.614610:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.614612:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.614616:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1478656->2097151] (req 1478656->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.614643:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8800/0xfb36a14ee608c923 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0de expref: 19 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.614653:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8800/0xfb36a14ee608c923 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0de expref: 19 pid: 20532 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.614663:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976922624:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.617090:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9200/0xfb36a14ee608c92a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0e5 expref: 12 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.617105:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9200/0xfb36a14ee608c92a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0e5 expref: 12 pid: 20532 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.617120:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976922752:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.618813:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c82e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f075 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.618824:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c82e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f075 expref: 10 pid: 8451 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746066799.618835:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976922880:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066799.618896:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.619419:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.619470:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977127040 00000100:00100000:2.0:1746066799.619476:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977127040 00000100:00100000:3.0:1746066799.619484:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976922752:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.619500:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9200/0xfb36a14ee608c92a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0e5 expref: 13 pid: 20532 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.619530:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7728 00000100:00100000:2.0:1746066799.619536:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1966:x1830882977127040:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.619562:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.619581:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9200/0xfb36a14ee608c92a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0e5 expref: 13 pid: 20532 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.619588:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9200/0xfb36a14ee608c92a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0e5 expref: 13 pid: 20532 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.619605:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9200/0xfb36a14ee608c92a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0e5 expref: 13 pid: 20532 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.619621:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066799.619659:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:1966:x1830882977127040:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 123us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.619665:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7728 00000100:00100000:2.0:1746066799.623134:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.623158:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.623180:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.623191:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.623203:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.623215:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.623235:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.623252:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977127168 00000100:00100000:2.0:1746066799.623257:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977127168 00010000:00010000:2.0:1746066799.623281:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8800/0xfb36a14ee608c923 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0de expref: 20 pid: 20532 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.623300:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977127424 00000100:00100000:2.0:1746066799.623302:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977127424 00010000:00010000:2.0:1746066799.623310:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c82e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f075 expref: 11 pid: 8451 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746066799.623321:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7729 00000100:00100000:2.0:1746066799.623327:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977127168:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.623337:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.623352:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8800/0xfb36a14ee608c923 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0de expref: 20 pid: 20532 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.623366:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8800/0xfb36a14ee608c923 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0de expref: 20 pid: 20532 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.623384:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066799.623418:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977127168:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 91us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.623423:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7729 00000100:00100000:2.0:1746066799.623436:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7730 00000100:00100000:2.0:1746066799.623441:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977127424:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.623447:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.623454:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c82e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f075 expref: 11 pid: 8451 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.623461:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c82e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f075 expref: 11 pid: 8451 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.623472:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.623474:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.623480:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.623487:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.623510:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066799.623521:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976923008:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066799.623575:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066799.623636:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977128064 00000100:00100000:1.0:1746066799.623640:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977128064 00002000:00100000:1.0:1746066799.623666:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a8695180 x1830882977128064/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.623692:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695180 with x1830882977128064 ext(3145728->4194303) 00002000:00010000:1.0:1746066799.623696:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8695180 00000100:00100000:1.0:1746066799.623706:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977128448 00000100:00100000:1.0:1746066799.623707:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977128448 00002000:00100000:1.0:1746066799.623718:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009b473b80 x1830882977128448/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.623724:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b473b80 with x1830882977128448 ext(3145728->4194303) 00002000:00010000:1.0:1746066799.623727:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b473b80 00000100:00100000:1.0:1746066799.623732:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977128320 00000100:00100000:1.0:1746066799.623734:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977128320 00002000:00100000:1.0:1746066799.623741:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009b470700 x1830882977128320/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.623746:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470700 with x1830882977128320 ext(2097152->3145727) 00002000:00010000:1.0:1746066799.623747:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b470700 00000100:00100000:1.0:1746066799.623754:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6818 00000100:00100000:1.0:1746066799.623759:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977128064:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066799.624849:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6819 00000100:00100000:1.0:1746066799.624856:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977128448:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066799.625913:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6820 00000100:00100000:3.0:1746066799.625921:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977128320:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066799.626854:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977127296 00000100:00100000:0.0:1746066799.627034:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977127552 00000100:00100000:0.0:1746066799.627040:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977127552 00000100:00100000:0.0:1746066799.627070:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15023 00000100:00100000:0.0:1746066799.627075:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:31836:x1830882977127552:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066799.627085:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.627098:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130edc400/0xfb36a14ee608c977 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f132 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.627115:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.627116:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.627122:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130edc400/0xfb36a14ee608c977 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f132 expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.627134:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130edc400/0xfb36a14ee608c977 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f132 expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.627147:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130edc400, rc 0) 00000100:00100000:0.0:1746066799.627166:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:31836:x1830882977127552:12345-192.168.202.57@tcp:101:cat.0 Request processed in 92us (3975us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.627171:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15023 00000100:00100000:3.0:1746066799.628935:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977127296 00000100:00100000:3.0:1746066799.628967:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15024 00000100:00100000:3.0:1746066799.628972:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:31834:x1830882977127296:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066799.628983:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.628993:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f12b expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.629010:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ed4c00/0xfb36a14ee608c835 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f083 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.629021:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130edc400/0xfb36a14ee608c977 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f132 expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.629026:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130edcc00/0xfb36a14ee608c94d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f101 expref: 31 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.629031:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.629032:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.629035:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.629056:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130edcc00/0xfb36a14ee608c94d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f101 expref: 31 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.629070:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130edcc00/0xfb36a14ee608c94d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f101 expref: 31 pid: 20532 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746066799.629080:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976923136:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.629151:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130edc400/0xfb36a14ee608c977 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f132 expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.629158:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130edc400/0xfb36a14ee608c977 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f132 expref: 20 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.629164:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976923264:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.629182:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ed4c00/0xfb36a14ee608c835 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f083 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.629189:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ed4c00/0xfb36a14ee608c835 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f083 expref: 10 pid: 8451 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746066799.629195:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976923392:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066799.629205:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00010000:00010000:3.0:1746066799.629230:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8800/0xfb36a14ee608c923 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0de expref: 21 pid: 20532 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.629244:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976922624:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.629253:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ed4400/0xfb36a14ee608c82e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f075 expref: 11 pid: 8451 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746066799.629259:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976922880:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.629278:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.629285:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0a5000, rc 0) 00000100:00100000:3.0:1746066799.629298:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:31835:x1830882977126912:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 14997us (15091us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.629304:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15022 00000100:00100000:2.0:1746066799.631291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.631404:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977127936 00000100:00100000:0.0:1746066799.631410:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977127936 00002000:00100000:0.0:1746066799.631443:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009e842d80 x1830882977127936/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066799.631452:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e842d80 with x1830882977127936 ext(2097152->3145727) 00002000:00010000:0.0:1746066799.631456:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e842d80 00000100:00100000:0.0:1746066799.631473:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6821 00000100:00100000:0.0:1746066799.631480:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977127936:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066799.643512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.643536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.643661:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976923008:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066799.643690:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066799.643722:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977127424:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 20280us (20540us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.643731:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7730 00000100:00100000:2.0:1746066799.643753:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977128704 00000100:00100000:2.0:1746066799.643757:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977128704 00010000:00010000:2.0:1746066799.643776:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed4c00/0xfb36a14ee608c835 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f083 expref: 11 pid: 8451 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746066799.643793:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7731 00000100:00100000:2.0:1746066799.643798:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977128704:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.643806:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.643820:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ed4c00/0xfb36a14ee608c835 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f083 expref: 11 pid: 8451 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.643829:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ed4c00/0xfb36a14ee608c835 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f083 expref: 11 pid: 8451 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.643848:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066799.643860:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977128704:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 62us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.643865:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7731 00000100:00100000:3.0:1746066799.643939:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976923136:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066799.643950:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976923264:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.643957:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ed4c00/0xfb36a14ee608c835 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f083 expref: 10 pid: 8451 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746066799.643972:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976923392:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.643997:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.644007:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099747200, rc 0) 00000100:00100000:2.0:1746066799.644012:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977128960 00000100:00100000:2.0:1746066799.644015:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977128960 00000100:00100000:3.0:1746066799.644029:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:31834:x1830882977127296:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 15057us (20870us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.644035:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15024 00002000:00100000:2.0:1746066799.644035:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38e:0x0] (1478656->1482751) req@ffff88009f16fb80 x1830882977128960/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.644042:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16fb80 with x1830882977128960 ext(1478656->1482751) 00002000:00010000:2.0:1746066799.644045:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16fb80 00000100:00100000:2.0:1746066799.644056:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6822 00000100:00100000:2.0:1746066799.644060:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1966:x1830882977128960:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066799.644525:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1966:x1830882977128960:12345-192.168.202.57@tcp:3:cat.0 Request processed in 463us (987us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066799.644531:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6822 00002000:00100000:2.0:1746066799.644535:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38e:0x0] (1478656->1482751) req@ffff88009f16fb80 x1830882977128960/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/4536 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.644551:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16fb80 with x1830882977128960 ext(1478656->1482751) 00002000:00010000:2.0:1746066799.644554:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16fb80 00000100:00100000:1.0:1746066799.644582:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977128064:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20822us (21376us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066799.644589:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6818 00002000:00100000:1.0:1746066799.644594:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a8695180 x1830882977128064/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.644601:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695180 with x1830882977128064 ext(3145728->4194303) 00002000:00010000:1.0:1746066799.644604:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8695180 00000100:00100000:0.0:1746066799.645182:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.645438:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977129216 00000100:00100000:1.0:1746066799.645442:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977129216 00002000:00100000:1.0:1746066799.645460:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009f16df80 x1830882977129216/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.645466:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16df80 with x1830882977129216 ext(2097152->3145727) 00010000:00010000:1.0:1746066799.645472:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130edc400/0xfb36a14ee608c977 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f132 expref: 20 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.645480:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130edc400/0xfb36a14ee608c977 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f132 expref: 20 pid: 4614 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746066799.645485:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f16df80 00000100:00100000:1.0:1746066799.645511:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2208 00000100:00100000:1.0:1746066799.645516:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977129216:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066799.645519:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977128320:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19600us (22282us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066799.645524:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6820 00002000:00100000:3.0:1746066799.645528:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009b470700 x1830882977128320/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066799.645533:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b470700 with x1830882977128320 ext(2097152->3145727) 00010000:00010000:3.0:1746066799.645538:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130edcc00/0xfb36a14ee608c94d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f101 expref: 30 pid: 20532 timeout: 860 lvb_type: 1 00010000:00010000:3.0:1746066799.645558:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130edcc00/0xfb36a14ee608c94d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f101 expref: 30 pid: 20532 timeout: 860 lvb_type: 1 00002000:00010000:3.0:1746066799.645563:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b470700 00000100:00100000:0.0:1746066799.645664:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977128448:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20809us (22447us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066799.645670:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6819 00002000:00100000:0.0:1746066799.645691:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009b473b80 x1830882977128448/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066799.645697:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b473b80 with x1830882977128448 ext(3145728->4194303) 00010000:00010000:0.0:1746066799.645701:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130edcc00/0xfb36a14ee608c94d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f101 expref: 28 pid: 20532 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746066799.645713:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130edcc00/0xfb36a14ee608c94d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f101 expref: 28 pid: 20532 timeout: 860 lvb_type: 1 00002000:00010000:0.0:1746066799.645717:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b473b80 00000100:00100000:2.0:1746066799.648027:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1964:x1830882977127936:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16538us (16734us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066799.648039:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6821 00002000:00100000:2.0:1746066799.648049:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009e842d80 x1830882977127936/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.648058:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e842d80 with x1830882977127936 ext(2097152->3145727) 00002000:00010000:2.0:1746066799.648063:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e842d80 00000100:00100000:1.0:1746066799.654348:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977129216:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8823us (9158us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066799.654358:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2208 00002000:00100000:1.0:1746066799.654368:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009f16df80 x1830882977129216/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.654383:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16df80 with x1830882977129216 ext(2097152->3145727) 00010000:00010000:1.0:1746066799.654391:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130edc400/0xfb36a14ee608c977 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f132 expref: 20 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746066799.654402:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130edc400/0xfb36a14ee608c977 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f132 expref: 20 pid: 4614 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746066799.654407:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f16df80 00000100:00100000:2.0:1746066799.654662:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.655060:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977129344 00000100:00100000:3.0:1746066799.655068:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977129344 00000100:00100000:3.0:1746066799.655107:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15025 00000100:00100000:3.0:1746066799.655113:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31832:x1830882977129344:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066799.655125:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.655137:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5a80c00/0xfb36a14ee608c985 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f139 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.655154:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.655156:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.655271:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a80c00/0xfb36a14ee608c985 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f139 expref: 29 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.655288:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a80c00/0xfb36a14ee608c985 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f139 expref: 29 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.655297:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a80c00, rc 0) 00000100:00100000:3.0:1746066799.655336:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:31832:x1830882977129344:12345-192.168.202.57@tcp:101:cat.0 Request processed in 223us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.655341:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15025 00000100:00100000:0.0:1746066799.657398:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.657482:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977129600 00000100:00100000:2.0:1746066799.657489:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977129600 00000100:00100000:2.0:1746066799.657559:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15026 00000100:00100000:2.0:1746066799.657566:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:31835:x1830882977129600:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066799.657578:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.657589:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f140 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.657608:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608c820 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f07c expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.657615:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b47e00/0xfb36a14ee608c938 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0f3 expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.657621:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9c00/0xfb36a14ee608c931 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ec expref: 30 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.657625:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.657627:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.657630:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1048576->1343487] (req 1048576->1343487) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 30 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.657653:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9c00/0xfb36a14ee608c931 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ec expref: 30 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.657661:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9c00/0xfb36a14ee608c931 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ec expref: 30 pid: 8452 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.657703:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976923520:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.657771:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b47e00/0xfb36a14ee608c938 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0f3 expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.657779:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b47e00/0xfb36a14ee608c938 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0f3 expref: 19 pid: 8452 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.657785:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976923648:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.657805:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608c820 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f07c expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.657812:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608c820 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f07c expref: 9 pid: 8451 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746066799.657820:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976923776:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.657834:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066799.659478:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976923520:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.659488:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976923648:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.659494:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976923776:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.659514:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [1048576->1343487] (req 1048576->1343487) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 30 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.659530:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f319400, rc 0) 00000100:00100000:2.0:1746066799.659947:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:31835:x1830882977129600:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2012us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.659956:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15026 00000100:00100000:0.0:1746066799.660135:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.660445:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.660476:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.660497:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.660501:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977129728 00000100:00100000:3.0:1746066799.660507:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977129728 00010000:00010000:3.0:1746066799.660529:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9c00/0xfb36a14ee608c931 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ec expref: 30 pid: 8452 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.660556:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977129984 00000100:00100000:3.0:1746066799.660558:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977129984 00010000:00010000:3.0:1746066799.660567:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608c820 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f07c expref: 10 pid: 8451 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746066799.660757:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977129472 00000100:00100000:3.0:1746066799.660758:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977129856 00000100:00100000:3.0:1746066799.660760:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977129856 00000100:00100000:2.0:1746066799.660760:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977129472 00010000:00010000:3.0:1746066799.660771:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b47e00/0xfb36a14ee608c938 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0f3 expref: 20 pid: 8452 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.660771:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130edcc00/0xfb36a14ee608c94d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f101 expref: 31 pid: 20532 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746066799.660781:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7732 00000100:00100000:3.0:1746066799.660786:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882977129728:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066799.660796:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066799.660813:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9c00/0xfb36a14ee608c931 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ec expref: 31 pid: 8452 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.660822:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9c00/0xfb36a14ee608c931 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ec expref: 31 pid: 8452 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.660840:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9c00/0xfb36a14ee608c931 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ec expref: 31 pid: 8452 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.660854:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066799.660875:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977129728:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 88us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.660984:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7733 00000100:00100000:2.0:1746066799.660991:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977129984:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.660998:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.661006:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608c820 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f07c expref: 10 pid: 8451 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.661014:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608c820 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f07c expref: 10 pid: 8451 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.661025:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608c820 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f07c expref: 10 pid: 8451 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.661037:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066799.661050:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977129984:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 61us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.661055:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7733 00000100:00100000:3.0:1746066799.661202:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7732 00000100:00100000:2.0:1746066799.661210:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7734 00000100:00100000:3.0:1746066799.661213:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7735 00000100:00100000:2.0:1746066799.661215:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977129472:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066799.661217:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977129856:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066799.661221:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.661221:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066799.661228:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b47e00/0xfb36a14ee608c938 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0f3 expref: 20 pid: 8452 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.661229:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130edcc00/0xfb36a14ee608c94d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f101 expref: 29 pid: 20532 timeout: 860 lvb_type: 1 00010000:00010000:3.0:1746066799.661236:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b47e00/0xfb36a14ee608c938 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0f3 expref: 20 pid: 8452 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.661236:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130edcc00/0xfb36a14ee608c94d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f101 expref: 29 pid: 20532 timeout: 860 lvb_type: 1 00010000:00010000:3.0:1746066799.661246:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b47e00/0xfb36a14ee608c938 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0f3 expref: 20 pid: 8452 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.661246:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130edcc00/0xfb36a14ee608c94d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f101 expref: 29 pid: 20532 timeout: 860 lvb_type: 1 00010000:00010000:3.0:1746066799.661254:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.661255:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066799.661256:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.661261:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 28 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066799.661267:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977129472:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 53us (792us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066799.661268:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 28 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066799.661272:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7734 00010000:00010000:3.0:1746066799.661290:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 27 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.661299:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976923904:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066799.661334:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.662169:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.662296:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977130240 00000100:00100000:1.0:1746066799.662300:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977130240 00002000:00100000:1.0:1746066799.662326:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009f16e680 x1830882977130240/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.662334:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16e680 with x1830882977130240 ext(3145728->4194303) 00002000:00010000:1.0:1746066799.662337:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16e680 00000100:00100000:1.0:1746066799.662362:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6823 00000100:00100000:1.0:1746066799.662367:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977130240:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066799.666827:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.667011:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977130368 00000100:00100000:0.0:1746066799.667019:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977130368 00000100:00100000:0.0:1746066799.667235:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15027 00000100:00100000:0.0:1746066799.667242:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:31836:x1830882977130368:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066799.667256:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.667269:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608c993 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f147 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.667287:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.667289:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066799.667295:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608c993 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f147 expref: 13 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.667306:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608c993 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f147 expref: 13 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.667318:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1e000, rc 0) 00000100:00100000:0.0:1746066799.667368:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:31836:x1830882977130368:12345-192.168.202.57@tcp:101:cat.0 Request processed in 127us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.667373:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15027 00000100:00100000:3.0:1746066799.668072:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976923904:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066799.668087:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066799.668124:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977129856:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6905us (7624us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.668131:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7735 00000100:00100000:0.0:1746066799.674276:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.674314:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.674405:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977130752 00000100:00100000:2.0:1746066799.674412:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977130752 00002000:00100000:2.0:1746066799.674448:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x390:0x0] (1339392->1343487) req@ffff88009f16dc00 x1830882977130752/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066799.674458:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977130496 00000100:00100000:3.0:1746066799.674462:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977130496 00010000:00010000:3.0:1746066799.674479:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130edc400/0xfb36a14ee608c977 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f132 expref: 19 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:3.0:1746066799.674502:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7736 00000100:00100000:3.0:1746066799.674507:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977130496:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066799.674517:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066799.674531:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130edc400/0xfb36a14ee608c977 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f132 expref: 19 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.674540:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130edc400/0xfb36a14ee608c977 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f132 expref: 19 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.674567:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130edc400/0xfb36a14ee608c977 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f132 expref: 19 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.674583:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.674584:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066799.674590:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.674597:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.674635:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.674649:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976924032:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066799.674718:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00002000:00100000:2.0:1746066799.674820:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16dc00 with x1830882977130752 ext(1339392->1343487) 00002000:00010000:2.0:1746066799.674824:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16dc00 00000100:00100000:2.0:1746066799.674849:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6824 00000100:00100000:2.0:1746066799.674855:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1966:x1830882977130752:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066799.674957:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1966:x1830882977130752:12345-192.168.202.57@tcp:3:cat.0 Request processed in 102us (641us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066799.674962:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6824 00002000:00100000:2.0:1746066799.674967:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x390:0x0] (1339392->1343487) req@ffff88009f16dc00 x1830882977130752/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/4536 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.674974:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16dc00 with x1830882977130752 ext(1339392->1343487) 00002000:00010000:2.0:1746066799.674976:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16dc00 00000100:00100000:1.0:1746066799.676131:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977130240:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13760us (13959us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066799.676138:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6823 00002000:00100000:1.0:1746066799.676145:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009f16e680 x1830882977130240/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.676152:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16e680 with x1830882977130240 ext(3145728->4194303) 00002000:00010000:1.0:1746066799.676156:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16e680 00000100:00100000:0.0:1746066799.676372:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.676429:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977131008 00000100:00100000:1.0:1746066799.676434:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977131008 00002000:00100000:1.0:1746066799.676453:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009f16e300 x1830882977131008/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.676460:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16e300 with x1830882977131008 ext(2097152->3145727) 00002000:00010000:1.0:1746066799.676463:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16e300 00000100:00100000:1.0:1746066799.676484:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6825 00000100:00100000:1.0:1746066799.676490:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977131008:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066799.680415:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976924032:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066799.680432:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066799.680479:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977130496:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5969us (6208us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.680488:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7736 00000100:00100000:2.0:1746066799.685181:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.685255:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977131264 00000100:00100000:3.0:1746066799.685263:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977131264 00002000:00100000:3.0:1746066799.685297:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2981888->2985983) req@ffff88009bb2dc00 x1830882977131264/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066799.685306:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2dc00 with x1830882977131264 ext(2981888->2985983) 00002000:00010000:3.0:1746066799.685311:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2dc00 00000100:00100000:3.0:1746066799.685324:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6826 00000100:00100000:3.0:1746066799.685329:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977131264:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066799.685459:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977131264:12345-192.168.202.57@tcp:3:cat.0 Request processed in 129us (285us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066799.685464:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6826 00002000:00100000:3.0:1746066799.685469:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (2981888->2985983) req@ffff88009bb2dc00 x1830882977131264/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/4536 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066799.685476:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2dc00 with x1830882977131264 ext(2981888->2985983) 00002000:00010000:3.0:1746066799.685478:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2dc00 00000100:00100000:0.0:1746066799.690514:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.691192:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977131392 00000100:00100000:2.0:1746066799.691199:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977131392 00000100:00100000:1.0:1746066799.691757:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977131008:12345-192.168.202.57@tcp:3:cat.0 Request processed in 15263us (15381us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066799.691767:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6825 00002000:00100000:1.0:1746066799.691777:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009f16e300 x1830882977131008/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066799.691786:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16e300 with x1830882977131008 ext(2097152->3145727) 00002000:00010000:1.0:1746066799.691790:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f16e300 00000100:00100000:2.0:1746066799.691917:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15028 00000100:00100000:2.0:1746066799.691925:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977131392:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066799.691938:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.691952:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c99a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f14e expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.691974:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c99a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f14e expref: 29 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.691983:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608c99a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f14e expref: 29 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.692005:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b1e00, rc 0) 00000100:00100000:2.0:1746066799.692028:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977131392:12345-192.168.202.57@tcp:101:cat.0 Request processed in 105us (1521us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066799.692033:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15028 00000100:00100000:0.0:1746066799.697411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.697447:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.697483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.697568:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977131776 00000100:00100000:2.0:1746066799.697575:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977131776 00000100:00100000:2.0:1746066799.697606:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977131904 00000100:00100000:2.0:1746066799.697608:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977131904 00000100:00100000:2.0:1746066799.697631:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15029 00000100:00100000:2.0:1746066799.697637:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:31834:x1830882977131776:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066799.697652:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.697668:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f155 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.697711:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ed5a00/0xfb36a14ee608c827 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f08a expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.697719:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608c993 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f147 expref: 14 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.697725:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608c954 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f108 expref: 17 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.697731:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.697733:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066799.697735:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->2740223] (req 2097152->2740223) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 14 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.697760:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608c954 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f108 expref: 17 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.697770:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608c954 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f108 expref: 17 pid: 20532 timeout: 860 lvb_type: 1 00000100:00100000:2.0:1746066799.697783:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976924160:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.697849:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608c993 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f147 expref: 14 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.697855:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608c993 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f147 expref: 14 pid: 4614 timeout: 860 lvb_type: 0 00000100:00100000:2.0:1746066799.697861:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976924288:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.697884:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ed5a00/0xfb36a14ee608c827 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f08a expref: 9 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.697891:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ed5a00/0xfb36a14ee608c827 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f08a expref: 9 pid: 8451 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746066799.697893:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15030 00000100:00100000:2.0:1746066799.697898:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976924416:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066799.697900:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+18:31836:x1830882977131904:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066799.697908:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066799.697909:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c180 going to sleep for 11 seconds 00010000:00010000:1.0:1746066799.697918:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135ec2c00/0xfb36a14ee608c9a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f15c expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066799.697924:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977131648 00000100:00100000:2.0:1746066799.697926:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977131648 00010000:00010000:1.0:1746066799.697929:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066799.697930:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066799.697935:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135ec2c00/0xfb36a14ee608c9a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f15c expref: 19 pid: 21973 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746066799.697947:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a590ea00 x1830882977131648/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746066799.697951:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135ec2c00/0xfb36a14ee608c9a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f15c expref: 19 pid: 21973 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746066799.697955:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590ea00 with x1830882977131648 ext(4194304->5091327) 00010000:00010000:1.0:1746066799.697958:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ec2c00, rc 0) 00002000:00010000:2.0:1746066799.697959:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590ea00 00000100:00100000:2.0:1746066799.697975:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6827 00000100:00100000:1.0:1746066799.697980:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+19:31836:x1830882977131904:12345-192.168.202.57@tcp:101:cat.0 Request processed in 80us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.697981:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977131648:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066799.697985:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15030 00000100:00100000:0.0:1746066799.705012:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.705120:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976924160:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.705130:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976924288:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066799.705436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.705510:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977132032 00000100:00100000:2.0:1746066799.705515:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977132160 00000100:00100000:3.0:1746066799.705516:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977132032 00000100:00100000:2.0:1746066799.705519:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977132160 00010000:00010000:3.0:1746066799.705550:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608c993 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f147 expref: 15 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:2.0:1746066799.705552:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608c954 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f108 expref: 18 pid: 20532 timeout: 860 lvb_type: 1 00000100:00100000:3.0:1746066799.705573:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7737 00000100:00100000:3.0:1746066799.705578:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977132032:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066799.705590:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066799.705606:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608c993 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f147 expref: 15 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.705613:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608c993 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f147 expref: 15 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.706121:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608c993 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f147 expref: 15 pid: 4614 timeout: 860 lvb_type: 0 00010000:00010000:3.0:1746066799.706137:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066799.706421:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7738 00000100:00100000:2.0:1746066799.706428:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1965:x1830882977132160:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066799.706436:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066799.706445:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608c954 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f108 expref: 18 pid: 20532 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.706455:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608c954 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f108 expref: 18 pid: 20532 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.706466:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608c954 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f108 expref: 18 pid: 20532 timeout: 860 lvb_type: 1 00010000:00010000:2.0:1746066799.706479:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066799.706483:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977132032:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 904us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.706489:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7737 00000100:00100000:2.0:1746066799.706494:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1965:x1830882977132160:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 67us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.706499:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7738 00000100:00100000:2.0:1746066799.706520:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976924416:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.706539:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->2740223] (req 2097152->2740223) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 13 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.706560:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b0000, rc 0) 00000100:00100000:2.0:1746066799.706576:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:31834:x1830882977131776:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 8940us (9129us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.706581:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15029 00000100:00100000:2.0:1746066799.708284:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977131648:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10297us (10875us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066799.708293:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6827 00002000:00100000:2.0:1746066799.708303:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a590ea00 x1830882977131648/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.708311:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590ea00 with x1830882977131648 ext(4194304->5091327) 00002000:00010000:2.0:1746066799.708315:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590ea00 00000100:00100000:0.0:1746066799.708841:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.708882:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977132288 00000100:00100000:1.0:1746066799.708889:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977132288 00010000:00010000:1.0:1746066799.708909:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed5a00/0xfb36a14ee608c827 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f08a expref: 10 pid: 8451 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746066799.708941:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7739 00000100:00100000:1.0:1746066799.708947:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977132288:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.708958:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.708973:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093ed5a00/0xfb36a14ee608c827 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f08a expref: 10 pid: 8451 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746066799.708983:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093ed5a00/0xfb36a14ee608c827 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f08a expref: 10 pid: 8451 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746066799.709000:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ed5a00/0xfb36a14ee608c827 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f08a expref: 10 pid: 8451 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746066799.709013:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066799.709015:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066799.709021:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2740223) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 12 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.709028:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2740223) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 12 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.709053:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2740223) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 12 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.709064:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976924544:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066799.709109:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52decc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066799.711212:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976924544:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066799.711231:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.711273:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977132288:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2324us (2431us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.711283:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7739 00000100:00100000:0.0:1746066799.715872:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.715955:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977132800 00000100:00100000:2.0:1746066799.715962:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977132800 00002000:00100000:2.0:1746066799.715997:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2736128->2740223) req@ffff8800a590e680 x1830882977132800/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.716006:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590e680 with x1830882977132800 ext(2736128->2740223) 00002000:00010000:2.0:1746066799.716010:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590e680 00000100:00100000:2.0:1746066799.716025:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6828 00000100:00100000:2.0:1746066799.716031:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977132800:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066799.717116:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977132800:12345-192.168.202.57@tcp:3:cat.0 Request processed in 1083us (1248us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066799.717126:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6828 00002000:00100000:2.0:1746066799.717132:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2736128->2740223) req@ffff8800a590e680 x1830882977132800/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/4536 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.717139:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590e680 with x1830882977132800 ext(2736128->2740223) 00002000:00010000:2.0:1746066799.717141:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590e680 00000100:00100000:0.0:1746066799.719400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.721313:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.722401:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977132544 00000100:00100000:2.0:1746066799.722410:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977132544 00000100:00100000:2.0:1746066799.722468:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15031 00000100:00100000:2.0:1746066799.722476:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1965:x1830882977132544:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066799.722490:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.722504:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0800/0xfb36a14ee608c9af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f16a expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066799.722563:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976924672:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066799.722641:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.722799:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.722822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.722835:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977133184 00000100:00100000:0.0:1746066799.722837:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977133184 00002000:00100000:0.0:1746066799.722856:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a590ce00 x1830882977133184/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066799.722864:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590ce00 with x1830882977133184 ext(3145728->4194303) 00002000:00010000:0.0:1746066799.722868:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590ce00 00000100:00100000:1.0:1746066799.722915:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977132416 00000100:00100000:1.0:1746066799.722918:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977132416 00000100:00100000:0.0:1746066799.723009:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977133312 00000100:00100000:0.0:1746066799.723011:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977133312 00002000:00100000:0.0:1746066799.723020:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a590d880 x1830882977133312/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066799.723026:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590d880 with x1830882977133312 ext(3145728->4194303) 00002000:00010000:0.0:1746066799.723029:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590d880 00000100:00100000:0.0:1746066799.723041:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6829 00000100:00100000:0.0:1746066799.723046:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977133184:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066799.724083:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6830 00000100:00100000:2.0:1746066799.724090:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977133312:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066799.725672:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15032 00000100:00100000:1.0:1746066799.725690:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882977132416:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066799.725702:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066799.725716:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50a6600/0xfb36a14ee608c9b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f163 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.725738:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50a6600/0xfb36a14ee608c9b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f163 expref: 29 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066799.725750:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50a6600/0xfb36a14ee608c9b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f163 expref: 29 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066799.725765:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50a6600, rc 0) 00000100:00100000:1.0:1746066799.728638:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882977132416:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2943us (7322us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066799.728649:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15032 00002000:00010000:2.0:1746066799.731146:0:4614:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime: 1746066798 -> 1746066799 00002000:00010000:2.0:1746066799.731152:0:4614:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime: 1746066798 -> 1746066799 00000100:00100000:2.0:1746066799.731168:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976924672:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066799.731195:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0800/0xfb36a14ee608c9af lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f16a expref: 18 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.731207:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0800/0xfb36a14ee608c9af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f16a expref: 18 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.731265:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b0800, rc 0) 00000100:00100000:2.0:1746066799.731303:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1965:x1830882977132544:12345-192.168.202.57@tcp:101:cat.0 Request processed in 8828us (11907us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066799.731310:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15031 00000100:00100000:0.0:1746066799.737142:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.737197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.738906:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977133184:12345-192.168.202.57@tcp:3:cat.0 Request processed in 15853us (16100us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066799.738916:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6829 00002000:00100000:2.0:1746066799.738926:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a590ce00 x1830882977133184/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.738934:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590ce00 with x1830882977133184 ext(3145728->4194303) 00002000:00010000:2.0:1746066799.738939:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590ce00 00000100:00100000:1.0:1746066799.739024:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977133440 00000100:00100000:1.0:1746066799.739031:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977133440 00000100:00100000:1.0:1746066799.739058:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977133568 00000100:00100000:1.0:1746066799.739061:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977133568 00000100:00100000:1.0:1746066799.739082:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15033 00000100:00100000:1.0:1746066799.739088:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882977133440:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066799.739100:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066799.739114:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a50a7a00/0xfb36a14ee608c9bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f171 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.739138:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a50a7a00/0xfb36a14ee608c9bd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f171 expref: 29 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066799.739148:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50a7a00/0xfb36a14ee608c9bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f171 expref: 29 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066799.739161:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50a7a00, rc 0) 00000100:00100000:1.0:1746066799.739179:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882977133440:12345-192.168.202.57@tcp:101:cat.0 Request processed in 92us (2045us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066799.739185:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15033 00000100:00100000:1.0:1746066799.739196:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15034 00000100:00100000:1.0:1746066799.739203:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1966:x1830882977133568:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066799.739209:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066799.739218:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50a6600/0xfb36a14ee608c9c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f178 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.739248:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976924800:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066799.739290:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52decc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066799.742859:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977133312:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18760us (20025us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066799.742870:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6830 00002000:00100000:2.0:1746066799.742880:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a590d880 x1830882977133312/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.742889:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590d880 with x1830882977133312 ext(3145728->4194303) 00002000:00010000:2.0:1746066799.742894:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590d880 00000100:00100000:1.0:1746066799.743286:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976924800:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066799.743313:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50a6600/0xfb36a14ee608c9c4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f178 expref: 18 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066799.743324:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50a6600/0xfb36a14ee608c9c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f178 expref: 18 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066799.743336:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50a6600, rc 0) 00000100:00100000:1.0:1746066799.743354:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1966:x1830882977133568:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4153us (6158us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066799.743360:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15034 00000100:00100000:0.0:1746066799.750318:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.750354:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.750380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.750419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.750636:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977133696 00000100:00100000:1.0:1746066799.750644:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977133696 00000100:00100000:1.0:1746066799.750710:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977133952 00000100:00100000:1.0:1746066799.750713:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977133952 00000100:00100000:1.0:1746066799.750726:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977133824 00000100:00100000:1.0:1746066799.750729:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977133824 00000100:00100000:1.0:1746066799.750742:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15035 00000100:00100000:1.0:1746066799.750753:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977133696:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066799.750769:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066799.750786:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7c00/0xfb36a14ee608c9cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f17f expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.750829:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976924928:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066799.750893:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52decc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066799.750911:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15036 00000100:00100000:1.0:1746066799.750916:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977133952:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066799.750922:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066799.750931:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0400/0xfb36a14ee608c9d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f18d expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.750947:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0400/0xfb36a14ee608c9d2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f18d expref: 21 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066799.750956:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b0400/0xfb36a14ee608c9d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f18d expref: 21 pid: 10402 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066799.750962:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977134208 00000100:00100000:2.0:1746066799.750967:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977134208 00010000:00010000:1.0:1746066799.750968:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b0400, rc 0) 00000100:00100000:1.0:1746066799.750986:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977133952:12345-192.168.202.57@tcp:101:cat.0 Request processed in 71us (631us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066799.750991:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15036 00000100:00100000:2.0:1746066799.750992:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4229 00000100:00100000:2.0:1746066799.750998:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31832:x1830882977134208:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:1.0:1746066799.751006:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15037 00000100:00100000:1.0:1746066799.751011:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977133824:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066799.751016:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066799.751021:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1c00/0xfb36a14ee608c9d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f186 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.751041:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976925056:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066799.751059:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066799.751460:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31832:x1830882977134208:12345-192.168.202.57@tcp:35:cat.0 Request processed in 461us (1039us total) trans 8589944167 rc 0/0 00000100:00100000:2.0:1746066799.751466:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4229 00002000:00010000:1.0:1746066799.756551:0:10402:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime: 1746066798 -> 1746066799 00002000:00010000:1.0:1746066799.756560:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime: 1746066798 -> 1746066799 00002000:00010000:1.0:1746066799.756561:0:10402:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime: 1746066798 -> 1746066799 00000100:00100000:1.0:1746066799.756583:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976925056:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066799.756611:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1c00/0xfb36a14ee608c9d9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f186 expref: 20 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066799.756625:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2b1c00/0xfb36a14ee608c9d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f186 expref: 20 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066799.756635:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2b1c00, rc 0) 00000100:00100000:1.0:1746066799.756690:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977133824:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5665us (6296us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066799.756699:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15037 00002000:00010000:1.0:1746066799.756738:0:21973:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime: 1746066798 -> 1746066799 00002000:00010000:1.0:1746066799.756740:0:21973:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime: 1746066798 -> 1746066799 00002000:00010000:1.0:1746066799.756742:0:21973:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime: 1746066798 -> 1746066799 00000100:00100000:1.0:1746066799.756752:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976924928:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066799.756770:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7c00/0xfb36a14ee608c9cb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f17f expref: 14 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066799.756778:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50a7c00/0xfb36a14ee608c9cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f17f expref: 14 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066799.756785:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50a7c00, rc 0) 00000100:00100000:1.0:1746066799.756802:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977133696:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6054us (6492us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066799.756806:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15035 00000100:00100000:0.0:1746066799.765210:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.765864:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977134464 00000100:00100000:2.0:1746066799.765872:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977134464 00002000:00100000:2.0:1746066799.765909:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800929cfb80 x1830882977134464/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.765919:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cfb80 with x1830882977134464 ext(4194304->5091327) 00002000:00010000:2.0:1746066799.765923:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929cfb80 00000100:00100000:2.0:1746066799.766084:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6831 00000100:00100000:2.0:1746066799.766090:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977134464:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066799.774142:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977134464:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8043us (8930us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066799.774152:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6831 00002000:00100000:2.0:1746066799.774161:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800929cfb80 x1830882977134464/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/440 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066799.774169:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cfb80 with x1830882977134464 ext(4194304->5091327) 00002000:00010000:2.0:1746066799.774174:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929cfb80 00000100:00100000:0.0:1746066799.777532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.777574:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.777616:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.777668:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977134720 00000100:00100000:3.0:1746066799.777701:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977134720 00000100:00100000:2.0:1746066799.777709:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977134592 00000100:00100000:2.0:1746066799.777712:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977134592 00000100:00100000:2.0:1746066799.777733:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977134848 00000100:00100000:2.0:1746066799.777734:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977134848 00000100:00100000:3.0:1746066799.777743:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15038 00000100:00100000:3.0:1746066799.777749:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977134592:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:2.0:1746066799.777754:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15039 00000100:00100000:2.0:1746066799.777758:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977134720:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066799.777764:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.777764:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.777777:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099014600/0xfb36a14ee608c9e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f194 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.777777:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608c9e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f19b expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.777815:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976925184:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066799.777815:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976925312:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066799.777864:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15040 00000100:00100000:2.0:1746066799.777872:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066799.777873:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066799.777882:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977134848:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066799.777887:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.777893:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099014c00/0xfb36a14ee608c9ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f1a2 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.777907:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099014c00/0xfb36a14ee608c9ee lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1a2 expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.777916:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099014c00/0xfb36a14ee608c9ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1a2 expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.777937:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099014c00, rc 0) 00000100:00100000:3.0:1746066799.777956:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977134848:12345-192.168.202.57@tcp:101:cat.0 Request processed in 87us (340us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066799.777961:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15040 00000100:00100000:2.0:1746066799.781713:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976925312:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066799.781738:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608c9e0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f19b expref: 20 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.781749:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608c9e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f19b expref: 20 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.782640:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3c400, rc 0) 00000100:00100000:2.0:1746066799.782701:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977134720:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4939us (5174us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066799.782709:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15039 00000100:00100000:3.0:1746066799.783949:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976925184:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066799.783971:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099014600/0xfb36a14ee608c9e7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f194 expref: 14 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.783981:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099014600/0xfb36a14ee608c9e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f194 expref: 14 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.783994:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099014600, rc 0) 00000100:00100000:3.0:1746066799.784036:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977134592:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6286us (6460us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066799.784042:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15038 00000100:00100000:0.0:1746066799.788064:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.789012:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.789272:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.790149:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977134976 00000100:00100000:3.0:1746066799.790157:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977134976 00000100:00100000:3.0:1746066799.790192:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977135104 00000100:00100000:3.0:1746066799.790194:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977135104 00000100:00100000:3.0:1746066799.790215:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977135232 00000100:00100000:3.0:1746066799.790217:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977135232 00000100:00100000:3.0:1746066799.790233:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15041 00000100:00100000:3.0:1746066799.790239:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:1966:x1830882977134976:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066799.790254:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.790269:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099015200/0xfb36a14ee608c9f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f1a9 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.790309:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976925440:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066799.790371:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066799.790387:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15042 00000100:00100000:3.0:1746066799.790392:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977135104:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066799.790399:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.790408:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1000/0xfb36a14ee608c9fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f1b0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066799.790431:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976925568:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066799.790451:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066799.790474:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15043 00000100:00100000:3.0:1746066799.790478:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+21:1965:x1830882977135232:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066799.790484:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.790490:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a287c00/0xfb36a14ee608ca03 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f1b7 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.790505:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a287c00/0xfb36a14ee608ca03 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1b7 expref: 22 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.790513:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a287c00/0xfb36a14ee608ca03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1b7 expref: 22 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.790521:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a287c00, rc 0) 00000100:00100000:3.0:1746066799.790537:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+21:1965:x1830882977135232:12345-192.168.202.57@tcp:101:cat.0 Request processed in 58us (1265us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066799.790553:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15043 00000100:00100000:3.0:1746066799.792663:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976925440:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066799.792715:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099015200/0xfb36a14ee608c9f5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1a9 expref: 14 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.792725:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099015200/0xfb36a14ee608c9f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1a9 expref: 14 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066799.792733:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099015200, rc 0) 00000100:00100000:3.0:1746066799.793156:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:1966:x1830882977134976:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2915us (5097us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066799.793163:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15041 00000100:00100000:2.0:1746066799.793645:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976925568:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066799.793660:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1000/0xfb36a14ee608c9fc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1b0 expref: 20 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.793669:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1000/0xfb36a14ee608c9fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1b0 expref: 20 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066799.793705:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b1000, rc 0) 00000100:00100000:2.0:1746066799.793736:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977135104:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3343us (4725us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066799.793741:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15042 00000100:00100000:0.0:1746066799.799723:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.799786:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977135488 00000100:00100000:2.0:1746066799.799794:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977135488 00000100:00100000:2.0:1746066799.799838:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4230 00000100:00100000:2.0:1746066799.799845:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+9:31836:x1830882977135488:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066799.800027:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:31836:x1830882977135488:12345-192.168.202.57@tcp:35:cat.0 Request processed in 182us (312us total) trans 8589944168 rc 0/0 00000100:00100000:2.0:1746066799.800034:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4230 00000100:00100000:0.0:1746066799.916091:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.917002:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977135744 00000100:00100000:2.0:1746066799.917010:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977135744 00000100:00100000:0.0:1746066799.918147:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10096 00000100:00100000:0.0:1746066799.918158:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31843:x1830882977135744:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066799.919032:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066799.919048:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786e00/0xfb36a14ee608ca0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f1be expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.919131:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787800/0xfb36a14ee608ca11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919142:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787800/0xfb36a14ee608ca11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919152:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787800/0xfb36a14ee608ca11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919163:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0xfb36a14ee608ca18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919169:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0xfb36a14ee608ca18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919174:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0xfb36a14ee608ca18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919258:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881c00/0xfb36a14ee608ca1f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919266:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881c00/0xfb36a14ee608ca1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919271:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881c00/0xfb36a14ee608ca1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:1.0:1746066799.919278:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066799.919343:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787800/0xfb36a14ee608ca11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919349:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787800/0xfb36a14ee608ca11 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919353:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787800/0xfb36a14ee608ca11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919357:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b787800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066799.919360:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787800/0xfb36a14ee608ca11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919365:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787800/0xfb36a14ee608ca11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919374:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066799.919376:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066799.919379:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787800/0xfb36a14ee608ca11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919383:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b787800/0xfb36a14ee608ca11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919414:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0xfb36a14ee608ca18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919419:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0xfb36a14ee608ca18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919423:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0xfb36a14ee608ca18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919427:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b786400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066799.919429:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0xfb36a14ee608ca18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919433:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0xfb36a14ee608ca18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919439:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13900) 00010000:00010000:1.0:1746066799.919441:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066799.919442:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0xfb36a14ee608ca18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919446:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786400/0xfb36a14ee608ca18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066799.919481:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b786e00/0xfb36a14ee608ca0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1be expref: 256 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.919491:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881c00/0xfb36a14ee608ca1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1be expref: 255 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.919497:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:1.0:1746066799.919499:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066799.919501:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e881c00, rc 0) 00000100:00100000:1.0:1746066799.920583:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31843:x1830882977135744:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2425us (4494us total) trans 8589944169 rc 0/0 00000100:00100000:1.0:1746066799.920591:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10096 00000100:00100000:0.0:1746066799.923322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.924195:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977136000 00000100:00100000:2.0:1746066799.924202:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977136000 00000100:00100000:2.0:1746066799.924251:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4231 00000100:00100000:2.0:1746066799.924258:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31843:x1830882977136000:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066799.924435:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:31843:x1830882977136000:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 177us (1117us total) trans 8589944170 rc 0/0 00000100:00100000:2.0:1746066799.924441:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4231 00000100:00100000:0.0:1746066799.952918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.953009:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977136128 00000100:00100000:2.0:1746066799.953016:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977136128 00000100:00100000:2.0:1746066799.953063:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15044 00000100:00100000:2.0:1746066799.953070:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31843:x1830882977136128:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066799.953084:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.953097:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f1c5 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.953120:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a80c00/0xfb36a14ee608c985 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f139 expref: 29 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.953132:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135ec2c00/0xfb36a14ee608c9a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f15c expref: 18 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.953137:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746066799.953138:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746066799.953141:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4009984->4194303] (req 4009984->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 29 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.953163:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135ec2c00/0xfb36a14ee608c9a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f15c expref: 18 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.953171:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135ec2c00/0xfb36a14ee608c9a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f15c expref: 18 pid: 21973 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066799.953180:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976925696:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.954668:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5a80c00/0xfb36a14ee608c985 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f139 expref: 29 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.954690:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a80c00/0xfb36a14ee608c985 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f139 expref: 29 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066799.954699:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976925824:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.955434:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.961002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.961039:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977136384 00000100:00100000:0.0:1746066799.961045:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977136384 00000100:00100000:0.0:1746066799.961075:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10097 00000100:00100000:0.0:1746066799.961080:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:31845:x1830882977136384:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066799.961097:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066799.961111:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608ca34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f1cc expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066799.961438:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976925696:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.961449:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976925824:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.961468:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4009984->4194303] (req 4009984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 29 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.961481:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3c200, rc 0) 00000100:00100000:2.0:1746066799.961513:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:31843:x1830882977136128:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 8444us (8603us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.961520:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15044 00010000:00010000:0.0:1746066799.961579:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ca3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961589:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ca3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961598:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ca3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961607:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608ca42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961612:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608ca42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961616:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608ca42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961708:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e800/0xfb36a14ee608ca49 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961715:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e800/0xfb36a14ee608ca49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961723:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e800/0xfb36a14ee608ca49 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:0.0:1746066799.961731:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066799.961788:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ca3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961793:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ca3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961798:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ca3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961802:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4a1fa00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066799.961805:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ca3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961810:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ca3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961816:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066799.961819:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066799.961821:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ca3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961825:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1fa00/0xfb36a14ee608ca3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961834:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608ca42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961838:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608ca42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961845:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608ca42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961848:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4a1ec00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066799.961850:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608ca42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961854:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608ca42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961858:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880136433700) 00010000:00010000:0.0:1746066799.961859:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066799.961861:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608ca42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961864:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ec00/0xfb36a14ee608ca42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.961889:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608ca34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1cc expref: 13 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.961896:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e800/0xfb36a14ee608ca49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1cc expref: 12 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066799.961901:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:0.0:1746066799.961902:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066799.961904:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1e800, rc 0) 00000100:00100000:0.0:1746066799.961921:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:31845:x1830882977136384:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 841us (925us total) trans 8589944171 rc 0/0 00000100:00100000:0.0:1746066799.961925:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10097 00000100:00100000:0.0:1746066799.962514:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.962828:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.962961:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977136512 00000100:00100000:1.0:1746066799.962966:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977136512 00010000:00010000:1.0:1746066799.962986:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a80c00/0xfb36a14ee608c985 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f139 expref: 29 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066799.963004:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977136640 00000100:00100000:1.0:1746066799.963006:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977136640 00010000:00010000:1.0:1746066799.963014:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135ec2c00/0xfb36a14ee608c9a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f15c expref: 19 pid: 21973 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066799.963034:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7740 00000100:00100000:1.0:1746066799.963039:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977136512:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.963049:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.963065:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a80c00/0xfb36a14ee608c985 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f139 expref: 29 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066799.963073:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5a80c00/0xfb36a14ee608c985 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f139 expref: 29 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066799.963088:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a80c00/0xfb36a14ee608c985 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f139 expref: 29 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066799.963107:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.963128:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977136512:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 89us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.963133:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7740 00000100:00100000:1.0:1746066799.963144:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7741 00000100:00100000:1.0:1746066799.963148:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882977136640:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066799.963154:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066799.963161:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135ec2c00/0xfb36a14ee608c9a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f15c expref: 19 pid: 21973 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066799.963168:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135ec2c00/0xfb36a14ee608c9a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f15c expref: 19 pid: 21973 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066799.963179:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135ec2c00/0xfb36a14ee608c9a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f15c expref: 19 pid: 21973 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066799.963187:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066799.963188:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066799.963193:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4009984->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 27 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.963200:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4009984->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 27 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066799.963223:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4009984->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 27 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066799.965154:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976925952:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066799.965227:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066799.966329:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.966711:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066799.966772:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977136896 00000100:00100000:1.0:1746066799.966779:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977136896 00000100:00100000:1.0:1746066799.966822:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4232 00000100:00100000:1.0:1746066799.966828:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:31845:x1830882977136896:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:1.0:1746066799.966993:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+13:31845:x1830882977136896:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 164us (665us total) trans 8589944172 rc 0/0 00000100:00100000:1.0:1746066799.966999:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4232 00000100:00100000:2.0:1746066799.967231:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977137024 00000100:00100000:2.0:1746066799.967235:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977137024 00000100:00100000:2.0:1746066799.967258:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10098 00000100:00100000:2.0:1746066799.967262:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:31846:x1830882977137024:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066799.967272:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066799.967284:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608ca57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f1d3 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.967321:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3da00/0xfb36a14ee608ca5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.967331:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3da00/0xfb36a14ee608ca5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.967340:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3da00/0xfb36a14ee608ca5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.967350:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3d800/0xfb36a14ee608ca65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.967355:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3d800/0xfb36a14ee608ca65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.967360:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3d800/0xfb36a14ee608ca65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.967439:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.967448:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0bb expref: 255 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.967454:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0b4 expref: 12 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.967461:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 5/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.967483:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0b4 expref: 12 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.967492:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0b4 expref: 12 pid: 16018 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066799.967502:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976926080:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.967566:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0bb expref: 255 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.967573:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0bb expref: 255 pid: 14549 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066799.967581:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976926208:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.967598:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066799.968368:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976925952:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066799.968380:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066799.968409:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977136640:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5259us (5580us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066799.968417:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7741 00000100:00100000:0.0:1746066799.968778:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.968821:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977137280 00000100:00100000:3.0:1746066799.968825:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977137280 00002000:00100000:3.0:1746066799.968849:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (4009984->4014079) req@ffff8800929cf800 x1830882977137280/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066799.968857:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cf800 with x1830882977137280 ext(4009984->4014079) 00002000:00010000:3.0:1746066799.968861:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929cf800 00000100:00100000:3.0:1746066799.968886:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6832 00000100:00100000:3.0:1746066799.968892:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977137280:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066799.969003:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977137280:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 111us (225us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066799.969009:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6832 00002000:00100000:3.0:1746066799.969014:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (4009984->4014079) req@ffff8800929cf800 x1830882977137280/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:205/0 lens 488/4536 e 0 to 0 dl 1746066810 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066799.969021:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cf800 with x1830882977137280 ext(4009984->4014079) 00002000:00010000:3.0:1746066799.969023:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929cf800 00000100:00100000:0.0:1746066799.974762:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066799.975104:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976926080:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066799.975114:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976926208:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066799.975133:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:1.0:1746066799.976613:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.976819:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977137664 00000100:00100000:0.0:1746066799.976825:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977137664 00010000:00010000:0.0:1746066799.976853:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0bb expref: 256 pid: 14549 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066799.976877:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7742 00000100:00100000:0.0:1746066799.976882:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:1963:x1830882977137664:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066799.976891:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.976895:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0bb expref: 256 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066799.976902:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0bb expref: 256 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066799.976919:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099ac9e00/0xfb36a14ee608c8d6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0bb expref: 256 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066799.976934:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:0.0:1746066799.976938:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.976944:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.976951:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.976955:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.976986:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:1963:x1830882977137664:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 103us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.976991:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7742 00000100:00100000:1.0:1746066799.977074:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066799.979070:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977137536 00000100:00100000:0.0:1746066799.979079:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977137536 00010000:00010000:0.0:1746066799.979106:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0b4 expref: 13 pid: 16018 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066799.979146:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7743 00000100:00100000:0.0:1746066799.979153:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977137536:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066799.979163:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066799.979167:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0b4 expref: 13 pid: 16018 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066799.979176:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0b4 expref: 13 pid: 16018 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066799.979190:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad1e00/0xfb36a14ee608c8e4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0b4 expref: 13 pid: 16018 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066799.979201:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:0.0:1746066799.979205:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.979216:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.979221:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066799.979239:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066799.979273:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977137536:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 119us (2198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066799.979278:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7743 00010000:00010000:2.0:1746066799.979454:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979461:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:2.0:1746066799.979495:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:2.0:1746066799.979498:0:14550:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746066799.979511:0:14550:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979519:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979527:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3da00/0xfb36a14ee608ca5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979533:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3da00/0xfb36a14ee608ca5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979537:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3da00/0xfb36a14ee608ca5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979552:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cb3da00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066799.979556:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3da00/0xfb36a14ee608ca5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979564:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3da00/0xfb36a14ee608ca5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979572:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066799.979574:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066799.979577:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3da00/0xfb36a14ee608ca5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979581:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3da00/0xfb36a14ee608ca5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979593:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3d800/0xfb36a14ee608ca65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979598:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3d800/0xfb36a14ee608ca65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979602:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3d800/0xfb36a14ee608ca65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979605:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cb3d800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066799.979607:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3d800/0xfb36a14ee608ca65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979611:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3d800/0xfb36a14ee608ca65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979616:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebece00) 00010000:00010000:2.0:1746066799.979617:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066799.979619:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3d800/0xfb36a14ee608ca65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979623:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3d800/0xfb36a14ee608ca65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066799.979648:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608ca57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1d3 expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.979658:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1d3 expref: 7 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066799.979664:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066799.979665:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066799.979667:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3ce00, rc 0) 00000100:00100000:2.0:1746066799.979716:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31846:x1830882977137024:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 12453us (13005us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066799.979722:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10098 00000100:00100000:3.0:1746066799.980082:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977137408 00000100:00100000:3.0:1746066799.980086:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977137408 00000100:00100000:3.0:1746066799.980110:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15045 00000100:00100000:3.0:1746066799.980115:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:31843:x1830882977137408:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066799.980127:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066799.980138:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f1da expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.980163:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2740223) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 12 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.980169:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066799.980170:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066799.980173:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->3313663] (req 3145728->3313663) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.980193:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2740223) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 12 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.980202:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2740223) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 12 pid: 4614 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066799.980211:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976926336:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066799.980252:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066799.988437:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976926336:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066799.988462:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->3313663] (req 3145728->3313663) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066799.988476:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a286600, rc 0) 00000100:00100000:3.0:1746066799.988533:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:31843:x1830882977137408:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 8416us (13777us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066799.988551:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15045 00000100:00100000:0.0:1746066799.990418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066799.991421:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977137792 00000100:00100000:3.0:1746066799.991430:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977137792 00002000:00100000:3.0:1746066799.991466:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->2740223) req@ffff880135e58000 x1830882977137792/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/0 e 0 to 0 dl 1746066810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066799.991475:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e58000 with x1830882977137792 ext(2097152->2740223) 00010000:00010000:3.0:1746066799.991483:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2740223) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 13 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066799.991494:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2740223) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 13 pid: 4614 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746066799.991500:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135e58000 00000100:00100000:3.0:1746066799.991517:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2209 00000100:00100000:3.0:1746066799.991523:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977137792:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066800.001633:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.001657:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977138688 00000100:00100000:2.0:1746066800.001665:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977138688 00000100:00100000:2.0:1746066800.001715:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10099 00000100:00100000:2.0:1746066800.001722:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31849:x1830882977138688:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066800.001741:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.001754:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f600/0xfb36a14ee608ca7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f204 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.001834:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f800/0xfb36a14ee608ca81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.001844:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f800/0xfb36a14ee608ca81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.001852:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f800/0xfb36a14ee608ca81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.001861:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489fe00/0xfb36a14ee608ca88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.001866:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489fe00/0xfb36a14ee608ca88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.001870:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489fe00/0xfb36a14ee608ca88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.001939:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608ca8f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.001945:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608ca8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.001950:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608ca8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:2.0:1746066800.001956:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066800.002008:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f800/0xfb36a14ee608ca81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.002019:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f800/0xfb36a14ee608ca81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.002024:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f800/0xfb36a14ee608ca81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.002028:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a489f800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066800.002030:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f800/0xfb36a14ee608ca81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.002035:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f800/0xfb36a14ee608ca81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.002043:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066800.002046:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066800.002048:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f800/0xfb36a14ee608ca81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.002053:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f800/0xfb36a14ee608ca81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00000100:00100000:1.0:1746066800.002182:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.002199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.002221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.002233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.002259:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.002271:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977137920 00000100:00100000:1.0:1746066800.002274:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977137920 00000100:00100000:1.0:1746066800.002290:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977138048 00000100:00100000:1.0:1746066800.002292:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977138048 00000100:00100000:1.0:1746066800.002301:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977138176 00000100:00100000:1.0:1746066800.002302:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977138176 00000100:00100000:1.0:1746066800.002309:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977138432 00000100:00100000:1.0:1746066800.002310:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977138432 00000100:00100000:1.0:1746066800.002316:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977138304 00000100:00100000:1.0:1746066800.002318:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977138304 00000100:00100000:1.0:1746066800.002325:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15046 00000100:00100000:1.0:1746066800.002329:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977137920:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066800.002336:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.002344:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e881e00/0xfb36a14ee608ca9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f1e1 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.002375:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976926464:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066800.002431:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066800.002445:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15047 00000100:00100000:1.0:1746066800.002450:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+18:31845:x1830882977138048:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066800.002458:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.002467:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f1e8 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.002479:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ed5c00/0xfb36a14ee608c812 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f067 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.002486:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608c8f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ad expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.002491:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009354c800/0xfb36a14ee608c8eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0a6 expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.002497:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.002498:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.002501:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [16384->368639] (req 16384->368639) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 19 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.002514:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009354c800/0xfb36a14ee608c8eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0a6 expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.002521:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009354c800/0xfb36a14ee608c8eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0a6 expref: 27 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.002528:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976926592:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.002558:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608c8f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ad expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.002564:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608c8f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ad expref: 19 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.002570:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092848a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976926720:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.002585:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ed5c00/0xfb36a14ee608c812 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f067 expref: 10 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.002591:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ed5c00/0xfb36a14ee608c812 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f067 expref: 10 pid: 8451 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746066800.002601:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976926848:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.002611:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066800.002622:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15048 00000100:00100000:1.0:1746066800.002626:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977138176:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066800.002631:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.002635:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed06e00/0xfb36a14ee608caab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f1ef expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.002650:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976926976:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066800.002661:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.002715:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15049 00000100:00100000:0.0:1746066800.002720:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977138432:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066800.002725:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.002731:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608cab2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f1fd expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.002750:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976927104:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066800.002777:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.002790:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15050 00000100:00100000:0.0:1746066800.002794:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977138304:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066800.002799:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.002805:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f800/0xfb36a14ee608cab9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f1f6 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.002821:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976927232:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066800.002839:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3d80 going to sleep for 11 seconds 00010000:00010000:2.0:1746066800.004099:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489fe00/0xfb36a14ee608ca88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.004105:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489fe00/0xfb36a14ee608ca88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.004110:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489fe00/0xfb36a14ee608ca88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.004115:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a489fe00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066800.004118:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489fe00/0xfb36a14ee608ca88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.004123:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489fe00/0xfb36a14ee608ca88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.004132:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebecd00) 00010000:00010000:2.0:1746066800.004134:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066800.004136:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489fe00/0xfb36a14ee608ca88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.004141:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489fe00/0xfb36a14ee608ca88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.004178:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f600/0xfb36a14ee608ca7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f204 expref: 258 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.004188:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608ca8f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f204 expref: 257 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.004193:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066800.004195:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066800.004197:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a489f000, rc 0) 00000100:00100000:2.0:1746066800.004218:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:31849:x1830882977138688:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2497us (2593us total) trans 8589944173 rc 0/0 00000100:00100000:2.0:1746066800.004224:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10099 00000100:00100000:1.0:1746066800.016197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.016237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.016361:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977138816 00000100:00100000:3.0:1746066800.016368:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977138816 00000100:00100000:3.0:1746066800.016405:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977138944 00000100:00100000:3.0:1746066800.016407:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977138944 00000100:00100000:3.0:1746066800.016420:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15051 00000100:00100000:3.0:1746066800.016426:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882977138816:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066800.016441:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.016454:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a287e00/0xfb36a14ee608cac0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f20b expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.016497:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976927360:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066800.016660:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15052 00000100:00100000:1.0:1746066800.016666:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1966:x1830882977138944:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066800.016673:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.016696:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed07c00/0xfb36a14ee608cac7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f212 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.016718:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092848000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976927488:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066800.016768:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52decc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.017431:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976926464:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066800.017455:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e881e00/0xfb36a14ee608ca9d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e1 expref: 12 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.017465:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e881e00/0xfb36a14ee608ca9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e1 expref: 12 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.017475:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e881e00, rc 0) 00000100:00100000:3.0:1746066800.017536:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.017627:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977137920:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 15295us (15444us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066800.017633:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15046 00000100:00100000:1.0:1746066800.022318:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976926592:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.022329:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092848a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976926720:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.022336:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976926848:192.168.202.57@tcp:104: 00002000:00010000:0.0:1746066800.022338:0:8452:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime: 1746066798 -> 1746066799 00000100:00100000:0.0:1746066800.022354:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976927104:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066800.022360:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [16384->368639] (req 16384->368639) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 19 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.022373:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608cab2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1fd expref: 10 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.022374:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb96200, rc 0) 00010000:00010000:0.0:1746066800.022382:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608cab2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1fd expref: 10 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.022390:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1ea00, rc 0) 00000100:00100000:1.0:1746066800.022407:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+19:31845:x1830882977138048:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 19956us (20207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.022407:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977138432:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 19687us (20173us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066800.022415:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15047 00000100:00100000:0.0:1746066800.022419:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15049 00000100:00100000:0.0:1746066800.022453:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.022457:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976926976:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066800.022471:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed06e00/0xfb36a14ee608caab lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1ef expref: 12 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.022479:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed06e00/0xfb36a14ee608caab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1ef expref: 12 pid: 21203 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066800.022486:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066800.022489:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed06e00, rc 0) 00000100:00100000:1.0:1746066800.022506:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977138176:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 19879us (20283us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066800.022511:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15048 00000100:00100000:0.0:1746066800.022522:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.023040:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977139200 00000100:00100000:1.0:1746066800.023046:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977139200 00010000:00010000:1.0:1746066800.023066:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608c8f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ad expref: 19 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.023083:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977139072 00000100:00100000:1.0:1746066800.023085:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977139072 00010000:00010000:1.0:1746066800.023092:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009354c800/0xfb36a14ee608c8eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0a6 expref: 30 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.023107:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977139328 00000100:00100000:1.0:1746066800.023109:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977139328 00010000:00010000:1.0:1746066800.023116:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed5c00/0xfb36a14ee608c812 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f067 expref: 11 pid: 8451 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746066800.023126:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7744 00000100:00100000:1.0:1746066800.023131:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882977139200:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066800.023141:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066800.023152:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608c8f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ad expref: 19 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.023159:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608c8f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ad expref: 19 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.023175:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009354c000/0xfb36a14ee608c8f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0ad expref: 19 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.023183:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066800.023201:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977139200:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 70us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.023206:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7744 00000100:00100000:1.0:1746066800.023216:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7745 00000100:00100000:1.0:1746066800.023220:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1965:x1830882977139072:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066800.023226:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066800.023233:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009354c800/0xfb36a14ee608c8eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0a6 expref: 30 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.023239:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009354c800/0xfb36a14ee608c8eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0a6 expref: 30 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.023248:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009354c800/0xfb36a14ee608c8eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0a6 expref: 30 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.023255:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066800.023268:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1965:x1830882977139072:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 48us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.023273:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7745 00000100:00100000:1.0:1746066800.023280:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7746 00000100:00100000:1.0:1746066800.023284:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1965:x1830882977139328:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066800.023291:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066800.023296:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ed5c00/0xfb36a14ee608c812 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f067 expref: 11 pid: 8451 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746066800.023303:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ed5c00/0xfb36a14ee608c812 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f067 expref: 11 pid: 8451 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746066800.023312:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ed5c00/0xfb36a14ee608c812 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f067 expref: 11 pid: 8451 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746066800.023318:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.023320:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.023325:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 17 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.023331:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 17 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.023353:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 17 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.023362:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976927616:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066800.023396:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066800.023419:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092848000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976927488:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066800.023433:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed07c00/0xfb36a14ee608cac7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f212 expref: 19 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.023440:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed07c00/0xfb36a14ee608cac7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f212 expref: 19 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.023446:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed07c00, rc 0) 00000100:00100000:1.0:1746066800.023461:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1966:x1830882977138944:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6796us (7224us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066800.023466:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15052 00002000:00010000:2.0:1746066800.023652:0:20532:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime: 1746066798 -> 1746066799 00002000:00010000:2.0:1746066800.023656:0:20532:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime: 1746066798 -> 1746066799 00002000:00010000:2.0:1746066800.023658:0:20532:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime: 1746066798 -> 1746066799 00000100:00100000:2.0:1746066800.023666:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976927232:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066800.023701:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f800/0xfb36a14ee608cab9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1f6 expref: 10 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.023710:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f800/0xfb36a14ee608cab9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1f6 expref: 10 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.023719:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1f800, rc 0) 00000100:00100000:2.0:1746066800.023741:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977138304:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 20947us (21482us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066800.023746:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15050 00000100:00100000:3.0:1746066800.024150:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976927360:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066800.024168:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a287e00/0xfb36a14ee608cac0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f20b expref: 28 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.024178:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a287e00/0xfb36a14ee608cac0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f20b expref: 28 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.024205:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a287e00, rc 0) 00000100:00100000:3.0:1746066800.024226:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1966:x1830882977138816:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7800us (8036us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066800.024232:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15051 00000100:00100000:2.0:1746066800.030319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.030343:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977139968 00000100:00100000:2.0:1746066800.030350:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977139968 00000100:00100000:2.0:1746066800.030386:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10100 00000100:00100000:2.0:1746066800.030392:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31846:x1830882977139968:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066800.030408:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.030422:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489ee00/0xfb36a14ee608cace lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f220 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.030495:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489e800/0xfb36a14ee608cad5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.030507:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1d3 expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.030513:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608ca8f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f204 expref: 256 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.030519:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489e800/0xfb36a14ee608cad5 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.030561:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608ca8f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f204 expref: 256 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.030571:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608ca8f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f204 expref: 256 pid: 14550 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.030581:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976927744:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066800.030639:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1d3 expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.030645:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1d3 expref: 8 pid: 14550 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.030653:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976927872:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066800.030668:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066800.030876:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976927616:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066800.030887:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066800.030890:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066800.030913:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977139328:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7627us (8390us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.030915:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.030924:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7746 00000100:00100000:0.0:1746066800.030963:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977139584 00000100:00100000:0.0:1746066800.030966:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977139584 00002000:00100000:0.0:1746066800.030995:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (16384->20479) req@ffff880135e5ad80 x1830882977139584/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066800.031004:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ad80 with x1830882977139584 ext(16384->20479) 00002000:00010000:0.0:1746066800.031008:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5ad80 00000100:00100000:0.0:1746066800.031021:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6833 00000100:00100000:0.0:1746066800.031025:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977139584:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066800.031160:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977139584:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 134us (274us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066800.031166:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6833 00002000:00100000:0.0:1746066800.031170:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (16384->20479) req@ffff880135e5ad80 x1830882977139584/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/4536 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066800.031177:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ad80 with x1830882977139584 ext(16384->20479) 00002000:00010000:0.0:1746066800.031179:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5ad80 00000100:00100000:0.0:1746066800.034274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.034329:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977140096 00000100:00100000:1.0:1746066800.034335:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977140096 00000100:00100000:2.0:1746066800.034345:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976927744:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.034361:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608ca8f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f204 expref: 257 pid: 14550 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.034388:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7747 00000100:00100000:1.0:1746066800.034395:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:1963:x1830882977140096:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066800.034404:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066800.034409:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608ca8f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f204 expref: 257 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.034418:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608ca8f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f204 expref: 257 pid: 14550 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.034426:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977139712 00000100:00100000:3.0:1746066800.034430:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977139712 00010000:00010000:1.0:1746066800.034436:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608ca8f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f204 expref: 257 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.034447:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:1.0:1746066800.034451:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489e800/0xfb36a14ee608cad5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.034458:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489e800/0xfb36a14ee608cad5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.034463:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066800.034492:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:1963:x1830882977140096:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 98us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.034501:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7747 00000100:00100000:3.0:1746066800.035120:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15053 00000100:00100000:3.0:1746066800.035127:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:31849:x1830882977139712:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066800.035140:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.035151:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608cadc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f219 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.035171:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 17 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.035178:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066800.035180:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066800.035182:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608cadc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f219 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.035203:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 17 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.035213:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 17 pid: 9776 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.035221:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976928000:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066800.036274:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.036411:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.036427:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977140224 00000100:00100000:0.0:1746066800.036432:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977140224 00010000:00010000:0.0:1746066800.036450:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1d3 expref: 9 pid: 14550 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066800.036470:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7748 00000100:00100000:0.0:1746066800.036475:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882977140224:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.036483:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.036487:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1d3 expref: 9 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.036494:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1d3 expref: 9 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.036508:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:0.0:1746066800.036511:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489e800/0xfb36a14ee608cad5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066800.036519:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489e800/0xfb36a14ee608cad5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066800.036524:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489e800/0xfb36a14ee608cad5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066800.036534:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.036565:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882977140224:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 89us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.036570:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7748 00010000:00010000:2.0:1746066800.036696:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608ca6c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1d3 expref: 8 pid: 14550 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.036709:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976927872:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066800.036724:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489e800/0xfb36a14ee608cad5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.036729:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489e800/0xfb36a14ee608cad5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.036734:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489e800/0xfb36a14ee608cad5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746066800.036748:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066800.036859:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489ee00/0xfb36a14ee608cace lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f220 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.036869:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489e800/0xfb36a14ee608cad5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f220 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.036874:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066800.036876:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066800.036878:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a489e800, rc 0) 00000100:00100000:2.0:1746066800.036898:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31846:x1830882977139968:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 6507us (6588us total) trans 8589944174 rc 0/0 00000100:00100000:2.0:1746066800.036904:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10100 00000100:00100000:3.0:1746066800.038108:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977137792:12345-192.168.202.57@tcp:4:cat.0 Request processed in 46581us (47690us total) trans 21474841007 rc 0/0 00000100:00100000:3.0:1746066800.038116:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2209 00002000:00100000:3.0:1746066800.038123:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->2740223) req@ffff880135e58000 x1830882977137792/t21474841007(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:205/0 lens 488/448 e 0 to 0 dl 1746066810 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.038133:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e58000 with x1830882977137792 ext(2097152->2740223) 00010000:00010000:3.0:1746066800.038139:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2740223) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 15 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.038149:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2740223) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 15 pid: 4614 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746066800.038156:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135e58000 00000100:00100000:2.0:1746066800.038718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.038719:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.038774:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977140480 00000100:00100000:3.0:1746066800.038778:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977140480 00000100:00100000:3.0:1746066800.038801:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10101 00000100:00100000:3.0:1746066800.038806:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:31852:x1830882977140480:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066800.038822:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.038832:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f160400/0xfb36a14ee608caea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f227 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.038903:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f161600/0xfb36a14ee608caf1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.038911:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f161600/0xfb36a14ee608caf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.038919:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f161600/0xfb36a14ee608caf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.038929:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012daa7600/0xfb36a14ee608caf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.038933:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012daa7600/0xfb36a14ee608caf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.038938:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012daa7600/0xfb36a14ee608caf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039009:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608caff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039016:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608caff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039021:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608caff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066800.039027:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066800.039076:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f161600/0xfb36a14ee608caf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039083:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f161600/0xfb36a14ee608caf1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039090:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f161600/0xfb36a14ee608caf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039094:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f161600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066800.039097:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f161600/0xfb36a14ee608caf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039102:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f161600/0xfb36a14ee608caf1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039110:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066800.039219:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066800.039224:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f161600/0xfb36a14ee608caf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039229:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f161600/0xfb36a14ee608caf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039771:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012daa7600/0xfb36a14ee608caf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039778:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012daa7600/0xfb36a14ee608caf8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039782:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012daa7600/0xfb36a14ee608caf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039786:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012daa7600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066800.039788:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012daa7600/0xfb36a14ee608caf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039793:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012daa7600/0xfb36a14ee608caf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039807:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d3b8500) 00010000:00010000:3.0:1746066800.039809:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066800.039812:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012daa7600/0xfb36a14ee608caf8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039816:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012daa7600/0xfb36a14ee608caf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.039848:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f160400/0xfb36a14ee608caea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f227 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.039858:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608caff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f227 expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.039863:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:3.0:1746066800.039865:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066800.039867:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a32800, rc 0) 00000100:00100000:3.0:1746066800.039909:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+14:31852:x1830882977140480:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1101us (1191us total) trans 8589944175 rc 0/0 00000100:00100000:3.0:1746066800.039914:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10101 00000100:00100000:3.0:1746066800.039943:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976928000:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066800.039959:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608cadc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f219 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.039969:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f24e00, rc 0) 00000100:00100000:3.0:1746066800.039994:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31849:x1830882977139712:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4868us (9078us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.040003:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15053 00000100:00100000:3.0:1746066800.040019:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977140736 00000100:00100000:3.0:1746066800.040022:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977140736 00002000:00100000:3.0:1746066800.040039:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (364544->368639) req@ffff880135e58380 x1830882977140736/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.040047:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e58380 with x1830882977140736 ext(364544->368639) 00010000:00010000:3.0:1746066800.040052:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 18 pid: 9776 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.040061:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 18 pid: 9776 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746066800.040067:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135e58380 00000100:00100000:3.0:1746066800.040501:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2210 00000100:00100000:3.0:1746066800.040509:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977140736:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066800.040875:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977140736:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 366us (2156us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066800.040881:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2210 00002000:00100000:3.0:1746066800.040887:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (364544->368639) req@ffff880135e58380 x1830882977140736/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/4536 e 0 to 0 dl 1746066811 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.040894:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e58380 with x1830882977140736 ext(364544->368639) 00010000:00010000:3.0:1746066800.040898:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 18 pid: 9776 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.040911:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 18 pid: 9776 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746066800.040916:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135e58380 00000100:00100000:0.0:1746066800.041399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.041558:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977140992 00000100:00100000:3.0:1746066800.041562:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977140992 00000100:00100000:3.0:1746066800.041819:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10102 00000100:00100000:3.0:1746066800.041825:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31846:x1830882977140992:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066800.041837:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.041840:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066800.041853:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489e800/0xfb36a14ee608cad5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f220 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.041864:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:3.0:1746066800.041867:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066800.041874:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a33600/0xfb36a14ee608cb0d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f22e expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.041930:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb14 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.041939:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb14 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.041945:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb14 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.041954:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb14 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.041959:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb14 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.041963:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb14 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.041968:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a32200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066800.041970:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb14 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.041975:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb14 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.041980:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:3.0:1746066800.041983:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066800.041985:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb14 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.041989:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb14 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.042007:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a33600/0xfb36a14ee608cb0d lrc: 1/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f22e expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.042014:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a33600/0xfb36a14ee608cb0d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f22e expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.042020:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a33600, rc 0) 00000100:00100000:3.0:1746066800.042057:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31846:x1830882977140992:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 232us (659us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066800.042063:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10102 00000100:00100000:0.0:1746066800.042210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.042588:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977141120 00000100:00100000:1.0:1746066800.042593:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977141120 00010000:00010000:1.0:1746066800.042610:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2740223) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 15 pid: 4614 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.042628:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7749 00000100:00100000:1.0:1746066800.042632:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882977141120:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066800.042640:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066800.042653:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2740223) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 15 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.042663:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2740223) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 15 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.042697:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0000/0xfb36a14ee608c9a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2740223) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f155 expref: 15 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.042706:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.042707:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.042713:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 17 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.042720:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 17 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.042742:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 17 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.042752:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976928128:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066800.042797:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.043626:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.043659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.043696:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977141760 00000100:00100000:1.0:1746066800.043700:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977141760 00000100:00100000:1.0:1746066800.043733:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4233 00000100:00100000:0.0:1746066800.043734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.043738:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093216c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+14:31845:x1830882977141760:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066800.043788:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977141248 00000100:00100000:2.0:1746066800.043792:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977141248 00000100:00100000:2.0:1746066800.043812:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 721 00000100:00100000:2.0:1746066800.043815:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977141248:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066800.043822:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066800.043833:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608caff lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f227 expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.043846:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066800.043849:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066800.043860:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977141248:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 44us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.043860:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093216c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:31845:x1830882977141760:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 122us (200us total) trans 8589944176 rc 0/0 00000100:00100000:2.0:1746066800.043865:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 721 00000100:00100000:1.0:1746066800.043865:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4233 00000100:00100000:3.0:1746066800.043920:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977141632 00000100:00100000:3.0:1746066800.043924:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977141632 00002000:00100000:3.0:1746066800.043944:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (16384->368639) req@ffff880135e5bb80 x1830882977141632/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.043952:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5bb80 with x1830882977141632 ext(16384->368639) 00010000:00010000:3.0:1746066800.043958:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 18 pid: 9776 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.043967:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 18 pid: 9776 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746066800.043972:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135e5bb80 00000100:00100000:3.0:1746066800.043983:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2211 00000100:00100000:3.0:1746066800.043987:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977141632:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:1.0:1746066800.044852:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.044867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.044877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.044906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.044912:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977141888 00000100:00100000:0.0:1746066800.044916:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977141888 00000100:00100000:0.0:1746066800.044943:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977142016 00000100:00100000:0.0:1746066800.044945:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977142016 00000100:00100000:0.0:1746066800.044956:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977142144 00000100:00100000:0.0:1746066800.044957:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977142144 00000100:00100000:0.0:1746066800.044965:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977142272 00000100:00100000:0.0:1746066800.044966:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977142272 00000100:00100000:0.0:1746066800.044977:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15054 00000100:00100000:0.0:1746066800.044982:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977141888:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066800.044992:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.045004:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f400/0xfb36a14ee608cb1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f235 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.045036:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976928256:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066800.045082:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.045096:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15055 00000100:00100000:0.0:1746066800.045101:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977142016:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066800.045102:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15056 00010000:00010000:0.0:1746066800.045107:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066800.045110:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977142144:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066800.045116:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f200/0xfb36a14ee608cb22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f23c expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.045117:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.045126:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a32600/0xfb36a14ee608cb29 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f243 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.045136:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976928384:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066800.045149:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976928512:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066800.045155:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.045169:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15057 00000100:00100000:0.0:1746066800.045173:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977142272:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066800.045174:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b600 going to sleep for 11 seconds 00010000:00010000:0.0:1746066800.045181:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.045186:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f800/0xfb36a14ee608cb30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f24a expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.046361:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976928640:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066800.046417:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066800.046552:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.046618:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976928128:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066800.046632:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066800.046652:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977141120:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4019us (4443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.046659:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7749 00000100:00100000:3.0:1746066800.046769:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977142528 00000100:00100000:3.0:1746066800.046774:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977142528 00000100:00100000:3.0:1746066800.046798:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4234 00000100:00100000:3.0:1746066800.046803:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31846:x1830882977142528:12345-192.168.202.57@tcp:35:mirror_io.0 00000100:00100000:3.0:1746066800.046944:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31846:x1830882977142528:12345-192.168.202.57@tcp:35:mirror_io.0 Request processed in 141us (403us total) trans 8589944177 rc 0/0 00000100:00100000:3.0:1746066800.046949:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4234 00000100:00100000:3.0:1746066800.049470:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882977141632:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 5477us (5729us total) trans 17179873700 rc 0/0 00000100:00100000:3.0:1746066800.049479:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2211 00002000:00100000:3.0:1746066800.049488:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (16384->368639) req@ffff880135e5bb80 x1830882977141632/t17179873700(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/448 e 0 to 0 dl 1746066811 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.049496:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5bb80 with x1830882977141632 ext(16384->368639) 00010000:00010000:3.0:1746066800.049504:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 24 pid: 9776 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.049516:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 24 pid: 9776 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746066800.049522:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135e5bb80 00000100:00100000:0.0:1746066800.049855:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.050897:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976928256:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066800.050921:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f400/0xfb36a14ee608cb1b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f235 expref: 17 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.050936:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f400/0xfb36a14ee608cb1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f235 expref: 17 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.050945:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1f400, rc 0) 00000100:00100000:1.0:1746066800.051059:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977141888:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6075us (6208us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066800.051066:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15054 00000100:00100000:0.0:1746066800.051347:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976928384:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066800.051363:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f200/0xfb36a14ee608cb22 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f23c expref: 23 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.051371:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f200/0xfb36a14ee608cb22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f23c expref: 23 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.051382:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1f200, rc 0) 00000100:00100000:0.0:1746066800.051397:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977142016:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6297us (6529us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066800.051402:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15055 00000100:00100000:3.0:1746066800.051953:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977142784 00000100:00100000:3.0:1746066800.051959:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977142784 00002000:00100000:3.0:1746066800.051987:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3309568->3313663) req@ffff88009a4ed180 x1830882977142784/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.051995:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ed180 with x1830882977142784 ext(3309568->3313663) 00002000:00010000:3.0:1746066800.051999:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4ed180 00000100:00100000:3.0:1746066800.052220:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6834 00000100:00100000:3.0:1746066800.052227:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1964:x1830882977142784:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066800.052358:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1964:x1830882977142784:12345-192.168.202.57@tcp:3:cat.0 Request processed in 131us (2504us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066800.052363:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6834 00002000:00100000:3.0:1746066800.052368:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3309568->3313663) req@ffff88009a4ed180 x1830882977142784/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/4536 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.052374:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ed180 with x1830882977142784 ext(3309568->3313663) 00002000:00010000:3.0:1746066800.052376:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a4ed180 00000100:00100000:1.0:1746066800.052891:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976928640:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066800.052909:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f800/0xfb36a14ee608cb30 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f24a expref: 15 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.052919:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f800/0xfb36a14ee608cb30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f24a expref: 15 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.052926:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1f800, rc 0) 00000100:00100000:1.0:1746066800.052959:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977142272:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7785us (8051us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066800.052964:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15057 00000100:00100000:2.0:1746066800.052996:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976928512:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066800.053011:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a32600/0xfb36a14ee608cb29 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f243 expref: 21 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.053020:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a32600/0xfb36a14ee608cb29 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f243 expref: 21 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.053026:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a32600, rc 0) 00000100:00100000:2.0:1746066800.053195:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977142144:12345-192.168.202.57@tcp:101:cat.0 Request processed in 8085us (8315us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066800.053204:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15056 00000100:00100000:0.0:1746066800.054359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.054415:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977142912 00000100:00100000:1.0:1746066800.054421:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977142912 00010000:00010000:1.0:1746066800.054443:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 20 pid: 9776 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.054461:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7750 00000100:00100000:1.0:1746066800.054467:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977142912:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066800.054478:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066800.054489:0:21351:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066798 -> 1746066799 00002000:00010000:1.0:1746066800.054492:0:21351:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066798 -> 1746066799 00010000:00010000:1.0:1746066800.054496:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 20 pid: 9776 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.054506:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 20 pid: 9776 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.054524:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb96200/0xfb36a14ee608caa4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->368639) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1e8 expref: 20 pid: 9776 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.054535:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.054536:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.054552:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608cadc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f219 expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.054559:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608cadc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f219 expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.054585:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608cadc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f219 expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.054594:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976928768:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066800.054661:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.055173:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.055251:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977143040 00000100:00100000:2.0:1746066800.055255:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977143040 00000100:00100000:2.0:1746066800.055521:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15058 00000100:00100000:2.0:1746066800.055528:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:31852:x1830882977143040:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066800.055548:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.055558:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a489fa00/0xfb36a14ee608cb37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f251 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.055571:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.055572:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.055576:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a489fa00/0xfb36a14ee608cb37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f251 expref: 21 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.055586:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a489fa00/0xfb36a14ee608cb37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f251 expref: 21 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.055592:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a489fa00, rc 0) 00000100:00100000:2.0:1746066800.055616:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+21:31852:x1830882977143040:12345-192.168.202.57@tcp:101:cat.0 Request processed in 88us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.055621:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15058 00000100:00100000:0.0:1746066800.055991:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.056228:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976928768:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066800.056240:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066800.056256:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977142912:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1790us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.056262:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7750 00000100:00100000:1.0:1746066800.056321:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977143296 00000100:00100000:1.0:1746066800.056324:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977143296 00000100:00100000:1.0:1746066800.056356:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4235 00000100:00100000:1.0:1746066800.056361:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:31843:x1830882977143296:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:1.0:1746066800.056493:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:31843:x1830882977143296:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 131us (501us total) trans 8589944178 rc 0/0 00000100:00100000:1.0:1746066800.056498:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4235 00000100:00100000:0.0:1746066800.062798:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.062841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.062867:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977143552 00000100:00100000:2.0:1746066800.062875:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977143552 00002000:00100000:2.0:1746066800.062910:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009270a680 x1830882977143552/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.062919:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009270a680 with x1830882977143552 ext(0->1048575) 00002000:00010000:2.0:1746066800.062924:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009270a680 00000100:00100000:3.0:1746066800.062935:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977143808 00000100:00100000:2.0:1746066800.062938:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6835 00000100:00100000:3.0:1746066800.062939:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977143808 00000100:00100000:2.0:1746066800.062944:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977143552:12345-192.168.202.57@tcp:3:cat.0 00002000:00100000:3.0:1746066800.062963:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880092708a80 x1830882977143808/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.062972:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092708a80 with x1830882977143808 ext(1048576->2097151) 00002000:00010000:3.0:1746066800.062976:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092708a80 00000100:00100000:3.0:1746066800.062987:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6836 00000100:00100000:3.0:1746066800.062991:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977143808:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066800.066198:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.066938:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.066967:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.066987:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.067004:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977144064 00000100:00100000:0.0:1746066800.067011:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977144064 00002000:00100000:0.0:1746066800.067045:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff880092709500 x1830882977144064/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066800.067054:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092709500 with x1830882977144064 ext(0->1048575) 00002000:00010000:0.0:1746066800.067058:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092709500 00000100:00100000:0.0:1746066800.067071:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977144448 00000100:00100000:0.0:1746066800.067073:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977144448 00002000:00100000:0.0:1746066800.067080:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x390:0x0] (1343488->2097151) req@ffff88009270ad80 x1830882977144448/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066800.067086:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009270ad80 with x1830882977144448 ext(1343488->2097151) 00002000:00010000:0.0:1746066800.067088:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009270ad80 00000100:00100000:0.0:1746066800.067094:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977144576 00000100:00100000:0.0:1746066800.067095:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977144576 00002000:00100000:0.0:1746066800.067103:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009270b480 x1830882977144576/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066800.067109:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009270b480 with x1830882977144576 ext(1048576->2097151) 00002000:00010000:0.0:1746066800.067111:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009270b480 00000100:00100000:0.0:1746066800.067117:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977144704 00000100:00100000:0.0:1746066800.067118:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977144704 00002000:00100000:0.0:1746066800.067125:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1478655) req@ffff88009270b100 x1830882977144704/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066800.067130:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009270b100 with x1830882977144704 ext(1048576->1478655) 00002000:00010000:0.0:1746066800.067133:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009270b100 00000100:00100000:0.0:1746066800.067141:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6837 00000100:00100000:0.0:1746066800.067147:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977144064:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066800.068094:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6838 00000100:00100000:2.0:1746066800.068103:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977144448:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066800.068162:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6839 00000100:00100000:0.0:1746066800.068168:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1964:x1830882977144576:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066800.068876:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6840 00000100:00100000:2.0:1746066800.068882:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977144704:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066800.072812:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977143808:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9811us (9961us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066800.072823:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6836 00002000:00100000:3.0:1746066800.072833:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880092708a80 x1830882977143808/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.072842:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092708a80 with x1830882977143808 ext(1048576->2097151) 00002000:00010000:3.0:1746066800.072848:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092708a80 00000100:00100000:2.0:1746066800.083106:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977143552:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20152us (20306us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066800.083116:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6835 00002000:00100000:2.0:1746066800.083127:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009270a680 x1830882977143552/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.083135:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009270a680 with x1830882977143552 ext(0->1048575) 00002000:00010000:2.0:1746066800.083140:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009270a680 00000100:00100000:2.0:1746066800.086426:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977144064:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19269us (20225us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066800.086437:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6837 00002000:00100000:2.0:1746066800.086448:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff880092709500 x1830882977144064/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.086463:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092709500 with x1830882977144064 ext(0->1048575) 00002000:00010000:2.0:1746066800.086468:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092709500 00000100:00100000:2.0:1746066800.089397:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977144448:12345-192.168.202.57@tcp:3:cat.0 Request processed in 21286us (22450us total) trans 0 rc 753664/753664 00000100:00100000:2.0:1746066800.089407:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6838 00002000:00100000:2.0:1746066800.089416:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1343488->2097151) req@ffff88009270ad80 x1830882977144448/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.089424:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009270ad80 with x1830882977144448 ext(1343488->2097151) 00002000:00010000:2.0:1746066800.089429:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009270ad80 00000100:00100000:2.0:1746066800.093718:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977144576:12345-192.168.202.57@tcp:3:cat.0 Request processed in 25542us (26742us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066800.093728:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6839 00002000:00100000:2.0:1746066800.093738:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009270b480 x1830882977144576/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.093747:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009270b480 with x1830882977144576 ext(1048576->2097151) 00002000:00010000:2.0:1746066800.093752:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009270b480 00000100:00100000:3.0:1746066800.094845:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1964:x1830882977144704:12345-192.168.202.57@tcp:3:cat.0 Request processed in 25961us (27854us total) trans 0 rc 430080/430080 00000100:00100000:3.0:1746066800.094852:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6840 00002000:00100000:3.0:1746066800.094858:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1478655) req@ffff88009270b100 x1830882977144704/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 430080/430080 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.094864:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009270b100 with x1830882977144704 ext(1048576->1478655) 00002000:00010000:3.0:1746066800.094868:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009270b100 00000100:00100000:0.0:1746066800.097783:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.097848:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977144960 00000100:00100000:1.0:1746066800.097855:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977144960 00000100:00100000:1.0:1746066800.097900:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15059 00000100:00100000:1.0:1746066800.097907:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:31852:x1830882977144960:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066800.097924:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.097938:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4c3a000/0xfb36a14ee608cb3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f258 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.097960:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 17 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.097967:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066800.097968:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066800.097971:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c3a000/0xfb36a14ee608cb3e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f258 expref: 15 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.097997:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 17 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.098007:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 17 pid: 8451 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.098022:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976928896:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.098934:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066800.099433:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976928896:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.099453:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c3a000/0xfb36a14ee608cb3e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f258 expref: 15 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.099465:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c3a000, rc 0) 00000100:00100000:1.0:1746066800.099500:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+15:31852:x1830882977144960:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1592us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.099506:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15059 00000100:00100000:0.0:1746066800.102465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.102562:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977145216 00000100:00100000:1.0:1746066800.102570:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977145216 00000100:00100000:1.0:1746066800.102612:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15060 00000100:00100000:1.0:1746066800.102619:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:31849:x1830882977145216:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066800.102635:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.102648:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608cb45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f25f expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.102668:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066800.102672:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608cb45 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f25f expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.102706:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608cb45 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f25f expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.102719:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cad0a00, rc 0) 00000100:00100000:1.0:1746066800.102756:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:31849:x1830882977145216:12345-192.168.202.57@tcp:101:cat.0 Request processed in 137us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.102761:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15060 00000100:00100000:0.0:1746066800.103695:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.103801:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977145088 00000100:00100000:3.0:1746066800.103806:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977145088 00002000:00100000:3.0:1746066800.103830:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1478656->2097151) req@ffff880092708380 x1830882977145088/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.103838:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092708380 with x1830882977145088 ext(1478656->2097151) 00010000:00010000:3.0:1746066800.103844:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 19 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.103855:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 19 pid: 8451 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746066800.103860:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092708380 00000100:00100000:3.0:1746066800.103884:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2212 00000100:00100000:3.0:1746066800.103890:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1963:x1830882977145088:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066800.111790:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882977145088:12345-192.168.202.57@tcp:4:cat.0 Request processed in 7892us (8106us total) trans 21474841008 rc 0/0 00000100:00100000:3.0:1746066800.111802:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2212 00002000:00100000:3.0:1746066800.111812:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1478656->2097151) req@ffff880092708380 x1830882977145088/t21474841008(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/448 e 0 to 0 dl 1746066811 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.111826:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092708380 with x1830882977145088 ext(1478656->2097151) 00010000:00010000:3.0:1746066800.111835:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 21 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.111846:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 21 pid: 8451 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746066800.111852:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092708380 00000100:00100000:0.0:1746066800.120730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.120791:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977145344 00000100:00100000:2.0:1746066800.120799:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977145344 00010000:00010000:2.0:1746066800.120831:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 21 pid: 8451 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.120879:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7751 00000100:00100000:2.0:1746066800.120886:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1965:x1830882977145344:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066800.120901:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066800.120918:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 21 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.120929:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 21 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.120979:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608c970 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1478656->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f124 expref: 21 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.121010:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.121012:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.121020:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c3a000/0xfb36a14ee608cb3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f258 expref: 14 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.121027:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c3a000/0xfb36a14ee608cb3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f258 expref: 14 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.121034:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.121035:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.121038:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608cb45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f25f expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.121042:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608cb45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f25f expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.121068:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608cb45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f25f expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.121083:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976929024:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066800.121163:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4c3a000/0xfb36a14ee608cb3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f258 expref: 14 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.121170:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976929152:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066800.121187:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.126406:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.126418:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976929024:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066800.126428:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976929152:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066800.126464:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977145600 00000100:00100000:3.0:1746066800.126468:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977145600 00002000:00100000:3.0:1746066800.126509:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880092709f80 x1830882977145600/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.126518:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092709f80 with x1830882977145600 ext(1048576->2097151) 00002000:00010000:3.0:1746066800.126522:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092709f80 00000100:00100000:3.0:1746066800.126559:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6841 00000100:00100000:3.0:1746066800.126566:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882977145600:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:2.0:1746066800.126624:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066800.126659:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1965:x1830882977145344:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5774us (5937us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.126666:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7751 00000100:00100000:0.0:1746066800.135443:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.135576:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977145856 00000100:00100000:2.0:1746066800.135583:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977145856 00002000:00100000:2.0:1746066800.135751:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009270a300 x1830882977145856/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.135761:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009270a300 with x1830882977145856 ext(1048576->2097151) 00002000:00010000:2.0:1746066800.135766:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009270a300 00000100:00100000:2.0:1746066800.135784:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6842 00000100:00100000:2.0:1746066800.135791:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977145856:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066800.135927:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882977145600:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9359us (9525us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066800.135933:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6841 00002000:00100000:3.0:1746066800.135940:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880092709f80 x1830882977145600/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.135946:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092709f80 with x1830882977145600 ext(1048576->2097151) 00002000:00010000:3.0:1746066800.135950:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092709f80 00000100:00100000:2.0:1746066800.142838:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977145856:12345-192.168.202.57@tcp:3:cat.0 Request processed in 7038us (7393us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066800.142851:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6842 00002000:00100000:2.0:1746066800.142863:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009270a300 x1830882977145856/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.142871:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009270a300 with x1830882977145856 ext(1048576->2097151) 00002000:00010000:2.0:1746066800.142876:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009270a300 00000100:00100000:0.0:1746066800.145176:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.145277:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977145984 00000100:00100000:1.0:1746066800.145286:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977145984 00000100:00100000:1.0:1746066800.145397:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15061 00000100:00100000:1.0:1746066800.145422:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+20:31852:x1830882977145984:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066800.145437:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.145456:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608cb4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f266 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.145485:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 27 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.145492:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066800.145493:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066800.145496:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608cb4c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f266 expref: 21 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.145525:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 27 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.145535:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 27 pid: 4614 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.145568:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976929280:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.145642:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066800.149743:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976929280:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.149768:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608cb4c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f266 expref: 21 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.149783:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cad1c00, rc 0) 00000100:00100000:1.0:1746066800.149828:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+21:31852:x1830882977145984:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4424us (4656us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.149835:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15061 00000100:00100000:0.0:1746066800.151405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.151488:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977146112 00000100:00100000:3.0:1746066800.151495:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977146112 00002000:00100000:3.0:1746066800.151526:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (1048576->1343487) req@ffff880092709c00 x1830882977146112/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.151534:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092709c00 with x1830882977146112 ext(1048576->1343487) 00010000:00010000:3.0:1746066800.151553:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 28 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.151564:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 28 pid: 4614 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746066800.151569:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092709c00 00000100:00100000:3.0:1746066800.151584:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2213 00000100:00100000:3.0:1746066800.151590:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977146112:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066800.153925:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.154267:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977146240 00000100:00100000:1.0:1746066800.154274:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977146240 00000100:00100000:1.0:1746066800.154316:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15062 00000100:00100000:1.0:1746066800.154323:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:31849:x1830882977146240:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066800.154336:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.154349:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608cb53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f26d expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.154371:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.154378:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066800.154380:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066800.154382:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608cb53 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f26d expref: 31 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.154412:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.154423:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 20 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.154433:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976929408:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.154493:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.156876:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.156897:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977146368 00000100:00100000:0.0:1746066800.156903:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977146368 00002000:00100000:0.0:1746066800.156935:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2981888->3145727) req@ffff88009270b800 x1830882977146368/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066800.156942:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092849c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976929408:192.168.202.57@tcp:104: 00002000:00100000:0.0:1746066800.156943:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009270b800 with x1830882977146368 ext(2981888->3145727) 00010000:00010000:0.0:1746066800.156950:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 21 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.156959:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 21 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.156963:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608cb53 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f26d expref: 31 pid: 8112 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066800.156965:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009270b800 00010000:00010000:1.0:1746066800.156974:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f094c00, rc 0) 00000100:00100000:0.0:1746066800.156994:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2214 00000100:00100000:0.0:1746066800.157001:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+21:1966:x1830882977146368:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066800.157003:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:31849:x1830882977146240:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2682us (3085us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.157009:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15062 00000100:00100000:3.0:1746066800.158163:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977146112:12345-192.168.202.57@tcp:4:cat.0 Request processed in 6570us (6758us total) trans 17179873701 rc 0/0 00000100:00100000:3.0:1746066800.158169:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2213 00002000:00100000:3.0:1746066800.158176:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (1048576->1343487) req@ffff880092709c00 x1830882977146112/t17179873701(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/448 e 0 to 0 dl 1746066811 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.158183:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092709c00 with x1830882977146112 ext(1048576->1343487) 00010000:00010000:3.0:1746066800.158188:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 31 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.158197:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 31 pid: 4614 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746066800.158202:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092709c00 00000100:00100000:2.0:1746066800.159529:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882977146368:12345-192.168.202.57@tcp:4:cat.0 Request processed in 2526us (2656us total) trans 17179873702 rc 0/0 00000100:00100000:2.0:1746066800.159535:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2214 00002000:00100000:2.0:1746066800.159550:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2981888->3145727) req@ffff88009270b800 x1830882977146368/t17179873702(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/448 e 0 to 0 dl 1746066811 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.159557:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009270b800 with x1830882977146368 ext(2981888->3145727) 00010000:00010000:2.0:1746066800.159562:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.159570:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00002000:00010000:2.0:1746066800.159575:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009270b800 00000100:00100000:0.0:1746066800.163718:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.163801:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.164128:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977146496 00000100:00100000:1.0:1746066800.164135:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977146496 00010000:00010000:1.0:1746066800.164161:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.164193:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977146624 00000100:00100000:1.0:1746066800.164195:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977146624 00010000:00010000:1.0:1746066800.164203:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 31 pid: 4614 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.164378:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7752 00000100:00100000:1.0:1746066800.164385:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882977146496:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066800.164396:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066800.164412:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.164421:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.164439:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099747200/0xfb36a14ee608c97e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f12b expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.164472:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7753 00000100:00100000:2.0:1746066800.164479:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977146624:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066800.164486:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066800.164496:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 31 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.164509:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 31 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.164520:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f319400/0xfb36a14ee608c98c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f140 expref: 31 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.164534:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.164536:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.164551:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608cb4c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f266 expref: 22 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.164558:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608cb4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f266 expref: 22 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.164584:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608cb4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f266 expref: 22 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.164594:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976929536:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066800.164757:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.164758:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.164763:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608cb53 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f26d expref: 30 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.164769:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608cb53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f26d expref: 30 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.164787:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608cb53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f26d expref: 30 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.164793:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092849c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976929664:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066800.165870:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066800.165913:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.168184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.168362:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976929536:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066800.168377:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066800.168405:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977146624:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3926us (4603us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.168414:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7753 00000100:00100000:3.0:1746066800.168545:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977146880 00000100:00100000:3.0:1746066800.168550:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977146880 00000100:00100000:3.0:1746066800.168577:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10103 00000100:00100000:3.0:1746066800.168582:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+14:31858:x1830882977146880:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066800.168598:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.168613:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32600/0xfb36a14ee608cb5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f274 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.168720:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a33600/0xfb36a14ee608cb61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168734:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a33600/0xfb36a14ee608cb61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168743:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a33600/0xfb36a14ee608cb61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168754:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168759:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168764:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168846:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608cb6f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168854:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608cb6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168859:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608cb6f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:3.0:1746066800.168868:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066800.168927:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a33600/0xfb36a14ee608cb61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168932:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a33600/0xfb36a14ee608cb61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168936:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a33600/0xfb36a14ee608cb61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168941:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a33600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066800.168943:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a33600/0xfb36a14ee608cb61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168948:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a33600/0xfb36a14ee608cb61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168955:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066800.168958:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066800.168961:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a33600/0xfb36a14ee608cb61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168965:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a33600/0xfb36a14ee608cb61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168977:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168980:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168984:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168991:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a32200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066800.168992:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.168996:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.169000:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d3b8500) 00010000:00010000:3.0:1746066800.169002:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066800.169003:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.169007:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32200/0xfb36a14ee608cb68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.169034:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32600/0xfb36a14ee608cb5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f274 expref: 17 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.169047:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608cb6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f274 expref: 16 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.169052:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:3.0:1746066800.169053:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066800.169055:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a32800, rc 0) 00000100:00100000:3.0:1746066800.169074:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+16:31858:x1830882977146880:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 492us (938us total) trans 8589944179 rc 0/0 00000100:00100000:3.0:1746066800.169079:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10103 00000100:00100000:1.0:1746066800.169190:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092849c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976929664:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066800.169201:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066800.169229:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882977146496:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4845us (5519us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.169234:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7752 00000100:00100000:0.0:1746066800.171474:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.171534:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977147136 00000100:00100000:2.0:1746066800.171551:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977147136 00002000:00100000:2.0:1746066800.171584:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009a0d2d80 x1830882977147136/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.171597:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d2d80 with x1830882977147136 ext(1048576->2097151) 00002000:00010000:2.0:1746066800.171601:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a0d2d80 00000100:00100000:2.0:1746066800.171624:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6843 00000100:00100000:2.0:1746066800.171630:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977147136:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066800.178313:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.178356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.178412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.178488:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977147776 00000100:00100000:3.0:1746066800.178495:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977147776 00002000:00100000:3.0:1746066800.178533:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009a0d0e00 x1830882977147776/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.178550:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d0e00 with x1830882977147776 ext(2097152->3145727) 00002000:00010000:3.0:1746066800.178555:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a0d0e00 00000100:00100000:3.0:1746066800.178568:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977147904 00000100:00100000:3.0:1746066800.178570:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977147904 00002000:00100000:3.0:1746066800.178581:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009a0d0700 x1830882977147904/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.178588:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d0700 with x1830882977147904 ext(2097152->3145727) 00002000:00010000:3.0:1746066800.178591:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a0d0700 00000100:00100000:3.0:1746066800.178601:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6844 00000100:00100000:3.0:1746066800.178607:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1965:x1830882977147776:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066800.179119:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977147392 00000100:00100000:2.0:1746066800.179122:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977147392 00000100:00100000:2.0:1746066800.179149:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10104 00000100:00100000:2.0:1746066800.179154:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:31860:x1830882977147392:12345-192.168.202.57@tcp:101:multiop.0 00000100:00100000:3.0:1746066800.179160:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6845 00000100:00100000:3.0:1746066800.179165:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1965:x1830882977147904:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:2.0:1746066800.179166:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.179180:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608cb7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f27b expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.179248:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3600/0xfb36a14ee608cb84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179258:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3600/0xfb36a14ee608cb84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179267:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3600/0xfb36a14ee608cb84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179276:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094a00/0xfb36a14ee608cb8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179280:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094a00/0xfb36a14ee608cb8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179518:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094a00/0xfb36a14ee608cb8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179613:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094800/0xfb36a14ee608cb92 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179620:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094800/0xfb36a14ee608cb92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179625:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094800/0xfb36a14ee608cb92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746066800.179631:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066800.179705:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3600/0xfb36a14ee608cb84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179711:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3600/0xfb36a14ee608cb84 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179715:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3600/0xfb36a14ee608cb84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179719:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800925a3600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066800.179722:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3600/0xfb36a14ee608cb84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179727:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3600/0xfb36a14ee608cb84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179735:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066800.179738:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066800.179742:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3600/0xfb36a14ee608cb84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179749:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3600/0xfb36a14ee608cb84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179767:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094a00/0xfb36a14ee608cb8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179772:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094a00/0xfb36a14ee608cb8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179776:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094a00/0xfb36a14ee608cb8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179779:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f094a00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066800.179781:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094a00/0xfb36a14ee608cb8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179785:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094a00/0xfb36a14ee608cb8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179790:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebecb00) 00010000:00010000:2.0:1746066800.179792:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066800.179794:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094a00/0xfb36a14ee608cb8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179798:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094a00/0xfb36a14ee608cb8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.179826:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2200/0xfb36a14ee608cb7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f27b expref: 260 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.179834:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094800/0xfb36a14ee608cb92 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f27b expref: 259 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.179843:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066800.179845:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066800.179847:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f094800, rc 0) 00000100:00100000:2.0:1746066800.179898:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:31860:x1830882977147392:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 743us (1596us total) trans 8589944180 rc 0/0 00000100:00100000:2.0:1746066800.179903:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10104 00000100:00100000:1.0:1746066800.183880:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.183905:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977148032 00000100:00100000:1.0:1746066800.183912:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977148032 00000100:00100000:1.0:1746066800.183957:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15063 00000100:00100000:1.0:1746066800.183964:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31860:x1830882977148032:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066800.183977:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.183990:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f282 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.184115:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c3a000/0xfb36a14ee608cb3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f258 expref: 14 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.184124:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608cb45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f25f expref: 23 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.184129:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.184131:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.184134:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1097728->1130495] (req 1097728->1130495) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 23 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.184157:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608cb45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f25f expref: 23 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.184171:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608cb45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f25f expref: 23 pid: 8112 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.184181:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092848700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976929792:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.184237:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4c3a000/0xfb36a14ee608cb3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f258 expref: 14 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.184245:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c3a000/0xfb36a14ee608cb3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f258 expref: 14 pid: 8112 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.184252:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976929920:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.184269:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066800.184722:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977147136:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13090us (13250us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066800.184731:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6843 00002000:00100000:2.0:1746066800.184738:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009a0d2d80 x1830882977147136/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.184746:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d2d80 with x1830882977147136 ext(1048576->2097151) 00002000:00010000:2.0:1746066800.184750:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a0d2d80 00000100:00100000:1.0:1746066800.187309:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092848700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976929792:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.187318:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976929920:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.187339:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1097728->1130495] (req 1097728->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 23 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.187357:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff40600, rc 0) 00000100:00100000:1.0:1746066800.187402:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:31860:x1830882977148032:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3438us (3527us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.187409:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15063 00000100:00100000:2.0:1746066800.189206:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1965:x1830882977147904:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10035us (10787us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066800.189219:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6845 00002000:00100000:2.0:1746066800.189229:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009a0d0700 x1830882977147904/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.189237:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d0700 with x1830882977147904 ext(2097152->3145727) 00002000:00010000:2.0:1746066800.189243:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a0d0700 00000100:00100000:0.0:1746066800.189717:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.189788:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977148160 00000100:00100000:1.0:1746066800.189794:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977148160 00010000:00010000:1.0:1746066800.189818:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c3a000/0xfb36a14ee608cb3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f258 expref: 15 pid: 8112 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.189850:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7754 00000100:00100000:1.0:1746066800.189856:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882977148160:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066800.189867:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066800.189882:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c3a000/0xfb36a14ee608cb3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f258 expref: 15 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.189891:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4c3a000/0xfb36a14ee608cb3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f258 expref: 15 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.189911:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c3a000/0xfb36a14ee608cb3e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f258 expref: 15 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.189929:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066800.189946:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+14:1966:x1830882977148160:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 90us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.189952:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7754 00000100:00100000:2.0:1746066800.190172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.190225:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.190325:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977148288 00000100:00100000:3.0:1746066800.190329:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977148288 00000100:00100000:3.0:1746066800.190410:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977148416 00000100:00100000:3.0:1746066800.190413:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977148416 00000100:00100000:1.0:1746066800.190416:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15064 00000100:00100000:1.0:1746066800.190421:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977148288:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066800.190433:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.190442:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608cba7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f289 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.190454:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.190461:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608cba7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f289 expref: 15 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.190470:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5831800/0xfb36a14ee608cba7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f289 expref: 15 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.190475:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5831800, rc 0) 00000100:00100000:1.0:1746066800.190506:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977148288:12345-192.168.202.57@tcp:101:cat.0 Request processed in 84us (334us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066800.190510:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15064 00000100:00100000:1.0:1746066800.190522:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15065 00000100:00100000:1.0:1746066800.190527:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977148416:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066800.190532:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.190552:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5830600/0xfb36a14ee608cbae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f290 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.190583:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976930048:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066800.190618:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.191294:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.191492:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977148544 00000100:00100000:2.0:1746066800.191496:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977148544 00000100:00100000:2.0:1746066800.191514:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15066 00000100:00100000:2.0:1746066800.191518:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977148544:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066800.191524:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.191531:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800925a2200/0xfb36a14ee608cbb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f297 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.191565:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976930176:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066800.191607:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066800.191702:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1965:x1830882977147776:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13094us (13345us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066800.191710:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6844 00002000:00100000:3.0:1746066800.191719:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009a0d0e00 x1830882977147776/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.191726:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d0e00 with x1830882977147776 ext(2097152->3145727) 00002000:00010000:3.0:1746066800.191729:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a0d0e00 00000100:00100000:1.0:1746066800.191867:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.191976:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977148672 00000100:00100000:3.0:1746066800.191980:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977148672 00010000:00010000:3.0:1746066800.191995:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608cb45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f25f expref: 21 pid: 8112 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.192453:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7755 00000100:00100000:3.0:1746066800.192460:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882977148672:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066800.192468:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066800.192483:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608cb45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f25f expref: 21 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.192493:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608cb45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f25f expref: 21 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.192508:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cad0a00/0xfb36a14ee608cb45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f25f expref: 21 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.192530:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.192532:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.192548:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.192556:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.192822:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.192835:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976930304:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066800.192882:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066800.196799:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976930048:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066800.196828:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5830600/0xfb36a14ee608cbae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f290 expref: 23 pid: 8112 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066800.196859:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066800.196912:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5830600/0xfb36a14ee608cbae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f290 expref: 23 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.196926:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5830600, rc 0) 00000100:00100000:1.0:1746066800.196964:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977148416:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6436us (6739us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066800.196972:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15065 00000100:00100000:3.0:1746066800.197637:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976930176:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066800.197654:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800925a2200/0xfb36a14ee608cbb5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f297 expref: 15 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.197663:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800925a2200/0xfb36a14ee608cbb5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f297 expref: 15 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.197671:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925a2200, rc 0) 00000100:00100000:3.0:1746066800.197734:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977148544:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6213us (6439us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066800.197740:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15066 00000100:00100000:0.0:1746066800.197759:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976930304:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066800.197770:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.197790:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977148672:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5329us (5923us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.197797:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7755 00000100:00100000:0.0:1746066800.197824:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977148928 00000100:00100000:0.0:1746066800.197829:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977148928 00002000:00100000:0.0:1746066800.197856:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1097728->1101823) req@ffff88009bb2d500 x1830882977148928/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066800.197864:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d500 with x1830882977148928 ext(1097728->1101823) 00002000:00010000:0.0:1746066800.197867:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2d500 00000100:00100000:0.0:1746066800.198280:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6846 00000100:00100000:0.0:1746066800.198287:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977148928:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066800.198643:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977148928:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 355us (1783us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066800.198652:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6846 00002000:00100000:0.0:1746066800.198657:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1097728->1101823) req@ffff88009bb2d500 x1830882977148928/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/4536 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066800.198665:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d500 with x1830882977148928 ext(1097728->1101823) 00002000:00010000:0.0:1746066800.198668:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2d500 00000100:00100000:1.0:1746066800.202652:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.203418:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.203577:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977149056 00000100:00100000:3.0:1746066800.203584:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977149056 00000100:00100000:1.0:1746066800.204514:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.204597:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977149440 00000100:00100000:2.0:1746066800.204602:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977149440 00002000:00100000:2.0:1746066800.204629:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1126400->1130495) req@ffff88009284b800 x1830882977149440/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.204638:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284b800 with x1830882977149440 ext(1126400->1130495) 00002000:00010000:2.0:1746066800.204642:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284b800 00000100:00100000:2.0:1746066800.204657:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6847 00000100:00100000:2.0:1746066800.204663:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977149440:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066800.204814:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977149440:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 151us (301us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066800.204820:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6847 00002000:00100000:2.0:1746066800.204825:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1126400->1130495) req@ffff88009284b800 x1830882977149440/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/4536 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.204830:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284b800 with x1830882977149440 ext(1126400->1130495) 00002000:00010000:2.0:1746066800.204833:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284b800 00000100:00100000:3.0:1746066800.205338:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977149184 00000100:00100000:3.0:1746066800.205341:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977149184 00000100:00100000:3.0:1746066800.205362:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15067 00000100:00100000:3.0:1746066800.205366:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:31849:x1830882977149056:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066800.205375:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.205387:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608cbbc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f2a5 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.205407:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4009984->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 31 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.205418:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066800.205420:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066800.205422:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608cbbc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2a5 expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.205442:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4009984->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 31 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.205451:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4009984->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 31 pid: 4614 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.205459:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976930432:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066800.205507:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066800.205806:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15068 00000100:00100000:2.0:1746066800.205813:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:31852:x1830882977149184:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066800.205820:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.205826:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608cbc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f29e expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.205838:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.205839:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.205845:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608cbc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f29e expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.205855:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608cbc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f29e expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.205863:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925a3000, rc 0) 00000100:00100000:2.0:1746066800.205884:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:31852:x1830882977149184:12345-192.168.202.57@tcp:101:cat.0 Request processed in 73us (2466us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.205890:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15068 00000100:00100000:0.0:1746066800.207187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.207209:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976930432:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066800.207227:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608cbbc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2a5 expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.207236:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a33200, rc 0) 00000100:00100000:2.0:1746066800.207238:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977149696 00000100:00100000:2.0:1746066800.207243:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977149696 00000100:00100000:3.0:1746066800.207273:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:31849:x1830882977149056:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1906us (4627us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.207280:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15067 00000100:00100000:2.0:1746066800.207281:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4236 00000100:00100000:2.0:1746066800.207287:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:31860:x1830882977149696:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066800.207451:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:31860:x1830882977149696:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 163us (268us total) trans 8589944181 rc 0/0 00000100:00100000:2.0:1746066800.207456:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4236 00000100:00100000:0.0:1746066800.208464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.208548:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977149824 00000100:00100000:2.0:1746066800.208551:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977149824 00002000:00100000:2.0:1746066800.208571:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (4009984->4194303) req@ffff88009a0d1c00 x1830882977149824/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.208579:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d1c00 with x1830882977149824 ext(4009984->4194303) 00010000:00010000:2.0:1746066800.208586:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4009984->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 31 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.208596:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4009984->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 31 pid: 4614 timeout: 861 lvb_type: 0 00002000:00010000:2.0:1746066800.208601:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a0d1c00 00000100:00100000:2.0:1746066800.208612:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2215 00000100:00100000:2.0:1746066800.208617:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977149824:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066800.210507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.210907:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977150080 00000100:00100000:2.0:1746066800.210912:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977150080 00002000:00100000:2.0:1746066800.210940:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009a0d2680 x1830882977150080/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.210949:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d2680 with x1830882977150080 ext(2097152->3145727) 00002000:00010000:2.0:1746066800.210952:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a0d2680 00000100:00100000:2.0:1746066800.210967:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6848 00000100:00100000:2.0:1746066800.210973:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882977150080:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066800.219650:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977149824:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 11025us (11180us total) trans 17179873703 rc 0/0 00000100:00100000:2.0:1746066800.219660:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2215 00002000:00100000:2.0:1746066800.219669:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (4009984->4194303) req@ffff88009a0d1c00 x1830882977149824/t17179873703(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/448 e 0 to 0 dl 1746066811 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.219700:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d1c00 with x1830882977149824 ext(4009984->4194303) 00010000:00010000:2.0:1746066800.219708:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4009984->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 33 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.219721:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4009984->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 33 pid: 4614 timeout: 861 lvb_type: 0 00002000:00010000:2.0:1746066800.219727:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a0d1c00 00000100:00100000:2.0:1746066800.235728:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882977150080:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24746us (25217us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066800.235739:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6848 00002000:00100000:2.0:1746066800.235749:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009a0d2680 x1830882977150080/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.235758:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d2680 with x1830882977150080 ext(2097152->3145727) 00002000:00010000:2.0:1746066800.235762:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a0d2680 00000100:00100000:0.0:1746066800.236556:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.237908:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977150208 00000100:00100000:2.0:1746066800.237918:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977150208 00010000:00010000:2.0:1746066800.237948:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4009984->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 33 pid: 4614 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.238925:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7756 00000100:00100000:2.0:1746066800.238934:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977150208:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066800.238946:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066800.238963:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4009984->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 33 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.238975:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4009984->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 33 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.238993:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c200/0xfb36a14ee608ca2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4009984->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1c5 expref: 33 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.239021:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.239023:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.239029:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608cbbc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2a5 expref: 32 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.239037:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608cbbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2a5 expref: 32 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.239064:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608cbbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2a5 expref: 32 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.239073:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976930560:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066800.239136:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.239199:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.239630:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977150336 00000100:00100000:2.0:1746066800.239634:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977150336 00000100:00100000:2.0:1746066800.239656:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15069 00000100:00100000:2.0:1746066800.239660:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+14:31852:x1830882977150336:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066800.239671:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.239695:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f2ac expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.239712:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.239717:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066800.239718:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066800.239721:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 15 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.239736:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.239744:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 19 pid: 4614 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.239751:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976930688:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066800.240411:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066800.240460:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976930560:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066800.240471:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066800.240488:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977150208:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1556us (3934us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.240495:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7756 00010000:00010000:2.0:1746066800.242082:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066800.246383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.246417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.246466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.246549:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977150720 00000100:00100000:3.0:1746066800.246557:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977150720 00000100:00100000:2.0:1746066800.246570:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976930688:192.168.202.57@tcp:104: 00002000:00100000:3.0:1746066800.246594:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009a0d1880 x1830882977150720/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746066800.246594:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 15 pid: 8451 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066800.246603:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d1880 with x1830882977150720 ext(3145728->4194303) 00002000:00010000:3.0:1746066800.246607:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a0d1880 00010000:00010000:2.0:1746066800.246609:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5e600, rc 0) 00000100:00100000:3.0:1746066800.246620:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977150848 00000100:00100000:3.0:1746066800.246621:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977150848 00002000:00100000:3.0:1746066800.246631:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (3313664->4194303) req@ffff88009a0d1500 x1830882977150848/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.246637:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d1500 with x1830882977150848 ext(3313664->4194303) 00010000:00010000:3.0:1746066800.246642:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 20 pid: 4614 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.246644:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:31852:x1830882977150336:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6983us (7445us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.246650:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15069 00010000:00010000:3.0:1746066800.246652:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 20 pid: 4614 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746066800.246657:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a0d1500 00000100:00100000:2.0:1746066800.246671:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977150976 00000100:00100000:2.0:1746066800.246673:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977150976 00000100:00100000:3.0:1746066800.246689:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2216 00000100:00100000:3.0:1746066800.246695:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977150848:12345-192.168.202.57@tcp:3:multiop.0 00002000:00100000:2.0:1746066800.246704:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3313663) req@ffff88009a0d2300 x1830882977150976/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.246710:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d2300 with x1830882977150976 ext(3145728->3313663) 00010000:00010000:2.0:1746066800.246715:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 21 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.246723:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 21 pid: 4614 timeout: 861 lvb_type: 0 00002000:00010000:2.0:1746066800.246728:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a0d2300 00000100:00100000:2.0:1746066800.246738:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2217 00000100:00100000:2.0:1746066800.246742:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1966:x1830882977150976:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:2.0:1746066800.246898:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6849 00000100:00100000:2.0:1746066800.246903:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977150720:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066800.257263:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1966:x1830882977150976:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 10513us (10789us total) trans 21474841009 rc 0/0 00000100:00100000:3.0:1746066800.257273:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2217 00002000:00100000:3.0:1746066800.257284:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3313663) req@ffff88009a0d2300 x1830882977150976/t21474841009(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/448 e 0 to 0 dl 1746066811 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.257294:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d2300 with x1830882977150976 ext(3145728->3313663) 00010000:00010000:3.0:1746066800.257302:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 24 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.257315:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 24 pid: 4614 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746066800.257321:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a0d2300 00000100:00100000:2.0:1746066800.262354:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977150720:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 15444us (15972us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066800.262364:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6849 00002000:00100000:2.0:1746066800.262373:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009a0d1880 x1830882977150720/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.262382:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d1880 with x1830882977150720 ext(3145728->4194303) 00002000:00010000:2.0:1746066800.262387:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a0d1880 00000100:00100000:0.0:1746066800.268184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.268376:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977151104 00000100:00100000:2.0:1746066800.268383:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977151104 00000100:00100000:2.0:1746066800.268414:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15070 00000100:00100000:2.0:1746066800.268420:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:31849:x1830882977151104:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066800.268433:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.268447:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608cbd1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f2b3 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.268469:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066800.268470:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066800.268474:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608cbd1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2b3 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.268483:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608cbd1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2b3 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.268490:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e881000, rc 0) 00000100:00100000:2.0:1746066800.268609:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31849:x1830882977151104:12345-192.168.202.57@tcp:101:cat.0 Request processed in 188us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.268615:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15070 00000100:00100000:3.0:1746066800.269297:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882977150848:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 22601us (22878us total) trans 0 rc 880640/880640 00000100:00100000:3.0:1746066800.269305:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2216 00002000:00100000:3.0:1746066800.269312:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (3313664->4194303) req@ffff88009a0d1500 x1830882977150848/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:H/200/0 rc 880640/880640 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.269320:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d1500 with x1830882977150848 ext(3313664->4194303) 00010000:00010000:3.0:1746066800.269326:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 23 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.269335:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 23 pid: 4614 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746066800.269341:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a0d1500 00000100:00100000:0.0:1746066800.271728:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.271823:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977151232 00000100:00100000:3.0:1746066800.271831:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977151232 00010000:00010000:3.0:1746066800.271856:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 23 pid: 4614 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.271885:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7757 00000100:00100000:3.0:1746066800.271892:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882977151232:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066800.271903:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066800.271920:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 23 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.271930:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 23 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.271948:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a286600/0xfb36a14ee608ca73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3313663) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1da expref: 23 pid: 4614 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.271976:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.271978:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.271985:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 14 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.271992:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 14 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.271999:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.272000:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.272003:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608cbd1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2b3 expref: 22 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.272009:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608cbd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2b3 expref: 22 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.272034:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608cbd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2b3 expref: 22 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.272045:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976930816:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066800.272112:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 14 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.272120:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976930944:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066800.272137:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066800.273507:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976930816:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066800.273515:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976930944:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066800.273528:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066800.274135:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977151232:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2242us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.274143:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7757 00000100:00100000:0.0:1746066800.284812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.286145:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.286167:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977151488 00000100:00100000:3.0:1746066800.286174:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977151488 00002000:00100000:3.0:1746066800.286212:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880135433100 x1830882977151488/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.286221:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135433100 with x1830882977151488 ext(2097152->3145727) 00002000:00010000:3.0:1746066800.286226:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135433100 00000100:00100000:3.0:1746066800.286255:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6850 00000100:00100000:3.0:1746066800.286262:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977151488:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066800.288144:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977151744 00000100:00100000:2.0:1746066800.288153:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977151744 00002000:00100000:2.0:1746066800.288181:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135431880 x1830882977151744/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.288189:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135431880 with x1830882977151744 ext(3145728->4194303) 00002000:00010000:2.0:1746066800.288193:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135431880 00000100:00100000:2.0:1746066800.288208:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6851 00000100:00100000:2.0:1746066800.288214:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977151744:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066800.304604:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977151488:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18334us (19790us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066800.304613:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6850 00002000:00100000:3.0:1746066800.304622:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880135433100 x1830882977151488/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.304631:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135433100 with x1830882977151488 ext(2097152->3145727) 00002000:00010000:3.0:1746066800.304636:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135433100 00000100:00100000:2.0:1746066800.308213:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977151744:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 19991us (22062us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066800.308223:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6851 00002000:00100000:2.0:1746066800.308233:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135431880 x1830882977151744/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.308242:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135431880 with x1830882977151744 ext(3145728->4194303) 00002000:00010000:2.0:1746066800.308246:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135431880 00000100:00100000:0.0:1746066800.311366:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.311412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.311516:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977151872 00000100:00100000:2.0:1746066800.311525:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977151872 00000100:00100000:2.0:1746066800.311568:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977152000 00000100:00100000:2.0:1746066800.311570:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977152000 00000100:00100000:2.0:1746066800.311597:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15071 00000100:00100000:3.0:1746066800.311628:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15072 00000100:00100000:3.0:1746066800.311635:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:31858:x1830882977152000:12345-192.168.202.57@tcp:101:multiop.0 00000100:00100000:2.0:1746066800.311642:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:31852:x1830882977151872:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066800.311649:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.311649:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.311665:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f2c1 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.311665:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e881400/0xfb36a14ee608cbd8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f2ba expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.311706:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.311708:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.311714:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881400/0xfb36a14ee608cbd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ba expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.311726:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e881400/0xfb36a14ee608cbd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ba expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.311735:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e881400, rc 0) 00010000:00010000:3.0:1746066800.311760:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 16 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.311767:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+24:31852:x1830882977151872:12345-192.168.202.57@tcp:101:cat.0 Request processed in 164us (409us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066800.311768:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608cbd1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2b3 expref: 21 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.311773:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066800.311773:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15071 00010000:00010000:3.0:1746066800.311788:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.311791:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2469888->3145727] (req 2469888->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 16 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.311828:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608cbd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2b3 expref: 21 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.311850:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608cbd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2b3 expref: 21 pid: 8451 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.311861:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976931072:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066800.311959:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 16 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.311966:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 16 pid: 8451 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.311990:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976931200:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066800.312025:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.321855:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.321897:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976931072:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066800.321897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.321932:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977152384 00000100:00100000:3.0:1746066800.321933:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976931200:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066800.321937:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977152384 00010000:00010000:3.0:1746066800.321957:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2469888->3145727] (req 2469888->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 16 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.321961:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608cbd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2b3 expref: 22 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.321992:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1fc00, rc 0) 00000100:00100000:0.0:1746066800.322000:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7758 00000100:00100000:0.0:1746066800.322007:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977152384:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.322019:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.322035:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608cbd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2b3 expref: 22 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.322044:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608cbd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2b3 expref: 22 pid: 8451 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.322048:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+16:31858:x1830882977152000:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 10414us (10635us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.322054:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15072 00010000:00010000:0.0:1746066800.322061:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608cbd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2b3 expref: 22 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.322082:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.322102:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1966:x1830882977152384:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 96us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.322108:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7758 00000100:00100000:2.0:1746066800.322224:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977152512 00000100:00100000:2.0:1746066800.322239:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977152512 00002000:00100000:2.0:1746066800.322260:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135430700 x1830882977152512/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.322283:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135430700 with x1830882977152512 ext(3145728->4194303) 00010000:00010000:2.0:1746066800.322289:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 16 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.322329:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 16 pid: 8451 timeout: 861 lvb_type: 0 00002000:00010000:2.0:1746066800.322335:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135430700 00000100:00100000:2.0:1746066800.322348:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2218 00000100:00100000:2.0:1746066800.322379:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882977152512:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066800.322909:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.322939:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.322980:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977152640 00000100:00100000:1.0:1746066800.322984:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977152640 00002000:00100000:1.0:1746066800.323001:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135431c00 x1830882977152640/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066800.323008:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135431c00 with x1830882977152640 ext(3145728->4194303) 00002000:00010000:1.0:1746066800.323012:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135431c00 00000100:00100000:1.0:1746066800.323024:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6852 00000100:00100000:1.0:1746066800.323029:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977152640:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066800.324448:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977152768 00000100:00100000:3.0:1746066800.324453:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977152768 00000100:00100000:3.0:1746066800.324487:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15073 00000100:00100000:3.0:1746066800.324493:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977152768:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066800.324503:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.324515:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608cbe6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f2c8 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.324529:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.324530:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.324547:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608cbe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c8 expref: 33 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.324560:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608cbe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c8 expref: 33 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.324567:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1ea00, rc 0) 00000100:00100000:3.0:1746066800.324591:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977152768:12345-192.168.202.57@tcp:101:cat.0 Request processed in 98us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.324596:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15073 00000100:00100000:3.0:1746066800.324632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.324643:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977152896 00000100:00100000:3.0:1746066800.324646:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977152896 00000100:00100000:3.0:1746066800.324665:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15074 00000100:00100000:3.0:1746066800.324670:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882977152896:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066800.324691:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.324704:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fe00/0xfb36a14ee608cbed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f2cf expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.324713:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.324720:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fe00/0xfb36a14ee608cbed lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2cf expref: 22 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.324727:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fe00/0xfb36a14ee608cbed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2cf expref: 22 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.324737:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1fe00, rc 0) 00000100:00100000:3.0:1746066800.324750:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882977152896:12345-192.168.202.57@tcp:101:cat.0 Request processed in 80us (118us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066800.324755:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15074 00000100:00100000:0.0:1746066800.331396:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.331715:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977153152 00000100:00100000:1.0:1746066800.331723:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977153152 00002000:00100000:1.0:1746066800.331759:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880135430380 x1830882977153152/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066800.331768:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135430380 with x1830882977153152 ext(4194304->5091327) 00002000:00010000:1.0:1746066800.331773:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135430380 00000100:00100000:1.0:1746066800.331804:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6853 00000100:00100000:1.0:1746066800.331812:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1966:x1830882977153152:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066800.337591:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882977152512:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 15229us (15734us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066800.337601:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2218 00002000:00100000:2.0:1746066800.337612:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135430700 x1830882977152512/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.337622:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135430700 with x1830882977152512 ext(3145728->4194303) 00010000:00010000:2.0:1746066800.337630:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 16 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.337648:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 16 pid: 8451 timeout: 861 lvb_type: 0 00002000:00010000:2.0:1746066800.337654:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135430700 00000100:00100000:1.0:1746066800.341443:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977152640:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 18405us (18525us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066800.341455:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6852 00002000:00100000:1.0:1746066800.341465:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135431c00 x1830882977152640/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066800.341473:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135431c00 with x1830882977152640 ext(3145728->4194303) 00002000:00010000:1.0:1746066800.341478:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135431c00 00000100:00100000:1.0:1746066800.343291:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1966:x1830882977153152:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11475us (11898us total) trans 0 rc 897024/897024 00000100:00100000:1.0:1746066800.343299:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6853 00002000:00100000:1.0:1746066800.343307:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880135430380 x1830882977153152/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066800.343313:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135430380 with x1830882977153152 ext(4194304->5091327) 00002000:00010000:1.0:1746066800.343318:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135430380 00000100:00100000:0.0:1746066800.347319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.347377:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977153280 00000100:00100000:2.0:1746066800.347386:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977153280 00010000:00010000:2.0:1746066800.347417:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 16 pid: 8451 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.347815:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7759 00000100:00100000:2.0:1746066800.347823:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977153280:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066800.347834:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066800.347851:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 16 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.347861:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 16 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.347878:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cbca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ac expref: 16 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.347899:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.347901:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.347907:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 15 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.347918:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 15 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.347945:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 15 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.347956:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976931328:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066800.349140:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.350395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.350429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.350473:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977153536 00000100:00100000:3.0:1746066800.350480:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977153536 00000100:00100000:3.0:1746066800.350513:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977153408 00000100:00100000:3.0:1746066800.350514:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977153408 00000100:00100000:3.0:1746066800.350827:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15075 00000100:00100000:3.0:1746066800.350834:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:31852:x1830882977153536:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:0.0:1746066800.350836:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15076 00000100:00100000:0.0:1746066800.350843:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1965:x1830882977153408:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066800.350847:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.350853:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.350860:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f000/0xfb36a14ee608cbf4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f2dd expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.350860:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed06200/0xfb36a14ee608cbfb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f2d6 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.350893:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135433480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976931456:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066800.350958:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066800.351740:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976931328:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066800.351758:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066800.351782:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977153280:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3961us (4471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.351790:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7759 00000100:00100000:0.0:1746066800.352087:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.352130:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977153792 00000100:00100000:1.0:1746066800.352223:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977153792 00002000:00100000:1.0:1746066800.352244:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2469888->2473983) req@ffff880135432300 x1830882977153792/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066800.352252:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135432300 with x1830882977153792 ext(2469888->2473983) 00002000:00010000:1.0:1746066800.352256:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135432300 00000100:00100000:1.0:1746066800.352267:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6854 00000100:00100000:1.0:1746066800.352271:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977153792:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066800.352374:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977153792:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 103us (289us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066800.352380:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6854 00002000:00100000:1.0:1746066800.352384:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2469888->2473983) req@ffff880135432300 x1830882977153792/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/4536 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066800.352390:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135432300 with x1830882977153792 ext(2469888->2473983) 00002000:00010000:1.0:1746066800.352392:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135432300 00010000:00010000:3.0:1746066800.352762:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 16 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.352770:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066800.352771:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066800.352774:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f000/0xfb36a14ee608cbf4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2dd expref: 16 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.352793:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 16 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.352802:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 16 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.352811:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976931584:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066800.352851:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b780 going to sleep for 11 seconds 00002000:00010000:2.0:1746066800.355280:0:8452:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime: 1746066799 -> 1746066800 00002000:00010000:2.0:1746066800.355286:0:8452:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime: 1746066799 -> 1746066800 00002000:00010000:2.0:1746066800.355287:0:8452:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime: 1746066799 -> 1746066800 00000100:00100000:2.0:1746066800.355307:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135433480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976931456:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066800.355333:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed06200/0xfb36a14ee608cbfb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2d6 expref: 22 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.355345:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed06200/0xfb36a14ee608cbfb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2d6 expref: 22 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.355355:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed06200, rc 0) 00000100:00100000:2.0:1746066800.355401:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1965:x1830882977153408:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4557us (4970us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066800.355408:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15076 00000100:00100000:3.0:1746066800.355475:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976931584:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066800.355488:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f000/0xfb36a14ee608cbf4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2dd expref: 16 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.355498:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1f000, rc 0) 00000100:00100000:3.0:1746066800.355828:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:31852:x1830882977153536:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4993us (5435us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.355833:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15075 00000100:00100000:0.0:1746066800.360354:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.362348:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977153920 00000100:00100000:3.0:1746066800.362357:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977153920 00000100:00100000:3.0:1746066800.362411:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15077 00000100:00100000:3.0:1746066800.362417:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1966:x1830882977153920:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066800.362432:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.362447:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f800/0xfb36a14ee608cc02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f2e4 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.362489:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976931712:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066800.362572:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.367429:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.367493:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976931712:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066800.367521:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f800/0xfb36a14ee608cc02 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2e4 expref: 22 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.367533:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f800/0xfb36a14ee608cc02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2e4 expref: 22 pid: 8451 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066800.367627:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977154176 00000100:00100000:1.0:1746066800.367634:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977154176 00002000:00100000:1.0:1746066800.367668:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (2469888->3145727) req@ffff880135432d80 x1830882977154176/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066800.367705:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135432d80 with x1830882977154176 ext(2469888->3145727) 00010000:00010000:1.0:1746066800.367711:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 16 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066800.367711:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066800.367836:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1f800, rc 0) 00000100:00100000:3.0:1746066800.367870:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1966:x1830882977153920:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5453us (7522us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066800.367877:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15077 00010000:00010000:1.0:1746066800.367899:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 16 pid: 8452 timeout: 861 lvb_type: 0 00002000:00010000:1.0:1746066800.367905:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135432d80 00000100:00100000:1.0:1746066800.367919:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2219 00000100:00100000:1.0:1746066800.367924:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977154176:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:2.0:1746066800.368886:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977154304 00000100:00100000:2.0:1746066800.368892:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977154304 00000100:00100000:2.0:1746066800.368924:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15078 00000100:00100000:2.0:1746066800.368929:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:31858:x1830882977154304:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066800.368938:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.368950:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f2eb expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.368970:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608cbbc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2a5 expref: 32 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.368978:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e881400/0xfb36a14ee608cbd8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ba expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.368984:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.368985:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.368988:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->3284991] (req 3145728->3284991) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 25 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.369012:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e881400/0xfb36a14ee608cbd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ba expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.369021:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e881400/0xfb36a14ee608cbd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ba expref: 25 pid: 8451 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.369035:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976931840:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066800.369134:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608cbbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2a5 expref: 32 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.369142:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608cbbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2a5 expref: 32 pid: 8451 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.369149:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976931968:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066800.369161:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066800.374791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.374813:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977154560 00000100:00100000:2.0:1746066800.374819:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977154560 00000100:00100000:3.0:1746066800.374836:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976931840:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066800.374845:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976931968:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066800.374859:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4237 00000100:00100000:2.0:1746066800.374864:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:31849:x1830882977154560:12345-192.168.202.57@tcp:35:cat.0 00010000:00010000:3.0:1746066800.374869:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->3284991] (req 3145728->3284991) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 25 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.374882:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0a5800, rc 0) 00000100:00100000:3.0:1746066800.374915:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:31858:x1830882977154304:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 5986us (7204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.374921:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15078 00000100:00100000:2.0:1746066800.375041:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:31849:x1830882977154560:12345-192.168.202.57@tcp:35:cat.0 Request processed in 175us (256us total) trans 8589944182 rc 0/0 00000100:00100000:2.0:1746066800.375047:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4237 00000100:00100000:2.0:1746066800.375085:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.375132:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977154688 00000100:00100000:3.0:1746066800.375135:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977154688 00010000:00010000:3.0:1746066800.375151:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881400/0xfb36a14ee608cbd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ba expref: 25 pid: 8451 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.375169:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7760 00000100:00100000:3.0:1746066800.375173:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977154688:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066800.375183:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066800.375198:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e881400/0xfb36a14ee608cbd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ba expref: 25 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.375206:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e881400/0xfb36a14ee608cbd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ba expref: 25 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.375223:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e881400/0xfb36a14ee608cbd8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2ba expref: 25 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.375234:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066800.375250:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882977154688:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 76us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.375255:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7760 00000100:00100000:2.0:1746066800.376437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.376697:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977154816 00000100:00100000:3.0:1746066800.376702:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977154816 00010000:00010000:3.0:1746066800.376718:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608cbbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2a5 expref: 33 pid: 8451 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.376746:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7761 00000100:00100000:3.0:1746066800.376751:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a530fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977154816:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066800.376759:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066800.376769:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608cbbc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2a5 expref: 33 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.376776:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608cbbc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2a5 expref: 33 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.376796:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a33200/0xfb36a14ee608cbbc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2a5 expref: 33 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.376805:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.376806:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.376812:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.376820:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.376844:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.376952:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976932096:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066800.377609:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066800.380125:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976932096:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066800.380141:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066800.381606:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a530fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977154816:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4848us (5166us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.381617:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7761 00000100:00100000:0.0:1746066800.383055:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977154176:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 15126us (15629us total) trans 21474841010 rc 0/0 00000100:00100000:0.0:1746066800.383064:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2219 00002000:00100000:0.0:1746066800.383073:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (2469888->3145727) req@ffff880135432d80 x1830882977154176/t21474841010(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/448 e 0 to 0 dl 1746066811 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066800.383081:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135432d80 with x1830882977154176 ext(2469888->3145727) 00010000:00010000:0.0:1746066800.383089:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 18 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.383101:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 18 pid: 8452 timeout: 861 lvb_type: 0 00002000:00010000:0.0:1746066800.383106:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135432d80 00000100:00100000:1.0:1746066800.383110:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.383121:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977155072 00000100:00100000:0.0:1746066800.383127:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977155072 00002000:00100000:0.0:1746066800.383150:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3280896->3284991) req@ffff880092848700 x1830882977155072/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066800.383158:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092848700 with x1830882977155072 ext(3280896->3284991) 00002000:00010000:0.0:1746066800.383161:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092848700 00000100:00100000:0.0:1746066800.383873:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6855 00000100:00100000:0.0:1746066800.383880:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977155072:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066800.384000:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977155072:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 120us (889us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066800.384006:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6855 00002000:00100000:0.0:1746066800.384011:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3280896->3284991) req@ffff880092848700 x1830882977155072/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/4536 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066800.384018:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092848700 with x1830882977155072 ext(3280896->3284991) 00002000:00010000:0.0:1746066800.384020:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092848700 00000100:00100000:0.0:1746066800.385613:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.385664:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977155200 00000100:00100000:3.0:1746066800.385670:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977155200 00010000:00010000:3.0:1746066800.385713:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 18 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.385750:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7762 00000100:00100000:3.0:1746066800.385756:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977155200:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066800.385766:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066800.385780:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 18 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.385793:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 18 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.385812:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cbdf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c1 expref: 18 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.385823:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.385825:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.385831:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f000/0xfb36a14ee608cbf4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2dd expref: 17 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.385838:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f000/0xfb36a14ee608cbf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2dd expref: 17 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.385862:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f000/0xfb36a14ee608cbf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2dd expref: 17 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.385871:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976932224:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066800.385936:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066800.388737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.390020:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977155456 00000100:00100000:2.0:1746066800.390027:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977155456 00000100:00100000:2.0:1746066800.390313:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4238 00000100:00100000:2.0:1746066800.390322:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+16:31858:x1830882977155456:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066800.390595:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976932224:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066800.390609:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066800.390649:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977155200:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4893us (5040us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.390657:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7762 00000100:00100000:2.0:1746066800.390800:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:31858:x1830882977155456:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 479us (2069us total) trans 8589944183 rc 0/0 00000100:00100000:2.0:1746066800.390805:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4238 00000100:00100000:0.0:1746066800.391666:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.391771:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977155712 00000100:00100000:2.0:1746066800.391775:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977155712 00002000:00100000:2.0:1746066800.391796:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135431500 x1830882977155712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.391805:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135431500 with x1830882977155712 ext(3145728->4194303) 00002000:00010000:2.0:1746066800.391942:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135431500 00000100:00100000:2.0:1746066800.391957:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6856 00000100:00100000:2.0:1746066800.391964:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977155712:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066800.402713:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977155712:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 10740us (11039us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066800.402725:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6856 00002000:00100000:3.0:1746066800.402735:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135431500 x1830882977155712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.402744:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135431500 with x1830882977155712 ext(3145728->4194303) 00002000:00010000:3.0:1746066800.402749:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135431500 00000100:00100000:0.0:1746066800.407759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.407837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.407906:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977155840 00000100:00100000:2.0:1746066800.407913:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977155840 00000100:00100000:2.0:1746066800.407956:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977155968 00000100:00100000:2.0:1746066800.407958:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977155968 00000100:00100000:2.0:1746066800.407973:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15079 00000100:00100000:2.0:1746066800.407979:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977155840:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066800.407993:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.408006:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608cc10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f2f2 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.408048:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b471500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976932352:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066800.408111:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066800.408127:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15080 00000100:00100000:2.0:1746066800.408132:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+24:1966:x1830882977155968:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066800.408139:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.408153:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608cc17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f2f9 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.408176:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c394700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976932480:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066800.408194:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ce40 going to sleep for 11 seconds 00002000:00010000:2.0:1746066800.410287:0:8451:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime: 1746066799 -> 1746066800 00002000:00010000:2.0:1746066800.410292:0:8451:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime: 1746066799 -> 1746066800 00002000:00010000:2.0:1746066800.410294:0:8451:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime: 1746066799 -> 1746066800 00002000:00010000:3.0:1746066800.410299:0:10402:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime: 1746066799 -> 1746066800 00002000:00010000:3.0:1746066800.410301:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime: 1746066799 -> 1746066800 00002000:00010000:3.0:1746066800.410302:0:10402:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime: 1746066799 -> 1746066800 00000100:00100000:3.0:1746066800.410312:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c394700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976932480:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066800.410312:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b471500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976932352:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066800.410331:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608cc17 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2f9 expref: 25 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.410331:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608cc10 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2f2 expref: 18 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.410342:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e881e00/0xfb36a14ee608cc17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2f9 expref: 25 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.410342:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608cc10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2f2 expref: 18 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.410353:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e881e00, rc 0) 00010000:00010000:2.0:1746066800.410354:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e880a00, rc 0) 00000100:00100000:3.0:1746066800.410381:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+24:1966:x1830882977155968:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2248us (2543us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066800.410381:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977155840:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2401us (2629us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066800.410387:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15079 00000100:00100000:3.0:1746066800.410390:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15080 00000100:00100000:0.0:1746066800.415144:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.416552:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977156224 00000100:00100000:3.0:1746066800.416561:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977156224 00002000:00100000:3.0:1746066800.416598:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88008efb5880 x1830882977156224/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.416608:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb5880 with x1830882977156224 ext(4194304->5091327) 00002000:00010000:3.0:1746066800.416612:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb5880 00000100:00100000:3.0:1746066800.416642:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6857 00000100:00100000:3.0:1746066800.416648:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882977156224:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066800.426041:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882977156224:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9385us (10896us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066800.426052:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6857 00002000:00100000:3.0:1746066800.426062:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88008efb5880 x1830882977156224/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/440 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.426071:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb5880 with x1830882977156224 ext(4194304->5091327) 00002000:00010000:3.0:1746066800.426076:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb5880 00000100:00100000:0.0:1746066800.429223:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.429314:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977156352 00000100:00100000:2.0:1746066800.429322:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977156352 00000100:00100000:2.0:1746066800.429370:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15081 00000100:00100000:2.0:1746066800.429377:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977156352:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066800.429391:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.429405:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608cc1e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f300 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.429446:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976932608:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066800.429515:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.430772:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.430847:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977156480 00000100:00100000:3.0:1746066800.430852:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977156480 00000100:00100000:3.0:1746066800.430936:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15082 00000100:00100000:3.0:1746066800.430942:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+24:1966:x1830882977156480:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066800.430953:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.430963:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608cc25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f307 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.431021:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976932736:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066800.431112:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.432306:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.432528:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977156736 00000100:00100000:2.0:1746066800.432533:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977156736 00000100:00100000:2.0:1746066800.432576:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10105 00000100:00100000:2.0:1746066800.432582:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:31865:x1830882977156736:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066800.432596:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.432607:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880000/0xfb36a14ee608cc2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f30e expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.432709:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.432722:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608cb6f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f274 expref: 16 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.432728:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094800/0xfb36a14ee608cb92 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f27b expref: 262 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.432733:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.432751:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094800/0xfb36a14ee608cb92 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f27b expref: 262 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.432761:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094800/0xfb36a14ee608cb92 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f27b expref: 262 pid: 14549 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.432775:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c396680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976932864:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066800.432959:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608cb6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f274 expref: 16 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.432967:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608cb6f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f274 expref: 16 pid: 14550 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.432974:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c397800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976932992:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066800.432992:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066800.434191:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976932608:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066800.434193:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976932736:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066800.434211:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608cc1e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f300 expref: 18 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.434211:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608cc25 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f307 expref: 25 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.434221:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e880e00/0xfb36a14ee608cc1e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f300 expref: 18 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.434225:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608cc25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f307 expref: 25 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.434233:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e880e00, rc 0) 00010000:00010000:2.0:1746066800.434247:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1f400, rc 0) 00000100:00100000:3.0:1746066800.434257:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977156352:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4880us (5040us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066800.434264:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15081 00000100:00100000:2.0:1746066800.434265:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+24:1966:x1830882977156480:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3323us (3495us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066800.434271:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15082 00000100:00100000:2.0:1746066800.439310:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.439340:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.439355:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977156992 00000100:00100000:3.0:1746066800.439356:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977156864 00000100:00100000:2.0:1746066800.439361:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977156992 00000100:00100000:3.0:1746066800.439362:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977156864 00010000:00010000:3.0:1746066800.439390:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094800/0xfb36a14ee608cb92 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f27b expref: 263 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.439390:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608cb6f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f274 expref: 17 pid: 14550 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066800.439805:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c396680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976932864:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066800.439815:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c397800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976932992:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066800.439831:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746066800.439895:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7763 00000100:00100000:3.0:1746066800.439903:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7764 00000100:00100000:2.0:1746066800.439903:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977156992:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066800.439910:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:1964:x1830882977156864:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066800.439913:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066800.439918:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066800.439918:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608cb6f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f274 expref: 17 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.439923:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094800/0xfb36a14ee608cb92 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f27b expref: 263 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.439927:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608cb6f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f274 expref: 17 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.439935:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094800/0xfb36a14ee608cb92 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f27b expref: 263 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.440026:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a32800/0xfb36a14ee608cb6f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f274 expref: 17 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.440032:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f094800/0xfb36a14ee608cb92 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f27b expref: 263 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.440147:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066800.440151:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.440159:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.440164:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.440171:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:3.0:1746066800.440174:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066800.440220:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:1964:x1830882977156864:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 310us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.440226:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7764 00010000:00010000:2.0:1746066800.440269:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066800.440288:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977156992:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 386us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.440293:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7763 00000100:00100000:1.0:1746066800.440307:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.440359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.440404:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977157120 00000100:00100000:3.0:1746066800.440407:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977157120 00000100:00100000:3.0:1746066800.440714:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977157248 00000100:00100000:3.0:1746066800.440717:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977157248 00010000:00010000:0.0:1746066800.440721:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066800.440726:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746066800.440737:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15083 00000004:00200000:0.0:1746066800.440741:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000100:00100000:3.0:1746066800.440742:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977157120:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066800.440753:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.440763:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608cc3a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f315 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.440794:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976933120:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066800.440857:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e880000/0xfb36a14ee608cc2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f30e expref: 263 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.440873:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f30e expref: 262 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.440879:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:0.0:1746066800.440881:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066800.440883:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e881600, rc 0) 00000100:00100000:0.0:1746066800.440912:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:31865:x1830882977156736:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 8329us (8607us total) trans 8589944184 rc 0/0 00000100:00100000:0.0:1746066800.440917:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10105 00000100:00100000:1.0:1746066800.440965:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15084 00000100:00100000:1.0:1746066800.440972:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+24:1966:x1830882977157248:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066800.440978:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.440986:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fdac000/0xfb36a14ee608cc48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f31c expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.441007:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976933248:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066800.441107:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52decc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066800.441198:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066800.443473:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976933120:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066800.443496:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608cc3a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f315 expref: 18 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.443507:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608cc3a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f315 expref: 18 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.443519:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1e000, rc 0) 00000100:00100000:1.0:1746066800.443555:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976933248:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066800.443567:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977157120:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2823us (3259us total) trans 0 rc 301/301 00010000:00010000:1.0:1746066800.443571:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fdac000/0xfb36a14ee608cc48 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f31c expref: 25 pid: 8112 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066800.443573:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15083 00010000:00010000:1.0:1746066800.443580:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fdac000/0xfb36a14ee608cc48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f31c expref: 25 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.443591:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fdac000, rc 0) 00000100:00100000:1.0:1746066800.443608:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+24:1966:x1830882977157248:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2638us (3250us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066800.443613:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15084 00000100:00100000:0.0:1746066800.450083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.450258:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977157504 00000100:00100000:2.0:1746066800.450265:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977157504 00000100:00100000:2.0:1746066800.450296:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4239 00000100:00100000:2.0:1746066800.450303:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093217450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+16:31852:x1830882977157504:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066800.450474:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093217450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:31852:x1830882977157504:12345-192.168.202.57@tcp:35:cat.0 Request processed in 170us (397us total) trans 8589944185 rc 0/0 00000100:00100000:2.0:1746066800.450479:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4239 00000100:00100000:0.0:1746066800.470094:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.471753:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977157760 00000100:00100000:3.0:1746066800.471762:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977157760 00002000:00100000:3.0:1746066800.471804:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1490944->1495039) req@ffff88008efb7b80 x1830882977157760/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.471815:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb7b80 with x1830882977157760 ext(1490944->1495039) 00002000:00010000:3.0:1746066800.471820:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb7b80 00000100:00100000:3.0:1746066800.471848:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6858 00000100:00100000:3.0:1746066800.471854:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882977157760:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066800.472002:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882977157760:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 147us (1915us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066800.472008:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6858 00002000:00100000:3.0:1746066800.472014:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1490944->1495039) req@ffff88008efb7b80 x1830882977157760/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/4536 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066800.472021:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb7b80 with x1830882977157760 ext(1490944->1495039) 00002000:00010000:3.0:1746066800.472024:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb7b80 00000100:00100000:0.0:1746066800.478020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.478089:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977158016 00000100:00100000:2.0:1746066800.478097:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977158016 00002000:00100000:2.0:1746066800.478132:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1957888->1961983) req@ffff88008efb4380 x1830882977158016/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.478141:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb4380 with x1830882977158016 ext(1957888->1961983) 00002000:00010000:2.0:1746066800.478146:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb4380 00000100:00100000:2.0:1746066800.478175:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6859 00000100:00100000:2.0:1746066800.478182:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977158016:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066800.479330:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977158016:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 1144us (1313us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066800.479337:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6859 00002000:00100000:2.0:1746066800.479344:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1957888->1961983) req@ffff88008efb4380 x1830882977158016/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 488/4536 e 0 to 0 dl 1746066811 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.479351:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb4380 with x1830882977158016 ext(1957888->1961983) 00002000:00010000:2.0:1746066800.479355:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb4380 00000100:00100000:0.0:1746066800.500319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.501135:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977158144 00000100:00100000:1.0:1746066800.501142:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977158144 00000100:00100000:1.0:1746066800.501189:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10106 00000100:00100000:1.0:1746066800.501195:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31868:x1830882977158144:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066800.501215:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.501398:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac800/0xfb36a14ee608cc4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f323 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.501455:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cc56 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.501465:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cc56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.501475:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cc56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.501487:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdacc00/0xfb36a14ee608cc5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.501492:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdacc00/0xfb36a14ee608cc5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.501496:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdacc00/0xfb36a14ee608cc5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.501591:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.501599:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f30e expref: 261 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.501605:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.501630:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f30e expref: 261 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.501639:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f30e expref: 261 pid: 14549 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.501654:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976933376:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.502829:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52decc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066800.509037:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976933376:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.509068:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066800.521348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.524604:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977158400 00000100:00100000:3.0:1746066800.524619:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977158400 00000100:00100000:3.0:1746066800.524692:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4240 00000100:00100000:3.0:1746066800.524701:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:7643:x1830882977158400:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746066800.524963:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:7643:x1830882977158400:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 263us (3626us total) trans 8589944186 rc 0/0 00000100:00100000:3.0:1746066800.524971:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4240 00000100:00100000:3.0:1746066800.535955:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.536066:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977158528 00000100:00100000:2.0:1746066800.536076:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977158528 00010000:00010000:2.0:1746066800.536115:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f30e expref: 263 pid: 14549 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.536145:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7765 00000100:00100000:2.0:1746066800.536152:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:1964:x1830882977158528:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066800.536164:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066800.536170:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f30e expref: 263 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.536180:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f30e expref: 263 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.536200:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881600/0xfb36a14ee608cc33 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f30e expref: 263 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.536226:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066800.536231:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.536241:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.536248:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066800.536270:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066800.536311:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:1964:x1830882977158528:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 160us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.536316:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7765 00010000:00010000:1.0:1746066800.536559:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536567:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746066800.536611:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:1.0:1746066800.536615:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746066800.536631:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536641:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536649:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cc56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536655:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cc56 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536660:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cc56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536665:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fdaca00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066800.536669:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cc56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536692:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cc56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536701:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066800.536703:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066800.536706:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cc56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536710:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cc56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536732:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdacc00/0xfb36a14ee608cc5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536736:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdacc00/0xfb36a14ee608cc5d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536741:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdacc00/0xfb36a14ee608cc5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536744:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fdacc00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066800.536746:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdacc00/0xfb36a14ee608cc5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536750:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdacc00/0xfb36a14ee608cc5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536755:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009d6bdd00) 00010000:00010000:1.0:1746066800.536757:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066800.536759:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdacc00/0xfb36a14ee608cc5d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536763:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdacc00/0xfb36a14ee608cc5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.536796:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac800/0xfb36a14ee608cc4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f323 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.536806:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f323 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.536812:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:1.0:1746066800.536813:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066800.536815:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fdace00, rc 0) 00000100:00100000:1.0:1746066800.536851:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31868:x1830882977158144:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 35656us (36539us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.536857:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10106 00000100:00100000:0.0:1746066800.540335:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.541724:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.541824:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977158656 00000100:00100000:3.0:1746066800.541834:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977158656 00000100:00100000:3.0:1746066800.541886:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977158784 00000100:00100000:3.0:1746066800.541888:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977158784 00000100:00100000:3.0:1746066800.541913:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15085 00000100:00100000:3.0:1746066800.541921:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977158656:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066800.541941:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.541960:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cc6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f32a expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.541986:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.541989:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.541997:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cc6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f32a expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.542011:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cc6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f32a expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.542022:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1fc00, rc 0) 00000100:00100000:3.0:1746066800.542068:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977158656:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 148us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.542073:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15085 00000100:00100000:3.0:1746066800.542087:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15086 00000100:00100000:3.0:1746066800.542092:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977158784:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066800.542099:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.542109:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fe00/0xfb36a14ee608cc72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f331 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.542149:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976933504:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066800.542211:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.544961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.544991:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.545531:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.545568:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977158912 00000100:00100000:2.0:1746066800.545576:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977158912 00000100:00100000:1.0:1746066800.545632:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977159168 00000100:00100000:1.0:1746066800.545635:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977159168 00000100:00100000:1.0:1746066800.545660:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15087 00000100:00100000:1.0:1746066800.545667:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977158912:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066800.545706:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.545724:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fdad200/0xfb36a14ee608cc79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f338 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.545748:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.545750:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.545758:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fdad200/0xfb36a14ee608cc79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f338 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.545774:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fdad200/0xfb36a14ee608cc79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f338 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.545790:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fdad200, rc 0) 00000100:00100000:1.0:1746066800.545833:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977158912:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 167us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.545839:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15087 00000100:00100000:1.0:1746066800.545854:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15088 00000100:00100000:1.0:1746066800.545858:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977159168:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066800.545865:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.545875:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fdade00/0xfb36a14ee608cc80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f346 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.545887:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.545888:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.545892:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fdade00/0xfb36a14ee608cc80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f346 expref: 12 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.545902:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fdade00/0xfb36a14ee608cc80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f346 expref: 12 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.545908:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fdade00, rc 0) 00000100:00100000:1.0:1746066800.545920:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882977159168:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 62us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.545925:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15088 00000100:00100000:3.0:1746066800.546711:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977159040 00000100:00100000:3.0:1746066800.546717:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977159040 00000100:00100000:3.0:1746066800.546740:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15089 00000100:00100000:3.0:1746066800.546746:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977159040:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066800.546753:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.546762:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e881600/0xfb36a14ee608cc87 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f33f expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.546803:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976933632:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066800.546860:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066800.547752:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976933504:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066800.547776:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fe00/0xfb36a14ee608cc72 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f331 expref: 11 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.547787:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1fe00/0xfb36a14ee608cc72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f331 expref: 11 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.547802:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1fe00, rc 0) 00000100:00100000:2.0:1746066800.547826:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977158784:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 5734us (6109us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066800.547832:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15086 00000100:00100000:3.0:1746066800.552717:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976933632:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066800.554293:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e881600/0xfb36a14ee608cc87 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f33f expref: 11 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.554312:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e881600/0xfb36a14ee608cc87 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f33f expref: 11 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.554343:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e881600, rc 0) 00000100:00100000:3.0:1746066800.554415:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977159040:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 7668us (8883us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066800.554426:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15089 00000100:00100000:0.0:1746066800.562101:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.562507:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977159424 00000100:00100000:1.0:1746066800.562518:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977159424 00000100:00100000:1.0:1746066800.562581:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10107 00000100:00100000:1.0:1746066800.562590:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31868:x1830882977159424:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066800.562611:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.562630:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cc8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f34d expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.562763:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.562778:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f323 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.562785:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.562816:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f323 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.562827:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f323 expref: 10 pid: 14549 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.562839:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976933760:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.562922:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52decc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066800.564722:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976933760:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.564743:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066800.565774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.566587:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977159552 00000100:00100000:3.0:1746066800.566596:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977159552 00010000:00010000:3.0:1746066800.566632:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f323 expref: 11 pid: 14549 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.566667:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7766 00000100:00100000:3.0:1746066800.566689:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977159552:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066800.566862:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066800.566868:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f323 expref: 11 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.566879:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f323 expref: 11 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.566900:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cc64 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f323 expref: 11 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.567047:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:3.0:1746066800.567052:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.567061:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.567068:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.567261:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066800.567305:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977159552:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 631us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.567312:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7766 00010000:00010000:1.0:1746066800.567365:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.567373:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746066800.567393:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066800.567550:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cc8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f34d expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.567577:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f34d expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.567583:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:1.0:1746066800.567585:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066800.567587:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fdac600, rc 0) 00000100:00100000:1.0:1746066800.567611:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31868:x1830882977159424:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 5023us (5521us total) trans 8589944187 rc 0/0 00000100:00100000:1.0:1746066800.567617:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10107 00000100:00100000:0.0:1746066800.569802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.570042:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977159680 00000100:00100000:1.0:1746066800.570051:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977159680 00000100:00100000:1.0:1746066800.570486:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10108 00000100:00100000:1.0:1746066800.570494:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31868:x1830882977159680:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066800.570517:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.570544:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdada00/0xfb36a14ee608cca3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f354 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.570624:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad800/0xfb36a14ee608ccaa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.570637:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f34d expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.570643:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad800/0xfb36a14ee608ccaa lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.570673:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f34d expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.570698:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f34d expref: 11 pid: 14549 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.570709:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976933888:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.571429:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52decc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.573918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.574023:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976933888:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.574047:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad800/0xfb36a14ee608ccaa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746066800.574117:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977159808 00000100:00100000:3.0:1746066800.574123:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977159808 00010000:00010000:3.0:1746066800.574154:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f34d expref: 12 pid: 14549 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.574192:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7767 00000100:00100000:3.0:1746066800.574199:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882977159808:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066800.574213:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066800.574219:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f34d expref: 12 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.574229:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f34d expref: 12 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.574250:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac600/0xfb36a14ee608cc95 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f34d expref: 12 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.574267:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:3.0:1746066800.574271:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad800/0xfb36a14ee608ccaa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.574281:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad800/0xfb36a14ee608ccaa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.574296:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad800/0xfb36a14ee608ccaa lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.575130:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066800.575176:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977159808:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 977us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.575184:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7767 00010000:00010000:1.0:1746066800.575672:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad800/0xfb36a14ee608ccaa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.575849:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad800/0xfb36a14ee608ccaa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746066800.575898:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:1.0:1746066800.575903:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746066800.575920:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad800/0xfb36a14ee608ccaa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.576574:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdada00/0xfb36a14ee608cca3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f354 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.576590:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad800/0xfb36a14ee608ccaa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f354 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.576605:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:1.0:1746066800.576608:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066800.576611:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fdad800, rc 0) 00000100:00100000:1.0:1746066800.576665:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31868:x1830882977159680:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 6172us (6870us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.576672:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10108 00000100:00100000:0.0:1746066800.579064:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.579114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.579218:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977159936 00000100:00100000:2.0:1746066800.579227:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977159936 00000100:00100000:2.0:1746066800.579265:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977160064 00000100:00100000:2.0:1746066800.579267:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977160064 00000100:00100000:2.0:1746066800.579291:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15090 00000100:00100000:2.0:1746066800.579299:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977159936:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066800.579315:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.579330:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135f31400/0xfb36a14ee608ccb1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f35b expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.579386:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c394000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976934016:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066800.579454:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066800.579474:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15091 00000100:00100000:2.0:1746066800.579478:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977160064:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066800.579485:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066800.579496:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135f31a00/0xfb36a14ee608ccb8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f362 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.579522:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c395500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976934144:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066800.579546:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066800.582290:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c395500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976934144:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066800.582321:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135f31a00/0xfb36a14ee608ccb8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f362 expref: 11 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.582335:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135f31a00/0xfb36a14ee608ccb8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f362 expref: 11 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.582345:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f31a00, rc 0) 00000100:00100000:3.0:1746066800.582386:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977160064:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2906us (3271us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066800.582393:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15091 00000100:00100000:2.0:1746066800.582491:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c394000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976934016:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066800.582505:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135f31400/0xfb36a14ee608ccb1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f35b expref: 11 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.582513:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135f31400/0xfb36a14ee608ccb1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f35b expref: 11 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.582542:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f31400, rc 0) 00000100:00100000:2.0:1746066800.582557:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977159936:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 3260us (3502us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066800.582562:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15090 00000100:00100000:0.0:1746066800.584980:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.585161:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977160320 00000100:00100000:1.0:1746066800.585170:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977160320 00000100:00100000:1.0:1746066800.585258:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10109 00000100:00100000:1.0:1746066800.585267:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31868:x1830882977160320:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066800.585287:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066800.585305:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad600/0xfb36a14ee608ccbf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f369 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.585402:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad400/0xfb36a14ee608ccc6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.585416:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad400/0xfb36a14ee608ccc6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.585427:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad400/0xfb36a14ee608ccc6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746066800.585436:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066800.585571:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad600/0xfb36a14ee608ccbf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f369 expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.585587:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad400/0xfb36a14ee608ccc6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f369 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.585595:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:1.0:1746066800.585597:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066800.585600:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fdad400, rc 0) 00000100:00100000:1.0:1746066800.585646:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31868:x1830882977160320:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 380us (673us total) trans 8589944188 rc 0/0 00000100:00100000:1.0:1746066800.585652:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10109 00000100:00100000:0.0:1746066800.589752:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.589784:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.589800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.589812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.589823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.589841:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.589902:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977160448 00000100:00100000:1.0:1746066800.589912:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977160448 00000100:00100000:1.0:1746066800.589951:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977160576 00000100:00100000:1.0:1746066800.589953:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977160576 00000100:00100000:1.0:1746066800.589965:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977160704 00000100:00100000:1.0:1746066800.589966:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977160704 00000100:00100000:1.0:1746066800.589975:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977160832 00000100:00100000:1.0:1746066800.589976:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977160832 00000100:00100000:1.0:1746066800.589985:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977160960 00000100:00100000:1.0:1746066800.589986:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977160960 00000100:00100000:1.0:1746066800.589992:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977161088 00000100:00100000:1.0:1746066800.589993:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977161088 00000100:00100000:1.0:1746066800.590005:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15092 00000100:00100000:1.0:1746066800.590012:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977160448:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:1.0:1746066800.590056:0:9776:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fdac800/0xfb36a14ee608ccd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.590074:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608cadc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f219 expref: 31 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.590082:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cc6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f32a expref: 12 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.590094:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a489fa00/0xfb36a14ee608cb37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f251 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.590100:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.590102:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.590104:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fdac800/0xfb36a14ee608ccd4 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.590134:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a489fa00/0xfb36a14ee608cb37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f251 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.590145:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a489fa00/0xfb36a14ee608cb37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f251 expref: 23 pid: 10402 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.590158:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976934272:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.590238:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cc6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f32a expref: 12 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.590246:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cc6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f32a expref: 12 pid: 10402 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746066800.590254:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976934400:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.590280:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608cadc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f219 expref: 31 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.590293:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608cadc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f219 expref: 31 pid: 10402 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.590300:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976934528:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.590314:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52decc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066800.590340:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15093 00000100:00100000:1.0:1746066800.590345:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977160576:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:1.0:1746066800.590366:0:20532:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608ccdb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.590376:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ed4800/0xfb36a14ee608c819 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f06e expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.590382:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b47c00/0xfb36a14ee608c91c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d7 expref: 16 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.590388:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9600/0xfb36a14ee608c915 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d0 expref: 20 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.590393:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.590394:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.590396:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608ccdb lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.590413:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9600/0xfb36a14ee608c915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d0 expref: 20 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.590421:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9600/0xfb36a14ee608c915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d0 expref: 20 pid: 20532 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.590430:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976934656:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.590452:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b47c00/0xfb36a14ee608c91c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d7 expref: 16 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.590459:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b47c00/0xfb36a14ee608c91c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d7 expref: 16 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.590466:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976934784:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.590482:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ed4800/0xfb36a14ee608c819 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f06e expref: 12 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066800.590488:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ed4800/0xfb36a14ee608c819 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f06e expref: 12 pid: 8451 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746066800.590495:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976934912:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.590506:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066800.590566:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15094 00000100:00100000:2.0:1746066800.590574:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977160704:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066800.590591:0:8112:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee608cce2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.590600:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.590605:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066800.590606:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066800.590608:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee608cce2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.590622:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1130495) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.590628:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1130495) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 20 pid: 8112 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.590635:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c394000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976935040:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066800.590653:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066800.590667:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15095 00000100:00100000:2.0:1746066800.590671:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977160832:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066800.590706:0:8452:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135f31400/0xfb36a14ee608cce9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.590715:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608cb4c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f266 expref: 23 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.590721:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fdad200/0xfb36a14ee608cc79 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f338 expref: 12 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.590727:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608cbe6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c8 expref: 31 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.590731:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.590732:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.590735:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f31400/0xfb36a14ee608cce9 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.590746:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608cbe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c8 expref: 31 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.590752:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608cbe6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c8 expref: 31 pid: 8452 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746066800.590759:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c397b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976935168:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066800.590783:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fdad200/0xfb36a14ee608cc79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f338 expref: 12 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066800.590790:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fdad200/0xfb36a14ee608cc79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f338 expref: 12 pid: 8112 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746066800.590796:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c395f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976935296:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066800.590810:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608cb4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f266 expref: 23 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.590817:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608cb4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f266 expref: 23 pid: 8112 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.590823:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c396d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976935424:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066800.590832:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066800.590936:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15096 00000100:00100000:3.0:1746066800.590943:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977160960:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066800.590959:0:21973:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ccf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.590969:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.590975:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608cb53 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f26d expref: 31 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.590986:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608cbc3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f29e expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.590991:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746066800.590993:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:3.0:1746066800.590995:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ccf0 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.591008:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608cbc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f29e expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.591016:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608cbc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f29e expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.591023:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976935552:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066800.591044:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608cb53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f26d expref: 31 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.591051:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608cb53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f26d expref: 31 pid: 8112 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.591057:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976935680:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066800.591072:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.591083:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.591090:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e869880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976935808:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066800.591100:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066800.591117:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15097 00000100:00100000:3.0:1746066800.591123:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977161088:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066800.591139:0:4614:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccf7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.591149:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f000/0xfb36a14ee608cbf4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2dd expref: 16 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.591156:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fdade00/0xfb36a14ee608cc80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f346 expref: 12 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.591161:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.591162:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.591163:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccf7 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.591176:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fdade00/0xfb36a14ee608cc80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f346 expref: 12 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.591183:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fdade00/0xfb36a14ee608cc80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f346 expref: 12 pid: 8112 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746066800.591191:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976935936:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066800.591209:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f000/0xfb36a14ee608cbf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2dd expref: 16 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.591216:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f000/0xfb36a14ee608cbf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2dd expref: 16 pid: 8451 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.591223:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976936064:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066800.591234:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.596990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.597155:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976934272:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.597167:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976934400:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.597175:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:9776:1830882976934528:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.597207:0:9776:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012fdac800/0xfb36a14ee608ccd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.599419:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.599573:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976934656:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066800.599585:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976934784:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066800.599594:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976934912:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066800.599619:0:20532:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608ccdb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.599649:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977161344 00000100:00100000:2.0:1746066800.599656:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977161344 00010000:00010000:2.0:1746066800.599710:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a489fa00/0xfb36a14ee608cb37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f251 expref: 24 pid: 10402 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.601876:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977161472 00000100:00100000:2.0:1746066800.601888:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977161472 00010000:00010000:2.0:1746066800.601924:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed4800/0xfb36a14ee608c819 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f06e expref: 13 pid: 8451 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746066800.602108:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7768 00000100:00100000:2.0:1746066800.602117:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a530f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882977161344:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066800.602132:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066800.602158:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a489fa00/0xfb36a14ee608cb37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f251 expref: 24 pid: 10402 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.602171:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a489fa00/0xfb36a14ee608cb37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f251 expref: 24 pid: 10402 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.602195:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a489fa00/0xfb36a14ee608cb37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f251 expref: 24 pid: 10402 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.602296:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7769 00000100:00100000:3.0:1746066800.602305:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099712d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1966:x1830882977161472:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066800.602314:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066800.602328:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093ed4800/0xfb36a14ee608c819 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f06e expref: 13 pid: 8451 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746066800.602336:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093ed4800/0xfb36a14ee608c819 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f06e expref: 13 pid: 8451 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746066800.602349:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ed4800/0xfb36a14ee608c819 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f06e expref: 13 pid: 8451 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746066800.602795:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066800.602863:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a530f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:1965:x1830882977161344:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 746us (5882us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.602871:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7768 00010000:00010000:3.0:1746066800.603164:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066800.603185:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099712d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1966:x1830882977161472:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 881us (3772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.603194:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7769 00000100:00100000:3.0:1746066800.605737:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e869880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976935808:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066800.605823:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c394000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976935040:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066800.605845:0:8112:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee608cce2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.611093:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.611646:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c397b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976935168:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066800.611657:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c395f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976935296:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066800.611665:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c396d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976935424:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066800.611705:0:8452:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135f31400/0xfb36a14ee608cce9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.611849:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977161216 00000100:00100000:3.0:1746066800.611856:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977161216 00010000:00010000:3.0:1746066800.611892:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cc6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f32a expref: 13 pid: 10402 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746066800.611929:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7770 00000100:00100000:3.0:1746066800.611936:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882977161216:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066800.611951:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066800.611976:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cc6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f32a expref: 13 pid: 10402 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746066800.611987:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cc6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f32a expref: 13 pid: 10402 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746066800.612011:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1fc00/0xfb36a14ee608cc6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f32a expref: 13 pid: 10402 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746066800.612159:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.612203:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976935936:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.612220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.612242:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976936064:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.612264:0:4614:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccf7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.612283:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066800.612493:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066800.612517:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976935552:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066800.612524:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976935680:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066800.612548:0:21973:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ccf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.613514:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882977161216:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1575us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.613525:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7770 00000100:00100000:3.0:1746066800.613560:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977162112 00000100:00100000:3.0:1746066800.613565:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977162112 00010000:00010000:3.0:1746066800.613585:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b47c00/0xfb36a14ee608c91c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d7 expref: 17 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.613634:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977162240 00000100:00100000:2.0:1746066800.613637:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977162240 00010000:00010000:2.0:1746066800.613652:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fdade00/0xfb36a14ee608cc80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f346 expref: 12 pid: 8112 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746066800.613672:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977162368 00000100:00100000:2.0:1746066800.613687:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977162368 00010000:00010000:2.0:1746066800.613699:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608cb53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f26d expref: 32 pid: 8112 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746066800.613719:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7771 00000100:00100000:2.0:1746066800.613726:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977162112:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066800.613737:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066800.613756:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b47c00/0xfb36a14ee608c91c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d7 expref: 17 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.613765:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b47c00/0xfb36a14ee608c91c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d7 expref: 17 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.613783:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b47c00/0xfb36a14ee608c91c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d7 expref: 17 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.613798:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066800.613974:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.613989:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.613999:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.614011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.614026:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.614045:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977161728 00000100:00100000:1.0:1746066800.614048:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977161728 00002000:00100000:1.0:1746066800.614078:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->3284991) req@ffff8800929ced80 x1830882977161728/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066800.614494:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977161600 00000100:00100000:0.0:1746066800.614498:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977161600 00010000:00010000:0.0:1746066800.614514:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9600/0xfb36a14ee608c915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d0 expref: 21 pid: 20532 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066800.614525:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977161984 00000100:00100000:0.0:1746066800.614527:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977161984 00010000:00010000:0.0:1746066800.614550:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fdad200/0xfb36a14ee608cc79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f338 expref: 12 pid: 8112 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746066800.614560:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977162496 00000100:00100000:0.0:1746066800.614563:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977162496 00010000:00010000:0.0:1746066800.614570:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608cb4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f266 expref: 24 pid: 8112 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066800.614579:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977161856 00000100:00100000:0.0:1746066800.614581:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977161856 00010000:00010000:0.0:1746066800.614588:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608cbe6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c8 expref: 33 pid: 8452 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746066800.614597:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7772 00000100:00100000:0.0:1746066800.614602:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977162240:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.614609:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.614620:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fdade00/0xfb36a14ee608cc80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f346 expref: 12 pid: 8112 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746066800.614628:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fdade00/0xfb36a14ee608cc80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f346 expref: 12 pid: 8112 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746066800.614641:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fdade00/0xfb36a14ee608cc80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f346 expref: 12 pid: 8112 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746066800.614655:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.614692:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1965:x1830882977162240:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 90us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.614698:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7772 00000100:00100000:0.0:1746066800.614710:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7773 00000100:00100000:0.0:1746066800.614714:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1966:x1830882977162368:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.614721:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.614735:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608cb53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f26d expref: 33 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.614743:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608cb53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f26d expref: 33 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.614755:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f094c00/0xfb36a14ee608cb53 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f26d expref: 33 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.614764:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.614777:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882977162368:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 63us (2493us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.614781:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7773 00000100:00100000:0.0:1746066800.614790:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7774 00000100:00100000:0.0:1746066800.614794:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882977161600:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.614801:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.614808:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9600/0xfb36a14ee608c915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d0 expref: 21 pid: 20532 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.614816:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9600/0xfb36a14ee608c915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d0 expref: 21 pid: 20532 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.614825:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e9600/0xfb36a14ee608c915 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0d0 expref: 21 pid: 20532 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.614833:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.614834:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.614839:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608ccdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.614847:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608ccdb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.614868:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.614880:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977161600:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 86us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.614884:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7774 00000100:00100000:0.0:1746066800.614895:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7775 00000100:00100000:0.0:1746066800.614900:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a530f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882977161984:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.614906:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.614915:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fdad200/0xfb36a14ee608cc79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f338 expref: 12 pid: 8112 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746066800.614922:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fdad200/0xfb36a14ee608cc79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f338 expref: 12 pid: 8112 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746066800.614932:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fdad200/0xfb36a14ee608cc79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f338 expref: 12 pid: 8112 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746066800.614940:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.614953:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a530f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977161984:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 53us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.614958:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7775 00000100:00100000:0.0:1746066800.614966:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7776 00000100:00100000:0.0:1746066800.614972:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882977162496:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.614977:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.614983:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608cb4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f266 expref: 24 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.614990:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608cb4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f266 expref: 24 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.614999:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cad1c00/0xfb36a14ee608cb4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f266 expref: 24 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.615006:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.615017:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882977162496:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 46us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.615021:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7776 00000100:00100000:0.0:1746066800.615029:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7777 00000100:00100000:0.0:1746066800.615033:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977161856:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.615038:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.615044:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608cbe6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c8 expref: 31 pid: 8452 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746066800.615051:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608cbe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c8 expref: 31 pid: 8452 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746066800.615059:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608cbe6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2c8 expref: 31 pid: 8452 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746066800.615071:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.615072:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.615075:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f31400/0xfb36a14ee608cce9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615081:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f31400/0xfb36a14ee608cce9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615094:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.615106:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977161856:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 73us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.615111:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7777 00010000:00010000:0.0:1746066800.615132:0:8452:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135f31400/0xfb36a14ee608cce9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615140:0:8452:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135f31400/0xfb36a14ee608cce9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615160:0:8452:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135f31400/0xfb36a14ee608cce9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615167:0:8452:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135f31400/0xfb36a14ee608cce9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615173:0:8452:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135f31400/0xfb36a14ee608cce9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615184:0:8452:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f31400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066800.615187:0:8452:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135f31400/0xfb36a14ee608cce9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615195:0:8452:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135f31400/0xfb36a14ee608cce9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615204:0:8452:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135f31400/0xfb36a14ee608cce9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615210:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135f31400/0xfb36a14ee608cce9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.615250:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1965:x1830882977160832:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 24578us (25436us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.615257:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15095 00000100:00100000:0.0:1746066800.615295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.615308:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977162752 00000100:00100000:0.0:1746066800.615310:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977162752 00010000:00010000:0.0:1746066800.615321:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608cadc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f219 expref: 30 pid: 10402 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066800.615331:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7778 00000100:00100000:0.0:1746066800.615335:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099713800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977162752:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.615341:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.615351:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608cadc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f219 expref: 30 pid: 10402 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.615358:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608cadc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f219 expref: 30 pid: 10402 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.615366:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4f24e00/0xfb36a14ee608cadc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f219 expref: 30 pid: 10402 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.615373:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.615375:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.615377:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fdac800/0xfb36a14ee608ccd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615382:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fdac800/0xfb36a14ee608ccd4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615401:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.615411:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099713800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977162752:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 75us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.615416:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7778 00000100:00100000:0.0:1746066800.615454:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.615463:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977162624 00000100:00100000:0.0:1746066800.615465:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977162624 00010000:00010000:0.0:1746066800.615472:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608cbc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f29e expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066800.615482:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7779 00000100:00100000:0.0:1746066800.615485:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882977162624:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.615491:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.615496:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608cbc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f29e expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.615503:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608cbc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f29e expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.615511:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608cbc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f29e expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.615518:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.615526:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977162624:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 40us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.615530:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7779 00000100:00100000:0.0:1746066800.615566:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.615573:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977163008 00000100:00100000:0.0:1746066800.615575:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977163008 00010000:00010000:0.0:1746066800.615583:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f000/0xfb36a14ee608cbf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2dd expref: 17 pid: 8451 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066800.615592:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7780 00000100:00100000:0.0:1746066800.615595:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099711f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977163008:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.615599:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.615604:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f000/0xfb36a14ee608cbf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2dd expref: 17 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.615611:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f000/0xfb36a14ee608cbf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2dd expref: 17 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.615621:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1f000/0xfb36a14ee608cbf4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2dd expref: 17 pid: 8451 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.615627:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.615629:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.615631:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615637:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccf7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615647:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.615654:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099711f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882977163008:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 59us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.615658:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7780 00010000:00010000:0.0:1746066800.615668:0:4614:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615690:0:4614:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615703:0:4614:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccf7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615708:0:4614:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccf7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615718:0:4614:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccf7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615723:0:4614:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e881000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066800.615725:0:4614:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccf7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615730:0:4614:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccf7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615736:0:4614:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccf7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.615740:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccf7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.615766:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1965:x1830882977161088:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 24643us (25923us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.615770:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15097 00000100:00100000:0.0:1746066800.615824:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.615896:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977162880 00000100:00100000:0.0:1746066800.615899:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977162880 00002000:00100000:0.0:1746066800.615918:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1097728->1961983) req@ffff880099710a80 x1830882977162880/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 504/0 e 0 to 0 dl 1746066811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066800.615927:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099710a80 with x1830882977162880 ext(1097728->1961983) 00010000:00010000:0.0:1746066800.615934:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 20 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.615942:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 20 pid: 8112 timeout: 861 lvb_type: 0 00002000:00010000:0.0:1746066800.615948:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099710a80 00000100:00100000:0.0:1746066800.615967:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2220 00000100:00100000:0.0:1746066800.615972:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977162880:12345-192.168.202.57@tcp:4:multiop.0 00002000:00100000:1.0:1746066800.618875:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929ced80 with x1830882977161728 ext(3145728->3284991) 00010000:00010000:1.0:1746066800.618893:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 21 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.618908:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 21 pid: 8452 timeout: 861 lvb_type: 0 00002000:00010000:1.0:1746066800.618916:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800929ced80 00010000:00010000:1.0:1746066800.618950:0:9776:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012fdac800/0xfb36a14ee608ccd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.618958:0:9776:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fdac800/0xfb36a14ee608ccd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.618990:0:9776:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fdac800/0xfb36a14ee608ccd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.618996:0:9776:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fdac800/0xfb36a14ee608ccd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.619003:0:9776:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fdac800/0xfb36a14ee608ccd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.619009:0:9776:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fdac800 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066800.619013:0:9776:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fdac800/0xfb36a14ee608ccd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.619020:0:9776:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fdac800/0xfb36a14ee608ccd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.619038:0:9776:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fdac800/0xfb36a14ee608ccd4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.619047:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fdac800/0xfb36a14ee608ccd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.619138:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1965:x1830882977160448:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 29126us (29396us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.619147:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15092 00000100:00100000:1.0:1746066800.619173:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2221 00000100:00100000:1.0:1746066800.619181:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977161728:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066800.620301:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882977162112:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6569us (8135us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.620310:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7771 00010000:00010000:2.0:1746066800.620379:0:20532:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608ccdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.620387:0:20532:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608ccdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.620410:0:20532:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608ccdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.620421:0:20532:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608ccdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.620428:0:20532:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608ccdb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.620433:0:20532:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a767e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066800.620436:0:20532:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608ccdb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.620444:0:20532:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608ccdb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.620455:0:20532:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608ccdb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.620460:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608ccdb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.620508:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1965:x1830882977160576:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 30162us (30723us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.620514:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15093 00000100:00100000:2.0:1746066800.628160:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977162880:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 12176us (12323us total) trans 21474841011 rc 0/0 00000100:00100000:2.0:1746066800.628173:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2220 00002000:00100000:2.0:1746066800.628186:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38e:0x0] (1097728->1961983) req@ffff880099710a80 x1830882977162880/t21474841011(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:206/0 lens 504/448 e 0 to 0 dl 1746066811 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066800.628195:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099710a80 with x1830882977162880 ext(1097728->1961983) 00010000:00010000:2.0:1746066800.628206:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 22 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746066800.628219:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 22 pid: 8112 timeout: 861 lvb_type: 0 00002000:00010000:2.0:1746066800.628225:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099710a80 00000100:00100000:1.0:1746066800.630698:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882977161728:12345-192.168.202.57@tcp:4:cat.0 Request processed in 11489us (16641us total) trans 17179873704 rc 0/0 00000100:00100000:1.0:1746066800.630711:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2221 00002000:00100000:1.0:1746066800.630722:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->3284991) req@ffff8800929ced80 x1830882977161728/t17179873704(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:206/0 lens 488/448 e 0 to 0 dl 1746066811 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066800.630730:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929ced80 with x1830882977161728 ext(3145728->3284991) 00010000:00010000:1.0:1746066800.630740:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.630752:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00002000:00010000:1.0:1746066800.630759:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800929ced80 00000100:00100000:0.0:1746066800.634046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.634129:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977163136 00000100:00100000:1.0:1746066800.634139:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977163136 00010000:00010000:1.0:1746066800.634178:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 22 pid: 8112 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746066800.635477:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7781 00000100:00100000:1.0:1746066800.635492:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977163136:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066800.635512:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066800.635550:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 22 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.635563:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1130495) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 22 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.635589:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff40600/0xfb36a14ee608cba0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1130495) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f282 expref: 22 pid: 8112 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.635606:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.635608:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.635613:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee608cce2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.635622:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee608cce2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.635654:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066800.636743:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977163136:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1250us (2700us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.636752:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7781 00010000:00010000:0.0:1746066800.637811:0:8112:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee608cce2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.637823:0:8112:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee608cce2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.637855:0:8112:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee608cce2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.637861:0:8112:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee608cce2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.637867:0:8112:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee608cce2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.637873:0:8112:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f31000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066800.637877:0:8112:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee608cce2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.637885:0:8112:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee608cce2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.637900:0:8112:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee608cce2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.637905:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135f31000/0xfb36a14ee608cce2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.637973:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977160704:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 47398us (48169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.637980:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15094 00000100:00100000:0.0:1746066800.640799:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.640901:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977163264 00000100:00100000:3.0:1746066800.640910:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977163264 00010000:00010000:3.0:1746066800.640950:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.640988:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7782 00000100:00100000:3.0:1746066800.640996:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a530f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882977163264:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066800.641009:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066800.641032:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.641044:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.641068:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0a5800/0xfb36a14ee608cc09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f2eb expref: 23 pid: 8452 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746066800.641095:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.641097:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.641103:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ccf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.641112:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ccf0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.641149:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066800.641186:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a530f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977163264:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 190us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.641192:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7782 00010000:00010000:2.0:1746066800.641305:0:21973:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ccf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.641315:0:21973:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ccf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.641334:0:21973:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ccf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.641341:0:21973:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ccf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.641348:0:21973:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ccf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.641355:0:21973:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e880000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066800.641359:0:21973:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ccf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.641368:0:21973:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ccf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.641378:0:21973:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ccf0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.641384:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e880000/0xfb36a14ee608ccf0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.641431:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977160960:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 50488us (51606us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.641438:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15096 00000100:00100000:0.0:1746066800.644878:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.646942:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977163520 00000100:00100000:3.0:1746066800.646953:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977163520 00000100:00100000:3.0:1746066800.647151:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10110 00000100:00100000:3.0:1746066800.647161:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31868:x1830882977163520:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:3.0:1746066800.647220:0:14550:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066800.647249:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad800/0xfb36a14ee608ccaa lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f354 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.647266:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:3.0:1746066800.647270:0:14550:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066800.647299:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.647310:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0fa expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.647322:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 16 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.647329:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608c962 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f116 expref: 261 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.647335:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881c00/0xfb36a14ee608ca1f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1be expref: 261 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.647341:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e800/0xfb36a14ee608ca49 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1cc expref: 16 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.647347:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 8/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.647378:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e800/0xfb36a14ee608ca49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1cc expref: 16 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.647390:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e800/0xfb36a14ee608ca49 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1cc expref: 16 pid: 14550 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.647404:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976936192:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066800.648615:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881c00/0xfb36a14ee608ca1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1be expref: 261 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.648627:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881c00/0xfb36a14ee608ca1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1be expref: 261 pid: 14550 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.648641:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976936320:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066800.649502:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608c962 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f116 expref: 261 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.649511:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608c962 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f116 expref: 261 pid: 16018 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.649518:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e869880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976936448:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066800.649556:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 16 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.649563:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 16 pid: 14550 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.649568:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976936576:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066800.649585:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0fa expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.649590:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0fa expref: 16 pid: 14549 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.649596:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976936704:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066800.649606:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066800.651969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.652096:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977163648 00000100:00100000:1.0:1746066800.652106:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977163648 00010000:00010000:1.0:1746066800.652139:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e800/0xfb36a14ee608ca49 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1cc expref: 17 pid: 14550 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.652634:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976936192:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066800.652697:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7783 00000100:00100000:1.0:1746066800.652706:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099711180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977163648:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066800.652722:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066800.652728:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e800/0xfb36a14ee608ca49 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1cc expref: 17 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.652739:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e800/0xfb36a14ee608ca49 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1cc expref: 17 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.652764:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e800/0xfb36a14ee608ca49 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1cc expref: 17 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746066800.652782:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:1.0:1746066800.652787:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066800.652796:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066800.652847:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099711180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977163648:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 143us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066800.652854:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7783 00000100:00100000:1.0:1746066800.657191:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.657217:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.657243:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.657333:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.657384:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977163904 00000100:00100000:2.0:1746066800.657392:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977163904 00010000:00010000:2.0:1746066800.657429:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608c962 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f116 expref: 262 pid: 16018 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746066800.657751:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976936320:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066800.657760:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e869880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976936448:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066800.657766:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976936576:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066800.657773:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976936704:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066800.657797:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:2.0:1746066800.658056:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977163776 00000100:00100000:2.0:1746066800.658059:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977163776 00010000:00010000:2.0:1746066800.658069:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881c00/0xfb36a14ee608ca1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1be expref: 263 pid: 14550 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066800.658178:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977164160 00000100:00100000:0.0:1746066800.658181:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977164160 00010000:00010000:0.0:1746066800.658195:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0fa expref: 16 pid: 14549 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066800.658213:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977164032 00000100:00100000:0.0:1746066800.658215:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977164032 00010000:00010000:0.0:1746066800.658221:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 17 pid: 14550 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746066800.658231:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7784 00000100:00100000:0.0:1746066800.658237:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:1963:x1830882977163904:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.658250:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.658255:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608c962 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f116 expref: 263 pid: 16018 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.658263:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608c962 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f116 expref: 263 pid: 16018 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.658285:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608c962 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f116 expref: 263 pid: 16018 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.658302:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:0.0:1746066800.658306:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066800.658312:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.658347:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:1963:x1830882977163904:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 110us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.658353:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7784 00000100:00100000:0.0:1746066800.658365:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7785 00000100:00100000:0.0:1746066800.658369:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:1963:x1830882977163776:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.658374:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.658377:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881c00/0xfb36a14ee608ca1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1be expref: 261 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.658384:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881c00/0xfb36a14ee608ca1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1be expref: 261 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.658392:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881c00/0xfb36a14ee608ca1f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f1be expref: 261 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.658401:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:0.0:1746066800.658403:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066800.658408:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.658416:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:1963:x1830882977163776:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 47us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.658420:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7785 00000100:00100000:0.0:1746066800.658425:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7786 00000100:00100000:0.0:1746066800.658429:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977164160:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.658433:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.658436:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0fa expref: 17 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.658443:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0fa expref: 17 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.658451:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f318000/0xfb36a14ee608c946 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f0fa expref: 17 pid: 14549 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.658457:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:0.0:1746066800.658459:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066800.658464:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.658472:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882977164160:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 43us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.658479:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7786 00000100:00100000:0.0:1746066800.658486:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7787 00000100:00100000:0.0:1746066800.658490:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882977164032:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066800.658494:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.658497:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 15 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.658504:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 15 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.658512:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a50a7e00/0xfb36a14ee608c95b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f10f expref: 15 pid: 14550 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746066800.658518:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:0.0:1746066800.658520:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066800.658526:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066800.658532:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066800.658558:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066800.658569:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+14:1966:x1830882977164032:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 79us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.658574:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7787 00010000:00010000:3.0:1746066800.659493:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.659500:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000040:00080000:3.0:1746066800.660139:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3170, 88 off268216 00000004:00080000:3.0:1746066800.660148:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761837471181ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.660196:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3178, 88 off268832 00000004:00080000:3.0:1746066800.660201:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761837524803ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066800.660229:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3179, 88 off268920 00000004:00080000:3.0:1746066800.660232:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761837556425ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066800.660240:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3171, 88 off268304 00000004:00080000:3.0:1746066800.660242:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761837566161ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.660248:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3172, 88 off268392 00000004:00080000:3.0:1746066800.660251:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761837574655ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.660257:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3180, 88 off269008 00000004:00080000:3.0:1746066800.660259:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761837583569ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066800.660266:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3181, 88 off269096 00000004:00080000:3.0:1746066800.660268:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761837592099ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066800.660275:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3182, 88 off269184 00000004:00080000:3.0:1746066800.660278:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761837602133ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066800.660285:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3173, 88 off268480 00000004:00080000:3.0:1746066800.660287:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761837611188ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.660293:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3183, 88 off269272 00000004:00080000:3.0:1746066800.660296:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761837619855ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066800.660302:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3174, 88 off268568 00000004:00080000:3.0:1746066800.660305:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761837628688ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.660311:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3184, 88 off269360 00000004:00080000:3.0:1746066800.660313:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761837637568ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066800.660319:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3175, 88 off268656 00000004:00080000:3.0:1746066800.660322:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761837646065ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.660328:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3176, 88 off268744 00000004:00080000:3.0:1746066800.660330:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761837654545ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.660337:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3177, 88 off268832 00000004:00080000:3.0:1746066800.660339:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761837663189ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.660345:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3178, 88 off268920 00000004:00080000:3.0:1746066800.660348:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761837671826ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.660354:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3185, 88 off269448 00000004:00080000:3.0:1746066800.660357:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761837680809ns, next at 749511475809ns, rc = 0 00000001:00080000:0.0:1746066800.767455:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944184 is committed 00000001:00080000:0.0:1746066800.767475:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944171 is committed 00000001:00080000:0.0:1746066800.767481:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944188 is committed 00000001:00080000:0.0:1746066800.767489:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944176 is committed 00000001:00080000:0.0:1746066800.767495:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944185 is committed 00000001:00080000:0.0:1746066800.767516:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944189 is committed 00000004:00080000:0.0:1746066800.767520:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2459 committed 00000004:00080000:0.0:1746066800.767530:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2451 committed 00000004:00080000:0.0:1746066800.767548:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2450 committed 00000004:00080000:0.0:1746066800.767550:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2449 committed 00000004:00080000:0.0:1746066800.767551:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2448 committed 00000004:00080000:0.0:1746066800.767552:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2458 committed 00000004:00080000:0.0:1746066800.767554:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2447 committed 00000004:00080000:0.0:1746066800.767555:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2457 committed 00000004:00080000:0.0:1746066800.767556:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2446 committed 00000004:00080000:0.0:1746066800.767558:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2456 committed 00000004:00080000:0.0:1746066800.767559:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2455 committed 00000004:00080000:0.0:1746066800.767560:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2454 committed 00000004:00080000:0.0:1746066800.767562:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2445 committed 00000004:00080000:0.0:1746066800.767563:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2444 committed 00000004:00080000:0.0:1746066800.767565:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2453 committed 00000004:00080000:0.0:1746066800.767567:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2452 committed 00000004:00080000:0.0:1746066800.767569:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2443 committed 00000001:00080000:0.0:1746066800.767574:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944186 is committed 00000100:00100000:0.0:1746066800.767710:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976936832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.767775:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.767821:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976937344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.767836:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.767854:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746066800.767858:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976937216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.767874:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.767883:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976937728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.767894:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.767909:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976936960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.767924:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.767933:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976937472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.767945:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.767956:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066800.767959:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976937088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.767972:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.767981:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976937600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.767991:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.768014:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976936832 00000100:00100000:0.0:1746066800.768020:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976936832 00000100:00100000:0.0:1746066800.768051:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937344 00000100:00100000:0.0:1746066800.768053:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937344 00000100:00100000:0.0:1746066800.768060:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937216 00000100:00100000:0.0:1746066800.768062:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937216 00000100:00100000:0.0:1746066800.768067:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937728 00000100:00100000:0.0:1746066800.768069:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937728 00000100:00100000:0.0:1746066800.768075:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976936960 00000100:00100000:0.0:1746066800.768076:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976936960 00000100:00100000:0.0:1746066800.768081:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937472 00000100:00100000:0.0:1746066800.768082:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937472 00000100:00100000:0.0:1746066800.768087:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937088 00000100:00100000:0.0:1746066800.768089:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937088 00000100:00100000:0.0:1746066800.768093:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937600 00000100:00100000:0.0:1746066800.768094:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937600 00000100:00100000:0.0:1746066800.768101:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15098 00000100:00100000:0.0:1746066800.768107:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3294:x1830882976936832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.768313:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3294:x1830882976936832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 206us (539us total) trans 21474841012 rc 0/0 00000100:00100000:0.0:1746066800.768319:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15098 00000100:00100000:0.0:1746066800.768332:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15099 00000100:00100000:0.0:1746066800.768335:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3294:x1830882976937344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.768392:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3294:x1830882976937344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (555us total) trans 21474841013 rc 0/0 00000100:00100000:0.0:1746066800.768397:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15099 00000100:00100000:0.0:1746066800.768404:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15100 00000100:00100000:0.0:1746066800.768407:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3294:x1830882976937216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.768466:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3294:x1830882976937216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (591us total) trans 21474841014 rc 0/0 00000100:00100000:0.0:1746066800.768471:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15100 00000100:00100000:0.0:1746066800.768479:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15101 00000100:00100000:0.0:1746066800.768483:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3294:x1830882976937728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.768566:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3294:x1830882976937728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (671us total) trans 21474841015 rc 0/0 00000100:00100000:0.0:1746066800.768571:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15101 00000100:00100000:0.0:1746066800.768581:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15102 00000100:00100000:0.0:1746066800.768584:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3295:x1830882976936960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.768661:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3295:x1830882976936960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (735us total) trans 21474841016 rc 0/0 00000100:00100000:0.0:1746066800.768666:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15102 00000100:00100000:0.0:1746066800.768693:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15103 00000100:00100000:0.0:1746066800.768698:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3295:x1830882976937472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.768764:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3295:x1830882976937472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (817us total) trans 21474841017 rc 0/0 00000100:00100000:0.0:1746066800.768769:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15103 00000100:00100000:0.0:1746066800.768776:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15104 00000100:00100000:0.0:1746066800.768780:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3295:x1830882976937088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.768851:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3295:x1830882976937088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (878us total) trans 21474841018 rc 0/0 00000100:00100000:0.0:1746066800.768857:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15104 00000100:00100000:0.0:1746066800.768865:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15105 00000100:00100000:0.0:1746066800.768869:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3295:x1830882976937600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.768936:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3295:x1830882976937600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (943us total) trans 21474841019 rc 0/0 00000100:00100000:0.0:1746066800.768941:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15105 00000004:00080000:0.0:1746066800.768989:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099712680/2, rc 0, transno 21474841018 00000100:00100000:0.0:1746066800.768994:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976937088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066800.768999:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099710700/2, rc 0, transno 21474841019 00000100:00100000:0.0:1746066800.769002:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976937600:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066800.769006:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099713100/2, rc 0, transno 21474841016 00000100:00100000:0.0:1746066800.769008:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976936960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066800.769013:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099713800/2, rc 0, transno 21474841017 00000100:00100000:0.0:1746066800.769015:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976937472:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066800.769028:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099710000/2, rc 0, transno 21474841014 00000100:00100000:0.0:1746066800.769031:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976937216:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066800.769037:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099711f80/2, rc 0, transno 21474841015 00000100:00100000:0.0:1746066800.769039:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976937728:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066800.769044:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099711880/2, rc 0, transno 21474841012 00000100:00100000:0.0:1746066800.769047:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976936832:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066800.769052:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099711c00/2, rc 0, transno 21474841013 00000100:00100000:0.0:1746066800.769054:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976937344:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066800.769184:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976938240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.769208:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066800.769225:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976938752:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.769235:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066800.769245:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746066800.769248:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976937856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.769258:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066800.769264:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976938368:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.769273:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066800.769286:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976938240 00000100:00100000:2.0:1746066800.769288:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976938240 00000100:00100000:2.0:1746066800.769304:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976938752 00000100:00100000:2.0:1746066800.769305:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976938752 00000100:00100000:2.0:1746066800.769312:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937856 00000100:00100000:2.0:1746066800.769313:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937856 00000100:00100000:2.0:1746066800.769319:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976938368 00000100:00100000:2.0:1746066800.769321:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976938368 00000100:00100000:2.0:1746066800.769328:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15106 00000100:00100000:2.0:1746066800.769332:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3293:x1830882976938240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.769429:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3293:x1830882976938240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (220us total) trans 17179873705 rc 0/0 00000100:00100000:2.0:1746066800.769433:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15106 00000100:00100000:2.0:1746066800.769441:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15107 00000100:00100000:2.0:1746066800.769444:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3293:x1830882976938752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.769503:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3293:x1830882976938752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (266us total) trans 17179873706 rc 0/0 00000100:00100000:2.0:1746066800.769508:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15107 00000100:00100000:2.0:1746066800.769515:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15108 00000100:00100000:2.0:1746066800.769519:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3293:x1830882976937856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.769704:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3293:x1830882976937856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 184us (444us total) trans 17179873707 rc 0/0 00000100:00100000:2.0:1746066800.769711:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15108 00000100:00100000:2.0:1746066800.769718:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15109 00000100:00100000:2.0:1746066800.769721:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3293:x1830882976938368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.769781:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3293:x1830882976938368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (507us total) trans 17179873708 rc 0/0 00000100:00100000:2.0:1746066800.769786:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15109 00000004:00080000:2.0:1746066800.769814:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c396d80/2, rc 0, transno 17179873707 00000100:00100000:2.0:1746066800.769820:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976937856:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066800.769826:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c396300/2, rc 0, transno 17179873708 00000100:00100000:2.0:1746066800.769828:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976938368:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066800.769833:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c394000/2, rc 0, transno 17179873705 00000100:00100000:2.0:1746066800.769836:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976938240:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066800.769841:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c395880/2, rc 0, transno 17179873706 00000100:00100000:2.0:1746066800.769843:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976938752:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.769863:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746066800.769867:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976938880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.769883:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066800.769897:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976938880 00000100:00100000:2.0:1746066800.769899:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976938880 00000100:00100000:2.0:1746066800.769912:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15110 00000100:00100000:2.0:1746066800.769916:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3293:x1830882976938880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.769987:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3293:x1830882976938880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (103us total) trans 17179873709 rc 0/0 00000100:00100000:2.0:1746066800.769991:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15110 00000004:00080000:2.0:1746066800.770007:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c395500/2, rc 0, transno 17179873709 00000100:00100000:2.0:1746066800.770010:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976938880:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746066800.770112:0:14550:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099712a00 reply state ffff88012bf79c00 transno 8589944189 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:3.0:1746066800.770122:0:14550:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746066800.770196:0:14550:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746066800.770220:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31868:x1830882977163520:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 123059us (125349us total) trans 8589944189 rc 0/0 00000100:00100000:3.0:1746066800.770226:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10110 00010000:00010000:2.0:1746066800.770330:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.770338:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.770345:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.770352:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e881000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066800.770355:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.770361:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.770377:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066800.770380:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066800.770384:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066800.770389:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608ccfe lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066800.770576:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976938112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066800.770597:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.770618:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976938624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066800.770631:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.770642:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746066800.770646:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976937984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066800.770659:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.770667:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976938496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066800.770704:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.770720:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976938112 00000100:00100000:0.0:1746066800.770723:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976938112 00000100:00100000:0.0:1746066800.770736:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976938624 00000100:00100000:0.0:1746066800.770737:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976938624 00000100:00100000:0.0:1746066800.770743:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976937984 00000100:00100000:0.0:1746066800.770745:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976937984 00000100:00100000:0.0:1746066800.770750:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976938496 00000100:00100000:0.0:1746066800.770751:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976938496 00000100:00100000:0.0:1746066800.770759:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15111 00000100:00100000:0.0:1746066800.770763:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3296:x1830882976938112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066800.770851:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3296:x1830882976938112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (252us total) trans 17179873710 rc 0/0 00000100:00100000:0.0:1746066800.770856:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15111 00000100:00100000:0.0:1746066800.770864:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15112 00000100:00100000:0.0:1746066800.770868:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3296:x1830882976938624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066800.770927:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746066800.770930:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746066800.770932:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066800.770934:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746066800.770935:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746066800.770949:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3296:x1830882976938624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (317us total) trans 17179873711 rc 0/0 00000100:00100000:0.0:1746066800.770954:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15112 00000100:00100000:0.0:1746066800.770962:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15113 00000100:00100000:0.0:1746066800.770965:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3296:x1830882976937984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066800.771035:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3296:x1830882976937984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (374us total) trans 17179873712 rc 0/0 00000100:00100000:0.0:1746066800.771040:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15113 00000100:00100000:0.0:1746066800.771047:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15114 00000100:00100000:0.0:1746066800.771052:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3296:x1830882976938496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066800.771117:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3296:x1830882976938496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (412us total) trans 17179873713 rc 0/0 00000100:00100000:0.0:1746066800.771122:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15114 00000004:00080000:0.0:1746066800.771145:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c395f80/2, rc 0, transno 17179873712 00000100:00100000:0.0:1746066800.771149:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976937984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066800.771155:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c395c00/2, rc 0, transno 17179873713 00000100:00100000:0.0:1746066800.771157:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976938496:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066800.771163:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c397b80/2, rc 0, transno 17179873710 00000100:00100000:0.0:1746066800.771165:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976938112:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066800.771170:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c394e00/2, rc 0, transno 17179873711 00000100:00100000:0.0:1746066800.771172:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976938624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066800.773213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.773546:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977164288 00000100:00100000:3.0:1746066800.773556:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977164288 00000100:00100000:3.0:1746066800.773607:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10111 00000100:00100000:3.0:1746066800.773614:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31868:x1830882977164288:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066800.773637:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.773654:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac800/0xfb36a14ee608cd05 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f370 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.773725:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac800/0xfb36a14ee608cd05 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f370 expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.773739:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac800/0xfb36a14ee608cd05 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f370 expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.773757:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:3.0:1746066800.773759:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066800.773762:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fdac800, rc 0) 00000100:00100000:3.0:1746066800.773800:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31868:x1830882977164288:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 186us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.773805:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10111 00000100:00100000:0.0:1746066800.780180:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.780913:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977164416 00000100:00100000:3.0:1746066800.780925:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977164416 00000100:00100000:3.0:1746066800.780985:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10112 00000100:00100000:3.0:1746066800.780993:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31868:x1830882977164416:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066800.781015:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.781035:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cd0c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f377 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.781124:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad600/0xfb36a14ee608cd13 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.781138:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad600/0xfb36a14ee608cd13 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.781149:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad600/0xfb36a14ee608cd13 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066800.781173:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066800.781176:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066800.781189:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad600/0xfb36a14ee608cd13 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066800.781210:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdace00/0xfb36a14ee608cd0c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f377 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.781222:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad600/0xfb36a14ee608cd13 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f377 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.781230:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:3.0:1746066800.781232:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066800.781235:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fdad600, rc 0) 00000100:00100000:3.0:1746066800.781282:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31868:x1830882977164416:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 290us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.781287:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10112 00000100:00100000:0.0:1746066800.787464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.787769:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977164544 00000100:00100000:3.0:1746066800.787780:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977164544 00000100:00100000:0.0:1746066800.788423:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.789507:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977164672 00000100:00100000:3.0:1746066800.789513:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977164672 00000100:00100000:3.0:1746066800.789565:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15115 00000100:00100000:3.0:1746066800.789574:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977164544:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066800.789599:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.789621:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fdacc00/0xfb36a14ee608cd1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f37e expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066800.789647:0:8112:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd6f, atime: 0x6812dd6e, ctime: 0x6812dd6f, blocks: 0x7e1 00010000:00010000:3.0:1746066800.789666:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.789668:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.789691:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fdacc00/0xfb36a14ee608cd1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f37e expref: 9 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.789706:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fdacc00/0xfb36a14ee608cd1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f37e expref: 9 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.789716:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fdacc00, rc 0) 00000100:00100000:3.0:1746066800.789772:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977164544:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 199us (2320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.789778:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15115 00000100:00100000:3.0:1746066800.789793:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15116 00000100:00100000:3.0:1746066800.789798:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977164672:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066800.789806:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.789817:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cd21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f385 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066800.789833:0:8112:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38d:0x0] initial LVB size: 2097152, mtime: 0x6812dd6e, atime: 0x6812dd6e, ctime: 0x6812dd6e, blocks: 0x81f 00010000:00010000:3.0:1746066800.789841:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.789843:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.789847:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cd21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f385 expref: 9 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.789856:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cd21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f385 expref: 9 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066800.789863:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fdaca00, rc 0) 00000100:00100000:3.0:1746066800.789878:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977164672:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 80us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.789883:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15116 00000100:00100000:0.0:1746066800.790221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.790272:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.790335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.790358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.790374:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977164928 00000100:00100000:0.0:1746066800.790377:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977164928 00000100:00100000:0.0:1746066800.790395:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977165184 00000100:00100000:0.0:1746066800.790397:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977165184 00000100:00100000:0.0:1746066800.790406:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977164800 00000100:00100000:0.0:1746066800.790408:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977164800 00000100:00100000:0.0:1746066800.790418:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977165056 00000100:00100000:0.0:1746066800.790419:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977165056 00000100:00100000:0.0:1746066800.790431:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15117 00000100:00100000:0.0:1746066800.790436:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977164928:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066800.790443:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.790451:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c600/0xfb36a14ee608cd28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f393 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066800.790470:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 2097152, mtime: 0x6812dd6f, atime: 0x6812dd6f, ctime: 0x6812dd6f, blocks: 0x821 00010000:00010000:0.0:1746066800.790478:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.790479:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.790484:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c600/0xfb36a14ee608cd28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f393 expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.790493:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c600/0xfb36a14ee608cd28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f393 expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.790500:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3c600, rc 0) 00000100:00100000:0.0:1746066800.790519:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977164928:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 82us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.790524:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15117 00000100:00100000:0.0:1746066800.790543:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15118 00000100:00100000:0.0:1746066800.790548:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977165184:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066800.790553:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.790560:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cd2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f3a1 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066800.790571:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38f:0x0] initial LVB size: 4194304, mtime: 0x6812dd70, atime: 0x6812dd6f, ctime: 0x6812dd70, blocks: 0x102b 00010000:00010000:0.0:1746066800.790577:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.790578:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.790581:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cd2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a1 expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.790594:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cd2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a1 expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.790600:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3ce00, rc 0) 00000100:00100000:0.0:1746066800.790612:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977165184:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 65us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.790616:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15118 00000100:00100000:0.0:1746066800.790623:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15119 00000100:00100000:0.0:1746066800.790626:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977164800:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066800.790630:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.790636:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608cd36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f38c expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066800.790644:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd70, atime: 0x6812dd6f, ctime: 0x6812dd70, blocks: 0x81d 00010000:00010000:0.0:1746066800.790649:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.790650:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.790653:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608cd36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f38c expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.790660:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608cd36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f38c expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.790664:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3c400, rc 0) 00000100:00100000:0.0:1746066800.790688:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977164800:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 48us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.790695:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15119 00000100:00100000:0.0:1746066800.790705:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15120 00000100:00100000:0.0:1746066800.790708:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977165056:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066800.790713:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.790719:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608cd3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f39a expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066800.790728:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 5090560, mtime: 0x6812dd70, atime: 0x6812dd70, ctime: 0x6812dd70, blocks: 0x1721 00010000:00010000:0.0:1746066800.790734:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.790735:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066800.790738:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608cd3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f39a expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.790745:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608cd3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f39a expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066800.790750:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3d800, rc 0) 00000100:00100000:0.0:1746066800.790760:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977165056:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 51us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066800.790764:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15120 00000100:00100000:0.0:1746066800.798234:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.798318:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977165440 00000100:00100000:1.0:1746066800.798328:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977165440 00000100:00100000:1.0:1746066800.798396:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6860 00000100:00100000:1.0:1746066800.798404:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1965:x1830882977165440:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:1.0:1746066800.798442:0:21552:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a767400/0xfb36a14ee608cd44 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.798456:0:21552:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.798458:0:21552:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.798462:0:21552:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a767400/0xfb36a14ee608cd44 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.798475:0:21552:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a767400/0xfb36a14ee608cd44 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.806784:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.808396:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.808693:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977165696 00000100:00100000:2.0:1746066800.808704:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977165696 00000100:00100000:2.0:1746066800.808760:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977165824 00000100:00100000:2.0:1746066800.808763:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977165824 00000100:00100000:2.0:1746066800.808782:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6861 00000100:00100000:2.0:1746066800.808790:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1966:x1830882977165696:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:2.0:1746066800.808830:0:1993:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135f31400/0xfb36a14ee608cd4b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.808845:0:1993:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.808847:0:1993:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.808852:0:1993:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135f31400/0xfb36a14ee608cd4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.808865:0:1993:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135f31400/0xfb36a14ee608cd4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.810700:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6862 00000100:00100000:1.0:1746066800.810712:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1966:x1830882977165824:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:1.0:1746066800.810748:0:21550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608cd52 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.810760:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.810761:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.810765:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608cd52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.810773:0:21550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608cd52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.813485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.814365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.815112:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.815141:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.815325:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977166464 00000100:00100000:3.0:1746066800.815335:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977166464 00000100:00100000:3.0:1746066800.815386:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977166592 00000100:00100000:3.0:1746066800.815389:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977166592 00000100:00100000:3.0:1746066800.815401:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977166208 00000100:00100000:3.0:1746066800.815402:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977166208 00000100:00100000:3.0:1746066800.815410:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977166720 00000100:00100000:3.0:1746066800.815412:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977166720 00000100:00100000:3.0:1746066800.815424:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6863 00000100:00100000:3.0:1746066800.815430:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1966:x1830882977166464:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:3.0:1746066800.815466:0:8457:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fdad200/0xfb36a14ee608cd59 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.815479:0:8457:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.815481:0:8457:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.815485:0:8457:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fdad200/0xfb36a14ee608cd59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.815497:0:8457:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fdad200/0xfb36a14ee608cd59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.816796:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6864 00000100:00100000:3.0:1746066800.816807:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882977166592:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:3.0:1746066800.816838:0:1992:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fdac000/0xfb36a14ee608cd60 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.816849:0:1992:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.816851:0:1992:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.816854:0:1992:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fdac000/0xfb36a14ee608cd60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.816863:0:1992:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fdac000/0xfb36a14ee608cd60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066800.818088:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6865 00000100:00100000:3.0:1746066800.818098:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1965:x1830882977166208:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:3.0:1746066800.818123:0:31368:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fdadc00/0xfb36a14ee608cd67 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.818132:0:31368:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.818133:0:31368:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066800.818136:0:31368:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fdadc00/0xfb36a14ee608cd67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.818145:0:31368:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fdadc00/0xfb36a14ee608cd67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.820886:0:11692:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6866 00000100:00100000:2.0:1746066800.820909:0:11692:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1965:x1830882977166720:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:2.0:1746066800.820959:0:11692:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135f31a00/0xfb36a14ee608cd6e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.820974:0:11692:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.820976:0:11692:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066800.820982:0:11692:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f31a00/0xfb36a14ee608cd6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.820995:0:11692:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135f31a00/0xfb36a14ee608cd6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.824498:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.824990:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977167104 00000100:00100000:1.0:1746066800.825000:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977167104 00000100:00100000:1.0:1746066800.825062:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6867 00000100:00100000:1.0:1746066800.825070:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:1966:x1830882977167104:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:1.0:1746066800.825106:0:21551:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b596e00/0xfb36a14ee608cd75 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.825121:0:21551:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.825122:0:21551:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066800.825129:0:21551:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b596e00/0xfb36a14ee608cd75 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.825144:0:21551:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b596e00/0xfb36a14ee608cd75 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.830971:0:21552:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a767400/0xfb36a14ee608cd44 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.830992:0:21552:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a767400/0xfb36a14ee608cd44 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.831001:0:21552:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a767400/0xfb36a14ee608cd44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.831008:0:21552:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a767400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066800.831012:0:21552:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a767400/0xfb36a14ee608cd44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.831020:0:21552:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a767400/0xfb36a14ee608cd44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.831041:0:21552:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a767400/0xfb36a14ee608cd44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.831047:0:21552:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a767400/0xfb36a14ee608cd44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.831113:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1965:x1830882977165440:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 32705us (32882us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066800.831122:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6860 00010000:00010000:2.0:1746066800.835598:0:1993:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135f31400/0xfb36a14ee608cd4b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.835615:0:1993:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135f31400/0xfb36a14ee608cd4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.835628:0:1993:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135f31400/0xfb36a14ee608cd4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.835634:0:1993:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f31400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066800.835638:0:1993:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135f31400/0xfb36a14ee608cd4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.835646:0:1993:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135f31400/0xfb36a14ee608cd4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.835666:0:1993:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135f31400/0xfb36a14ee608cd4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.835671:0:1993:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135f31400/0xfb36a14ee608cd4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1993 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.835757:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:1966:x1830882977165696:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 26962us (28976us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066800.835767:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6861 00010000:00010000:1.0:1746066800.843516:0:21550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608cd52 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.843546:0:21550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608cd52 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.843555:0:21550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608cd52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.843561:0:21550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a767e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066800.843565:0:21550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608cd52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.843573:0:21550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608cd52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.843593:0:21550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608cd52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.843599:0:21550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a767e00/0xfb36a14ee608cd52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.846887:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1966:x1830882977165824:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 36162us (38480us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066800.846901:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6862 00010000:00010000:0.0:1746066800.859869:0:8457:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fdad200/0xfb36a14ee608cd59 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.859886:0:8457:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fdad200/0xfb36a14ee608cd59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.859894:0:8457:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fdad200/0xfb36a14ee608cd59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.859900:0:8457:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fdad200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066800.859903:0:8457:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fdad200/0xfb36a14ee608cd59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.859910:0:8457:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fdad200/0xfb36a14ee608cd59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.859927:0:8457:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fdad200/0xfb36a14ee608cd59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.859932:0:8457:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fdad200/0xfb36a14ee608cd59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066800.862556:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1966:x1830882977166464:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 47113us (49067us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066800.862569:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6863 00010000:00010000:1.0:1746066800.871242:0:11692:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135f31a00/0xfb36a14ee608cd6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.871262:0:11692:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135f31a00/0xfb36a14ee608cd6e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.871270:0:11692:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135f31a00/0xfb36a14ee608cd6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.871277:0:11692:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f31a00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066800.871281:0:11692:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135f31a00/0xfb36a14ee608cd6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.871289:0:11692:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135f31a00/0xfb36a14ee608cd6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.871309:0:11692:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135f31a00/0xfb36a14ee608cd6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.871315:0:11692:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135f31a00/0xfb36a14ee608cd6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11692 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.872201:0:11692:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882977166720:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 51296us (57051us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066800.872214:0:11692:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6866 00010000:00010000:2.0:1746066800.872310:0:1992:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fdac000/0xfb36a14ee608cd60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.872320:0:1992:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fdac000/0xfb36a14ee608cd60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.872327:0:1992:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fdac000/0xfb36a14ee608cd60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.872337:0:1992:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fdac000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066800.872339:0:1992:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fdac000/0xfb36a14ee608cd60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.872345:0:1992:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fdac000/0xfb36a14ee608cd60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.872356:0:1992:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fdac000/0xfb36a14ee608cd60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.872363:0:1992:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fdac000/0xfb36a14ee608cd60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1992 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.872430:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882977166592:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 55625us (58066us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066800.872436:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6864 00010000:00010000:1.0:1746066800.881050:0:21551:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b596e00/0xfb36a14ee608cd75 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.881069:0:21551:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b596e00/0xfb36a14ee608cd75 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.881077:0:21551:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b596e00/0xfb36a14ee608cd75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.881085:0:21551:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b596e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066800.881089:0:21551:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b596e00/0xfb36a14ee608cd75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.881097:0:21551:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b596e00/0xfb36a14ee608cd75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.881116:0:21551:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b596e00/0xfb36a14ee608cd75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.881122:0:21551:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b596e00/0xfb36a14ee608cd75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.881237:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977167104:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 56162us (56743us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066800.881248:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6867 00010000:00010000:2.0:1746066800.885156:0:31368:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fdadc00/0xfb36a14ee608cd67 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.885175:0:31368:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fdadc00/0xfb36a14ee608cd67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.885184:0:31368:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fdadc00/0xfb36a14ee608cd67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.885191:0:31368:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fdadc00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066800.885196:0:31368:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fdadc00/0xfb36a14ee608cd67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.885205:0:31368:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fdadc00/0xfb36a14ee608cd67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.885226:0:31368:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fdadc00/0xfb36a14ee608cd67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066800.885233:0:31368:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fdadc00/0xfb36a14ee608cd67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066800.885309:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1965:x1830882977166208:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 67207us (70191us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066800.885320:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6865 00000100:00100000:3.0:1746066800.894411:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.894497:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977167360 00000100:00100000:0.0:1746066800.894507:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977167360 00000100:00100000:0.0:1746066800.894565:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10113 00000100:00100000:0.0:1746066800.894573:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31868:x1830882977167360:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:0.0:1746066800.894627:0:14550:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066800.894656:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad600/0xfb36a14ee608cd13 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f377 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.894707:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:0.0:1746066800.894711:0:14550:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066800.894747:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cd7c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066800.894760:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cd7c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066800.894768:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cd7c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00010000:0.0:1746066800.894946:0:14550:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009e86a680 reply state ffff88009f86d000 transno 8589944190 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cd7c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066800.894953:0:14550:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746066800.895022:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31868:x1830882977167360:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 450us (622us total) trans 8589944190 rc 0/0 00000100:00100000:0.0:1746066800.895028:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10113 00000100:00100000:2.0:1746066800.897969:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066800.898306:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cd7c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066800.898318:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cd7c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066800.898325:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cd7c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066800.898331:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faf4600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066800.898335:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cd7c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066800.898341:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cd7c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066800.898355:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:0.0:1746066800.898358:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066800.898361:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cd7c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066800.898365:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cd7c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00000100:00100000:2.0:1746066800.898415:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.898428:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.898445:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977167488 00000100:00100000:2.0:1746066800.898453:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977167488 00000100:00100000:2.0:1746066800.898484:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977167616 00000100:00100000:2.0:1746066800.898485:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977167616 00000100:00100000:2.0:1746066800.898494:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977167744 00000100:00100000:2.0:1746066800.898495:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977167744 00000100:00100000:2.0:1746066800.898506:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15121 00000100:00100000:2.0:1746066800.898513:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977167488:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:2.0:1746066800.898731:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746066800.898734:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066799 -> 1746066800 00002000:00010000:2.0:1746066800.898736:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066798 -> 1746066800 00002000:00010000:2.0:1746066800.898739:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066799 -> 1746066800 00002000:00010000:2.0:1746066800.898741:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2017 -> 2017 00000100:00100000:0.0:1746066800.898815:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15122 00000100:00100000:0.0:1746066800.898821:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882977167616:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:0.0:1746066800.898921:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066800.898923:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066798 -> 1746066800 00002000:00010000:0.0:1746066800.898924:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066798 -> 1746066800 00002000:00010000:0.0:1746066800.898926:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066798 -> 1746066800 00002000:00010000:0.0:1746066800.898928:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746066800.898991:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15123 00000100:00100000:3.0:1746066800.898998:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882977167744:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:3.0:1746066800.899064:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066800.899066:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066800.899068:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066799 -> 1746066800 00002000:00010000:3.0:1746066800.899069:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066800.899071:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746066800.899550:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882977167488:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 1036us (1588us total) trans 17179873714 rc 0/0 00000100:00100000:2.0:1746066800.899557:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15121 00000100:00100000:0.0:1746066800.899612:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882977167616:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 790us (1196us total) trans 21474841020 rc 0/0 00000100:00100000:0.0:1746066800.899618:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15122 00000100:00100000:3.0:1746066800.899664:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882977167744:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 666us (1234us total) trans 21474841021 rc 0/0 00000100:00100000:3.0:1746066800.899669:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15123 00000100:00100000:0.0:1746066800.899750:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.900082:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.900116:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.900145:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977167872 00000100:00100000:1.0:1746066800.900150:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977167872 00000100:00100000:1.0:1746066800.900170:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977168000 00000100:00100000:1.0:1746066800.900172:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977168000 00000100:00100000:1.0:1746066800.900178:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977168128 00000100:00100000:1.0:1746066800.900179:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977168128 00000100:00100000:1.0:1746066800.900189:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15124 00000100:00100000:1.0:1746066800.900194:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882977167872:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:1.0:1746066800.900289:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066800.900292:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066799 -> 1746066800 00002000:00010000:1.0:1746066800.900294:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066799 -> 1746066800 00002000:00010000:1.0:1746066800.900296:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066799 -> 1746066800 00002000:00010000:1.0:1746066800.900297:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746066800.900321:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882977167872:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 127us (570us total) trans 17179873715 rc 0/0 00000100:00100000:1.0:1746066800.900327:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15124 00000100:00100000:1.0:1746066800.900337:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15125 00000100:00100000:1.0:1746066800.900342:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882977168000:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:1.0:1746066800.900396:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:1.0:1746066800.900398:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:1.0:1746066800.900400:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:1.0:1746066800.900402:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:1.0:1746066800.900404:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5921 -> 5921 00000100:00100000:1.0:1746066800.900418:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882977168000:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 75us (336us total) trans 17179873716 rc 0/0 00000100:00100000:1.0:1746066800.900423:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15125 00000100:00100000:1.0:1746066800.900431:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15126 00000100:00100000:1.0:1746066800.900436:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882977168128:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:1.0:1746066800.900499:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746066800.900501:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:1.0:1746066800.900503:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066799 -> 1746066800 00002000:00010000:1.0:1746066800.900505:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:1.0:1746066800.900507:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746066800.900521:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1963:x1830882977168128:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 84us (404us total) trans 21474841022 rc 0/0 00000100:00100000:1.0:1746066800.900526:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15126 00000100:00100000:0.0:1746066800.903204:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.903556:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977168384 00000100:00100000:3.0:1746066800.903565:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977168384 00000100:00100000:3.0:1746066800.903654:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4241 00000100:00100000:3.0:1746066800.903662:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31868:x1830882977168384:12345-192.168.202.57@tcp:35:lfs.0 00000004:00010000:3.0:1746066800.903741:0:16596:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x318:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad400/0xfb36a14ee608ccc6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f369 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.903790:0:16596:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066800.903802:0:16596:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac800/0xfb36a14ee608cd05 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f370 expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.903808:0:16596:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066800.903839:0:16596:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac800/0xfb36a14ee608cd05 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f370 expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.903854:0:16596:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac800/0xfb36a14ee608cd05 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f370 expref: 9 pid: 14550 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746066800.903866:0:16596:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16596:1830882976939008:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066800.903952:0:16596:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066800.906732:0:16596:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16596:1830882976939008:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066800.906757:0:16596:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00000100:00100000:0.0:1746066800.906767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.906921:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977168512 00000100:00100000:2.0:1746066800.906926:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977168512 00010000:00010000:2.0:1746066800.906958:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac800/0xfb36a14ee608cd05 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f370 expref: 10 pid: 14550 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746066800.906996:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7788 00000100:00100000:2.0:1746066800.907003:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977168512:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066800.907018:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066800.907023:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac800/0xfb36a14ee608cd05 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f370 expref: 10 pid: 14550 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066800.907033:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac800/0xfb36a14ee608cd05 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f370 expref: 10 pid: 14550 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066800.907055:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdac800/0xfb36a14ee608cd05 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f370 expref: 10 pid: 14550 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066800.907081:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066800.907085:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066800.907093:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066800.907107:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066800.907125:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066800.907128:0:16596:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066800.907133:0:16596:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00000100:00100000:2.0:1746066800.907171:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977168512:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 168us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066800.907177:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7788 00000040:00080000:3.0:1746066800.907898:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3179, 88 off269008 00000004:00080000:3.0:1746066800.907904:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762085227076ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.907954:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3186, 88 off269536 00000004:00080000:3.0:1746066800.907957:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762085281481ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066800.907978:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3187, 88 off269624 00000004:00080000:3.0:1746066800.907981:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762085304889ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066800.907988:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3180, 88 off269096 00000004:00080000:3.0:1746066800.907991:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762085315049ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.907996:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3181, 88 off269184 00000004:00080000:3.0:1746066800.907998:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762085322442ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.908092:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3188, 88 off269712 00000004:00080000:3.0:1746066800.908096:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762085420265ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066800.908116:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3189, 88 off269800 00000004:00080000:3.0:1746066800.908118:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762085442005ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066800.908124:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3190, 88 off269888 00000004:00080000:3.0:1746066800.908126:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762085450271ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066800.908133:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3182, 88 off269272 00000004:00080000:3.0:1746066800.908135:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762085458835ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.908150:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3191, 88 off269976 00000004:00080000:3.0:1746066800.908153:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762085477110ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066800.908159:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3183, 88 off269360 00000004:00080000:3.0:1746066800.908161:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762085485166ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.908166:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3192, 88 off270064 00000004:00080000:3.0:1746066800.908169:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762085493381ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066800.908175:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3184, 88 off269448 00000004:00080000:3.0:1746066800.908177:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762085501440ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.908182:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3185, 88 off269536 00000004:00080000:3.0:1746066800.908184:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762085508502ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.908189:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3186, 88 off269624 00000004:00080000:3.0:1746066800.908191:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762085515632ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.908197:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3187, 88 off269712 00000004:00080000:3.0:1746066800.908199:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762085523059ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066800.908204:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3193, 88 off270152 00000004:00080000:3.0:1746066800.908208:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762085531920ns, next at 749511475809ns, rc = 0 00000004:00010000:3.0:1746066800.936075:0:16596:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880092044700 reply state ffff88009317d400 transno 8589944191 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00000100:00100000:3.0:1746066800.936094:0:16596:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746066800.936106:0:16596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:3.0:1746066800.936110:0:16596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066800.936121:0:16596:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fdad400/0xfb36a14ee608ccc6 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f369 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746066800.936240:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944190 is committed 00000100:00100000:3.0:1746066800.936243:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31868:x1830882977168384:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 32580us (33044us total) trans 8589944191 rc 0/0 00000100:00100000:3.0:1746066800.936251:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4241 00000001:00080000:0.0:1746066800.936255:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944191 is committed 00000004:00080000:0.0:1746066800.936261:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2467 committed 00000004:00080000:0.0:1746066800.936276:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2460 committed 00000004:00080000:0.0:1746066800.936282:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2459 committed 00000004:00080000:0.0:1746066800.936284:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2458 committed 00000004:00080000:0.0:1746066800.936285:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2457 committed 00000004:00080000:0.0:1746066800.936287:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2466 committed 00000004:00080000:0.0:1746066800.936289:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2456 committed 00000004:00080000:0.0:1746066800.936291:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2465 committed 00000004:00080000:0.0:1746066800.936292:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2455 committed 00000004:00080000:0.0:1746066800.936293:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2464 committed 00000004:00080000:0.0:1746066800.936295:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2463 committed 00000004:00080000:0.0:1746066800.936296:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2462 committed 00000004:00080000:0.0:1746066800.936297:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2454 committed 00000004:00080000:0.0:1746066800.936299:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2453 committed 00000004:00080000:0.0:1746066800.936300:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2461 committed 00000004:00080000:0.0:1746066800.936301:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2460 committed 00000004:00080000:0.0:1746066800.936303:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2452 committed 00000100:00100000:0.0:1746066800.936343:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976939136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066800.936394:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066800.936424:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976939648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066800.936430:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976939136 00000100:00100000:3.0:1746066800.936436:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976939136 00000100:00100000:0.0:1746066800.936439:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066800.936462:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976939648 00000100:00100000:3.0:1746066800.936465:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976939648 00000100:00100000:3.0:1746066800.936477:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15127 00000100:00100000:3.0:1746066800.936483:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3295:x1830882976939136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066800.936665:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746066800.936669:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066800.936671:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066800.936673:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066800.936694:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2017 -> 2017 00000100:00100000:1.0:1746066800.937086:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15128 00000100:00100000:1.0:1746066800.937099:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3295:x1830882976939648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066800.937244:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:1.0:1746066800.937246:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:1.0:1746066800.937248:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:1.0:1746066800.937250:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:1.0:1746066800.937251:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5921 -> 5921 00000100:00100000:0.0:1746066800.937924:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976940160:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066800.938006:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16596 initiator: MDT0 00000100:00100000:3.0:1746066800.938016:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3295:x1830882976939136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1532us (1621us total) trans 17179873717 rc 0/0 00010000:00010000:2.0:1746066800.938016:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066800.938022:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16596 initiator: MDT0 00000100:00100000:3.0:1746066800.938025:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15127 00010000:00010000:2.0:1746066800.938028:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800925a3000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066800.938038:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066800.938045:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16596 initiator: MDT0 00000100:00100000:1.0:1746066800.938115:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3295:x1830882976939648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1018us (1671us total) trans 17179873718 rc 0/0 00000100:00100000:1.0:1746066800.938122:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15128 00010000:00010000:2.0:1746066800.938175:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13d00) 00010000:00010000:2.0:1746066800.938178:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066800.938183:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066800.938189:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608cd83 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16596 initiator: MDT0 00000100:00100000:2.0:1746066800.938354:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e869880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976939392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.938381:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066800.938863:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976939392 00000100:00100000:1.0:1746066800.938870:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976939392 00000100:00100000:0.0:1746066800.939375:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976939264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.939408:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066800.939452:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976939904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066800.939543:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976939264 00000100:00100000:1.0:1746066800.939547:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976939264 00000100:00100000:3.0:1746066800.939552:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15129 00000100:00100000:0.0:1746066800.939556:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976939776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066800.939563:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:3293:x1830882976939392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066800.939570:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15130 00000100:00100000:0.0:1746066800.939571:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066800.939577:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3296:x1830882976939264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.939730:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976940288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066800.939745:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746066800.939754:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066800.939757:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066800.939759:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066800.939761:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066800.939762:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:1.0:1746066800.939763:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066800.939767:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:1.0:1746066800.939769:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:1.0:1746066800.939771:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:1.0:1746066800.939772:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746066800.939786:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3293:x1830882976939392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (1404us total) trans 17179873719 rc 0/0 00000100:00100000:3.0:1746066800.939792:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15129 00000100:00100000:1.0:1746066800.939807:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3296:x1830882976939264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 231us (398us total) trans 21474841023 rc 0/0 00000100:00100000:1.0:1746066800.939812:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15130 00000100:00100000:0.0:1746066800.939985:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976940800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066800.939999:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066800.940083:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976939776 00000100:00100000:3.0:1746066800.940088:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976940288 00000100:00100000:2.0:1746066800.940088:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976939776 00000100:00100000:3.0:1746066800.940090:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976940288 00000100:00100000:2.0:1746066800.940110:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15131 00000100:00100000:3.0:1746066800.940113:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15132 00000100:00100000:2.0:1746066800.940114:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3296:x1830882976939776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066800.940116:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3296:x1830882976940288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066800.940193:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3296:x1830882976940288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (447us total) trans 17179873721 rc 0/0 00000100:00100000:2.0:1746066800.940197:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3296:x1830882976939776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (625us total) trans 17179873720 rc 0/0 00000100:00100000:3.0:1746066800.940199:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15132 00000100:00100000:2.0:1746066800.940202:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15131 00000100:00100000:2.0:1746066800.942327:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976939520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066800.942872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.943193:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977168640 00000100:00100000:3.0:1746066800.943200:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977168640 00000100:00100000:3.0:1746066800.943243:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10114 00000100:00100000:3.0:1746066800.943250:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:31868:x1830882977168640:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066800.943275:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.943296:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608cd8a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f3a8 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.943502:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976940800 00000100:00100000:1.0:1746066800.943512:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976940800 00000004:00080000:0.0:1746066800.943521:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929ce300/2, rc 0, transno 21474841023 00000100:00100000:0.0:1746066800.943528:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976939264:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066800.943550:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e86b480/2, rc 0, transno 17179873720 00000100:00100000:1.0:1746066800.943559:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15133 00000100:00100000:0.0:1746066800.943559:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976939776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066800.943565:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3296:x1830882976940800:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066800.943568:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e86a300/2, rc 0, transno 17179873721 00000100:00100000:0.0:1746066800.943571:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976940288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.943627:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066800.943647:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976940032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.943666:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066800.943696:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976940544:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.943712:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066800.943723:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976941056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066800.943736:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066800.943759:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066800.943776:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976940416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066800.943778:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3296:x1830882976940800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 212us (3775us total) trans 17179873722 rc 0/0 00000100:00100000:1.0:1746066800.943784:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15133 00000100:00100000:2.0:1746066800.943794:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066800.943807:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976939520 00000100:00100000:1.0:1746066800.943810:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976939520 00000100:00100000:1.0:1746066800.943825:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976940032 00000100:00100000:1.0:1746066800.943827:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976940032 00000100:00100000:1.0:1746066800.943836:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976940544 00000100:00100000:1.0:1746066800.943838:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976940544 00000100:00100000:1.0:1746066800.943845:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976941056 00010000:00010000:3.0:1746066800.943846:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608cd8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a8 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.943847:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976941056 00000100:00100000:1.0:1746066800.943852:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976939904 00000100:00100000:1.0:1746066800.943854:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976939904 00010000:00010000:3.0:1746066800.943859:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608cd8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a8 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066800.943860:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976940416 00000100:00100000:1.0:1746066800.943862:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976940416 00000100:00100000:1.0:1746066800.943870:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15134 00000100:00100000:1.0:1746066800.943874:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3294:x1830882976939520:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746066800.943877:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066800.943880:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066800.943883:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e881000, rc 0) 00000100:00100000:3.0:1746066800.943920:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31868:x1830882977168640:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 671us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066800.943927:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10114 00000100:00100000:3.0:1746066800.943991:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15135 00000100:00100000:3.0:1746066800.943997:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3294:x1830882976940032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066800.944050:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066800.944053:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:1.0:1746066800.944055:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:1.0:1746066800.944057:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:1.0:1746066800.944058:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746066800.944088:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3294:x1830882976939520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (460us total) trans 21474841024 rc 0/0 00000100:00100000:1.0:1746066800.944093:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15134 00000100:00100000:1.0:1746066800.944104:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15136 00000100:00100000:1.0:1746066800.944108:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3294:x1830882976940544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.944156:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976940928:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066800.944184:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746066800.944187:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746066800.944188:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066800.944190:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746066800.944191:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746066800.944302:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15137 00000100:00100000:0.0:1746066800.944310:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3294:x1830882976941056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066800.945319:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3294:x1830882976940032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1321us (1650us total) trans 17179873723 rc 0/0 00000100:00100000:3.0:1746066800.945327:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15135 00000100:00100000:3.0:1746066800.945345:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15138 00000100:00100000:3.0:1746066800.945351:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3293:x1830882976939904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066800.945443:0:4614:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066800.945446:0:4614:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066800.945447:0:4614:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066800.945449:0:4614:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066800.945450:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:2.0:1746066800.945520:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746066800.945566:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e869880/2, rc 0, transno 17179873719 00000100:00100000:2.0:1746066800.945571:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e869880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976939392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.945591:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976940928 00000100:00100000:2.0:1746066800.945595:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976940928 00000100:00100000:2.0:1746066800.945614:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15139 00000100:00100000:2.0:1746066800.945619:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3293:x1830882976940416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066800.945731:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3293:x1830882976940416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (1936us total) trans 21474841027 rc 0/0 00000100:00100000:2.0:1746066800.945737:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15139 00000100:00100000:2.0:1746066800.945746:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15140 00000100:00100000:2.0:1746066800.945750:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3293:x1830882976940928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066800.945819:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3293:x1830882976940928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (299us total) trans 21474841028 rc 0/0 00000100:00100000:2.0:1746066800.945825:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15140 00000004:00080000:2.0:1746066800.945873:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e841f80/2, rc 0, transno 21474841024 00000100:00100000:2.0:1746066800.945878:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976939520:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066800.945886:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e86bb80/2, rc 0, transno 17179873723 00000100:00100000:2.0:1746066800.945888:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976940032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.945905:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066800.945928:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976940672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066800.945944:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746066800.945960:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e86b800/2, rc 0, transno 17179873717 00000100:00100000:2.0:1746066800.945963:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976939136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.945971:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976941184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.945986:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746066800.945998:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e868e00/2, rc 0, transno 17179873718 00000100:00100000:2.0:1746066800.946001:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976939648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.946012:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976940160 00000100:00100000:2.0:1746066800.946014:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976940160 00000100:00100000:2.0:1746066800.946023:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976940672 00000100:00100000:2.0:1746066800.946025:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976940672 00000100:00100000:2.0:1746066800.946031:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976941184 00000100:00100000:2.0:1746066800.946033:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976941184 00000100:00100000:2.0:1746066800.946041:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15141 00000100:00100000:2.0:1746066800.946045:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3295:x1830882976940160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066800.946123:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3295:x1830882976940160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (217us total) trans 21474841029 rc 0/0 00000100:00100000:2.0:1746066800.946129:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15141 00000100:00100000:2.0:1746066800.946136:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15142 00000100:00100000:2.0:1746066800.946141:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3295:x1830882976940672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066800.946206:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3295:x1830882976940672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (260us total) trans 21474841030 rc 0/0 00000100:00100000:2.0:1746066800.946211:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15142 00000100:00100000:2.0:1746066800.946219:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15143 00000100:00100000:2.0:1746066800.946223:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3295:x1830882976941184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066800.946306:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3295:x1830882976941184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (319us total) trans 17179873725 rc 0/0 00000100:00100000:2.0:1746066800.946311:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15143 00000004:00080000:2.0:1746066800.946328:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e868000/2, rc 0, transno 17179873725 00000100:00100000:2.0:1746066800.946331:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976941184:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066800.946338:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e841880/2, rc 0, transno 21474841029 00000100:00100000:2.0:1746066800.946341:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976940160:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066800.946348:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e843800/2, rc 0, transno 21474841030 00000100:00100000:2.0:1746066800.946351:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976940672:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066800.946362:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e841180/2, rc 0, transno 21474841027 00000100:00100000:2.0:1746066800.946365:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976940416:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066800.946371:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e840a80/2, rc 0, transno 21474841028 00000100:00100000:2.0:1746066800.946373:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976940928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066800.946990:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3293:x1830882976939904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1639us (3230us total) trans 21474841026 rc 0/0 00000100:00100000:0.0:1746066800.946991:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3294:x1830882976941056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2681us (3252us total) trans 21474841025 rc 0/0 00000100:00100000:3.0:1746066800.946996:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15138 00000100:00100000:0.0:1746066800.946999:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15137 00000100:00100000:1.0:1746066800.947009:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3294:x1830882976940544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2892us (3287us total) trans 17179873724 rc 0/0 00000100:00100000:1.0:1746066800.947020:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15136 00000004:00080000:0.0:1746066800.947099:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e868700/2, rc 0, transno 17179873722 00000100:00100000:0.0:1746066800.947103:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976940800:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066800.948114:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e86b100/2, rc 0, transno 17179873724 00000100:00100000:2.0:1746066800.948120:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976940544:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066800.948131:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16f480/2, rc 0, transno 21474841025 00000100:00100000:2.0:1746066800.948134:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976941056:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066800.948150:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e843b80/2, rc 0, transno 21474841026 00000100:00100000:2.0:1746066800.948153:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976939904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066800.960631:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.962296:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977168896 00000100:00100000:3.0:1746066800.962309:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977168896 00000100:00100000:3.0:1746066800.962366:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4242 00000100:00100000:3.0:1746066800.962374:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31868:x1830882977168896:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:3.0:1746066800.962998:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31868:x1830882977168896:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 622us (2374us total) trans 8589944192 rc 0/0 00000100:00100000:3.0:1746066800.963006:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4242 00000100:00100000:0.0:1746066800.981013:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066800.981480:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977169152 00000100:00100000:3.0:1746066800.981491:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977169152 00000100:00100000:3.0:1746066800.981563:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10115 00000100:00100000:3.0:1746066800.981572:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+6:31874:x1830882977169152:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066800.981598:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066800.981629:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cd91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f3af expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.981775:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f200/0xfb36a14ee608cd98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.981788:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f200/0xfb36a14ee608cd98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.981798:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f200/0xfb36a14ee608cd98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.981811:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608cd9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.981816:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608cd9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.981821:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608cd9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.981932:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e400/0xfb36a14ee608cda6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.981939:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e400/0xfb36a14ee608cda6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.981944:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e400/0xfb36a14ee608cda6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:3.0:1746066800.981955:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066800.982041:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f200/0xfb36a14ee608cd98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.982048:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f200/0xfb36a14ee608cd98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.982053:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f200/0xfb36a14ee608cd98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.982059:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b5f200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066800.982063:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f200/0xfb36a14ee608cd98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.982070:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f200/0xfb36a14ee608cd98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.982084:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066800.982087:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066800.982091:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f200/0xfb36a14ee608cd98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.982096:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f200/0xfb36a14ee608cd98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.985576:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608cd9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.985593:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608cd9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.985600:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608cd9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.985611:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b5ea00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066800.985615:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608cd9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.985631:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608cd9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.985649:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d3b8d00) 00010000:00010000:3.0:1746066800.985652:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066800.985655:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608cd9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.985659:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608cd9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066800.985749:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608cd91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3af expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.985761:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e400/0xfb36a14ee608cda6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3af expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066800.985766:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066800.985768:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066800.985770:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5e400, rc 0) 00000100:00100000:3.0:1746066800.985853:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:31874:x1830882977169152:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4280us (4849us total) trans 8589944193 rc 0/0 00000100:00100000:3.0:1746066800.985862:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10115 00000100:00100000:0.0:1746066800.993371:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066800.993972:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066800.997492:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066800.998004:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977169536 00000100:00100000:1.0:1746066800.998016:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977169536 00000100:00100000:2.0:1746066800.998062:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977169664 00000100:00100000:2.0:1746066800.998066:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977169664 00000100:00100000:2.0:1746066800.998102:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977169920 00000100:00100000:2.0:1746066800.998104:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977169920 00000100:00100000:1.0:1746066800.998148:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10116 00000100:00100000:0.0:1746066800.998155:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10117 00000100:00100000:1.0:1746066800.998157:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+9:31874:x1830882977169664:12345-192.168.202.57@tcp:101:multiop.0 00000100:00100000:0.0:1746066800.998162:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+9:31879:x1830882977169536:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:1.0:1746066800.998191:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10118 00000100:00100000:1.0:1746066800.998196:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+250:31880:x1830882977169920:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066800.998209:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.998209:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.998212:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066800.998226:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cdb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f3c4 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.998236:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e400/0xfb36a14ee608cda6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3af expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.998252:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066800.998257:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066800.998262:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06200/0xfb36a14ee608cdbb lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f3bd expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.998300:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066800.998310:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608cd8a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a8 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066800.998316:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066800.998333:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4400/0xfb36a14ee608cdc9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998340:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4400/0xfb36a14ee608cdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066800.998344:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608cd8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a8 expref: 7 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.998349:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4400/0xfb36a14ee608cdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066800.998353:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608cd8a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a8 expref: 7 pid: 14549 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066800.998360:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4200/0xfb36a14ee608cdd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998364:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4200/0xfb36a14ee608cdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00000100:00100000:0.0:1746066800.998364:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976941312:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066800.998369:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4200/0xfb36a14ee608cdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998462:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4000/0xfb36a14ee608cdd7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998468:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4000/0xfb36a14ee608cdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998473:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4000/0xfb36a14ee608cdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:1.0:1746066800.998481:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000100:00100000:0.0:1746066800.998504:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746066800.998520:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066800.998527:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06a00/0xfb36a14ee608cde5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f3b6 expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.998575:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4000/0xfb36a14ee608cdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066800.998576:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4a00/0xfb36a14ee608cdec lrc: 3/1,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066800.998581:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4000/0xfb36a14ee608cdd7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998590:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4000/0xfb36a14ee608cdd7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066800.998591:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4a00/0xfb36a14ee608cdec lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066800.998596:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4a00/0xfb36a14ee608cdec lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066800.998597:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eee4000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066800.998601:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4000/0xfb36a14ee608cdd7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00000004:00200000:0.0:1746066800.998602:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066800.998607:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4000/0xfb36a14ee608cdd7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998614:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066800.998616:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1746066800.998619:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4000/0xfb36a14ee608cdd7 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998623:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4000/0xfb36a14ee608cdd7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998635:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4400/0xfb36a14ee608cdc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998639:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4400/0xfb36a14ee608cdc9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998643:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4400/0xfb36a14ee608cdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998647:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eee4400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066800.998649:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4400/0xfb36a14ee608cdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998653:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4400/0xfb36a14ee608cdc9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066800.998654:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06a00/0xfb36a14ee608cde5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3b6 expref: 12 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.998662:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066800.998664:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066800.998664:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4a00/0xfb36a14ee608cdec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3b6 expref: 11 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.998666:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4400/0xfb36a14ee608cdc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998670:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4400/0xfb36a14ee608cdc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066800.998670:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066800.998672:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066800.998688:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf4a00, rc 0) 00010000:00010000:1.0:1746066800.998692:0:20127:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4200/0xfb36a14ee608cdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998695:0:20127:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4200/0xfb36a14ee608cdd0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998699:0:20127:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4200/0xfb36a14ee608cdd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998703:0:20127:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eee4200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066800.998705:0:20127:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4200/0xfb36a14ee608cdd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998709:0:20127:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4200/0xfb36a14ee608cdd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00000100:00100000:0.0:1746066800.998712:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:31879:x1830882977169536:12345-192.168.202.57@tcp:101:cat.0 Request processed in 551us (5354us total) trans 8589944195 rc 0/0 00010000:00010000:1.0:1746066800.998715:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebeb500) 00010000:00010000:1.0:1746066800.998716:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066800.998718:0:20127:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4200/0xfb36a14ee608cdd0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00000100:00100000:0.0:1746066800.998718:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10117 00010000:00010000:1.0:1746066800.998722:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4200/0xfb36a14ee608cdd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00010000:00010000:1.0:1746066800.998742:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cdb4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3c4 expref: 252 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.998750:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cdb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3c4 expref: 252 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066800.998757:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eee5c00, rc 0) 00000100:00100000:1.0:1746066800.998774:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:31880:x1830882977169920:12345-192.168.202.57@tcp:101:cat.0 Request processed in 578us (1293us total) trans 8589944194 rc 301/301 00000100:00100000:1.0:1746066800.998779:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10118 00000100:00100000:0.0:1746066801.003274:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976941312:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066801.003303:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746066801.003512:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.003552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.003584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.003631:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.003658:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977170048 00000100:00100000:2.0:1746066801.003664:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977170048 00010000:00010000:2.0:1746066801.003725:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608cd8a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a8 expref: 8 pid: 14549 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746066801.003755:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7789 00000100:00100000:2.0:1746066801.003763:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a540a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977170048:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.003775:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.003781:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608cd8a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a8 expref: 8 pid: 14549 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.003790:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608cd8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a8 expref: 8 pid: 14549 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.003812:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e881000/0xfb36a14ee608cd8a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a8 expref: 8 pid: 14549 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.003828:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066801.003833:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066801.003842:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066801.003847:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066801.003864:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.003903:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a540a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977170048:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 141us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.003908:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7789 00000100:00100000:3.0:1746066801.004111:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977170176 00000100:00100000:3.0:1746066801.004116:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977170176 00000100:00100000:3.0:1746066801.004139:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977170560 00000100:00100000:3.0:1746066801.004141:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977170560 00000100:00100000:3.0:1746066801.004153:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977170304 00000100:00100000:3.0:1746066801.004155:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977170304 00000100:00100000:3.0:1746066801.004164:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10119 00000100:00100000:3.0:1746066801.004169:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+11:31879:x1830882977170176:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.004189:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.004200:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fc00/0xfb36a14ee608cdfa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f3cb expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.004279:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066801.004287:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066801.004292:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066801.004304:0:809:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066801.004311:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:3.0:1746066801.004341:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10120 00000100:00100000:3.0:1746066801.004346:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31876:x1830882977170560:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066801.004355:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.004361:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fa00/0xfb36a14ee608ce08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f3d9 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.004440:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ce0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004447:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ce0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004454:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ce0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004465:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f600/0xfb36a14ee608ce16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004470:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f600/0xfb36a14ee608ce16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004475:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f600/0xfb36a14ee608ce16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004576:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608ce1d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004583:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608ce1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004588:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608ce1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746066801.004596:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066801.004702:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608ce1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004709:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608ce1d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004719:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608ce1d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004725:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b5e600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066801.004727:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608ce1d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004733:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608ce1d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004740:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066801.004742:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1746066801.004744:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066801.004749:0:14548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066801.004755:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608ce1d lrc: 2/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004759:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608ce1d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004775:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ce0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004779:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ce0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004783:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ce0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004786:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b5fe00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066801.004790:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ce0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004794:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ce0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004799:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066801.004801:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066801.004803:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ce0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004807:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608ce0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004814:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f600/0xfb36a14ee608ce16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004818:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f600/0xfb36a14ee608ce16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004822:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f600/0xfb36a14ee608ce16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004825:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b5f600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066801.004827:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f600/0xfb36a14ee608ce16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004831:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f600/0xfb36a14ee608ce16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004836:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d3b8300) 00010000:00010000:3.0:1746066801.004838:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066801.004840:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f600/0xfb36a14ee608ce16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004848:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f600/0xfb36a14ee608ce16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004878:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fa00/0xfb36a14ee608ce08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3d9 expref: 254 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.004885:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fa00/0xfb36a14ee608ce08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3d9 expref: 254 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.004891:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5fa00, rc 0) 00000100:00100000:3.0:1746066801.004919:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31876:x1830882977170560:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 573us (1367us total) trans 8589944196 rc 301/301 00000100:00100000:3.0:1746066801.004925:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10120 00000100:00100000:3.0:1746066801.004938:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10121 00000100:00100000:3.0:1746066801.004944:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31880:x1830882977170304:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.004951:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.004956:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e000/0xfb36a14ee608ce2b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f3d2 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.004986:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004992:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.004996:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00080000:1.0:1746066801.005171:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746066801.005510:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066801.005521:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00000040:00080000:0.0:1746066801.006347:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3188, 88 off269800 00000004:00080000:0.0:1746066801.006355:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762183678305ns, next at 749511128030ns, rc = 0 00000040:00080000:0.0:1746066801.006397:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3194, 88 off270240 00000004:00080000:0.0:1746066801.006402:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762183725787ns, next at 749511475809ns, rc = 0 00000040:00080000:0.0:1746066801.008640:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3196, 88 off270424 00000004:00080000:0.0:1746066801.008652:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762185975691ns, next at 749511475809ns, rc = 0 00000040:00080000:0.0:1746066801.008689:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3189, 88 off269888 00000004:00080000:0.0:1746066801.008694:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762186017701ns, next at 749511128030ns, rc = 0 00000040:00080000:0.0:1746066801.008706:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3190, 88 off269976 00000004:00080000:0.0:1746066801.008709:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762186033016ns, next at 749511128030ns, rc = 0 00000040:00080000:0.0:1746066801.008718:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3197, 88 off270512 00000004:00080000:0.0:1746066801.008720:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762186044283ns, next at 749511475809ns, rc = 0 00000040:00080000:0.0:1746066801.008726:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3198, 88 off270600 00000004:00080000:0.0:1746066801.008728:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762186052521ns, next at 749511475809ns, rc = 0 00000040:00080000:0.0:1746066801.008735:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3199, 88 off270688 00000004:00080000:0.0:1746066801.008737:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762186061071ns, next at 749511475809ns, rc = 0 00000040:00080000:0.0:1746066801.008742:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3191, 88 off270064 00000004:00080000:0.0:1746066801.008744:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762186068191ns, next at 749511128030ns, rc = 0 00000040:00080000:0.0:1746066801.008749:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3200, 88 off270776 00000004:00080000:0.0:1746066801.008751:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762186075506ns, next at 749511475809ns, rc = 0 00000040:00080000:0.0:1746066801.008756:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3192, 88 off270152 00000004:00080000:0.0:1746066801.008758:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762186082321ns, next at 749511128030ns, rc = 0 00000040:00080000:0.0:1746066801.008764:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3201, 88 off270864 00000004:00080000:0.0:1746066801.008767:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762186091306ns, next at 749511475809ns, rc = 0 00000040:00080000:0.0:1746066801.008772:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3193, 88 off270240 00000004:00080000:0.0:1746066801.008775:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762186098698ns, next at 749511128030ns, rc = 0 00000040:00080000:0.0:1746066801.008826:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3195, 88 off270424 00000004:00080000:0.0:1746066801.008828:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762186152593ns, next at 749511128030ns, rc = 0 00000040:00080000:0.0:1746066801.008836:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3196, 88 off270512 00000004:00080000:0.0:1746066801.008839:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762186162708ns, next at 749511128030ns, rc = 0 00000040:00080000:0.0:1746066801.008845:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3197, 88 off270600 00000004:00080000:0.0:1746066801.008847:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762186171586ns, next at 749511128030ns, rc = 0 00000040:00080000:0.0:1746066801.008854:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3202, 88 off270952 00000004:00080000:0.0:1746066801.008857:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762186180854ns, next at 749511475809ns, rc = 0 00010000:00010000:3.0:1746066801.054540:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3bd expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.054559:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066801.054562:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746066801.054565:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066801.054574:0:14549:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066801.054579:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066801.054584:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.054589:0:14549:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.054593:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.054635:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06200/0xfb36a14ee608cdbb lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3bd expref: 14 pid: 14549 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746066801.054653:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3bd expref: 13 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.054705:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed06000, rc 0) 00000100:00100000:3.0:1746066801.054773:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:31874:x1830882977169664:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 56616us (60800us total) trans 8589944197 rc 0/0 00000100:00100000:3.0:1746066801.054783:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10116 00010000:00010000:3.0:1746066801.054817:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.054823:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746066801.054855:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066801.054859:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066801.054875:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.054899:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e000/0xfb36a14ee608ce2b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3d2 expref: 254 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.054909:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3d2 expref: 253 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.054914:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066801.054916:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746066801.054918:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5ea00, rc 0) 00000100:00100000:3.0:1746066801.054934:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31880:x1830882977170304:12345-192.168.202.57@tcp:101:cat.0 Request processed in 49991us (51349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.054940:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10121 00010000:00010000:3.0:1746066801.054957:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066801.054962:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:3.0:1746066801.054978:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066801.054980:0:809:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066801.054985:0:809:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066801.055004:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fc00/0xfb36a14ee608cdfa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3cb expref: 13 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.055013:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3cb expref: 12 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.055019:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066801.055021:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746066801.055022:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5f800, rc 0) 00000100:00100000:3.0:1746066801.055037:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:31879:x1830882977170176:12345-192.168.202.57@tcp:101:cat.0 Request processed in 50869us (51527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.055043:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10119 00000001:00080000:0.0:1746066801.055244:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944197 is committed 00000004:00080000:0.0:1746066801.055252:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2475 committed 00000004:00080000:0.0:1746066801.055269:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2469 committed 00000004:00080000:0.0:1746066801.055275:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2468 committed 00000004:00080000:0.0:1746066801.055277:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2467 committed 00000004:00080000:0.0:1746066801.055278:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2466 committed 00000004:00080000:0.0:1746066801.055280:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2474 committed 00000004:00080000:0.0:1746066801.055282:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2465 committed 00000004:00080000:0.0:1746066801.055285:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2473 committed 00000004:00080000:0.0:1746066801.055286:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2464 committed 00000004:00080000:0.0:1746066801.055288:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2472 committed 00000004:00080000:0.0:1746066801.055290:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2471 committed 00000004:00080000:0.0:1746066801.055292:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2470 committed 00000004:00080000:0.0:1746066801.055294:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2463 committed 00000004:00080000:0.0:1746066801.055295:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2462 committed 00000004:00080000:0.0:1746066801.055297:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2469 committed 00000004:00080000:0.0:1746066801.055299:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2468 committed 00000004:00080000:0.0:1746066801.055301:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2461 committed 00000001:00080000:0.0:1746066801.055314:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944194 is committed 00000001:00080000:0.0:1746066801.055319:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944196 is committed 00000001:00080000:0.0:1746066801.055326:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944192 is committed 00000100:00100000:2.0:1746066801.057357:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746066801.057380:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976941440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066801.057487:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976941696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066801.057547:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066801.057581:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066801.057608:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976941568:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066801.057628:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066801.057629:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976941952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066801.057725:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976941696 00000100:00100000:3.0:1746066801.057734:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976941696 00000100:00100000:2.0:1746066801.057760:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976941440 00000100:00100000:2.0:1746066801.057764:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976941440 00000100:00100000:3.0:1746066801.057774:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976941568 00000100:00100000:3.0:1746066801.057777:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976941568 00000100:00100000:2.0:1746066801.057790:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15144 00000100:00100000:2.0:1746066801.057798:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3294:x1830882976941696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066801.058101:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:2.0:1746066801.058104:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:2.0:1746066801.058106:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:2.0:1746066801.058109:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:2.0:1746066801.058110:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5921 -> 5921 00000100:00100000:2.0:1746066801.058143:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3294:x1830882976941696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 344us (595us total) trans 17179873726 rc 0/0 00000100:00100000:3.0:1746066801.058334:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15145 00000100:00100000:0.0:1746066801.058352:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15146 00000100:00100000:2.0:1746066801.058358:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15144 00000100:00100000:0.0:1746066801.058359:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3293:x1830882976941568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066801.058465:0:8452:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066801.058468:0:8452:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066801.058470:0:8452:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066801.058471:0:8452:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066801.058473:0:8452:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746066801.058499:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3293:x1830882976941568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 142us (870us total) trans 17179873727 rc 0/0 00000100:00100000:0.0:1746066801.058505:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15146 00000100:00100000:0.0:1746066801.058521:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066801.058544:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976941952 00000100:00100000:0.0:1746066801.058547:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976941952 00000100:00100000:0.0:1746066801.058563:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15147 00000100:00100000:0.0:1746066801.058567:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3296:x1830882976941952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066801.058651:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3296:x1830882976941952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (129us total) trans 17179873728 rc 0/0 00000100:00100000:0.0:1746066801.058657:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15147 00000100:00100000:3.0:1746066801.058767:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3295:x1830882976941440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066801.058847:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746066801.058849:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066801.058851:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066801.058853:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066801.058855:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2017 -> 2017 00000100:00100000:3.0:1746066801.058889:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3295:x1830882976941440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (1308us total) trans 17179873729 rc 0/0 00000100:00100000:3.0:1746066801.058895:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15145 00000100:00080000:3.0:1746066801.058911:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066801.060367:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.060590:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977170688 00000100:00100000:3.0:1746066801.060597:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977170688 00000100:00100000:3.0:1746066801.060645:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15148 00000100:00100000:3.0:1746066801.060651:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+22:31874:x1830882977170688:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066801.060666:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.060702:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f3e0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746066801.060706:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746066801.060731:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608cd3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f39a expref: 13 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.060738:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.060740:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.060744:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2416640->2424831] (req 2416640->2424831) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 23 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.060773:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608cd3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f39a expref: 13 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.060785:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608cd3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f39a expref: 13 pid: 21203 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746066801.060797:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976942464:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066801.061203:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.061405:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977170816 00000100:00100000:3.0:1746066801.061409:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977170816 00000100:00100000:3.0:1746066801.061435:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10122 00000100:00100000:3.0:1746066801.061440:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:31880:x1830882977170816:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.061457:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.061471:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b40aa00/0xfb36a14ee608ce40 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f3e7 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.061520:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b40aa00/0xfb36a14ee608ce40 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e7 expref: 252 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.061544:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b40aa00/0xfb36a14ee608ce40 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e7 expref: 252 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.061561:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066801.061564:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066801.061566:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b40aa00, rc 0) 00000100:00100000:3.0:1746066801.061590:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31880:x1830882977170816:12345-192.168.202.57@tcp:101:cat.0 Request processed in 150us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.061596:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10122 00000004:00080000:3.0:1746066801.062703:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099713480/2, rc 0, transno 17179873726 00000004:00080000:2.0:1746066801.062710:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e868380/2, rc 0, transno 17179873729 00000100:00100000:3.0:1746066801.062717:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976941696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066801.062717:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976941440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066801.062726:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976942208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066801.062731:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976941824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066801.062762:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066801.062782:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976942336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066801.062793:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066801.062803:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746066801.062806:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976942592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066801.062821:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066801.062832:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976941824 00000100:00100000:2.0:1746066801.062834:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976942976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066801.062835:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976941824 00000100:00100000:2.0:1746066801.062844:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066801.062853:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976943488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066801.062856:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976942336 00000100:00100000:3.0:1746066801.062858:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976942336 00000100:00100000:2.0:1746066801.062864:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066801.062872:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746066801.062875:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976943104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066801.062885:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066801.062894:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976943616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066801.062905:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066801.062913:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976942592 00000100:00100000:0.0:1746066801.062916:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976942592 00000100:00100000:2.0:1746066801.062921:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976942976 00000100:00100000:2.0:1746066801.062924:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976942976 00000100:00100000:0.0:1746066801.062935:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976943488 00000100:00100000:2.0:1746066801.062936:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976943104 00000100:00100000:0.0:1746066801.062937:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976943488 00000100:00100000:2.0:1746066801.062939:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976943104 00000100:00100000:0.0:1746066801.062945:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976943616 00000100:00100000:0.0:1746066801.062946:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976943616 00000100:00100000:2.0:1746066801.062947:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15149 00000100:00100000:2.0:1746066801.062952:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:3295:x1830882976941824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066801.062954:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15150 00000100:00100000:0.0:1746066801.062958:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3295:x1830882976942336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066801.063041:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15151 00000100:00100000:2.0:1746066801.063046:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3295:x1830882976942592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066801.063122:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3295:x1830882976942336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 163us (327us total) trans 17179873730 rc 0/0 00000100:00100000:0.0:1746066801.063127:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15150 00000100:00100000:0.0:1746066801.063138:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15152 00000100:00100000:0.0:1746066801.063141:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3295:x1830882976942976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066801.063155:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066801.063158:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:2.0:1746066801.063160:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:2.0:1746066801.063162:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:2.0:1746066801.063165:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746066801.063183:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3295:x1830882976942592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (360us total) trans 21474841031 rc 0/0 00000100:00100000:2.0:1746066801.063189:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15151 00000100:00100000:2.0:1746066801.063200:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15153 00002000:00010000:0.0:1746066801.063204:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:2.0:1746066801.063205:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3295:x1830882976943488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066801.063206:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066801.063208:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066801.063210:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066801.063211:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746066801.063226:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3295:x1830882976942976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (380us total) trans 21474841032 rc 0/0 00000100:00100000:0.0:1746066801.063230:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15152 00000100:00100000:0.0:1746066801.063238:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15154 00000100:00100000:0.0:1746066801.063241:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3295:x1830882976943104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066801.063275:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3295:x1830882976943488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (410us total) trans 21474841033 rc 0/0 00000100:00100000:2.0:1746066801.063281:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15153 00000100:00100000:2.0:1746066801.063289:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15155 00000100:00100000:2.0:1746066801.063293:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3295:x1830882976943616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066801.063300:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3295:x1830882976943104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (413us total) trans 21474841034 rc 0/0 00000100:00100000:0.0:1746066801.063305:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15154 00000100:00080000:0.0:1746066801.063316:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746066801.063334:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099712300/2, rc 0, transno 17179873728 00000100:00100000:0.0:1746066801.063336:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976941952:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066801.063351:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16c380/2, rc 0, transno 21474841034 00000100:00100000:0.0:1746066801.063353:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976943104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066801.063360:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3295:x1830882976943616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (453us total) trans 21474841035 rc 0/0 00000004:00080000:0.0:1746066801.063360:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16ce00/2, rc 0, transno 21474841035 00000100:00100000:0.0:1746066801.063362:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976943616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066801.063366:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15155 00000004:00080000:0.0:1746066801.063367:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16d180/2, rc 0, transno 21474841033 00000100:00100000:0.0:1746066801.063370:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976943488:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066801.063376:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16d500/2, rc 0, transno 21474841032 00000100:00100000:0.0:1746066801.063378:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976942976:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066801.063384:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16f100/2, rc 0, transno 21474841031 00000100:00100000:0.0:1746066801.063386:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976942592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066801.063391:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099712d80/2, rc 0, transno 17179873730 00000100:00100000:0.0:1746066801.063393:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976942336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066801.063430:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3295:x1830882976941824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 478us (668us total) trans 17179873731 rc 0/0 00000100:00100000:2.0:1746066801.063435:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15149 00000004:00080000:2.0:1746066801.063458:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099711180/2, rc 0, transno 17179873727 00000100:00100000:2.0:1746066801.063462:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976941568:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066801.063467:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976942080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066801.063473:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066801.063484:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066801.063491:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976942848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066801.063497:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976942720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066801.063509:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066801.063514:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976942208 00000100:00100000:2.0:1746066801.063516:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976942208 00000100:00100000:3.0:1746066801.063520:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976943360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066801.063526:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976942080 00000100:00100000:2.0:1746066801.063528:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976942080 00000100:00100000:3.0:1746066801.063542:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066801.063550:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976942848 00000100:00100000:2.0:1746066801.063552:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976942848 00000100:00100000:3.0:1746066801.063560:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976943360 00000100:00100000:3.0:1746066801.063562:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976943360 00000100:00100000:2.0:1746066801.063562:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15156 00000100:00100000:2.0:1746066801.063566:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3294:x1830882976942208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066801.063575:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15157 00000100:00100000:3.0:1746066801.063580:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3293:x1830882976942080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066801.063625:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15158 00000100:00100000:2.0:1746066801.063631:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3294:x1830882976942848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066801.063668:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3293:x1830882976942080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (182us total) trans 17179873733 rc 0/0 00000100:00100000:3.0:1746066801.063687:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15157 00000100:00100000:3.0:1746066801.063698:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15159 00000100:00100000:3.0:1746066801.063701:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3294:x1830882976943360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066801.063721:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3294:x1830882976942848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (211us total) trans 17179873734 rc 0/0 00000100:00100000:2.0:1746066801.063727:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15158 00000100:00100000:2.0:1746066801.063741:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066801.063756:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f16ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976943232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066801.063766:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+51:3294:x1830882976943360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (223us total) trans 21474841036 rc 0/0 00000100:00100000:3.0:1746066801.063771:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15159 00000100:00100000:2.0:1746066801.063772:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066801.063778:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976942720 00000100:00100000:3.0:1746066801.063780:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976942720 00000004:00080000:2.0:1746066801.063783:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099711500/2, rc 0, transno 17179873733 00000100:00100000:3.0:1746066801.063786:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976943232 00000100:00100000:2.0:1746066801.063786:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976942080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066801.063788:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976943232 00000100:00100000:3.0:1746066801.063794:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15160 00000100:00100000:3.0:1746066801.063797:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3293:x1830882976942720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066801.063799:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15161 00000100:00100000:2.0:1746066801.063803:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3293:x1830882976943232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066801.063851:0:4614:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066801.063853:0:4614:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066801.063855:0:4614:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066801.063857:0:4614:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:3.0:1746066801.063858:0:4614:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746066801.063878:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:3293:x1830882976942720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (137us total) trans 21474841037 rc 0/0 00000100:00100000:2.0:1746066801.063878:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3293:x1830882976943232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (105us total) trans 21474841038 rc 0/0 00000100:00100000:3.0:1746066801.063882:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15160 00000100:00100000:2.0:1746066801.063885:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15161 00002000:00010000:3.0:1746066801.063902:0:9776:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746066801.063904:0:9776:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746066801.063905:0:9776:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066801.063907:0:9776:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746066801.063908:0:9776:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746066801.063919:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:3294:x1830882976942208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 353us (446us total) trans 17179873732 rc 0/0 00000100:00100000:3.0:1746066801.063923:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15156 00000004:00080000:3.0:1746066801.063936:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e7800/2, rc 0, transno 17179873734 00000100:00100000:3.0:1746066801.063938:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976942848:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066801.063944:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16c000/2, rc 0, transno 21474841036 00000100:00100000:3.0:1746066801.063946:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976943360:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066801.063950:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099710380/2, rc 0, transno 17179873732 00000100:00100000:3.0:1746066801.063952:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976942208:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066801.063967:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16d880/2, rc 0, transno 21474841037 00000100:00100000:2.0:1746066801.063970:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976942720:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066801.063977:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f16ea00/2, rc 0, transno 21474841038 00000100:00100000:2.0:1746066801.063980:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f16ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976943232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066801.063997:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066801.067450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.067484:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.067497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.067509:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.067520:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000004:00080000:0.0:1746066801.067577:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099713b80/2, rc 0, transno 17179873731 00000100:00100000:0.0:1746066801.067584:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976941824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066801.067908:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976942464:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066801.068183:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066801.068185:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2416640->2424831] (req 2416640->2424831) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 23 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066801.068195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066801.068204:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b40a400, rc 0) 00000100:00100000:3.0:1746066801.068208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.068221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.068240:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977171072 00000100:00100000:1.0:1746066801.068241:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977170944 00000100:00100000:1.0:1746066801.068247:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977170944 00000100:00100000:0.0:1746066801.068247:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977171072 00000100:00100000:1.0:1746066801.068275:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977171328 00000100:00100000:0.0:1746066801.068275:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977171200 00000100:00100000:1.0:1746066801.068277:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977171328 00000100:00100000:0.0:1746066801.068277:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977171200 00000100:00100000:1.0:1746066801.068284:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977171584 00000100:00100000:0.0:1746066801.068284:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977171456 00000100:00100000:1.0:1746066801.068285:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977171584 00000100:00100000:0.0:1746066801.068285:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977171456 00000100:00100000:1.0:1746066801.068291:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977171712 00000100:00100000:0.0:1746066801.068291:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977171840 00000100:00100000:0.0:1746066801.068292:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977171840 00000100:00100000:1.0:1746066801.068293:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977171712 00000100:00100000:0.0:1746066801.068299:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977171968 00000100:00100000:0.0:1746066801.068301:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977171968 00000100:00100000:1.0:1746066801.068305:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15162 00000100:00100000:0.0:1746066801.068329:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15163 00000100:00100000:0.0:1746066801.068335:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977171072:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066801.068351:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066801.068367:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faf5000/0xfb36a14ee608ce47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f3f5 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.068385:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.068387:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.068395:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faf5000/0xfb36a14ee608ce47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3f5 expref: 18 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.068407:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faf5000/0xfb36a14ee608ce47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3f5 expref: 18 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.068414:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf5000, rc 0) 00000100:00100000:1.0:1746066801.068728:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977170944:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066801.068737:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066801.068747:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eee4a00/0xfb36a14ee608ce4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f3ee expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.068758:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066801.068759:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066801.068763:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eee4a00/0xfb36a14ee608ce4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3ee expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066801.068773:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eee4a00/0xfb36a14ee608ce4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3ee expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066801.068780:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eee4a00, rc 0) 00000100:00100000:3.0:1746066801.068956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.068958:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+27:31874:x1830882977170688:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 8306us (8597us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.068965:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15148 00000100:00100000:2.0:1746066801.068982:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977172096 00000100:00100000:2.0:1746066801.068985:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977172096 00000100:00100000:2.0:1746066801.068996:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15164 00000100:00100000:2.0:1746066801.069000:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977171200:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.069005:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.069013:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0400/0xfb36a14ee608ce55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f3fc expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.069022:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.069024:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.069027:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0400/0xfb36a14ee608ce55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3fc expref: 19 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.069036:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0400/0xfb36a14ee608ce55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3fc expref: 19 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.069042:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b0400, rc 0) 00000100:00100000:3.0:1746066801.069055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.069059:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977171200:12345-192.168.202.57@tcp:101:cat.0 Request processed in 59us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.069064:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15164 00000100:00100000:2.0:1746066801.069073:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977172224 00000100:00100000:2.0:1746066801.069076:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977172224 00000100:00100000:3.0:1746066801.069084:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.069085:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15165 00000100:00100000:2.0:1746066801.069089:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+26:1965:x1830882977171328:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.069098:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066801.069099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066801.069105:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608ce5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f403 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.069113:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.069114:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.069117:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608ce5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f403 expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.069125:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608ce5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f403 expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066801.069131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066801.069131:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b1e00, rc 0) 00000100:00100000:2.0:1746066801.069144:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882977171328:12345-192.168.202.57@tcp:101:cat.0 Request processed in 54us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.069148:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15165 00000100:00100000:2.0:1746066801.069156:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977172352 00000100:00100000:2.0:1746066801.069158:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977172352 00000100:00100000:2.0:1746066801.069168:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15166 00000100:00100000:3.0:1746066801.069170:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977172480 00000100:00100000:2.0:1746066801.069171:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977171584:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066801.069172:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977172480 00010000:00010000:2.0:1746066801.069176:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.069182:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0e00/0xfb36a14ee608ce63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f411 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.069189:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608cd3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f39a expref: 14 pid: 21203 timeout: 862 lvb_type: 1 00010000:00010000:2.0:1746066801.069190:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.069191:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.069194:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0e00/0xfb36a14ee608ce63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f411 expref: 19 pid: 21973 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066801.069206:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7790 00010000:00010000:2.0:1746066801.069206:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0e00/0xfb36a14ee608ce63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f411 expref: 19 pid: 21973 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066801.069210:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882977172480:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.069213:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b0e00, rc 0) 00010000:00010000:3.0:1746066801.069218:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066801.069228:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882977171584:12345-192.168.202.57@tcp:101:cat.0 Request processed in 56us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.069232:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15166 00010000:00010000:3.0:1746066801.069238:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608cd3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f39a expref: 14 pid: 21203 timeout: 862 lvb_type: 1 00000100:00100000:2.0:1746066801.069240:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15167 00000100:00100000:2.0:1746066801.069244:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977171456:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.069248:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608cd3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f39a expref: 14 pid: 21203 timeout: 862 lvb_type: 1 00010000:00010000:2.0:1746066801.069248:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.069253:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0200/0xfb36a14ee608ce6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f40a expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.069261:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.069262:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608cd3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f39a expref: 14 pid: 21203 timeout: 862 lvb_type: 1 00010000:00010000:2.0:1746066801.069265:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0200/0xfb36a14ee608ce6a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f40a expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.069272:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b0200/0xfb36a14ee608ce6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f40a expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.069273:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.069274:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.069278:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 26 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.069279:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b0200, rc 0) 00000100:00100000:2.0:1746066801.069290:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977171456:12345-192.168.202.57@tcp:101:cat.0 Request processed in 46us (1769us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066801.069294:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15167 00010000:00010000:3.0:1746066801.069296:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 26 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.069302:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15168 00000100:00100000:2.0:1746066801.069306:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882977171840:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.069311:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.069316:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608ce71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f41f expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.069324:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.069325:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.069326:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 25 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.069328:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608ce71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f41f expref: 24 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.069336:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608ce71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f41f expref: 24 pid: 21973 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066801.069339:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976943744:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066801.069342:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b1c00, rc 0) 00000100:00100000:2.0:1746066801.069353:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977171840:12345-192.168.202.57@tcp:101:cat.0 Request processed in 47us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.069357:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15168 00000100:00100000:2.0:1746066801.069365:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15169 00000100:00100000:2.0:1746066801.069369:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977171712:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.069374:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.069378:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1800/0xfb36a14ee608ce78 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f418 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066801.069380:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b480 going to sleep for 11 seconds 00010000:00010000:2.0:1746066801.069388:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.069389:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.069392:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1800/0xfb36a14ee608ce78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f418 expref: 32 pid: 21973 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066801.069397:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15170 00000100:00100000:3.0:1746066801.069402:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882977171968:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.069404:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1800/0xfb36a14ee608ce78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f418 expref: 32 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.069407:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.069410:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b1800, rc 0) 00010000:00010000:3.0:1746066801.069412:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608ce7f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f426 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.069420:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.069421:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066801.069421:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977171712:12345-192.168.202.57@tcp:101:cat.0 Request processed in 52us (1225us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066801.069425:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608ce7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f426 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066801.069425:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15169 00010000:00010000:3.0:1746066801.069433:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608ce7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f426 expref: 24 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066801.069433:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15171 00000100:00100000:2.0:1746066801.069437:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977172096:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.069440:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5e8600, rc 0) 00010000:00010000:2.0:1746066801.069441:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.069447:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608ce86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f42d expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066801.069451:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977171968:12345-192.168.202.57@tcp:101:cat.0 Request processed in 50us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.069455:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15170 00010000:00010000:2.0:1746066801.069455:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.069456:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.069459:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608ce86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f42d expref: 32 pid: 21973 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066801.069463:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15172 00000100:00100000:3.0:1746066801.069467:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977172224:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.069467:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608ce86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f42d expref: 32 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.069472:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.069472:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925a3000, rc 0) 00010000:00010000:3.0:1746066801.069476:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9600/0xfb36a14ee608ce8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f434 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.069483:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977172096:12345-192.168.202.57@tcp:101:cat.0 Request processed in 46us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.069487:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15171 00000100:00100000:2.0:1746066801.069496:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15173 00000100:00100000:3.0:1746066801.069498:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976943872:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066801.069500:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882977172352:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.069504:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.069508:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0800/0xfb36a14ee608ce94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f43b expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066801.069516:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b600 going to sleep for 11 seconds 00010000:00010000:2.0:1746066801.069516:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.069517:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.069520:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0800/0xfb36a14ee608ce94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f43b expref: 24 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.069527:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0800/0xfb36a14ee608ce94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f43b expref: 24 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.069545:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b0800, rc 0) 00000100:00100000:2.0:1746066801.069555:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977172352:12345-192.168.202.57@tcp:101:cat.0 Request processed in 55us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.069560:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15173 00000100:00100000:0.0:1746066801.069809:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977171072:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1473us (2323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.069816:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15163 00000100:00080000:0.0:1746066801.069831:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746066801.069834:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066801.070232:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+25:1966:x1830882977170944:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1919us (2793us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.070239:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15162 00000100:00100000:2.0:1746066801.072193:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977172608 00000100:00100000:2.0:1746066801.072205:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977172608 00000100:00100000:2.0:1746066801.072256:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10123 00000100:00100000:2.0:1746066801.072263:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31876:x1830882977172608:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066801.072281:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.072300:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92200/0xfb36a14ee608ce9b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f442 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.072358:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92200/0xfb36a14ee608ce9b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f442 expref: 253 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.072373:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92200/0xfb36a14ee608ce9b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f442 expref: 253 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.072391:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066801.072395:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066801.072398:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ef92200, rc 0) 00000100:00100000:2.0:1746066801.072455:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31876:x1830882977172608:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 192us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.072460:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10123 00000100:00100000:3.0:1746066801.074364:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976943744:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066801.074387:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.074426:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977172480:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5214us (5325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.074437:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7790 00000100:00100000:2.0:1746066801.074555:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976943872:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066801.074581:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9600/0xfb36a14ee608ce8d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f434 expref: 32 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.074594:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5e9600/0xfb36a14ee608ce8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f434 expref: 32 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.074605:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5e9600, rc 0) 00000100:00100000:2.0:1746066801.074625:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977172224:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5158us (5570us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066801.074632:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15172 00000100:00100000:0.0:1746066801.078551:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.078585:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.078625:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.078630:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977172864 00000100:00100000:3.0:1746066801.078640:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977172864 00000100:00100000:2.0:1746066801.078704:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977172992 00000100:00100000:2.0:1746066801.078708:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977172992 00000100:00100000:3.0:1746066801.078720:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 722 00000100:00100000:3.0:1746066801.078727:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:1963:x1830882977172864:12345-192.168.202.57@tcp:103:ldlm_bl.0 00002000:00100000:2.0:1746066801.078740:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (2416640->2420735) req@ffff8800a590fb80 x1830882977172992/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746066801.078741:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:2.0:1746066801.078749:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590fb80 with x1830882977172992 ext(2416640->2420735) 00002000:00010000:2.0:1746066801.078754:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590fb80 00010000:00010000:3.0:1746066801.078765:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ef92200/0xfb36a14ee608ce9b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f442 expref: 253 pid: 14548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.078779:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6868 00000100:00100000:2.0:1746066801.078784:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977172992:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066801.078964:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977172992:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 178us (421us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066801.078970:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6868 00002000:00100000:2.0:1746066801.078976:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (2416640->2420735) req@ffff8800a590fb80 x1830882977172992/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.078982:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590fb80 with x1830882977172992 ext(2416640->2420735) 00002000:00010000:2.0:1746066801.078984:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590fb80 00000100:00100000:2.0:1746066801.079005:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977173120 00000100:00100000:2.0:1746066801.079007:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977173120 00000100:00100000:2.0:1746066801.079026:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15174 00000100:00100000:2.0:1746066801.079030:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:31876:x1830882977173120:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066801.079418:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.079433:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f449 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.079457:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cd21 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f385 expref: 13 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.079465:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608ce71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f41f expref: 25 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.079472:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faf5000/0xfb36a14ee608ce47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3f5 expref: 17 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.079479:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.079481:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.079484:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.079512:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009faf5000/0xfb36a14ee608ce47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3f5 expref: 17 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.079522:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009faf5000/0xfb36a14ee608ce47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3f5 expref: 17 pid: 8452 timeout: 862 lvb_type: 1 00000100:00100000:2.0:1746066801.079541:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976944000:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.079614:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608ce71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f41f expref: 25 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.079619:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066801.079622:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608ce71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f41f expref: 25 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.079623:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.079630:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976944128:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066801.079641:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:1963:x1830882977172864:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 915us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.079647:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 722 00010000:00010000:2.0:1746066801.079651:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cd21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f385 expref: 13 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.079658:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cd21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f385 expref: 13 pid: 8112 timeout: 862 lvb_type: 1 00000100:00100000:2.0:1746066801.079671:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092848a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976944256:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.080243:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.083560:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976944000:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.085039:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.085070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.085138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.085167:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977173504 00000100:00100000:3.0:1746066801.085174:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977173504 00000100:00100000:2.0:1746066801.085176:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976944128:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066801.085209:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009faf5000/0xfb36a14ee608ce47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3f5 expref: 18 pid: 8452 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746066801.085232:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977173376 00000100:00100000:3.0:1746066801.085236:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7791 00000100:00100000:1.0:1746066801.085236:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977173376 00000100:00100000:3.0:1746066801.085242:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977173504:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066801.085256:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1746066801.085264:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2420736->2424831) req@ffff880092849c00 x1830882977173376/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.085273:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849c00 with x1830882977173376 ext(2420736->2424831) 00002000:00010000:1.0:1746066801.085276:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092849c00 00010000:00010000:3.0:1746066801.085278:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009faf5000/0xfb36a14ee608ce47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3f5 expref: 18 pid: 8452 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.085288:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009faf5000/0xfb36a14ee608ce47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3f5 expref: 18 pid: 8452 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.085312:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faf5000/0xfb36a14ee608ce47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3f5 expref: 18 pid: 8452 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.085324:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.085366:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977173504:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 123us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.085372:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7791 00000100:00100000:0.0:1746066801.085386:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977173760 00000100:00100000:0.0:1746066801.085389:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977173760 00002000:00100000:0.0:1746066801.085403:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009284aa00 x1830882977173760/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.085410:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284aa00 with x1830882977173760 ext(0->1048575) 00002000:00010000:0.0:1746066801.085413:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284aa00 00000100:00100000:0.0:1746066801.085427:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6869 00000100:00100000:0.0:1746066801.085431:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977173376:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066801.085596:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977173376:12345-192.168.202.57@tcp:3:cat.0 Request processed in 163us (559us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066801.085602:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6869 00002000:00100000:0.0:1746066801.085607:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (2420736->2424831) req@ffff880092849c00 x1830882977173376/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.085614:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849c00 with x1830882977173376 ext(2420736->2424831) 00002000:00010000:0.0:1746066801.085617:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092849c00 00000100:00100000:0.0:1746066801.085628:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6870 00000100:00100000:0.0:1746066801.085633:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882977173760:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066801.094261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.094284:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.094308:0:1992:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977174144 00000100:00100000:2.0:1746066801.094316:0:1992:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977174144 00002000:00100000:2.0:1746066801.094367:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff880092849500 x1830882977174144/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.094378:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849500 with x1830882977174144 ext(0->1048575) 00002000:00010000:2.0:1746066801.094384:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092849500 00000100:00100000:2.0:1746066801.094405:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6871 00000100:00100000:2.0:1746066801.094412:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882977174144:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066801.094804:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.094821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.094855:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.094872:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977174400 00000100:00100000:1.0:1746066801.094875:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977174400 00002000:00100000:1.0:1746066801.094892:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009f16ca80 x1830882977174400/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.094899:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16ca80 with x1830882977174400 ext(1048576->2097151) 00010000:00010000:1.0:1746066801.094906:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608ce71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f41f expref: 26 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746066801.094920:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608ce71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f41f expref: 26 pid: 21973 timeout: 862 lvb_type: 1 00002000:00010000:1.0:1746066801.094926:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f16ca80 00000100:00100000:1.0:1746066801.094937:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977174656 00000100:00100000:1.0:1746066801.094939:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977174656 00002000:00100000:1.0:1746066801.094946:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880135e58a80 x1830882977174656/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.094952:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e58a80 with x1830882977174656 ext(1048576->2097151) 00002000:00010000:1.0:1746066801.094955:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e58a80 00000100:00100000:1.0:1746066801.094961:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977174912 00000100:00100000:1.0:1746066801.094963:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977174912 00002000:00100000:1.0:1746066801.094969:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff880135e5b100 x1830882977174912/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.094975:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5b100 with x1830882977174912 ext(1048576->2097151) 00002000:00010000:1.0:1746066801.094977:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5b100 00000100:00100000:1.0:1746066801.094984:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2222 00000100:00100000:1.0:1746066801.094988:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977174400:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066801.095792:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6872 00000100:00100000:2.0:1746066801.095798:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977174656:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066801.096120:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6873 00000100:00100000:1.0:1746066801.096126:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977174912:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066801.098113:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977173888 00000100:00100000:3.0:1746066801.098126:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977173888 00010000:00010000:3.0:1746066801.098182:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cd21 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f385 expref: 14 pid: 8112 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746066801.098208:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7792 00000100:00100000:3.0:1746066801.098215:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882977173888:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066801.098228:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066801.098249:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cd21 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f385 expref: 14 pid: 8112 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.098262:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cd21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f385 expref: 14 pid: 8112 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.098290:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.098335:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882977173888:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 120us (4086us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.098342:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7792 00000100:00080000:0.0:1746066801.098767:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746066801.103188:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fdaca00/0xfb36a14ee608cd21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f385 expref: 13 pid: 8112 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746066801.103209:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092848a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976944256:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066801.103245:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.103263:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5b0c00, rc 0) 00000100:00100000:3.0:1746066801.103291:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:31876:x1830882977173120:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 24258us (24664us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.103300:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15174 00000100:00100000:0.0:1746066801.106102:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.106234:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977175168 00000100:00100000:3.0:1746066801.106245:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977175168 00000100:00100000:1.0:1746066801.107707:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882977173760:12345-192.168.202.57@tcp:3:cat.0 Request processed in 22068us (22563us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066801.107719:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6870 00002000:00100000:1.0:1746066801.107731:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009284aa00 x1830882977173760/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.107740:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284aa00 with x1830882977173760 ext(0->1048575) 00002000:00010000:1.0:1746066801.107745:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284aa00 00000100:00100000:3.0:1746066801.107832:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4243 00000100:00100000:3.0:1746066801.107841:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+9:31874:x1830882977175168:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066801.109486:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:31874:x1830882977175168:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 1636us (3384us total) trans 8589944198 rc 0/0 00000100:00100000:3.0:1746066801.109495:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4243 00000100:00100000:0.0:1746066801.125769:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977174144:12345-192.168.202.57@tcp:3:cat.0 Request processed in 31342us (31469us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066801.125782:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6871 00002000:00100000:0.0:1746066801.125799:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff880092849500 x1830882977174144/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.125809:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849500 with x1830882977174144 ext(0->1048575) 00002000:00010000:0.0:1746066801.125816:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092849500 00000100:00100000:3.0:1746066801.126142:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.126172:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977175296 00000100:00100000:3.0:1746066801.126179:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977175296 00000100:00100000:3.0:1746066801.126224:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15175 00000100:00100000:3.0:1746066801.126229:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:31879:x1830882977175296:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.126244:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.126267:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8800/0xfb36a14ee608cea9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f450 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.126293:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.126300:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.126306:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066801.126309:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8800/0xfb36a14ee608cea9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f450 expref: 18 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.126351:0:8450:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.126363:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8800/0xfb36a14ee608cea9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f450 expref: 18 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.126373:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebc8800, rc 0) 00000100:00100000:3.0:1746066801.126412:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:31879:x1830882977175296:12345-192.168.202.57@tcp:101:cat.0 Request processed in 183us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.126421:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15175 00000100:00100000:1.0:1746066801.126519:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977174400:12345-192.168.202.57@tcp:3:cat.0 Request processed in 31529us (31714us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066801.126540:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2222 00002000:00100000:1.0:1746066801.126547:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009f16ca80 x1830882977174400/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.126554:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16ca80 with x1830882977174400 ext(1048576->2097151) 00010000:00010000:1.0:1746066801.126560:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608ce71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f41f expref: 27 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746066801.126574:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608ce71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f41f expref: 27 pid: 21973 timeout: 862 lvb_type: 1 00002000:00010000:1.0:1746066801.126580:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f16ca80 00000100:00100000:1.0:1746066801.127868:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882977174912:12345-192.168.202.57@tcp:3:cat.0 Request processed in 31737us (33006us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066801.127877:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6873 00002000:00100000:1.0:1746066801.127885:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff880135e5b100 x1830882977174912/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.127893:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5b100 with x1830882977174912 ext(1048576->2097151) 00002000:00010000:1.0:1746066801.127898:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5b100 00000100:00100000:2.0:1746066801.130672:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977174656:12345-192.168.202.57@tcp:3:cat.0 Request processed in 34864us (35838us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066801.130712:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6872 00002000:00100000:2.0:1746066801.130726:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880135e58a80 x1830882977174656/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.130736:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e58a80 with x1830882977174656 ext(1048576->2097151) 00002000:00010000:2.0:1746066801.130742:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e58a80 00000100:00100000:0.0:1746066801.133433:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.133601:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977175424 00000100:00100000:2.0:1746066801.133611:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977175424 00000100:00100000:2.0:1746066801.133662:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15176 00000100:00100000:2.0:1746066801.133670:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31880:x1830882977175424:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.133725:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.133822:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608ceb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f457 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.133881:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.133889:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608ceb0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f457 expref: 26 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.133900:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608ceb0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f457 expref: 26 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.133912:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed69200, rc 0) 00000100:00100000:2.0:1746066801.133998:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31880:x1830882977175424:12345-192.168.202.57@tcp:101:cat.0 Request processed in 328us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.134004:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15176 00000100:00100000:0.0:1746066801.135575:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.135731:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977175552 00000100:00100000:3.0:1746066801.135737:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977175552 00010000:00010000:3.0:1746066801.135766:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608ce71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f41f expref: 26 pid: 21973 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746066801.135799:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7793 00000100:00100000:3.0:1746066801.135806:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977175552:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066801.135818:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066801.135844:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608ce71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f41f expref: 26 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.135856:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608ce71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f41f expref: 26 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.135879:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b1c00/0xfb36a14ee608ce71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f41f expref: 26 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.136021:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.136023:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.136031:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.136039:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.136073:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 25 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.136084:0:9852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 25 pid: 8450 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746066801.136097:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976944512:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066801.136181:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066801.137743:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976944512:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066801.137760:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.137798:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977175552:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1990us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.137807:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7793 00000100:00100000:0.0:1746066801.137983:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.138083:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977175808 00000100:00100000:2.0:1746066801.138088:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977175808 00002000:00100000:2.0:1746066801.138126:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38d:0x0] (2002944->2007039) req@ffff8800a8695f80 x1830882977175808/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.138142:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695f80 with x1830882977175808 ext(2002944->2007039) 00010000:00010000:2.0:1746066801.138149:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 25 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.138160:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 25 pid: 8450 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746066801.138166:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8695f80 00000100:00100000:2.0:1746066801.138255:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2223 00000100:00100000:2.0:1746066801.138262:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977175808:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066801.138725:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977175808:12345-192.168.202.57@tcp:3:cat.0 Request processed in 463us (741us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066801.138731:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2223 00002000:00100000:2.0:1746066801.138737:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38d:0x0] (2002944->2007039) req@ffff8800a8695f80 x1830882977175808/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.138744:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695f80 with x1830882977175808 ext(2002944->2007039) 00010000:00010000:2.0:1746066801.138749:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 25 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.138757:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 25 pid: 8450 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746066801.138763:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8695f80 00000100:00100000:0.0:1746066801.141834:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.141879:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.141904:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977176192 00000100:00100000:2.0:1746066801.141913:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977176192 00000100:00100000:2.0:1746066801.141981:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15177 00000100:00100000:2.0:1746066801.142043:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31876:x1830882977176192:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066801.142061:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.142079:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f45e expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.142111:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608cd36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f38c expref: 12 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.142120:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608ce7f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f426 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.142127:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0400/0xfb36a14ee608ce55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3fc expref: 17 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.142134:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.142135:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.142139:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->1458175] (req 1048576->1458175) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 26 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.142168:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0400/0xfb36a14ee608ce55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3fc expref: 17 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.142179:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0400/0xfb36a14ee608ce55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3fc expref: 17 pid: 21973 timeout: 862 lvb_type: 1 00000100:00100000:2.0:1746066801.142193:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976944640:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.142477:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608ce7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f426 expref: 26 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.142512:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608ce7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f426 expref: 26 pid: 8450 timeout: 862 lvb_type: 1 00000100:00100000:2.0:1746066801.142520:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092848000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976944768:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.142743:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608cd36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f38c expref: 12 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.142752:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608cd36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f38c expref: 12 pid: 21203 timeout: 862 lvb_type: 1 00000100:00100000:2.0:1746066801.142760:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092848a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976944896:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.142861:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066801.142881:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977176064 00000100:00100000:3.0:1746066801.142886:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977176064 00002000:00100000:3.0:1746066801.142914:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38d:0x0] (2002944->2097151) req@ffff8800a8695500 x1830882977176064/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.142923:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695500 with x1830882977176064 ext(2002944->2097151) 00010000:00010000:3.0:1746066801.142930:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 27 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746066801.142939:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 27 pid: 8450 timeout: 862 lvb_type: 0 00002000:00010000:3.0:1746066801.142945:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8695500 00000100:00100000:3.0:1746066801.142973:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2224 00000100:00100000:3.0:1746066801.142978:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882977176064:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066801.145262:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976944640:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066801.145661:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.145781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.145821:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1965:x1830882977176064:12345-192.168.202.57@tcp:4:cat.0 Request processed in 2840us (3998us total) trans 21474841039 rc 0/0 00000100:00100000:3.0:1746066801.145829:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2224 00002000:00100000:3.0:1746066801.145840:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38d:0x0] (2002944->2097151) req@ffff8800a8695500 x1830882977176064/t21474841039(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/448 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.145848:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695500 with x1830882977176064 ext(2002944->2097151) 00010000:00010000:3.0:1746066801.145856:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 29 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746066801.145868:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 29 pid: 8450 timeout: 862 lvb_type: 0 00002000:00010000:3.0:1746066801.145873:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8695500 00000100:00100000:3.0:1746066801.145902:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092848000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976944768:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066801.145909:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092848a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976944896:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066801.145930:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->1458175] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.145943:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed68200, rc 0) 00000100:00100000:3.0:1746066801.145957:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31876:x1830882977176192:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3918us (4078us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.145963:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15177 00000100:00100000:2.0:1746066801.146008:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977176448 00000100:00100000:2.0:1746066801.146013:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977176448 00010000:00010000:2.0:1746066801.146037:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608cd36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f38c expref: 13 pid: 21203 timeout: 862 lvb_type: 1 00000100:00100000:2.0:1746066801.146063:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977176320 00000100:00100000:2.0:1746066801.146065:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977176320 00010000:00010000:2.0:1746066801.146075:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0400/0xfb36a14ee608ce55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3fc expref: 18 pid: 21973 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746066801.146085:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7794 00000100:00100000:3.0:1746066801.146093:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977176448:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066801.146097:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7795 00000100:00100000:2.0:1746066801.146103:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a530ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977176320:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066801.146104:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.146112:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066801.146121:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608cd36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f38c expref: 13 pid: 21203 timeout: 862 lvb_type: 1 00010000:00010000:2.0:1746066801.146122:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0400/0xfb36a14ee608ce55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3fc expref: 18 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.146131:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608cd36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f38c expref: 13 pid: 21203 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746066801.146220:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.146340:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977176576 00000100:00100000:1.0:1746066801.146344:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977176576 00010000:00010000:1.0:1746066801.146358:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608ce7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f426 expref: 28 pid: 8450 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746066801.146380:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7796 00000100:00100000:1.0:1746066801.146385:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977176576:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.146393:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.146456:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0400/0xfb36a14ee608ce55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3fc expref: 18 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.146479:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c400/0xfb36a14ee608cd36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f38c expref: 13 pid: 21203 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746066801.146479:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608ce7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f426 expref: 28 pid: 8450 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746066801.146487:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608ce7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f426 expref: 28 pid: 8450 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746066801.146500:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8600/0xfb36a14ee608ce7f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f426 expref: 28 pid: 8450 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.146503:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066801.146514:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.146524:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977176448:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 432us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.146541:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977176576:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 145us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.146542:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7794 00000100:00100000:1.0:1746066801.146547:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7796 00010000:00010000:2.0:1746066801.146629:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0400/0xfb36a14ee608ce55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3fc expref: 18 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:2.0:1746066801.146653:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.146655:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.146662:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 26 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.146670:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 26 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.146720:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 26 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.146732:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976945024:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066801.146775:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066801.147090:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.147225:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977176704 00000100:00100000:2.0:1746066801.147228:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977176704 00010000:00010000:2.0:1746066801.147239:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 27 pid: 8450 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746066801.147506:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7797 00000100:00100000:2.0:1746066801.147513:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977176704:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.147520:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.147542:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 27 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.147551:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 27 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.147563:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0c00/0xfb36a14ee608cea2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f449 expref: 27 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.147571:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.147573:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.147577:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8800/0xfb36a14ee608cea9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f450 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.147583:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8800/0xfb36a14ee608cea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f450 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.147589:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.147591:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.147594:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608ceb0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f457 expref: 26 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.147600:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608ceb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f457 expref: 26 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.147618:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608ceb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f457 expref: 26 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.147626:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092849880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976945152:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066801.147662:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8800/0xfb36a14ee608cea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f450 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.147670:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092848a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976945280:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066801.147723:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066801.148405:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976945024:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066801.148417:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.148437:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a530ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977176320:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2334us (2656us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.148443:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7795 00000100:00100000:0.0:1746066801.153802:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.153806:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092849880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976945152:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066801.153817:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092848a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976945280:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066801.153835:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.153881:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977176704:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6368us (6791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.153893:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7797 00000100:00100000:3.0:1746066801.153971:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977177088 00000100:00100000:3.0:1746066801.153978:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977177088 00002000:00100000:3.0:1746066801.154019:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8800996d8e00 x1830882977177088/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.154030:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8e00 with x1830882977177088 ext(1048576->2097151) 00002000:00010000:3.0:1746066801.154035:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996d8e00 00000100:00100000:3.0:1746066801.154059:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6874 00000100:00100000:3.0:1746066801.154066:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977177088:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066801.157139:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.157729:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.158177:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977177216 00000100:00100000:1.0:1746066801.158187:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977177216 00002000:00100000:1.0:1746066801.158240:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8800996db800 x1830882977177216/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.158251:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996db800 with x1830882977177216 ext(1048576->2097151) 00002000:00010000:1.0:1746066801.158257:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996db800 00000100:00100000:1.0:1746066801.158275:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977177472 00000100:00100000:1.0:1746066801.158278:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977177472 00002000:00100000:1.0:1746066801.158289:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1454080->1458175) req@ffff8800996d9c00 x1830882977177472/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.158296:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d9c00 with x1830882977177472 ext(1454080->1458175) 00002000:00010000:1.0:1746066801.158300:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996d9c00 00000100:00100000:1.0:1746066801.158324:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6875 00000100:00100000:1.0:1746066801.158332:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977177216:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066801.159304:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6876 00000100:00100000:2.0:1746066801.159312:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977177472:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066801.160201:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977177472:12345-192.168.202.57@tcp:3:cat.0 Request processed in 888us (2471us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066801.160208:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6876 00002000:00100000:2.0:1746066801.160216:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1454080->1458175) req@ffff8800996d9c00 x1830882977177472/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.160231:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d9c00 with x1830882977177472 ext(1454080->1458175) 00002000:00010000:2.0:1746066801.160235:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996d9c00 00000100:00100000:0.0:1746066801.167482:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.167565:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977177728 00000100:00100000:2.0:1746066801.167577:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977177728 00000100:00100000:2.0:1746066801.167636:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4244 00000100:00100000:2.0:1746066801.167643:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d04850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:31876:x1830882977177728:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066801.167723:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977177088:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13656us (13929us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066801.167731:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6874 00002000:00100000:3.0:1746066801.167740:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8800996d8e00 x1830882977177088/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.167747:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8e00 with x1830882977177088 ext(1048576->2097151) 00002000:00010000:3.0:1746066801.167753:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996d8e00 00000100:00100000:2.0:1746066801.168231:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d04850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31876:x1830882977177728:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 588us (761us total) trans 8589944199 rc 0/0 00000100:00100000:2.0:1746066801.168237:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4244 00000100:00100000:0.0:1746066801.168569:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977177216:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10237us (11440us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066801.168576:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6875 00002000:00100000:0.0:1746066801.168581:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8800996db800 x1830882977177216/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.168588:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996db800 with x1830882977177216 ext(1048576->2097151) 00002000:00010000:0.0:1746066801.168591:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996db800 00000100:00100000:0.0:1746066801.173440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.173518:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977177856 00000100:00100000:3.0:1746066801.173537:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977177856 00000100:00100000:1.0:1746066801.174280:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.175411:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15178 00000100:00100000:3.0:1746066801.175425:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+17:31879:x1830882977177856:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.175446:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.175464:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8000/0xfb36a14ee608cebe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f465 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.175495:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 25 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.175502:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066801.175504:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066801.175507:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8000/0xfb36a14ee608cebe lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f465 expref: 18 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.175551:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 25 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.175566:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 25 pid: 20532 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746066801.175578:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976945408:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066801.177518:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977178112 00000100:00100000:0.0:1746066801.177536:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977178112 00002000:00100000:0.0:1746066801.177581:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1458176->2097151) req@ffff880135e59500 x1830882977178112/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.177592:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e59500 with x1830882977178112 ext(1458176->2097151) 00010000:00010000:0.0:1746066801.177601:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 26 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066801.177613:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 26 pid: 20532 timeout: 862 lvb_type: 0 00002000:00010000:0.0:1746066801.177620:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135e59500 00000100:00100000:0.0:1746066801.177645:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2225 00000100:00100000:0.0:1746066801.177650:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977178112:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066801.177810:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066801.180565:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976945408:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066801.180599:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8000/0xfb36a14ee608cebe lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f465 expref: 18 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.180617:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebc8000, rc 0) 00000100:00100000:3.0:1746066801.180695:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+18:31879:x1830882977177856:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5273us (7266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.180703:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15178 00000100:00100000:2.0:1746066801.180978:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.181279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.181297:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977178368 00000100:00100000:3.0:1746066801.181303:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977178368 00000100:00100000:3.0:1746066801.181345:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15179 00000100:00100000:3.0:1746066801.181353:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31880:x1830882977178368:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.181368:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.181384:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebc9e00/0xfb36a14ee608cec5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f46c expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.181561:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066801.181567:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebc9e00/0xfb36a14ee608cec5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f46c expref: 29 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.181580:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebc9e00/0xfb36a14ee608cec5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f46c expref: 29 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.181588:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebc9e00, rc 0) 00000100:00100000:3.0:1746066801.181620:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:31880:x1830882977178368:12345-192.168.202.57@tcp:101:cat.0 Request processed in 269us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.181625:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15179 00000100:00100000:0.0:1746066801.181703:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977178240 00000100:00100000:0.0:1746066801.181708:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977178240 00002000:00100000:0.0:1746066801.181736:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1458175) req@ffff880092848a80 x1830882977178240/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.181745:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092848a80 with x1830882977178240 ext(1048576->1458175) 00010000:00010000:0.0:1746066801.181751:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 29 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066801.181761:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 29 pid: 20532 timeout: 862 lvb_type: 0 00002000:00010000:0.0:1746066801.181768:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092848a80 00000100:00100000:0.0:1746066801.181789:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2226 00000100:00100000:0.0:1746066801.181794:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977178240:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066801.186626:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977178112:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8961us (12333us total) trans 0 rc 638976/638976 00000100:00100000:1.0:1746066801.186639:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2225 00002000:00100000:1.0:1746066801.187272:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1458176->2097151) req@ffff880135e59500 x1830882977178112/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 638976/638976 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.187283:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e59500 with x1830882977178112 ext(1458176->2097151) 00010000:00010000:1.0:1746066801.187297:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 29 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.187313:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 29 pid: 20532 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746066801.187321:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135e59500 00000100:00100000:2.0:1746066801.191135:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977178240:12345-192.168.202.57@tcp:4:cat.0 Request processed in 9328us (10146us total) trans 21474841040 rc 0/0 00000100:00100000:2.0:1746066801.191149:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2226 00002000:00100000:2.0:1746066801.191162:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1458175) req@ffff880092848a80 x1830882977178240/t21474841040(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/448 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.191172:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092848a80 with x1830882977178240 ext(1048576->1458175) 00010000:00010000:2.0:1746066801.191183:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 29 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.191200:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 29 pid: 20532 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746066801.191207:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092848a80 00000100:00100000:0.0:1746066801.197771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.198868:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977178496 00000100:00100000:2.0:1746066801.198882:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977178496 00010000:00010000:2.0:1746066801.198953:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 29 pid: 20532 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746066801.198999:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7798 00000100:00100000:2.0:1746066801.199006:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977178496:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.199023:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.199049:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 29 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.199062:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 29 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.199088:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68200/0xfb36a14ee608ceb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f45e expref: 29 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.199116:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.199119:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.199129:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8000/0xfb36a14ee608cebe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f465 expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.199139:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8000/0xfb36a14ee608cebe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f465 expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.199148:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.199149:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.199153:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebc9e00/0xfb36a14ee608cec5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f46c expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.199167:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebc9e00/0xfb36a14ee608cec5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f46c expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.199205:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebc9e00/0xfb36a14ee608cec5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f46c expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.199221:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092849880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976945536:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066801.199368:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8000/0xfb36a14ee608cebe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f465 expref: 17 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.199376:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092848000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976945664:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066801.199397:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.201827:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092849880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976945536:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066801.201842:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092848000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976945664:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066801.201861:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.201905:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977178496:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2898us (4146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.201918:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7798 00000100:00100000:0.0:1746066801.205947:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.206003:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977178752 00000100:00100000:2.0:1746066801.206013:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977178752 00002000:00100000:2.0:1746066801.206064:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800996d9880 x1830882977178752/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.206074:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d9880 with x1830882977178752 ext(1048576->2097151) 00002000:00010000:2.0:1746066801.206081:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996d9880 00000100:00100000:2.0:1746066801.206114:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6877 00000100:00100000:2.0:1746066801.206122:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977178752:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066801.211251:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.211477:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977179008 00000100:00100000:0.0:1746066801.211489:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977179008 00002000:00100000:0.0:1746066801.211553:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880135e5aa00 x1830882977179008/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.211564:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5aa00 with x1830882977179008 ext(1048576->2097151) 00002000:00010000:0.0:1746066801.211573:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5aa00 00000100:00100000:0.0:1746066801.211609:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6878 00000100:00100000:0.0:1746066801.211619:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977179008:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066801.213475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.214643:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977179264 00000100:00100000:3.0:1746066801.214652:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977179264 00002000:00100000:3.0:1746066801.214764:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88008c394380 x1830882977179264/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.214774:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394380 with x1830882977179264 ext(1048576->2097151) 00002000:00010000:3.0:1746066801.214779:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c394380 00000100:00100000:3.0:1746066801.215458:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6879 00000100:00100000:3.0:1746066801.215467:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882977179264:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066801.221115:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977178752:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14978us (15167us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066801.221129:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6877 00002000:00100000:2.0:1746066801.221143:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800996d9880 x1830882977178752/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.221154:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d9880 with x1830882977178752 ext(1048576->2097151) 00002000:00010000:2.0:1746066801.221162:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996d9880 00000100:00100000:2.0:1746066801.223799:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977179008:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12167us (12542us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066801.223812:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6878 00002000:00100000:2.0:1746066801.223829:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880135e5aa00 x1830882977179008/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.223840:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5aa00 with x1830882977179008 ext(1048576->2097151) 00002000:00010000:2.0:1746066801.223847:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5aa00 00000100:00100000:3.0:1746066801.230525:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882977179264:12345-192.168.202.57@tcp:3:cat.0 Request processed in 15047us (17044us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066801.230545:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6879 00002000:00100000:3.0:1746066801.230558:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88008c394380 x1830882977179264/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.230567:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394380 with x1830882977179264 ext(1048576->2097151) 00002000:00010000:3.0:1746066801.230574:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c394380 00000100:00100000:0.0:1746066801.230858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.230920:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977179392 00000100:00100000:3.0:1746066801.230929:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977179392 00000100:00100000:3.0:1746066801.230977:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15180 00000100:00100000:3.0:1746066801.230984:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:31880:x1830882977179392:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.230999:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.231017:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8c00/0xfb36a14ee608cecc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f473 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.231052:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 24 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.231060:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066801.231062:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066801.231065:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8c00/0xfb36a14ee608cecc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f473 expref: 32 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.231098:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 24 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.231108:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 24 pid: 21973 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746066801.231119:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976945792:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066801.231822:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066801.238571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.238597:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976945792:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.238713:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977179520 00000100:00100000:2.0:1746066801.238719:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977179520 00002000:00100000:2.0:1746066801.238766:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2416640->2424831) req@ffff88009bfe0a80 x1830882977179520/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 8680/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.238776:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0a80 with x1830882977179520 ext(2416640->2424831) 00010000:00010000:2.0:1746066801.238786:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 25 pid: 21973 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.238806:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 25 pid: 21973 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746066801.238812:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe0a80 00000100:00100000:2.0:1746066801.238834:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2227 00000100:00100000:2.0:1746066801.238842:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:1966:x1830882977179520:12345-192.168.202.57@tcp:4:cat.0 00010000:00010000:3.0:1746066801.239112:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8c00/0xfb36a14ee608cecc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f473 expref: 32 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.239131:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebc8c00, rc 0) 00000100:00100000:3.0:1746066801.239177:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:31880:x1830882977179392:12345-192.168.202.57@tcp:101:cat.0 Request processed in 8193us (8320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.239184:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15180 00000100:00100000:2.0:1746066801.239508:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977179520:12345-192.168.202.57@tcp:4:cat.0 Request processed in 666us (950us total) trans 17179873735 rc 0/0 00000100:00100000:2.0:1746066801.239514:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2227 00002000:00100000:2.0:1746066801.239520:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2416640->2424831) req@ffff88009bfe0a80 x1830882977179520/t17179873735(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 8680/448 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.239527:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0a80 with x1830882977179520 ext(2416640->2424831) 00010000:00010000:2.0:1746066801.239540:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 27 pid: 21973 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.239550:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 27 pid: 21973 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746066801.239555:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe0a80 00010000:00010000:1.0:1746066801.246361:0:9850:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066801.249059:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.249101:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.249513:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977179776 00000100:00100000:0.0:1746066801.249516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.249523:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977179776 00000100:00100000:0.0:1746066801.249569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.249575:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977180032 00000100:00100000:3.0:1746066801.249580:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977180032 00000100:00100000:1.0:1746066801.249623:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977180288 00000100:00100000:1.0:1746066801.249627:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977180288 00002000:00100000:3.0:1746066801.249629:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3153920->4194303) req@ffff88009bfe0700 x1830882977180032/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.249639:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0700 with x1830882977180032 ext(3153920->4194303) 00002000:00100000:1.0:1746066801.249642:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009bfe1180 x1830882977180288/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746066801.249648:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 28 pid: 21973 timeout: 862 lvb_type: 0 00002000:00100000:1.0:1746066801.249648:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1180 with x1830882977180288 ext(2097152->3145727) 00002000:00010000:1.0:1746066801.249652:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe1180 00010000:00010000:3.0:1746066801.249661:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 28 pid: 21973 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746066801.249666:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977180544 00002000:00010000:3.0:1746066801.249667:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe0700 00000100:00100000:1.0:1746066801.249668:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977180544 00002000:00100000:1.0:1746066801.249703:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009bfe0e00 x1830882977180544/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066801.249704:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2228 00002000:00100000:1.0:1746066801.249709:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0e00 with x1830882977180544 ext(3145728->4194303) 00000100:00100000:3.0:1746066801.249712:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882977180032:12345-192.168.202.57@tcp:3:cat.0 00002000:00010000:1.0:1746066801.249712:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe0e00 00000100:00100000:1.0:1746066801.249729:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6880 00000100:00100000:1.0:1746066801.249733:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977180288:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066801.250976:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6881 00000100:00100000:1.0:1746066801.250984:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977180544:12345-192.168.202.57@tcp:3:cat.0 00002000:00100000:2.0:1746066801.251546:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3153919) req@ffff88009bfe1880 x1830882977179776/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 504/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.251555:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1880 with x1830882977179776 ext(2097152->3153919) 00010000:00010000:2.0:1746066801.251564:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 29 pid: 21973 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.251575:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 29 pid: 21973 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746066801.251581:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe1880 00000100:00100000:2.0:1746066801.251600:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2229 00000100:00100000:2.0:1746066801.251605:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977179776:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066801.274376:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977180288:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24628us (24845us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066801.274389:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6880 00002000:00100000:1.0:1746066801.274404:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009bfe1180 x1830882977180288/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.274414:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1180 with x1830882977180288 ext(2097152->3145727) 00002000:00010000:1.0:1746066801.274421:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe1180 00000100:00100000:3.0:1746066801.282102:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977180032:12345-192.168.202.57@tcp:3:cat.0 Request processed in 32378us (32986us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746066801.282114:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2228 00002000:00100000:3.0:1746066801.282128:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3153920->4194303) req@ffff88009bfe0700 x1830882977180032/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 1040384/1040384 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.282145:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0700 with x1830882977180032 ext(3153920->4194303) 00010000:00010000:3.0:1746066801.282157:0:1993:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 29 pid: 21973 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746066801.282173:0:1993:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 29 pid: 21973 timeout: 862 lvb_type: 0 00002000:00010000:3.0:1746066801.282181:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe0700 00000100:00100000:1.0:1746066801.286794:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977180544:12345-192.168.202.57@tcp:3:cat.0 Request processed in 35797us (37210us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066801.286809:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6881 00002000:00100000:1.0:1746066801.286823:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009bfe0e00 x1830882977180544/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.286833:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0e00 with x1830882977180544 ext(3145728->4194303) 00002000:00010000:1.0:1746066801.286840:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe0e00 00000100:00100000:2.0:1746066801.291813:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977179776:12345-192.168.202.57@tcp:3:cat.0 Request processed in 40194us (42752us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066801.291825:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2229 00002000:00100000:2.0:1746066801.291839:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3153919) req@ffff88009bfe1880 x1830882977179776/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 504/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.291848:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1880 with x1830882977179776 ext(2097152->3153919) 00010000:00010000:2.0:1746066801.291859:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 27 pid: 21973 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.291874:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 27 pid: 21973 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746066801.291881:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe1880 00000100:00100000:0.0:1746066801.298296:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.298399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.298805:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977180800 00000100:00100000:3.0:1746066801.298815:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977180800 00000100:00100000:3.0:1746066801.298873:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15181 00000100:00100000:3.0:1746066801.298881:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+27:31879:x1830882977180800:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.298900:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.298917:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608ced3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f47a expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.298943:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066801.298946:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066801.298951:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608ced3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f47a expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.298963:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608ced3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f47a expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.298974:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebc8600, rc 0) 00000100:00100000:3.0:1746066801.299022:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+28:31879:x1830882977180800:12345-192.168.202.57@tcp:101:cat.0 Request processed in 142us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.299029:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15181 00000100:00100000:2.0:1746066801.299443:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977180672 00000100:00100000:2.0:1746066801.299447:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977180672 00010000:00010000:2.0:1746066801.299465:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 28 pid: 21973 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746066801.299490:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7799 00000100:00100000:2.0:1746066801.299496:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882977180672:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.299504:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.299525:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 28 pid: 21973 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.299545:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 28 pid: 21973 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.299566:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b40a400/0xfb36a14ee608ce39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2416640->2424831) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e0 expref: 28 pid: 21973 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.299590:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.299592:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.299598:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8c00/0xfb36a14ee608cecc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f473 expref: 31 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.299606:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8c00/0xfb36a14ee608cecc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f473 expref: 31 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.299613:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.299614:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.299617:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608ced3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f47a expref: 27 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.299623:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608ced3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f47a expref: 27 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.299650:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608ced3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f47a expref: 27 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.299662:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092848000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976945920:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066801.301228:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8c00/0xfb36a14ee608cecc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f473 expref: 31 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.301242:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092849880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976946048:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066801.304615:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.305546:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.305720:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092848000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976945920:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066801.306312:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977181056 00000100:00100000:3.0:1746066801.306319:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977181056 00002000:00100000:3.0:1746066801.306364:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009284bb80 x1830882977181056/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.306374:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284bb80 with x1830882977181056 ext(3145728->4194303) 00002000:00010000:3.0:1746066801.306379:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284bb80 00000100:00100000:3.0:1746066801.306663:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6882 00000100:00100000:3.0:1746066801.306672:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882977181056:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066801.315299:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092849880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976946048:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066801.315420:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.315474:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977180672:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 15976us (17187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.315484:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7799 00000100:00100000:3.0:1746066801.317516:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977181056:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10836us (11964us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066801.317536:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6882 00002000:00100000:3.0:1746066801.317550:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009284bb80 x1830882977181056/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.317559:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284bb80 with x1830882977181056 ext(3145728->4194303) 00002000:00010000:3.0:1746066801.317565:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284bb80 00000100:00100000:2.0:1746066801.320849:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.320880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.321021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.321043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.321080:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977181312 00000100:00100000:2.0:1746066801.321091:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977181312 00002000:00100000:2.0:1746066801.321137:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880092849880 x1830882977181312/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.321147:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849880 with x1830882977181312 ext(2097152->3145727) 00002000:00010000:2.0:1746066801.321154:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092849880 00000100:00100000:3.0:1746066801.321161:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977181568 00000100:00100000:3.0:1746066801.321166:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977181568 00000100:00100000:2.0:1746066801.321175:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977181824 00000100:00100000:3.0:1746066801.321177:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977182080 00000100:00100000:2.0:1746066801.321178:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977181824 00000100:00100000:3.0:1746066801.321179:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977182080 00002000:00100000:2.0:1746066801.321190:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880092849180 x1830882977181824/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.321196:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009284ad80 x1830882977182080/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.321197:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849180 with x1830882977181824 ext(2097152->3145727) 00002000:00010000:2.0:1746066801.321200:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092849180 00002000:00100000:3.0:1746066801.321204:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284ad80 with x1830882977182080 ext(3145728->4194303) 00002000:00010000:3.0:1746066801.321206:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284ad80 00000100:00100000:2.0:1746066801.321214:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6883 00000100:00100000:2.0:1746066801.321220:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977181312:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066801.321221:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6884 00000100:00100000:3.0:1746066801.321226:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977181824:12345-192.168.202.57@tcp:3:cat.0 00002000:00100000:2.0:1746066801.323325:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880092848000 x1830882977181568/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.323336:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092848000 with x1830882977181568 ext(3145728->4194303) 00002000:00010000:2.0:1746066801.323341:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092848000 00000100:00100000:2.0:1746066801.323372:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6885 00000100:00100000:2.0:1746066801.323380:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977182080:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066801.325373:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6886 00000100:00100000:0.0:1746066801.325388:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977181568:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066801.345073:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.346580:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977182336 00000100:00100000:2.0:1746066801.346593:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977182336 00002000:00100000:2.0:1746066801.346643:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a5bb1180 x1830882977182336/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.346654:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb1180 with x1830882977182336 ext(4194304->5091327) 00002000:00010000:2.0:1746066801.346660:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb1180 00000100:00100000:2.0:1746066801.346695:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6887 00000100:00100000:2.0:1746066801.346702:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977182336:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066801.351579:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977181312:12345-192.168.202.57@tcp:3:cat.0 Request processed in 30345us (30727us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066801.351592:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6883 00002000:00100000:2.0:1746066801.351608:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880092849880 x1830882977181312/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.351618:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849880 with x1830882977181312 ext(2097152->3145727) 00002000:00010000:2.0:1746066801.351625:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092849880 00000100:00100000:3.0:1746066801.356075:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977181824:12345-192.168.202.57@tcp:3:cat.0 Request processed in 34835us (35040us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066801.356087:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6884 00002000:00100000:3.0:1746066801.356101:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880092849180 x1830882977181824/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.356111:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849180 with x1830882977181824 ext(2097152->3145727) 00002000:00010000:3.0:1746066801.356117:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092849180 00000100:00100000:2.0:1746066801.362120:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977181568:12345-192.168.202.57@tcp:3:cat.0 Request processed in 36724us (41225us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066801.362133:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6886 00002000:00100000:2.0:1746066801.362147:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880092848000 x1830882977181568/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.362158:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092848000 with x1830882977181568 ext(3145728->4194303) 00002000:00010000:2.0:1746066801.362164:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092848000 00000100:00100000:0.0:1746066801.368438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.368606:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977182592 00000100:00100000:2.0:1746066801.368616:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977182592 00000100:00100000:2.0:1746066801.368667:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10124 00000100:00100000:2.0:1746066801.368704:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+10:31885:x1830882977182592:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066801.368732:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.368752:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135437400/0xfb36a14ee608ceda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f481 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.368865:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135437200/0xfb36a14ee608cee1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.368878:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135437200/0xfb36a14ee608cee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.368893:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135437200/0xfb36a14ee608cee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.368906:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135437000/0xfb36a14ee608cee8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.368911:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135437000/0xfb36a14ee608cee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.368917:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135437000/0xfb36a14ee608cee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369024:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135436e00/0xfb36a14ee608ceef lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369032:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135436e00/0xfb36a14ee608ceef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369038:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135436e00/0xfb36a14ee608ceef lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746066801.369046:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066801.369131:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135437200/0xfb36a14ee608cee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369138:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135437200/0xfb36a14ee608cee1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369143:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135437200/0xfb36a14ee608cee1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369148:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135437200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066801.369152:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135437200/0xfb36a14ee608cee1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369159:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135437200/0xfb36a14ee608cee1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369168:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066801.369171:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066801.369174:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135437200/0xfb36a14ee608cee1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369179:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135437200/0xfb36a14ee608cee1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369213:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135437000/0xfb36a14ee608cee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369218:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135437000/0xfb36a14ee608cee8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369222:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135437000/0xfb36a14ee608cee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369226:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135437000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066801.369228:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135437000/0xfb36a14ee608cee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369232:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135437000/0xfb36a14ee608cee8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369237:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebec600) 00010000:00010000:2.0:1746066801.369239:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066801.369241:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135437000/0xfb36a14ee608cee8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369245:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135437000/0xfb36a14ee608cee8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.369280:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135437400/0xfb36a14ee608ceda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f481 expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.369290:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135436e00/0xfb36a14ee608ceef lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f481 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.369295:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066801.369297:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066801.369299:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135436e00, rc 0) 00000100:00100000:2.0:1746066801.369349:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:31885:x1830882977182592:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 674us (921us total) trans 8589944200 rc 0/0 00000100:00100000:2.0:1746066801.369355:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10124 00000100:00100000:2.0:1746066801.376086:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977182080:12345-192.168.202.57@tcp:3:cat.0 Request processed in 52697us (55030us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066801.376098:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6885 00002000:00100000:2.0:1746066801.376110:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009284ad80 x1830882977182080/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.376120:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284ad80 with x1830882977182080 ext(3145728->4194303) 00002000:00010000:2.0:1746066801.376126:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284ad80 00000100:00100000:2.0:1746066801.377548:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977182336:12345-192.168.202.57@tcp:3:cat.0 Request processed in 30839us (32480us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066801.377557:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6887 00002000:00100000:2.0:1746066801.377567:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a5bb1180 x1830882977182336/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.377582:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb1180 with x1830882977182336 ext(4194304->5091327) 00002000:00010000:2.0:1746066801.377587:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb1180 00000100:00100000:0.0:1746066801.394854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.394965:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977182848 00000100:00100000:2.0:1746066801.394975:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977182848 00002000:00100000:2.0:1746066801.395023:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a5bb2d80 x1830882977182848/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.395034:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb2d80 with x1830882977182848 ext(4194304->5091327) 00002000:00010000:2.0:1746066801.395039:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb2d80 00000100:00100000:2.0:1746066801.395425:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6888 00000100:00100000:2.0:1746066801.395431:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977182848:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066801.404032:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.404161:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977182976 00000100:00100000:1.0:1746066801.404171:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977182976 00000100:00100000:1.0:1746066801.404226:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15182 00000100:00100000:1.0:1746066801.404233:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:31885:x1830882977182976:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066801.404252:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066801.404271:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f488 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.404299:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cd2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a1 expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066801.404308:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0800/0xfb36a14ee608ce94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f43b expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066801.404314:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0e00/0xfb36a14ee608ce63 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f411 expref: 19 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066801.404319:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066801.404321:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066801.404323:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2138112->2494463] (req 2138112->2494463) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.404355:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0e00/0xfb36a14ee608ce63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f411 expref: 19 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066801.404366:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0e00/0xfb36a14ee608ce63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f411 expref: 19 pid: 21973 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746066801.404382:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c395180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976946176:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066801.405202:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0800/0xfb36a14ee608ce94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f43b expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066801.405212:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0800/0xfb36a14ee608ce94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f43b expref: 27 pid: 21973 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746066801.405221:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c397480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976946304:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066801.405266:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cd2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a1 expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066801.405274:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cd2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a1 expref: 11 pid: 21203 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746066801.405281:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c394700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976946432:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066801.405300:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dc300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066801.408706:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c395180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976946176:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066801.408720:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c397480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976946304:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066801.408726:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c394700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976946432:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066801.408757:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2138112->2494463] (req 2138112->2494463) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.408777:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5316a00, rc 0) 00000100:00100000:1.0:1746066801.408831:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:31885:x1830882977182976:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4596us (4808us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.408840:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15182 00000100:00100000:3.0:1746066801.411592:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977182848:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16150us (16738us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066801.411605:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6888 00002000:00100000:3.0:1746066801.411617:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a5bb2d80 x1830882977182848/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.411630:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb2d80 with x1830882977182848 ext(4194304->5091327) 00002000:00010000:3.0:1746066801.411636:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb2d80 00000100:00100000:0.0:1746066801.412969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.413065:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977183104 00000100:00100000:2.0:1746066801.413073:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977183104 00010000:00010000:2.0:1746066801.413107:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cd2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a1 expref: 12 pid: 21203 timeout: 862 lvb_type: 1 00000100:00100000:2.0:1746066801.413235:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7800 00000100:00100000:2.0:1746066801.413243:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1966:x1830882977183104:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.413256:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.413277:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cd2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a1 expref: 12 pid: 21203 timeout: 862 lvb_type: 1 00010000:00010000:2.0:1746066801.413288:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cd2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a1 expref: 12 pid: 21203 timeout: 862 lvb_type: 1 00010000:00010000:2.0:1746066801.413317:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cd2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3a1 expref: 12 pid: 21203 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746066801.414243:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.414261:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977183360 00000100:00100000:3.0:1746066801.414265:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977183360 00010000:00010000:3.0:1746066801.414284:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0e00/0xfb36a14ee608ce63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f411 expref: 19 pid: 21973 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746066801.414304:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7801 00000100:00100000:3.0:1746066801.414309:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977183360:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066801.414320:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066801.414333:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0e00/0xfb36a14ee608ce63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f411 expref: 19 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.414341:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0e00/0xfb36a14ee608ce63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f411 expref: 19 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.414354:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0e00/0xfb36a14ee608ce63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f411 expref: 19 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.414371:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.414403:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977183360:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 94us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.414408:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7801 00000100:00100000:3.0:1746066801.414491:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.414504:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977183232 00000100:00100000:3.0:1746066801.414506:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977183232 00010000:00010000:3.0:1746066801.414518:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0800/0xfb36a14ee608ce94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f43b expref: 28 pid: 21973 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746066801.414539:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7802 00000100:00100000:3.0:1746066801.414543:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a540a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977183232:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066801.414549:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066801.414555:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0800/0xfb36a14ee608ce94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f43b expref: 28 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.414568:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0800/0xfb36a14ee608ce94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f43b expref: 28 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.414579:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5b0800/0xfb36a14ee608ce94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f43b expref: 28 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.414586:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.414588:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.414595:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2494463) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.414604:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2494463) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.414635:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2494463) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066801.414647:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976946560:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066801.414710:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961bc00 going to sleep for 11 seconds 00010000:00010000:2.0:1746066801.415028:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.415052:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977183104:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1809us (2085us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.415058:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7800 00000100:00100000:3.0:1746066801.418506:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976946560:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066801.418535:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.418599:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a540a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977183232:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4052us (4105us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.418609:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7802 00000100:00100000:1.0:1746066801.419168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.419280:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977183488 00000100:00100000:2.0:1746066801.419287:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977183488 00000100:00100000:2.0:1746066801.419332:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15183 00000100:00100000:2.0:1746066801.419338:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977183488:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.419360:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.419376:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135436400/0xfb36a14ee608cf04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f48f expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.419434:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976946688:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066801.419502:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066801.420111:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.421001:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977183744 00000100:00100000:3.0:1746066801.421008:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977183744 00002000:00100000:3.0:1746066801.421058:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (2138112->2142207) req@ffff8800a5bb3480 x1830882977183744/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.421069:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb3480 with x1830882977183744 ext(2138112->2142207) 00002000:00010000:3.0:1746066801.421075:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb3480 00000100:00100000:3.0:1746066801.421100:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6889 00000100:00100000:3.0:1746066801.421106:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977183744:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066801.421305:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977183744:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 198us (1194us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066801.421312:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6889 00002000:00100000:3.0:1746066801.421317:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (2138112->2142207) req@ffff8800a5bb3480 x1830882977183744/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.421323:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb3480 with x1830882977183744 ext(2138112->2142207) 00002000:00010000:3.0:1746066801.421326:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb3480 00000100:00100000:0.0:1746066801.421572:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.421592:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977184000 00000100:00100000:0.0:1746066801.421595:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977184000 00000100:00100000:0.0:1746066801.421623:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10125 00000100:00100000:0.0:1746066801.421627:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:31888:x1830882977184000:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066801.421646:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066801.421663:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92400/0xfb36a14ee608cf0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f496 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.421791:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92c00/0xfb36a14ee608cf12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.421806:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92c00/0xfb36a14ee608cf12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.421821:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92c00/0xfb36a14ee608cf12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.421833:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93c00/0xfb36a14ee608cf19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.421838:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93c00/0xfb36a14ee608cf19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.421844:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93c00/0xfb36a14ee608cf19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00002000:00010000:2.0:1746066801.421875:0:8450:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime: 1746066800 -> 1746066801 00002000:00010000:2.0:1746066801.421878:0:8450:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime: 1746066800 -> 1746066801 00002000:00010000:2.0:1746066801.421880:0:8450:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime: 1746066800 -> 1746066801 00000100:00100000:2.0:1746066801.421891:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976946688:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066801.421916:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135436400/0xfb36a14ee608cf04 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f48f expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.421925:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135436400/0xfb36a14ee608cf04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f48f expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.421936:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135436400, rc 0) 00010000:00010000:0.0:1746066801.421948:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93a00/0xfb36a14ee608cf20 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.421956:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93a00/0xfb36a14ee608cf20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00000100:00100000:2.0:1746066801.421961:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977183488:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2623us (2814us total) trans 0 rc 301/301 00010000:00010000:0.0:1746066801.421962:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93a00/0xfb36a14ee608cf20 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:2.0:1746066801.421966:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15183 00000004:00200000:0.0:1746066801.421971:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066801.422255:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92c00/0xfb36a14ee608cf12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.422263:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92c00/0xfb36a14ee608cf12 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.422269:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92c00/0xfb36a14ee608cf12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.422275:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed92c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066801.422280:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92c00/0xfb36a14ee608cf12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.422287:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92c00/0xfb36a14ee608cf12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.422299:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066801.422303:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066801.422308:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92c00/0xfb36a14ee608cf12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.422313:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92c00/0xfb36a14ee608cf12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.422336:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93c00/0xfb36a14ee608cf19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.422342:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93c00/0xfb36a14ee608cf19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.422346:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93c00/0xfb36a14ee608cf19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.422350:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed93c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066801.422353:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93c00/0xfb36a14ee608cf19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.422356:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93c00/0xfb36a14ee608cf19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.422362:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b74000) 00010000:00010000:1.0:1746066801.422364:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066801.422367:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93c00/0xfb36a14ee608cf19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.422371:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93c00/0xfb36a14ee608cf19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.422407:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92400/0xfb36a14ee608cf0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f496 expref: 256 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.422417:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93a00/0xfb36a14ee608cf20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f496 expref: 255 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.422423:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066801.422424:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066801.422426:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed93a00, rc 0) 00000100:00100000:1.0:1746066801.422459:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31888:x1830882977184000:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 831us (888us total) trans 8589944201 rc 0/0 00000100:00100000:1.0:1746066801.422465:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10125 00000100:00100000:0.0:1746066801.426525:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.426906:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977184128 00000100:00100000:2.0:1746066801.426916:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977184128 00000100:00100000:2.0:1746066801.426971:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15184 00000100:00100000:2.0:1746066801.426979:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882977184128:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.426998:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.427016:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135436600/0xfb36a14ee608cf2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f49d expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.427074:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976946816:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066801.427171:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066801.429148:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.429286:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.429316:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977184384 00000100:00100000:1.0:1746066801.429324:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977184384 00002000:00100000:1.0:1746066801.429366:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2490368->2494463) req@ffff8800a5bb0e00 x1830882977184384/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.429377:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb0e00 with x1830882977184384 ext(2490368->2494463) 00002000:00010000:1.0:1746066801.429381:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb0e00 00000100:00100000:1.0:1746066801.429411:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6890 00000100:00100000:1.0:1746066801.429416:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977184384:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066801.429732:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977184512 00000100:00100000:3.0:1746066801.429736:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977184512 00000100:00100000:3.0:1746066801.429760:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15185 00000100:00100000:3.0:1746066801.429765:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:31888:x1830882977184512:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066801.429774:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.429790:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f4a4 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.429812:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fdacc00/0xfb36a14ee608cd1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f37e expref: 12 pid: 8112 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066801.429820:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977184384:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 403us (679us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1746066801.429825:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1800/0xfb36a14ee608ce78 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f418 expref: 33 pid: 21973 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066801.429826:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6890 00010000:00010000:3.0:1746066801.429831:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eee4a00/0xfb36a14ee608ce4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3ee expref: 26 pid: 21203 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746066801.429832:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2490368->2494463) req@ffff8800a5bb0e00 x1830882977184384/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746066801.429838:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:1.0:1746066801.429839:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb0e00 with x1830882977184384 ext(2490368->2494463) 00010000:00010000:3.0:1746066801.429840:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746066801.429841:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb0e00 00010000:00010000:3.0:1746066801.429844:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [20480->69631] (req 20480->69631) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 33 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.429903:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eee4a00/0xfb36a14ee608ce4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3ee expref: 26 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.429915:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eee4a00/0xfb36a14ee608ce4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3ee expref: 26 pid: 21203 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746066801.429926:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976946944:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066801.430014:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1800/0xfb36a14ee608ce78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f418 expref: 33 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.430022:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1800/0xfb36a14ee608ce78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f418 expref: 33 pid: 21973 timeout: 862 lvb_type: 1 00000100:00100000:2.0:1746066801.430024:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976946816:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066801.430029:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976947072:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.430051:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135436600/0xfb36a14ee608cf2e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f49d expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.430060:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135436600/0xfb36a14ee608cf2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f49d expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.430070:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135436600, rc 0) 00000100:00100000:2.0:1746066801.430776:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882977184128:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3798us (4261us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066801.430786:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15184 00010000:00010000:3.0:1746066801.430854:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fdacc00/0xfb36a14ee608cd1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f37e expref: 12 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.430864:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fdacc00/0xfb36a14ee608cd1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f37e expref: 12 pid: 8112 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746066801.430873:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976947200:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066801.430893:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066801.437749:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976946944:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066801.437763:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976947072:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066801.437779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.439164:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977184768 00000100:00100000:2.0:1746066801.439173:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977184768 00000100:00100000:2.0:1746066801.439230:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4245 00000100:00100000:2.0:1746066801.439237:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:31885:x1830882977184768:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066801.439578:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976947200:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.439598:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:31885:x1830882977184768:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 360us (1819us total) trans 8589944202 rc 0/0 00000100:00100000:2.0:1746066801.439605:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4245 00010000:00010000:3.0:1746066801.439613:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [20480->69631] (req 20480->69631) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 33 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.439629:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf5a00, rc 0) 00000100:00100000:3.0:1746066801.439651:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:31888:x1830882977184512:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 9886us (10365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.439657:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15185 00000100:00100000:0.0:1746066801.439969:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.439999:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.440008:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977184896 00000100:00100000:3.0:1746066801.440012:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977184896 00010000:00010000:3.0:1746066801.440029:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1800/0xfb36a14ee608ce78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f418 expref: 33 pid: 21973 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746066801.440057:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977185024 00000100:00100000:3.0:1746066801.440060:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977185024 00010000:00010000:3.0:1746066801.440071:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eee4a00/0xfb36a14ee608ce4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3ee expref: 27 pid: 21203 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746066801.440097:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7803 00000100:00100000:3.0:1746066801.440103:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977184896:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066801.440113:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066801.440132:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1800/0xfb36a14ee608ce78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f418 expref: 33 pid: 21973 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746066801.440139:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7804 00010000:00010000:3.0:1746066801.440141:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1800/0xfb36a14ee608ce78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f418 expref: 33 pid: 21973 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746066801.440147:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977185024:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.440154:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066801.440164:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1800/0xfb36a14ee608ce78 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f418 expref: 33 pid: 21973 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746066801.440164:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eee4a00/0xfb36a14ee608ce4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3ee expref: 27 pid: 21203 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746066801.440177:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eee4a00/0xfb36a14ee608ce4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3ee expref: 27 pid: 21203 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746066801.440215:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.440320:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977185280 00000100:00100000:2.0:1746066801.440324:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977185280 00000100:00100000:2.0:1746066801.440352:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4246 00000100:00100000:2.0:1746066801.440357:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:31880:x1830882977185280:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:0.0:1746066801.440586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.440721:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:31880:x1830882977185280:12345-192.168.202.57@tcp:35:cat.0 Request processed in 363us (506us total) trans 8589944203 rc 0/0 00000100:00100000:2.0:1746066801.440727:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4246 00000100:00100000:2.0:1746066801.440743:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977185408 00000100:00100000:2.0:1746066801.440746:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977185408 00010000:00010000:2.0:1746066801.440756:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fdacc00/0xfb36a14ee608cd1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f37e expref: 13 pid: 8112 timeout: 862 lvb_type: 1 00000100:00100000:2.0:1746066801.440772:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7805 00010000:00010000:3.0:1746066801.440870:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.440887:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977184896:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 784us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.440892:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7803 00010000:00010000:1.0:1746066801.441042:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eee4a00/0xfb36a14ee608ce4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3ee expref: 27 pid: 21203 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746066801.441057:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066801.441072:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977185024:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 927us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.441077:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7804 00000100:00100000:2.0:1746066801.441374:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977185408:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.441383:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.441393:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fdacc00/0xfb36a14ee608cd1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f37e expref: 13 pid: 8112 timeout: 862 lvb_type: 1 00010000:00010000:2.0:1746066801.441406:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fdacc00/0xfb36a14ee608cd1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f37e expref: 13 pid: 8112 timeout: 862 lvb_type: 1 00010000:00010000:2.0:1746066801.441417:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fdacc00/0xfb36a14ee608cd1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f37e expref: 13 pid: 8112 timeout: 862 lvb_type: 1 00010000:00010000:2.0:1746066801.441425:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.441427:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.441434:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->69631) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 31 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.441441:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->69631) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 31 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.441468:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->69631) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 31 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.441479:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976947328:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066801.442024:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.443003:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976947328:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066801.443016:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.443048:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977185408:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2269us (2461us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.443130:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.443355:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7805 00000100:00100000:1.0:1746066801.443469:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977185664 00000100:00100000:1.0:1746066801.443476:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977185664 00002000:00100000:1.0:1746066801.443522:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (20480->24575) req@ffff88009e634000 x1830882977185664/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.443539:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e634000 with x1830882977185664 ext(20480->24575) 00002000:00010000:1.0:1746066801.443543:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e634000 00000100:00100000:1.0:1746066801.443567:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6891 00000100:00100000:1.0:1746066801.443573:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882977185664:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066801.444903:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882977185664:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 1326us (1770us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066801.444911:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6891 00002000:00100000:1.0:1746066801.444917:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (20480->24575) req@ffff88009e634000 x1830882977185664/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.444925:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e634000 with x1830882977185664 ext(20480->24575) 00002000:00010000:1.0:1746066801.444931:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e634000 00000100:00100000:0.0:1746066801.450356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.450458:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977185920 00000100:00100000:1.0:1746066801.450468:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977185920 00002000:00100000:1.0:1746066801.450512:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (65536->69631) req@ffff88009e635c00 x1830882977185920/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.450522:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e635c00 with x1830882977185920 ext(65536->69631) 00002000:00010000:1.0:1746066801.450534:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e635c00 00000100:00100000:1.0:1746066801.450565:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6892 00000100:00100000:1.0:1746066801.450573:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977185920:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066801.450798:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977185920:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 225us (453us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066801.450804:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6892 00002000:00100000:1.0:1746066801.450810:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (65536->69631) req@ffff88009e635c00 x1830882977185920/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.450898:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e635c00 with x1830882977185920 ext(65536->69631) 00002000:00010000:1.0:1746066801.450902:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e635c00 00000100:00100000:0.0:1746066801.457362:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.457554:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977186176 00000100:00100000:2.0:1746066801.457566:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977186176 00000100:00100000:2.0:1746066801.457610:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4247 00000100:00100000:2.0:1746066801.457618:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:31888:x1830882977186176:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066801.457903:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:31888:x1830882977186176:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 285us (553us total) trans 8589944204 rc 0/0 00000100:00100000:2.0:1746066801.457910:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4247 00000100:00100000:0.0:1746066801.518812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.519203:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977186304 00000100:00100000:3.0:1746066801.519213:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977186304 00000100:00100000:3.0:1746066801.519845:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15186 00000100:00100000:3.0:1746066801.519855:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977186304:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.519881:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.519901:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608cf3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f4ab expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066801.519963:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976947456:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066801.520434:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b6c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746066801.523493:0:20532:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime: 1746066800 -> 1746066801 00002000:00010000:3.0:1746066801.523501:0:20532:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime: 1746066800 -> 1746066801 00002000:00010000:3.0:1746066801.523503:0:20532:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime: 1746066800 -> 1746066801 00000100:00100000:3.0:1746066801.523988:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976947456:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066801.524024:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608cf3c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ab expref: 27 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.524039:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608cf3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ab expref: 27 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.524069:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf4600, rc 0) 00000100:00100000:3.0:1746066801.524124:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977186304:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4269us (5321us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066801.524134:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15186 00000100:00100000:0.0:1746066801.527245:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.527318:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977186432 00000100:00100000:3.0:1746066801.527326:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977186432 00000100:00100000:3.0:1746066801.527370:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15187 00000100:00100000:3.0:1746066801.527376:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+26:31894:x1830882977186432:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.527392:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.527408:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faf4000/0xfb36a14ee608cf43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f4b2 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.527593:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->69631) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 31 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.527602:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066801.527604:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066801.527607:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf4000/0xfb36a14ee608cf43 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b2 expref: 27 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.527648:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->69631) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 31 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.527660:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->69631) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 31 pid: 20532 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746066801.527672:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976947584:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066801.528349:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066801.530218:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976947584:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066801.530316:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faf4000/0xfb36a14ee608cf43 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b2 expref: 27 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.530333:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf4000, rc 0) 00000100:00100000:3.0:1746066801.530386:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+27:31894:x1830882977186432:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3008us (3147us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.530395:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15187 00000100:00100000:0.0:1746066801.530910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.530931:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977186560 00000100:00100000:1.0:1746066801.531209:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977186560 00002000:00100000:1.0:1746066801.531250:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (20480->69631) req@ffff88009b7f8e00 x1830882977186560/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.531260:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f8e00 with x1830882977186560 ext(20480->69631) 00010000:00010000:1.0:1746066801.531267:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->69631) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 32 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.531278:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->69631) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 32 pid: 20532 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746066801.531285:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b7f8e00 00000100:00100000:1.0:1746066801.531301:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2230 00000100:00100000:1.0:1746066801.531306:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977186560:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:1.0:1746066801.537752:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977186560:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 6433us (6830us total) trans 17179873736 rc 0/0 00000100:00100000:1.0:1746066801.537767:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2230 00002000:00100000:1.0:1746066801.537779:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (20480->69631) req@ffff88009b7f8e00 x1830882977186560/t17179873736(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/448 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.537789:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f8e00 with x1830882977186560 ext(20480->69631) 00010000:00010000:1.0:1746066801.537800:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->69631) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 34 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.537816:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->69631) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 34 pid: 20532 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746066801.537822:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b7f8e00 00000100:00100000:0.0:1746066801.540251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.540575:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977186688 00000100:00100000:2.0:1746066801.540586:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977186688 00010000:00010000:2.0:1746066801.540628:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->69631) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 34 pid: 20532 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746066801.540671:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7806 00000100:00100000:2.0:1746066801.540716:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977186688:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.540734:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.540757:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->69631) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 34 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.540770:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->69631) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 34 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.540797:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5a00/0xfb36a14ee608cf35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->69631) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4a4 expref: 34 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.540827:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.540830:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.540839:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faf4000/0xfb36a14ee608cf43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b2 expref: 26 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.540881:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf4000/0xfb36a14ee608cf43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b2 expref: 26 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.540922:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009faf4000/0xfb36a14ee608cf43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b2 expref: 26 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.540935:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976947712:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066801.541021:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.542912:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976947712:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066801.542931:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.542963:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977186688:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2249us (2722us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.542972:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7806 00000100:00100000:0.0:1746066801.545462:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.545651:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977186944 00000100:00100000:1.0:1746066801.545660:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977186944 00002000:00100000:1.0:1746066801.545731:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009b7fa680 x1830882977186944/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.545741:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fa680 with x1830882977186944 ext(0->1048575) 00002000:00010000:1.0:1746066801.545747:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7fa680 00000100:00100000:1.0:1746066801.545774:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6893 00000100:00100000:1.0:1746066801.545781:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977186944:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066801.555900:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977186944:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10100us (10426us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066801.555915:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6893 00002000:00100000:1.0:1746066801.555928:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009b7fa680 x1830882977186944/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.555939:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fa680 with x1830882977186944 ext(0->1048575) 00002000:00010000:1.0:1746066801.555946:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7fa680 00000100:00100000:0.0:1746066801.577444:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.577555:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977187200 00000100:00100000:1.0:1746066801.577566:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977187200 00000100:00100000:1.0:1746066801.577631:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10126 00000100:00100000:1.0:1746066801.577640:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:31897:x1830882977187200:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066801.577667:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066801.577712:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3d800/0xfb36a14ee608cf4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f4b9 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.577817:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cf51 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.577832:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cf51 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.577843:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cf51 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:1.0:1746066801.577854:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066801.577981:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3d800/0xfb36a14ee608cf4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b9 expref: 260 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.578005:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cf51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b9 expref: 259 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.578328:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066801.578331:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746066801.578335:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3ce00, rc 0) 00000100:00100000:1.0:1746066801.578965:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:31897:x1830882977187200:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1323us (1529us total) trans 8589944205 rc 0/0 00000100:00100000:1.0:1746066801.578972:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10126 00000100:00100000:2.0:1746066801.583128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.583171:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.583219:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.583246:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977187456 00000100:00100000:2.0:1746066801.583254:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977187456 00000100:00100000:1.0:1746066801.583287:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977187712 00000100:00100000:1.0:1746066801.583291:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977187712 00002000:00100000:2.0:1746066801.583302:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009284a680 x1830882977187456/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.583306:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3502079) req@ffff88009ed73b80 x1830882977187712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 504/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.583312:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284a680 with x1830882977187456 ext(2097152->3145727) 00002000:00100000:1.0:1746066801.583313:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73b80 with x1830882977187712 ext(2097152->3502079) 00002000:00010000:2.0:1746066801.583317:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284a680 00002000:00010000:1.0:1746066801.583317:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed73b80 00000100:00100000:1.0:1746066801.583334:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977187968 00000100:00100000:1.0:1746066801.583336:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977187968 00002000:00100000:1.0:1746066801.583344:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3502080->4194303) req@ffff88009ed70000 x1830882977187968/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.583349:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed70000 with x1830882977187968 ext(3502080->4194303) 00002000:00010000:1.0:1746066801.583352:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed70000 00000100:00100000:2.0:1746066801.584289:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6894 00000100:00100000:2.0:1746066801.584299:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977187712:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066801.584384:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6895 00000100:00100000:1.0:1746066801.584390:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977187456:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066801.584804:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6896 00000100:00100000:3.0:1746066801.584813:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977187968:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066801.589867:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.589901:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977188096 00000100:00100000:2.0:1746066801.589910:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977188096 00000100:00100000:2.0:1746066801.589961:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15188 00000100:00100000:2.0:1746066801.589971:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977188096:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.589989:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.590007:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135437400/0xfb36a14ee608cf5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f4c0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.590031:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.590033:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.590042:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135437400/0xfb36a14ee608cf5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4c0 expref: 34 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.590058:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135437400/0xfb36a14ee608cf5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4c0 expref: 34 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.590070:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135437400, rc 0) 00000100:00100000:2.0:1746066801.590109:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977188096:12345-192.168.202.57@tcp:101:cat.0 Request processed in 140us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.590116:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15188 00000100:00100000:2.0:1746066801.590161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.590194:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977188224 00000100:00100000:2.0:1746066801.590196:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977188224 00000100:00100000:2.0:1746066801.590215:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15189 00000100:00100000:2.0:1746066801.590220:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977188224:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.590228:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.590239:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135437200/0xfb36a14ee608cf66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f4c7 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.590281:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976947840:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066801.590339:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.599341:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976947840:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066801.599381:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135437200/0xfb36a14ee608cf66 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4c7 expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.599396:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135437200/0xfb36a14ee608cf66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4c7 expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.599412:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135437200, rc 0) 00000100:00100000:2.0:1746066801.599462:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977188224:12345-192.168.202.57@tcp:101:cat.0 Request processed in 9240us (9298us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066801.599470:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15189 00000100:00100000:2.0:1746066801.604005:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977187712:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19696us (20821us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066801.604019:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6894 00002000:00100000:2.0:1746066801.604033:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3502079) req@ffff88009ed73b80 x1830882977187712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 504/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.604041:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73b80 with x1830882977187712 ext(2097152->3502079) 00002000:00010000:2.0:1746066801.604047:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed73b80 00000100:00100000:1.0:1746066801.612259:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977187968:12345-192.168.202.57@tcp:3:cat.0 Request processed in 27435us (29026us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746066801.612271:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6896 00002000:00100000:1.0:1746066801.612283:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3502080->4194303) req@ffff88009ed70000 x1830882977187968/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.612293:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed70000 with x1830882977187968 ext(3502080->4194303) 00002000:00010000:1.0:1746066801.612300:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed70000 00000100:00100000:0.0:1746066801.616487:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.616727:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977188480 00000100:00100000:1.0:1746066801.616738:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977188480 00002000:00100000:1.0:1746066801.616791:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009b7faa00 x1830882977188480/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.616801:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7faa00 with x1830882977188480 ext(0->1048575) 00002000:00010000:1.0:1746066801.616807:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7faa00 00000100:00100000:1.0:1746066801.616841:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6897 00000100:00100000:1.0:1746066801.616849:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977188480:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066801.621077:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977187456:12345-192.168.202.57@tcp:3:cat.0 Request processed in 36675us (37948us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066801.621092:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6895 00002000:00100000:3.0:1746066801.621106:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009284a680 x1830882977187456/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.621117:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284a680 with x1830882977187456 ext(2097152->3145727) 00002000:00010000:3.0:1746066801.621123:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284a680 00000100:00100000:1.0:1746066801.634434:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977188480:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17572us (17948us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066801.634449:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6897 00002000:00100000:1.0:1746066801.634463:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009b7faa00 x1830882977188480/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.634474:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7faa00 with x1830882977188480 ext(0->1048575) 00002000:00010000:1.0:1746066801.634481:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7faa00 00000100:00100000:1.0:1746066801.655395:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.657763:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977188608 00000100:00100000:2.0:1746066801.657778:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977188608 00000100:00100000:2.0:1746066801.657860:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15190 00000100:00100000:2.0:1746066801.657870:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:31897:x1830882977188608:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.657888:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.657909:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed68800/0xfb36a14ee608cf6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f4ce expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.657941:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2494463) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.657948:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066801.657949:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066801.657953:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed68800/0xfb36a14ee608cf6d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ce expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.657989:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2494463) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.658001:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2494463) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 17 pid: 8450 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746066801.658013:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976947968:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.658127:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066801.661479:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.661616:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a4ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976947968:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.661653:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed68800/0xfb36a14ee608cf6d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ce expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.661673:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed68800, rc 0) 00000100:00100000:2.0:1746066801.662641:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31897:x1830882977188608:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4770us (7255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.662650:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15190 00000100:00100000:0.0:1746066801.662914:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977188736 00000100:00100000:0.0:1746066801.662922:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977188736 00002000:00100000:0.0:1746066801.662962:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2138112->2494463) req@ffff88008c396a00 x1830882977188736/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.662971:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396a00 with x1830882977188736 ext(2138112->2494463) 00010000:00010000:0.0:1746066801.662979:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 18 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746066801.662991:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 18 pid: 8450 timeout: 862 lvb_type: 0 00002000:00010000:0.0:1746066801.662997:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c396a00 00000100:00100000:0.0:1746066801.663015:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2231 00000100:00100000:0.0:1746066801.663023:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977188736:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066801.674838:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.674935:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977188992 00000100:00100000:0.0:1746066801.674944:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977188992 00000100:00100000:0.0:1746066801.675006:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10127 00000100:00100000:0.0:1746066801.675014:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:31900:x1830882977188992:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066801.675040:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066801.675059:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4200/0xfb36a14ee608cf74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f4d5 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.675158:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.675173:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3cb expref: 14 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.675181:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3d2 expref: 258 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.675187:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135436e00/0xfb36a14ee608ceef lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f481 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.675192:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93a00/0xfb36a14ee608cf20 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f496 expref: 258 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.675198:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 7/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.675233:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93a00/0xfb36a14ee608cf20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f496 expref: 258 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.675244:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93a00/0xfb36a14ee608cf20 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f496 expref: 258 pid: 809 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066801.675256:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976948096:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066801.675335:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135436e00/0xfb36a14ee608ceef lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f481 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.675342:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135436e00/0xfb36a14ee608ceef lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f481 expref: 14 pid: 14548 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066801.675350:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976948224:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066801.675372:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3d2 expref: 258 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.675378:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3d2 expref: 258 pid: 14548 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066801.675385:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976948352:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066801.675407:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3cb expref: 14 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.675413:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3cb expref: 14 pid: 809 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066801.675421:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976948480:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066801.675453:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.677636:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977188736:12345-192.168.202.57@tcp:4:cat.0 Request processed in 14601us (16157us total) trans 21474841041 rc 0/0 00000100:00100000:2.0:1746066801.677650:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2231 00002000:00100000:2.0:1746066801.677665:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2138112->2494463) req@ffff88008c396a00 x1830882977188736/t21474841041(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/448 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.677690:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396a00 with x1830882977188736 ext(2138112->2494463) 00010000:00010000:2.0:1746066801.677701:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 20 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.677715:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 20 pid: 8450 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746066801.677722:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c396a00 00000100:00100000:1.0:1746066801.678115:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.678142:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.678160:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977189120 00000100:00100000:1.0:1746066801.678167:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977189120 00010000:00010000:1.0:1746066801.678194:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135436e00/0xfb36a14ee608ceef lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f481 expref: 15 pid: 14548 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746066801.678226:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977189376 00000100:00100000:1.0:1746066801.678229:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977189376 00010000:00010000:1.0:1746066801.678240:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3d2 expref: 259 pid: 14548 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746066801.678254:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7807 00000100:00100000:1.0:1746066801.678260:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882977189120:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.678274:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066801.678279:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135436e00/0xfb36a14ee608ceef lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f481 expref: 15 pid: 14548 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.678290:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135436e00/0xfb36a14ee608ceef lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f481 expref: 15 pid: 14548 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.678313:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066801.678318:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.678326:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.678331:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066801.678365:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882977189120:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 106us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.678374:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7807 00000100:00100000:1.0:1746066801.678384:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7808 00000100:00100000:1.0:1746066801.678389:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:1964:x1830882977189376:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.678395:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066801.678399:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3d2 expref: 259 pid: 14548 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.678406:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3d2 expref: 259 pid: 14548 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.678415:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066801.678417:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.678422:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.678426:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066801.678440:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:1964:x1830882977189376:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 51us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.678445:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7808 00000100:00100000:1.0:1746066801.678477:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.678488:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977189248 00000100:00100000:1.0:1746066801.678491:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977189248 00010000:00010000:1.0:1746066801.678499:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93a00/0xfb36a14ee608cf20 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f496 expref: 259 pid: 809 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746066801.678512:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7809 00000100:00100000:1.0:1746066801.678517:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a540a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:1964:x1830882977189248:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.678523:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066801.678540:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93a00/0xfb36a14ee608cf20 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f496 expref: 259 pid: 809 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.678547:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93a00/0xfb36a14ee608cf20 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f496 expref: 259 pid: 809 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.678557:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066801.678559:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.678564:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.678569:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066801.678582:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a540a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:1964:x1830882977189248:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 64us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.678587:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7809 00010000:00010000:0.0:1746066801.679605:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93a00/0xfb36a14ee608cf20 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f496 expref: 258 pid: 809 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066801.679626:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976948096:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066801.679639:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135436e00/0xfb36a14ee608ceef lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f481 expref: 14 pid: 14548 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066801.679647:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976948224:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066801.679656:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ea00/0xfb36a14ee608ce32 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3d2 expref: 257 pid: 14548 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066801.679665:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976948352:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066801.679672:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976948480:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.679732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.679790:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977189504 00000100:00100000:3.0:1746066801.679794:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977189504 00010000:00010000:3.0:1746066801.679811:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3cb expref: 14 pid: 809 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746066801.679826:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7810 00000100:00100000:3.0:1746066801.679831:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+14:1966:x1830882977189504:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066801.679838:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066801.679842:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3cb expref: 14 pid: 809 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746066801.679849:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3cb expref: 14 pid: 809 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746066801.679861:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5f800/0xfb36a14ee608ce01 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3cb expref: 14 pid: 809 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746066801.679872:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066801.679875:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066801.679883:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066801.679890:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066801.679904:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.679925:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+13:1966:x1830882977189504:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 94us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.679929:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7810 00010000:00010000:0.0:1746066801.680120:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.680128:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.680133:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:0.0:1746066801.680151:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066801.680467:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee4200/0xfb36a14ee608cf74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4d5 expref: 14 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.680478:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4d5 expref: 13 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.680484:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066801.680486:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066801.680488:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eee5c00, rc 0) 00000100:00100000:3.0:1746066801.681659:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:31900:x1830882977188992:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6640us (6826us total) trans 8589944206 rc 0/0 00000100:00100000:3.0:1746066801.681866:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10127 00000100:00100000:0.0:1746066801.685408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.685459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.685521:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977189760 00000100:00100000:3.0:1746066801.685538:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977189760 00000100:00100000:3.0:1746066801.685581:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15191 00000100:00100000:3.0:1746066801.685588:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:31900:x1830882977189760:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066801.685607:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.685623:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f4dc expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.685656:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8c00/0xfb36a14ee608cecc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f473 expref: 33 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.685664:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608ced3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f47a expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.685669:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.685671:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.685700:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3325952->3371007] (req 3325952->3371007) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.685732:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608ced3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f47a expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.685741:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608ced3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f47a expref: 28 pid: 20532 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746066801.685753:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976948608:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066801.685838:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8c00/0xfb36a14ee608cecc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f473 expref: 33 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.685845:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8c00/0xfb36a14ee608cecc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f473 expref: 33 pid: 20532 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746066801.685852:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976948736:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066801.685867:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.686078:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977189632 00000100:00100000:2.0:1746066801.686083:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977189632 00010000:00010000:2.0:1746066801.686106:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 20 pid: 8450 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746066801.686125:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7811 00000100:00100000:2.0:1746066801.686130:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977189632:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.686140:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.686163:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2494463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 20 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.686174:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2494463) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 20 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.686193:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5316a00/0xfb36a14ee608cefd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2494463) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f488 expref: 20 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.686210:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.686211:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.686219:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68800/0xfb36a14ee608cf6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ce expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.686226:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed68800/0xfb36a14ee608cf6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ce expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.686248:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed68800/0xfb36a14ee608cf6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ce expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.686256:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b471f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976948864:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066801.686281:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066801.687725:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976948608:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066801.687735:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976948736:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066801.687760:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3325952->3371007] (req 3325952->3371007) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.687772:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099a09c00, rc 0) 00000100:00100000:3.0:1746066801.688459:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+28:31900:x1830882977189760:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2221us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.688467:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15191 00000100:00100000:2.0:1746066801.689615:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b471f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976948864:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066801.689631:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.689660:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977189632:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3528us (4260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.689669:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7811 00000100:00100000:0.0:1746066801.698831:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.699382:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.699465:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977190144 00000100:00100000:0.0:1746066801.699467:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.699476:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977190144 00000100:00100000:3.0:1746066801.699495:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977189888 00000100:00100000:3.0:1746066801.699497:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977189888 00010000:00010000:3.0:1746066801.699547:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608ced3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f47a expref: 28 pid: 20532 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746066801.699587:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977190272 00000100:00100000:3.0:1746066801.699589:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977190272 00010000:00010000:3.0:1746066801.699600:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8c00/0xfb36a14ee608cecc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f473 expref: 34 pid: 20532 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746066801.699616:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7812 00000100:00100000:3.0:1746066801.699623:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882977189888:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066801.699638:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066801.699662:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608ced3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f47a expref: 28 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746066801.699673:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608ced3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f47a expref: 28 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746066801.699723:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608ced3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f47a expref: 28 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746066801.699743:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.699787:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977189888:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 164us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.699793:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7812 00000100:00100000:3.0:1746066801.699807:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7813 00000100:00100000:3.0:1746066801.699817:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977190272:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066801.699823:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066801.699830:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8c00/0xfb36a14ee608cecc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f473 expref: 34 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746066801.699837:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8c00/0xfb36a14ee608cecc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f473 expref: 34 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746066801.699848:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8c00/0xfb36a14ee608cecc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f473 expref: 34 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746066801.699856:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.699858:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.699865:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3371007) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.699873:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3371007) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.699910:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3371007) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066801.699923:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976948992:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066801.700045:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b300 going to sleep for 11 seconds 00002000:00100000:3.0:1746066801.700080:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880135e5e680 x1830882977190144/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066801.700154:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:3.0:1746066801.700217:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5e680 with x1830882977190144 ext(2097152->3145727) 00002000:00010000:3.0:1746066801.700221:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5e680 00000100:00100000:3.0:1746066801.700237:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6898 00000100:00100000:3.0:1746066801.700242:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882977190144:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066801.700371:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977190528 00000100:00100000:2.0:1746066801.700376:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977190528 00000100:00100000:2.0:1746066801.700410:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10128 00000100:00100000:2.0:1746066801.700415:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:31902:x1830882977190528:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066801.700481:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.700495:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69e00/0xfb36a14ee608cf90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f4e3 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.700602:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69800/0xfb36a14ee608cf97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.700613:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69800/0xfb36a14ee608cf97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.700623:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69800/0xfb36a14ee608cf97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.700634:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608cf9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.700640:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608cf9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.700645:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608cf9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.701831:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68200/0xfb36a14ee608cfa5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.701843:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68200/0xfb36a14ee608cfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.701852:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68200/0xfb36a14ee608cfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:2.0:1746066801.701866:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066801.701961:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69800/0xfb36a14ee608cf97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.701967:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69800/0xfb36a14ee608cf97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.701973:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69800/0xfb36a14ee608cf97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.701979:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed69800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066801.701982:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69800/0xfb36a14ee608cf97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.701989:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69800/0xfb36a14ee608cf97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.701998:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066801.702001:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066801.702004:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69800/0xfb36a14ee608cf97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.702009:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69800/0xfb36a14ee608cf97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.702038:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608cf9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.702044:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608cf9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.702049:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608cf9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.702058:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed69c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066801.702060:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608cf9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.702065:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608cf9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.702071:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebecd00) 00010000:00010000:2.0:1746066801.702072:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066801.702075:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608cf9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.702079:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608cf9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.702121:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69e00/0xfb36a14ee608cf90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4e3 expref: 260 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.702133:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68200/0xfb36a14ee608cfa5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4e3 expref: 259 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.702139:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066801.702141:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066801.702143:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed68200, rc 0) 00000100:00100000:2.0:1746066801.702208:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:31902:x1830882977190528:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 1792us (2053us total) trans 8589944207 rc 0/0 00000100:00100000:2.0:1746066801.702215:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10128 00000100:00100000:0.0:1746066801.710048:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.710128:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.710196:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977190912 00000100:00100000:2.0:1746066801.710208:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977190912 00000100:00100000:2.0:1746066801.710271:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15192 00000100:00100000:2.0:1746066801.710279:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:31902:x1830882977190912:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066801.710300:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.710318:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f4ea expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.710350:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faf4000/0xfb36a14ee608cf43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b2 expref: 26 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.710359:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135437400/0xfb36a14ee608cf5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4c0 expref: 35 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.710365:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.710367:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.710371:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [876544->995327] (req 876544->995327) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 35 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.710402:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135437400/0xfb36a14ee608cf5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4c0 expref: 35 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.710414:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135437400/0xfb36a14ee608cf5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4c0 expref: 35 pid: 8450 timeout: 862 lvb_type: 1 00000100:00100000:2.0:1746066801.710426:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b471f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976949120:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.710515:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faf4000/0xfb36a14ee608cf43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b2 expref: 26 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.710540:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faf4000/0xfb36a14ee608cf43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b2 expref: 26 pid: 20532 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746066801.710548:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b471500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976949248:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.710567:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066801.711271:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976948992:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066801.711291:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.711317:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882977190272:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 11504us (11850us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.711326:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7813 00000100:00100000:1.0:1746066801.711536:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977190784 00000100:00100000:1.0:1746066801.711541:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977190784 00002000:00100000:1.0:1746066801.711574:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3325952->3330047) req@ffff880135e5ce00 x1830882977190784/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.711584:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ce00 with x1830882977190784 ext(3325952->3330047) 00002000:00010000:1.0:1746066801.711588:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5ce00 00000100:00100000:1.0:1746066801.711865:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6899 00000100:00100000:1.0:1746066801.711872:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977190784:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066801.712051:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977190784:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 179us (2013us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066801.712057:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6899 00002000:00100000:1.0:1746066801.712062:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3325952->3330047) req@ffff880135e5ce00 x1830882977190784/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.712074:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5ce00 with x1830882977190784 ext(3325952->3330047) 00002000:00010000:1.0:1746066801.712077:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5ce00 00000100:00100000:3.0:1746066801.718275:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882977190144:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18018us (18879us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066801.718287:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6898 00002000:00100000:3.0:1746066801.718301:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880135e5e680 x1830882977190144/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.718311:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5e680 with x1830882977190144 ext(2097152->3145727) 00002000:00010000:3.0:1746066801.718317:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e5e680 00000100:00100000:2.0:1746066801.718945:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b471f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976949120:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066801.721930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.721973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.722062:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.722253:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b471500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976949248:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.722288:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [876544->995327] (req 876544->995327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 34 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.722308:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed68600, rc 0) 00000100:00100000:2.0:1746066801.722356:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:31902:x1830882977190912:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 12076us (12226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.722365:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15192 00000100:00100000:2.0:1746066801.722416:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977191296 00000100:00100000:2.0:1746066801.722423:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977191296 00002000:00100000:2.0:1746066801.722462:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3366912->3371007) req@ffff88012c0fca80 x1830882977191296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.722470:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fca80 with x1830882977191296 ext(3366912->3371007) 00002000:00010000:2.0:1746066801.722475:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fca80 00000100:00100000:2.0:1746066801.722497:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6900 00000100:00100000:2.0:1746066801.722503:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977191296:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066801.722744:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977191040 00000100:00100000:3.0:1746066801.722747:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977191040 00010000:00010000:3.0:1746066801.722765:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135437400/0xfb36a14ee608cf5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4c0 expref: 34 pid: 8450 timeout: 862 lvb_type: 1 00000100:00100000:3.0:1746066801.722783:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977191424 00000100:00100000:3.0:1746066801.722785:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977191424 00010000:00010000:3.0:1746066801.722792:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf4000/0xfb36a14ee608cf43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b2 expref: 28 pid: 20532 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746066801.722811:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7814 00000100:00100000:3.0:1746066801.722815:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977191040:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066801.722824:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066801.722841:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135437400/0xfb36a14ee608cf5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4c0 expref: 34 pid: 8450 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.722851:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135437400/0xfb36a14ee608cf5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4c0 expref: 34 pid: 8450 timeout: 862 lvb_type: 1 00010000:00010000:3.0:1746066801.722875:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135437400/0xfb36a14ee608cf5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4c0 expref: 34 pid: 8450 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746066801.723064:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7815 00000100:00100000:1.0:1746066801.723072:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882977191424:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.723080:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066801.723090:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faf4000/0xfb36a14ee608cf43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b2 expref: 28 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.723099:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faf4000/0xfb36a14ee608cf43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b2 expref: 28 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.723111:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faf4000/0xfb36a14ee608cf43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b2 expref: 28 pid: 20532 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.723127:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066801.723129:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066801.723136:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 876544->995327) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.723145:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 876544->995327) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.723177:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 876544->995327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066801.723189:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c396680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976949376:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066801.724227:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977191296:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 1722us (2251us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066801.724236:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6900 00002000:00100000:2.0:1746066801.724244:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3366912->3371007) req@ffff88012c0fca80 x1830882977191296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.724252:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fca80 with x1830882977191296 ext(3366912->3371007) 00002000:00010000:2.0:1746066801.724256:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fca80 00000100:00100000:0.0:1746066801.724419:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066801.724617:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.724643:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977191040:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1827us (2723us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.724651:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7814 00000100:00100000:2.0:1746066801.724747:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977191552 00000100:00100000:2.0:1746066801.724751:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977191552 00000100:00100000:1.0:1746066801.724755:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dc900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.724776:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15193 00000100:00100000:2.0:1746066801.724781:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:31897:x1830882977191552:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.724793:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.724806:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xfb36a14ee608cfba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f4f1 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.724827:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3371007) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.724833:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066801.724835:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066801.724838:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xfb36a14ee608cfba lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f1 expref: 34 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.724858:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3371007) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 26 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.724868:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3371007) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 26 pid: 8450 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746066801.724883:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b471500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976949504:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.724910:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.726872:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b471500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882976949504:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.726900:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xfb36a14ee608cfba lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f1 expref: 34 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.726914:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed69c00, rc 0) 00000100:00100000:2.0:1746066801.726960:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:31897:x1830882977191552:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2178us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.726967:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15193 00000100:00100000:1.0:1746066801.727054:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c396680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976949376:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066801.727071:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066801.727090:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+26:1965:x1830882977191424:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4020us (5028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.727098:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7815 00000100:00100000:0.0:1746066801.729453:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.729588:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977191808 00000100:00100000:2.0:1746066801.729599:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977191808 00002000:00100000:2.0:1746066801.729648:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (876544->880639) req@ffff88012c0fc380 x1830882977191808/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.729660:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fc380 with x1830882977191808 ext(876544->880639) 00002000:00010000:2.0:1746066801.729664:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fc380 00000100:00100000:2.0:1746066801.729715:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6901 00000100:00100000:2.0:1746066801.729723:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977191808:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066801.729892:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977191808:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 169us (447us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066801.729897:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6901 00002000:00100000:2.0:1746066801.729902:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (876544->880639) req@ffff88012c0fc380 x1830882977191808/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.729914:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fc380 with x1830882977191808 ext(876544->880639) 00002000:00010000:2.0:1746066801.729916:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fc380 00000100:00100000:0.0:1746066801.732804:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.733337:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977192064 00000100:00100000:2.0:1746066801.733346:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977192064 00002000:00100000:2.0:1746066801.733388:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3325952->3371007) req@ffff88012c0fce00 x1830882977192064/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.733398:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fce00 with x1830882977192064 ext(3325952->3371007) 00010000:00010000:2.0:1746066801.733407:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 26 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.733419:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 26 pid: 8450 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746066801.733425:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c0fce00 00000100:00100000:2.0:1746066801.733458:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2232 00000100:00100000:2.0:1746066801.733466:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977192064:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066801.733877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.733894:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977192320 00000100:00100000:2.0:1746066801.733897:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977192320 00002000:00100000:2.0:1746066801.733912:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (991232->995327) req@ffff88012c0fe680 x1830882977192320/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.733919:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fe680 with x1830882977192320 ext(991232->995327) 00002000:00010000:2.0:1746066801.733922:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fe680 00000100:00100000:2.0:1746066801.734125:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6902 00000100:00100000:2.0:1746066801.734132:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977192320:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066801.734281:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977192320:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 148us (407us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066801.734287:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6902 00002000:00100000:2.0:1746066801.734293:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (991232->995327) req@ffff88012c0fe680 x1830882977192320/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.734301:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fe680 with x1830882977192320 ext(991232->995327) 00002000:00010000:2.0:1746066801.734304:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fe680 00000100:00100000:2.0:1746066801.735238:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882977192064:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 1772us (2441us total) trans 17179873737 rc 0/0 00000100:00100000:2.0:1746066801.735244:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2232 00002000:00100000:2.0:1746066801.735249:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3325952->3371007) req@ffff88012c0fce00 x1830882977192064/t17179873737(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/448 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.735256:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fce00 with x1830882977192064 ext(3325952->3371007) 00010000:00010000:2.0:1746066801.735262:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 28 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.735273:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 28 pid: 8450 timeout: 862 lvb_type: 0 00002000:00010000:2.0:1746066801.735279:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c0fce00 00000100:00100000:2.0:1746066801.739114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.739166:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.739230:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977192704 00000100:00100000:0.0:1746066801.739239:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977192704 00000100:00100000:0.0:1746066801.739288:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4248 00000100:00100000:0.0:1746066801.739295:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:31902:x1830882977192704:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:0.0:1746066801.739516:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:31902:x1830882977192704:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 221us (412us total) trans 8589944208 rc 0/0 00000100:00100000:0.0:1746066801.739522:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4248 00000100:00100000:1.0:1746066801.739707:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977192448 00000100:00100000:1.0:1746066801.739712:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977192448 00010000:00010000:1.0:1746066801.739734:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3325952->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 28 pid: 8450 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746066801.739756:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7816 00000100:00100000:1.0:1746066801.739761:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5409c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882977192448:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.739772:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066801.739788:0:21351:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066800 -> 1746066801 00002000:00010000:1.0:1746066801.739791:0:21351:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066800 -> 1746066801 00010000:00010000:1.0:1746066801.739796:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3325952->3371007) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 28 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.739807:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3325952->3371007) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 28 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.739829:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a09c00/0xfb36a14ee608cf89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3325952->3371007) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4dc expref: 28 pid: 8450 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746066801.739846:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066801.739848:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066801.739855:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xfb36a14ee608cfba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f1 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.739863:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xfb36a14ee608cfba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f1 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.739894:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xfb36a14ee608cfba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f1 expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066801.739906:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c396680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976949632:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066801.739961:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dc900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066801.743188:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c396680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976949632:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066801.743215:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066801.743263:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5409c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977192448:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3500us (4094us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.743273:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7816 00000100:00100000:0.0:1746066801.749503:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.749956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.750450:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977192960 00000100:00100000:2.0:1746066801.750460:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977192960 00002000:00100000:2.0:1746066801.750518:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88012c0fd180 x1830882977192960/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.750538:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fd180 with x1830882977192960 ext(3145728->4194303) 00002000:00010000:2.0:1746066801.750544:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fd180 00000100:00100000:2.0:1746066801.750561:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977193216 00000100:00100000:2.0:1746066801.750563:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977193216 00002000:00100000:2.0:1746066801.750581:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88012c0fea00 x1830882977193216/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.750588:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fea00 with x1830882977193216 ext(3145728->4194303) 00002000:00010000:2.0:1746066801.750591:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fea00 00000100:00100000:2.0:1746066801.750616:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6903 00000100:00100000:2.0:1746066801.750623:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977192960:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066801.750633:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6904 00000100:00100000:1.0:1746066801.750644:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977193216:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066801.772466:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977192960:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 21829us (22960us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066801.772479:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6903 00002000:00100000:2.0:1746066801.772492:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88012c0fd180 x1830882977192960/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.772501:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fd180 with x1830882977192960 ext(3145728->4194303) 00002000:00010000:2.0:1746066801.772507:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fd180 00000100:00100000:1.0:1746066801.776184:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977193216:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 25531us (26217us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066801.776197:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6904 00002000:00100000:1.0:1746066801.776209:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88012c0fea00 x1830882977193216/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.776217:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fea00 with x1830882977193216 ext(3145728->4194303) 00002000:00010000:1.0:1746066801.776223:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fea00 00000100:00100000:0.0:1746066801.783479:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.783598:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977193472 00000100:00100000:2.0:1746066801.783607:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977193472 00000100:00100000:3.0:1746066801.786192:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10129 00000100:00100000:3.0:1746066801.786212:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+13:31907:x1830882977193472:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.786239:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.786265:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4c00/0xfb36a14ee608cfc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f4f8 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.786379:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cfc8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786392:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cfc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786403:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cfc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786415:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608cfcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786420:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608cfcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786425:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608cfcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786653:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608cfd6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786661:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608cfd6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786668:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608cfd6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746066801.786690:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066801.786780:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cfc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786786:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cfc8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786792:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cfc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786797:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faf4600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066801.786801:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cfc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786807:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cfc8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786817:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066801.786820:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066801.786824:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cfc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786829:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608cfc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786853:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608cfcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786857:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608cfcf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786861:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608cfcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786868:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faf5800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066801.786870:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608cfcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786874:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608cfcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786879:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d3b8b00) 00010000:00010000:3.0:1746066801.786881:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066801.786882:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608cfcf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786886:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608cfcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.786920:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4c00/0xfb36a14ee608cfc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f8 expref: 16 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.786930:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608cfd6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f8 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.786936:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066801.786938:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066801.786940:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf5400, rc 0) 00000100:00100000:3.0:1746066801.786999:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:31907:x1830882977193472:12345-192.168.202.57@tcp:101:cat.0 Request processed in 795us (3532us total) trans 8589944209 rc 0/0 00000100:00100000:3.0:1746066801.787005:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10129 00000100:00100000:0.0:1746066801.796272:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.796391:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977193728 00000100:00100000:1.0:1746066801.796402:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977193728 00002000:00100000:1.0:1746066801.796457:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88012c0fdc00 x1830882977193728/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.796468:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fdc00 with x1830882977193728 ext(4194304->5091327) 00002000:00010000:1.0:1746066801.796474:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fdc00 00000100:00100000:0.0:1746066801.796985:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.797028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.797059:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977194112 00000100:00100000:0.0:1746066801.797062:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977194112 00000100:00100000:3.0:1746066801.797129:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977193984 00000100:00100000:3.0:1746066801.797133:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977193984 00000100:00100000:3.0:1746066801.797159:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4249 00000100:00100000:3.0:1746066801.797165:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:31907:x1830882977193984:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:1.0:1746066801.797194:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6905 00000100:00100000:1.0:1746066801.797201:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882977193728:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066801.797335:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10130 00000100:00100000:0.0:1746066801.797346:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:31908:x1830882977194112:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066801.797359:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066801.797380:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eae00/0xfb36a14ee608cfe4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f4ff expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.797423:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eaa00/0xfb36a14ee608cfeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066801.797435:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eaa00/0xfb36a14ee608cfeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066801.797445:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eaa00/0xfb36a14ee608cfeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066801.797457:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eb200/0xfb36a14ee608cff2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066801.797463:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eb200/0xfb36a14ee608cff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066801.797468:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eb200/0xfb36a14ee608cff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066801.797577:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066801.797586:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4d5 expref: 16 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.797593:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066801.797624:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4d5 expref: 16 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.797640:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4d5 expref: 16 pid: 809 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746066801.797653:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094129500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976949760:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066801.798059:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066801.798623:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+16:31907:x1830882977193984:12345-192.168.202.57@tcp:35:cat.0 Request processed in 1456us (1636us total) trans 8589944210 rc 0/0 00000100:00100000:3.0:1746066801.798630:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4249 00000100:00100000:0.0:1746066801.804300:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.804837:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977194496 00000100:00100000:3.0:1746066801.804845:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977194496 00000100:00100000:3.0:1746066801.804890:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4250 00000100:00100000:3.0:1746066801.804897:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d05c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+16:23712:x1830882977194496:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066801.805326:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094129500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976949760:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066801.805353:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746066801.806935:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d05c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:23712:x1830882977194496:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 2033us (2639us total) trans 8589944211 rc 0/0 00000100:00100000:3.0:1746066801.806950:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4250 00000100:00100000:2.0:1746066801.807501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.807540:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977194624 00000100:00100000:2.0:1746066801.807546:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977194624 00000100:00100000:1.0:1746066801.807565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.807581:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977194240 00000100:00100000:2.0:1746066801.807583:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977194240 00000100:00100000:2.0:1746066801.807601:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15194 00000100:00100000:2.0:1746066801.807607:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882977194624:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.807622:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.807640:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed68400/0xfb36a14ee608d000 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f50d expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066801.807646:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15195 00000100:00100000:0.0:1746066801.807655:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977194240:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.807661:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.807662:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.807663:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.807669:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cb3dc00/0xfb36a14ee608d007 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f506 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.807696:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed68400/0xfb36a14ee608d000 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f50d expref: 29 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.807713:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed68400/0xfb36a14ee608d000 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f50d expref: 30 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.807724:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed68400, rc 0) 00000100:00100000:0.0:1746066801.807732:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009412a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976949888:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066801.807752:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+30:1963:x1830882977194624:12345-192.168.202.57@tcp:101:cat.0 Request processed in 145us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.807757:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15194 00000100:00100000:0.0:1746066801.807785:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066801.809269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.812255:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882977193728:12345-192.168.202.57@tcp:3:cat.0 Request processed in 15041us (15980us total) trans 0 rc 897024/897024 00000100:00100000:1.0:1746066801.812268:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6905 00002000:00100000:1.0:1746066801.812281:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88012c0fdc00 x1830882977193728/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.812297:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fdc00 with x1830882977193728 ext(4194304->5091327) 00002000:00010000:1.0:1746066801.812304:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0fdc00 00000100:00100000:2.0:1746066801.813240:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977194752 00000100:00100000:2.0:1746066801.813251:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977194752 00000100:00100000:2.0:1746066801.813312:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15196 00000100:00100000:2.0:1746066801.813324:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977194752:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.813342:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.813365:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5800/0xfb36a14ee608d00e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f514 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.813389:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.813392:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.813399:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5800/0xfb36a14ee608d00e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f514 expref: 20 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.813414:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5800/0xfb36a14ee608d00e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f514 expref: 20 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.813424:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0a5800, rc 0) 00000100:00100000:2.0:1746066801.813451:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977194752:12345-192.168.202.57@tcp:101:cat.0 Request processed in 133us (4187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.813456:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15196 00000100:00100000:0.0:1746066801.814534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.815304:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977194880 00000100:00100000:2.0:1746066801.815311:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977194880 00010000:00010000:2.0:1746066801.815342:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4d5 expref: 17 pid: 809 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746066801.815382:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7817 00000100:00100000:2.0:1746066801.815388:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977194880:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.815401:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.815407:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4d5 expref: 17 pid: 809 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.815417:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4d5 expref: 17 pid: 809 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.815438:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eee5c00/0xfb36a14ee608cf7b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4d5 expref: 17 pid: 809 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746066801.815457:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066801.815462:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.815470:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.815476:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.815506:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.815553:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977194880:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 165us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.815559:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7817 00010000:00010000:1.0:1746066801.815719:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815728:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:1.0:1746066801.815771:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:1.0:1746066801.815776:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746066801.815792:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815802:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815810:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eaa00/0xfb36a14ee608cfeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815816:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eaa00/0xfb36a14ee608cfeb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815822:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eaa00/0xfb36a14ee608cfeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815827:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f6eaa00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066801.815831:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eaa00/0xfb36a14ee608cfeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815837:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eaa00/0xfb36a14ee608cfeb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815845:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066801.815848:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066801.815852:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eaa00/0xfb36a14ee608cfeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815856:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eaa00/0xfb36a14ee608cfeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815880:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eb200/0xfb36a14ee608cff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815885:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eb200/0xfb36a14ee608cff2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815890:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eb200/0xfb36a14ee608cff2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815894:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f6eb200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066801.815896:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eb200/0xfb36a14ee608cff2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815901:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eb200/0xfb36a14ee608cff2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815908:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009acdd600) 00010000:00010000:1.0:1746066801.815909:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066801.815911:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eb200/0xfb36a14ee608cff2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066801.815915:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eb200/0xfb36a14ee608cff2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746066801.816111:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009412a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976949888:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066801.816137:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3dc00/0xfb36a14ee608d007 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f506 expref: 29 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.816147:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3dc00/0xfb36a14ee608d007 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f506 expref: 29 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.816163:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3dc00, rc 0) 00000100:00100000:0.0:1746066801.816182:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882977194240:12345-192.168.202.57@tcp:101:cat.0 Request processed in 8529us (8618us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066801.816187:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15195 00010000:00010000:1.0:1746066801.816666:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6eae00/0xfb36a14ee608cfe4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ff expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.816716:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ff expref: 7 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.816722:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066801.816724:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066801.816727:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f6ea000, rc 0) 00000100:00100000:1.0:1746066801.816760:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31908:x1830882977194112:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 19415us (19732us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.816766:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10130 00000100:00100000:0.0:1746066801.831433:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.831584:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977195008 00000100:00100000:2.0:1746066801.831594:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977195008 00000100:00100000:2.0:1746066801.831648:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15197 00000100:00100000:2.0:1746066801.831655:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+28:31907:x1830882977195008:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.831698:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.831718:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eee5c00/0xfb36a14ee608d015 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f51b expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.831748:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->995327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.831756:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066801.831758:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066801.831761:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eee5c00/0xfb36a14ee608d015 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f51b expref: 29 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.831791:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->995327) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 33 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.831804:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->995327) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 33 pid: 8450 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066801.831817:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b471500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976950016:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.831911:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066801.833079:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.833169:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977195136 00000100:00100000:2.0:1746066801.833173:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977195136 00000100:00100000:2.0:1746066801.833203:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15198 00000100:00100000:2.0:1746066801.833209:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882977195136:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066801.833220:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.833234:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8a00/0xfb36a14ee608d01c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f522 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.833266:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093212300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976950144:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066801.833318:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066801.833443:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.833474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.834364:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977195264 00000100:00100000:3.0:1746066801.834369:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977195264 00000100:00100000:3.0:1746066801.834392:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977195520 00000100:00100000:3.0:1746066801.834394:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977195520 00000100:00100000:3.0:1746066801.834406:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15199 00000100:00100000:3.0:1746066801.834411:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977195264:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066801.834421:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.834434:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d023 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f529 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.834448:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.834450:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.834459:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f529 expref: 12 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.834479:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f529 expref: 12 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.834490:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf4800, rc 0) 00000100:00100000:3.0:1746066801.834517:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882977195264:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 106us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.834534:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15199 00000100:00100000:3.0:1746066801.834550:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15200 00000100:00100000:3.0:1746066801.834555:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882977195520:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066801.834561:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.834569:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faf5c00/0xfb36a14ee608d02a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f537 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.834577:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.834578:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.834582:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5c00/0xfb36a14ee608d02a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f537 expref: 15 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.834592:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faf5c00/0xfb36a14ee608d02a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f537 expref: 15 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.834598:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf5c00, rc 0) 00000100:00100000:3.0:1746066801.834612:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1963:x1830882977195520:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 58us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.834617:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15200 00000100:00100000:1.0:1746066801.834715:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.834748:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.835083:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977195392 00000100:00100000:2.0:1746066801.835088:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977195392 00000100:00100000:2.0:1746066801.835105:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977195648 00000100:00100000:2.0:1746066801.835107:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977195648 00000100:00100000:2.0:1746066801.835118:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15201 00000100:00100000:2.0:1746066801.835122:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882977195392:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066801.835129:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.835150:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed92000/0xfb36a14ee608d031 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f530 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.835166:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.835167:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.835171:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed92000/0xfb36a14ee608d031 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f530 expref: 14 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.835181:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed92000/0xfb36a14ee608d031 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f530 expref: 14 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.835188:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed92000, rc 0) 00000100:00100000:2.0:1746066801.835204:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882977195392:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 81us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.835210:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15201 00000100:00100000:2.0:1746066801.835220:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15202 00000100:00100000:2.0:1746066801.835224:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882977195648:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066801.835229:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.835236:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed92200/0xfb36a14ee608d038 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f53e expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.835245:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.835246:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.835250:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed92200/0xfb36a14ee608d038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f53e expref: 14 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.835258:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed92200/0xfb36a14ee608d038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f53e expref: 14 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.835269:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed92200, rc 0) 00000100:00100000:2.0:1746066801.835282:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882977195648:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 58us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.835287:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15202 00000100:00100000:0.0:1746066801.835456:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.835503:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977195776 00000100:00100000:1.0:1746066801.835507:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977195776 00002000:00100000:1.0:1746066801.835544:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x38e:0x0] (876544->995327) req@ffff88009412b800 x1830882977195776/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.835553:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412b800 with x1830882977195776 ext(876544->995327) 00010000:00010000:1.0:1746066801.835562:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 876544->995327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 34 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066801.835573:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 876544->995327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 34 pid: 8450 timeout: 863 lvb_type: 0 00002000:00010000:1.0:1746066801.835580:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009412b800 00000100:00100000:1.0:1746066801.835594:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2233 00000100:00100000:1.0:1746066801.835600:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977195776:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066801.835716:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b471500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976950016:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.835736:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eee5c00/0xfb36a14ee608d015 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f51b expref: 29 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.835745:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eee5c00, rc 0) 00000100:00100000:2.0:1746066801.835765:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+29:31907:x1830882977195008:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4112us (4343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.835771:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15197 00000100:00100000:2.0:1746066801.835810:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093212300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976950144:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066801.835826:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8a00/0xfb36a14ee608d01c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f522 expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.835833:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8a00/0xfb36a14ee608d01c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f522 expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.835845:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebc8a00, rc 0) 00000100:00100000:2.0:1746066801.835861:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882977195136:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 2652us (2785us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066801.835866:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15198 00000100:00100000:0.0:1746066801.842811:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.844387:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882977195776:12345-192.168.202.57@tcp:4:cat.0 Request processed in 8782us (8926us total) trans 17179873738 rc 0/0 00000100:00100000:1.0:1746066801.844401:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2233 00002000:00100000:1.0:1746066801.844414:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x38e:0x0] (876544->995327) req@ffff88009412b800 x1830882977195776/t17179873738(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/448 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.844423:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412b800 with x1830882977195776 ext(876544->995327) 00010000:00010000:1.0:1746066801.844435:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->995327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 36 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066801.844449:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->995327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 36 pid: 8450 timeout: 863 lvb_type: 0 00002000:00010000:1.0:1746066801.844456:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009412b800 00000100:00100000:2.0:1746066801.845132:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977196032 00000100:00100000:2.0:1746066801.845141:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977196032 00000100:00100000:2.0:1746066801.845185:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10131 00000100:00100000:2.0:1746066801.845191:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:31908:x1830882977196032:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066801.845207:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.845224:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92600/0xfb36a14ee608d03f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f545 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.845319:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92800/0xfb36a14ee608d046 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.845333:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ff expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.845340:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92800/0xfb36a14ee608d046 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066801.845371:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ff expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.845386:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ff expref: 8 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066801.845397:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093212300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976950272:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.845470:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.848649:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093212300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976950272:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.848709:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92800/0xfb36a14ee608d046 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:2.0:1746066801.850304:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.850619:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977196160 00000100:00100000:3.0:1746066801.850627:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977196160 00010000:00010000:3.0:1746066801.850662:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->995327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 36 pid: 8450 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066801.850715:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7818 00000100:00100000:3.0:1746066801.850723:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093212300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882977196160:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066801.850735:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066801.850761:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 876544->995327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 36 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066801.850772:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 876544->995327) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 36 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066801.850795:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed68600/0xfb36a14ee608cfb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 876544->995327) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ea expref: 36 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066801.850812:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.850814:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.850822:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eee5c00/0xfb36a14ee608d015 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f51b expref: 28 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.850831:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eee5c00/0xfb36a14ee608d015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f51b expref: 28 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.850864:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eee5c00/0xfb36a14ee608d015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f51b expref: 28 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066801.850882:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976950400:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066801.850957:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066801.856296:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.857473:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977196288 00000100:00100000:0.0:1746066801.857484:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977196288 00010000:00010000:0.0:1746066801.857922:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ff expref: 9 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746066801.857955:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7819 00000100:00100000:0.0:1746066801.857963:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977196288:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066801.857984:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066801.857989:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ff expref: 9 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066801.858001:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ff expref: 9 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066801.858032:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6ea000/0xfb36a14ee608cff9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ff expref: 9 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066801.858052:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066801.858058:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92800/0xfb36a14ee608d046 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066801.858067:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92800/0xfb36a14ee608d046 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066801.858074:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92800/0xfb36a14ee608d046 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:0.0:1746066801.858110:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066801.858160:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977196288:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 198us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.858166:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7819 00000100:00100000:2.0:1746066801.858385:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976950400:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066801.858400:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.858420:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093212300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1963:x1830882977196160:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7698us (8120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.858430:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7818 00010000:00010000:3.0:1746066801.858739:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92800/0xfb36a14ee608d046 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.858747:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92800/0xfb36a14ee608d046 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746066801.858767:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066801.859271:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92600/0xfb36a14ee608d03f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f545 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.859472:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92800/0xfb36a14ee608d046 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f545 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.859480:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066801.859483:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066801.859485:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed92800, rc 0) 00000100:00100000:3.0:1746066801.859790:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31908:x1830882977196032:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 14598us (16988us total) trans 8589944212 rc 0/0 00000100:00100000:3.0:1746066801.859798:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10131 00000100:00100000:1.0:1746066801.864480:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.864607:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.864672:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977196544 00000100:00100000:1.0:1746066801.864695:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977196544 00002000:00100000:1.0:1746066801.864745:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009412ad80 x1830882977196544/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.864755:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412ad80 with x1830882977196544 ext(0->1048575) 00002000:00010000:1.0:1746066801.864761:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009412ad80 00000100:00100000:3.0:1746066801.864798:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977196800 00000100:00100000:3.0:1746066801.864802:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977196800 00000100:00100000:1.0:1746066801.865649:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6906 00000100:00100000:1.0:1746066801.865658:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977196544:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066801.865774:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10132 00000100:00100000:3.0:1746066801.865781:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31908:x1830882977196800:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066801.865799:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.865803:0:14548:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066801.865830:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92800/0xfb36a14ee608d046 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f545 expref: 8 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.865846:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066801.865851:0:14548:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066801.865862:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5a00/0xfb36a14ee608d054 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f54c expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.865945:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d05b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.865958:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d05b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.865966:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d05b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746066801.865977:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066801.866093:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5a00/0xfb36a14ee608d054 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f54c expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.866106:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d05b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f54c expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.866113:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066801.866116:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066801.866117:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf4000, rc 0) 00000100:00100000:3.0:1746066801.866167:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31908:x1830882977196800:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 386us (1701us total) trans 8589944213 rc 0/0 00000100:00100000:3.0:1746066801.866173:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10132 00000100:00100000:0.0:1746066801.871117:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.871955:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977196928 00000100:00100000:3.0:1746066801.871965:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977196928 00000100:00100000:3.0:1746066801.872020:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10133 00000100:00100000:3.0:1746066801.872029:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31908:x1830882977196928:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066801.872055:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.872075:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d069 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f553 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.872138:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d069 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f553 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.872149:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d069 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f553 expref: 10 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.872178:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066801.872181:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066801.872184:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf5e00, rc 0) 00000100:00100000:3.0:1746066801.872241:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31908:x1830882977196928:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 214us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.872247:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10133 00000100:00100000:1.0:1746066801.878169:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977196544:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12386us (13439us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066801.878185:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6906 00002000:00100000:1.0:1746066801.878198:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009412ad80 x1830882977196544/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.878208:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412ad80 with x1830882977196544 ext(0->1048575) 00002000:00010000:1.0:1746066801.878214:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009412ad80 00000100:00100000:0.0:1746066801.879451:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.879485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.879509:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.879521:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.879543:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.879566:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.879804:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977197056 00000100:00100000:2.0:1746066801.879814:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977197056 00000100:00100000:2.0:1746066801.879851:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977197312 00000100:00100000:2.0:1746066801.879853:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977197312 00000100:00100000:2.0:1746066801.879864:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977197568 00000100:00100000:2.0:1746066801.879865:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977197568 00000100:00100000:2.0:1746066801.879874:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977197184 00000100:00100000:2.0:1746066801.879876:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977197184 00000100:00100000:2.0:1746066801.879884:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977197440 00000100:00100000:2.0:1746066801.879886:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977197440 00000100:00100000:2.0:1746066801.879891:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977197696 00000100:00100000:2.0:1746066801.879893:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977197696 00000100:00100000:2.0:1746066801.879903:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15203 00000100:00100000:2.0:1746066801.879908:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882977197056:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066801.879961:0:21203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e7aa000/0xfb36a14ee608d070 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.879978:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eee5c00/0xfb36a14ee608d015 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f51b expref: 28 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.879985:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.879987:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.879990:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7aa000/0xfb36a14ee608d070 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880033:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eee5c00/0xfb36a14ee608d015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f51b expref: 28 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880045:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eee5c00/0xfb36a14ee608d015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f51b expref: 28 pid: 8452 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066801.880058:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976950528:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.880134:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.880155:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15204 00000100:00100000:2.0:1746066801.880161:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1965:x1830882977197312:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066801.880182:0:8452:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e7aa600/0xfb36a14ee608d077 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880193:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8000/0xfb36a14ee608cebe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f465 expref: 19 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880200:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed92000/0xfb36a14ee608d031 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f530 expref: 16 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.880207:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebc9e00/0xfb36a14ee608cec5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f46c expref: 27 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880212:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.880213:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.880215:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7aa600/0xfb36a14ee608d077 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880231:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebc9e00/0xfb36a14ee608cec5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f46c expref: 27 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880239:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ebc9e00/0xfb36a14ee608cec5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f46c expref: 27 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066801.880247:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093213b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976950656:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.880274:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed92000/0xfb36a14ee608d031 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f530 expref: 16 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.880281:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed92000/0xfb36a14ee608d031 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f530 expref: 16 pid: 21973 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066801.880288:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976950784:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.880309:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8000/0xfb36a14ee608cebe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f465 expref: 19 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880317:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8000/0xfb36a14ee608cebe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f465 expref: 19 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066801.880324:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976950912:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.880336:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.880351:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15205 00000100:00100000:2.0:1746066801.880356:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882977197568:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066801.880373:0:21973:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e7ab400/0xfb36a14ee608d07e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880383:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xfb36a14ee608cfba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f1 expref: 34 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880390:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5c00/0xfb36a14ee608d02a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f537 expref: 15 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.880396:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed68400/0xfb36a14ee608d000 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f50d expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.880401:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.880402:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.880404:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7ab400/0xfb36a14ee608d07e lrc: 6/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880416:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed68400/0xfb36a14ee608d000 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f50d expref: 28 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.880424:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed68400/0xfb36a14ee608d000 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f50d expref: 28 pid: 8450 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066801.880431:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976951040:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.880456:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faf5c00/0xfb36a14ee608d02a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f537 expref: 15 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.880467:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faf5c00/0xfb36a14ee608d02a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f537 expref: 15 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066801.880474:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976951168:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.880496:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xfb36a14ee608cfba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f1 expref: 34 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880503:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xfb36a14ee608cfba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f1 expref: 34 pid: 8450 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066801.880509:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976951296:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.880543:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.880561:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15206 00000100:00100000:2.0:1746066801.880566:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1965:x1830882977197184:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066801.880583:0:20532:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880594:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8800/0xfb36a14ee608cea9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f450 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880601:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d023 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f529 expref: 16 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.880606:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608ceb0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f457 expref: 27 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880613:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.880614:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.880616:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880629:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608ceb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f457 expref: 27 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880637:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608ceb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f457 expref: 27 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066801.880640:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15207 00000100:00100000:2.0:1746066801.880644:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976951424:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066801.880648:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882977197440:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:3.0:1746066801.880666:0:8112:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d08c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880670:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f529 expref: 16 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.880700:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c600/0xfb36a14ee608cd28 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f393 expref: 15 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.880701:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d023 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f529 expref: 16 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066801.880709:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976951552:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066801.880713:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608ce86 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f42d expref: 34 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.880719:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608ce5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f403 expref: 28 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.880724:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.880725:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.880726:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d08c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.880737:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8800/0xfb36a14ee608cea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f450 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.880741:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608ce5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f403 expref: 28 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066801.880744:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8800/0xfb36a14ee608cea9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f450 expref: 19 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066801.880747:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608ce5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f403 expref: 28 pid: 21973 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746066801.880754:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976951808:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.880756:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093212a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976951680:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.880769:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c000 going to sleep for 11 seconds 00010000:00010000:3.0:1746066801.880778:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608ce86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f42d expref: 34 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.880784:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608ce86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f42d expref: 34 pid: 21973 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746066801.880790:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976951936:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066801.880803:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c600/0xfb36a14ee608cd28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f393 expref: 15 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.880809:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c600/0xfb36a14ee608cd28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f393 expref: 15 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746066801.880815:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976952064:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066801.880818:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15208 00000100:00100000:3.0:1746066801.880823:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066801.880826:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1965:x1830882977197696:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066801.880845:0:10402:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136b5e000/0xfb36a14ee608d093 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.880856:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68800/0xfb36a14ee608cf6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ce expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.880863:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed92200/0xfb36a14ee608d038 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f53e expref: 16 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.880871:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5800/0xfb36a14ee608d00e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f514 expref: 19 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.880876:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.880877:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.880878:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b5e000/0xfb36a14ee608d093 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.880893:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5800/0xfb36a14ee608d00e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f514 expref: 19 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.880901:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5800/0xfb36a14ee608d00e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f514 expref: 19 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066801.880908:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976952192:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066801.880934:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed92200/0xfb36a14ee608d038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f53e expref: 16 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.880942:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed92200/0xfb36a14ee608d038 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f53e expref: 16 pid: 21973 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066801.880949:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976952320:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066801.880973:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed68800/0xfb36a14ee608cf6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ce expref: 27 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.880985:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed68800/0xfb36a14ee608cf6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ce expref: 27 pid: 8450 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746066801.880992:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976952448:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066801.881006:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52de000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066801.886550:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976950528:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066801.886578:0:21203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e7aa000/0xfb36a14ee608d070 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.886720:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976951424:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066801.886760:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976951552:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066801.886837:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093213b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976950656:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066801.886845:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976950784:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066801.886850:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976950912:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066801.886866:0:8452:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e7aa600/0xfb36a14ee608d077 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066801.886917:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976951040:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066801.886925:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976951168:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066801.886932:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976951296:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066801.886946:0:21973:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e7ab400/0xfb36a14ee608d07e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066801.887307:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.887344:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.887369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.887391:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977197824 00000100:00100000:0.0:1746066801.887397:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977197824 00010000:00010000:0.0:1746066801.887430:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed68400/0xfb36a14ee608d000 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f50d expref: 29 pid: 8450 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066801.887456:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977198080 00000100:00100000:0.0:1746066801.887458:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977198080 00010000:00010000:0.0:1746066801.887467:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed92000/0xfb36a14ee608d031 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f530 expref: 17 pid: 21973 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066801.887478:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977198592 00000100:00100000:0.0:1746066801.887480:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977198592 00010000:00010000:0.0:1746066801.887491:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608ceb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f457 expref: 28 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746066801.887505:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7820 00000100:00100000:0.0:1746066801.887512:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1965:x1830882977197824:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066801.887534:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066801.887850:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7821 00000100:00100000:2.0:1746066801.887857:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:1965:x1830882977198080:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.887867:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.887883:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed92000/0xfb36a14ee608d031 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f530 expref: 17 pid: 21973 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746066801.887892:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed92000/0xfb36a14ee608d031 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f530 expref: 17 pid: 21973 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746066801.887913:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed92000/0xfb36a14ee608d031 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f530 expref: 17 pid: 21973 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746066801.887932:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.887971:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1965:x1830882977198080:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 115us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.887976:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7821 00000100:00100000:2.0:1746066801.887992:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7822 00000100:00100000:2.0:1746066801.887996:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977198592:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.888004:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.888012:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608ceb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f457 expref: 28 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066801.888019:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608ceb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f457 expref: 28 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066801.888029:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608ceb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f457 expref: 28 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066801.888037:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.888047:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882977198592:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 51us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.888051:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7822 00000100:00100000:2.0:1746066801.888077:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093212a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976951680:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.888094:0:20532:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066801.888406:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.888420:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977197952 00000100:00100000:1.0:1746066801.888423:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977197952 00010000:00010000:1.0:1746066801.888439:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5c00/0xfb36a14ee608d02a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f537 expref: 16 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066801.888456:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7823 00000100:00100000:1.0:1746066801.888461:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5409850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1965:x1830882977197952:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.888469:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066801.888478:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faf5c00/0xfb36a14ee608d02a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f537 expref: 16 pid: 20532 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066801.888485:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faf5c00/0xfb36a14ee608d02a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f537 expref: 16 pid: 20532 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066801.888506:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5c00/0xfb36a14ee608d02a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f537 expref: 16 pid: 20532 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066801.888519:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066801.888545:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5409850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882977197952:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 84us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.888551:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7823 00000100:00100000:1.0:1746066801.888587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.888599:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977198336 00000100:00100000:1.0:1746066801.888601:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977198336 00010000:00010000:1.0:1746066801.888612:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8000/0xfb36a14ee608cebe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f465 expref: 20 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066801.888625:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7824 00000100:00100000:1.0:1746066801.888629:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:1965:x1830882977198336:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.888636:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066801.888644:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8000/0xfb36a14ee608cebe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f465 expref: 20 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066801.888651:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8000/0xfb36a14ee608cebe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f465 expref: 20 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066801.888662:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8000/0xfb36a14ee608cebe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f465 expref: 20 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066801.888670:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066801.888707:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882977198336:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 76us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.888712:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7824 00000100:00100000:1.0:1746066801.888744:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.888754:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977198720 00000100:00100000:1.0:1746066801.888757:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977198720 00010000:00010000:1.0:1746066801.888767:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d023 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f529 expref: 16 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066801.888780:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7825 00000100:00100000:1.0:1746066801.888784:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1965:x1830882977198720:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.888790:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066801.888797:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d023 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f529 expref: 16 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746066801.888802:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976951808:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066801.888804:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f529 expref: 16 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746066801.888811:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976951936:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066801.888815:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d023 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f529 expref: 16 pid: 20532 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066801.888823:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066801.888836:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882977198720:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 52us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.888841:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7825 00000100:00100000:1.0:1746066801.888953:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976952320:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066801.888973:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed68400/0xfb36a14ee608d000 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f50d expref: 29 pid: 8450 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066801.888980:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976952192:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066801.888982:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed68400/0xfb36a14ee608d000 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f50d expref: 29 pid: 8450 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066801.888993:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed68400/0xfb36a14ee608d000 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f50d expref: 29 pid: 8450 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066801.889013:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066801.889031:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882977197824:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1521us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.889036:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976952448:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066801.889037:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7820 00010000:00010000:1.0:1746066801.889055:0:10402:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136b5e000/0xfb36a14ee608d093 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066801.889144:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976952064:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066801.889161:0:8112:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d08c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066801.890037:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.890105:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977199104 00000100:00100000:2.0:1746066801.890109:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977199104 00000100:00100000:2.0:1746066801.890154:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10134 00000100:00100000:2.0:1746066801.890161:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:31911:x1830882977199104:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066801.890179:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.890192:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0e00/0xfb36a14ee608d09a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f55a expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.890296:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0800/0xfb36a14ee608d0a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.890308:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0800/0xfb36a14ee608d0a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.890316:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0800/0xfb36a14ee608d0a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.890328:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0a00/0xfb36a14ee608d0a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.890332:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0a00/0xfb36a14ee608d0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.890336:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0a00/0xfb36a14ee608d0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.890433:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.890442:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d05b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f54c expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.890448:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.890472:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d05b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f54c expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.890481:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d05b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f54c expref: 9 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066801.890495:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093212a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976952576:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066801.891034:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.891064:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.891072:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977199744 00000100:00100000:1.0:1746066801.891076:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977199744 00010000:00010000:1.0:1746066801.891093:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608ce5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f403 expref: 28 pid: 21973 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066801.891097:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066801.891111:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7826 00000100:00100000:1.0:1746066801.891116:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+28:1966:x1830882977199744:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.891124:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066801.891140:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608ce5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f403 expref: 28 pid: 21973 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066801.891149:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608ce5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f403 expref: 28 pid: 21973 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066801.891162:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5b1e00/0xfb36a14ee608ce5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f403 expref: 28 pid: 21973 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066801.891173:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.891193:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977199872 00000100:00100000:3.0:1746066801.891197:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977199872 00000100:00100000:1.0:1746066801.891206:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977199744:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 89us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.891211:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7826 00000100:00100000:3.0:1746066801.891218:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15209 00000100:00100000:3.0:1746066801.891224:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:31907:x1830882977199872:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.891234:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.891981:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099a08a00/0xfb36a14ee608d0b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f561 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.891998:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.892001:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.892007:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066801.892011:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099a08a00/0xfb36a14ee608d0b6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f561 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.892023:0:8450:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.892036:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099a08a00/0xfb36a14ee608d0b6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f561 expref: 20 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.892049:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099a08a00, rc 0) 00000100:00100000:3.0:1746066801.892143:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:31907:x1830882977199872:12345-192.168.202.57@tcp:101:cat.0 Request processed in 918us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.892150:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15209 00000100:00100000:0.0:1746066801.892802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.892830:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.892854:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.892874:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.892899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.892913:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.893642:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977198464 00000100:00100000:2.0:1746066801.893647:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977198464 00000100:00100000:0.0:1746066801.893658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.893668:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066801.893672:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xfb36a14ee608cfba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f1 expref: 35 pid: 8450 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066801.893863:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977199232 00000100:00100000:1.0:1746066801.893867:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977199232 00010000:00010000:1.0:1746066801.893882:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608ce86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f42d expref: 36 pid: 21973 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066801.893902:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977199488 00000100:00100000:1.0:1746066801.893904:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977199488 00010000:00010000:1.0:1746066801.893914:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed92200/0xfb36a14ee608d038 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f53e expref: 15 pid: 21973 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066801.893922:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977200000 00000100:00100000:1.0:1746066801.893924:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977200000 00010000:00010000:1.0:1746066801.893931:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed68800/0xfb36a14ee608cf6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ce expref: 27 pid: 8450 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066801.893939:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977198208 00000100:00100000:1.0:1746066801.893941:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977198208 00010000:00010000:1.0:1746066801.893949:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebc9e00/0xfb36a14ee608cec5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f46c expref: 28 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066801.893957:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977198848 00000100:00100000:1.0:1746066801.893958:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977198848 00010000:00010000:1.0:1746066801.893966:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8800/0xfb36a14ee608cea9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f450 expref: 20 pid: 8450 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066801.893974:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977199360 00000100:00100000:1.0:1746066801.893975:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977199360 00010000:00010000:1.0:1746066801.893983:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c600/0xfb36a14ee608cd28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f393 expref: 15 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066801.893991:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977199616 00000100:00100000:1.0:1746066801.893993:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977199616 00010000:00010000:1.0:1746066801.894000:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5800/0xfb36a14ee608d00e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f514 expref: 21 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066801.894010:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7827 00000100:00100000:1.0:1746066801.894016:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882977199232:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.894027:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066801.894046:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608ce86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f42d expref: 36 pid: 21973 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066801.894056:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608ce86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f42d expref: 36 pid: 21973 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066801.894076:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800925a3000/0xfb36a14ee608ce86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f42d expref: 36 pid: 21973 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066801.894088:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066801.894122:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1963:x1830882977199232:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 106us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.894127:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7827 00000100:00100000:1.0:1746066801.894139:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7828 00000100:00100000:1.0:1746066801.894143:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1963:x1830882977199488:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.894150:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066801.894161:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed92200/0xfb36a14ee608d038 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f53e expref: 15 pid: 21973 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066801.894168:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed92200/0xfb36a14ee608d038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f53e expref: 15 pid: 21973 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746066801.894518:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7829 00000100:00100000:3.0:1746066801.894536:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5409450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977200000:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066801.894544:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066801.894611:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7830 00000100:00100000:2.0:1746066801.894617:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977198208:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.894623:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066801.894624:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093212a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976952576:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066801.894633:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ebc9e00/0xfb36a14ee608cec5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f46c expref: 28 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066801.894647:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.894652:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ebc9e00/0xfb36a14ee608cec5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f46c expref: 28 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066801.894665:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebc9e00/0xfb36a14ee608cec5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f46c expref: 28 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066801.894689:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.894691:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.894695:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e7aa600/0xfb36a14ee608d077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.894703:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7aa600/0xfb36a14ee608d077 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.894724:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.894740:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977198208:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 124us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.894745:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7830 00000100:00100000:2.0:1746066801.894754:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7831 00000100:00100000:2.0:1746066801.894758:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977198848:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066801.894761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066801.894764:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.894773:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8800/0xfb36a14ee608cea9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f450 expref: 21 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066801.894781:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8800/0xfb36a14ee608cea9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f450 expref: 21 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066801.894792:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8800/0xfb36a14ee608cea9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f450 expref: 21 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066801.894800:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.894802:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.894804:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.894809:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.894823:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.894842:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977198848:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 83us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.894848:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7831 00000100:00100000:2.0:1746066801.895309:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977200128 00000100:00100000:2.0:1746066801.895313:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977200128 00010000:00010000:2.0:1746066801.895326:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d05b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f54c expref: 10 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066801.895336:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7832 00000100:00100000:2.0:1746066801.895341:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1963:x1830882977199360:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.895346:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.895356:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c600/0xfb36a14ee608cd28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f393 expref: 15 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746066801.895363:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c600/0xfb36a14ee608cd28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f393 expref: 15 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746066801.895374:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c600/0xfb36a14ee608cd28 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f393 expref: 15 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746066801.895382:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.895383:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.895385:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d08c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.895391:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d08c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.895406:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.896270:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882977199360:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 926us (2609us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.896275:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7832 00000100:00100000:2.0:1746066801.896289:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7833 00000100:00100000:2.0:1746066801.896294:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977199616:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.896303:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.896313:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5800/0xfb36a14ee608d00e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f514 expref: 19 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746066801.896321:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5800/0xfb36a14ee608d00e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f514 expref: 19 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746066801.896332:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0a5800/0xfb36a14ee608d00e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f514 expref: 19 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746066801.896346:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.896364:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977199616:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 70us (2695us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.896369:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7833 00000100:00100000:2.0:1746066801.896378:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7834 00000100:00100000:2.0:1746066801.896384:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977198464:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066801.896390:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.896400:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xfb36a14ee608cfba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f1 expref: 34 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066801.896407:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xfb36a14ee608cfba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f1 expref: 34 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066801.896417:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed69c00/0xfb36a14ee608cfba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f1 expref: 34 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066801.896425:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.896426:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.896428:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e7ab400/0xfb36a14ee608d07e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.896434:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7ab400/0xfb36a14ee608d07e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.896468:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed92200/0xfb36a14ee608d038 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f53e expref: 15 pid: 21973 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066801.896476:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066801.896493:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882977199488:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2350us (3638us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.896498:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7828 00000100:00100000:1.0:1746066801.896511:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7835 00000100:00100000:1.0:1746066801.896517:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977200128:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.896534:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066801.896540:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d05b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f54c expref: 10 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066801.896547:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d05b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f54c expref: 10 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066801.896560:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d05b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f54c expref: 10 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066801.896572:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066801.896577:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.896585:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066801.896590:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066801.896748:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.896769:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977198464:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 385us (3967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.896775:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7834 00010000:00010000:2.0:1746066801.896811:0:20532:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.896818:0:20532:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.896841:0:20532:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.896849:0:20532:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.896860:0:20532:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.896866:0:20532:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e0200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066801.896870:0:20532:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.896877:0:20532:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.896887:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.896888:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.896893:0:20532:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a08a00/0xfb36a14ee608d0b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f561 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.896899:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099a08a00/0xfb36a14ee608d0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f561 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.896925:0:20532:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099a08a00/0xfb36a14ee608d0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f561 expref: 17 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.896936:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976952704:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066801.896983:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c000 going to sleep for 11 seconds 00010000:00010000:0.0:1746066801.897030:0:21973:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e7ab400/0xfb36a14ee608d07e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.897037:0:21973:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e7ab400/0xfb36a14ee608d07e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.897051:0:21973:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e7ab400/0xfb36a14ee608d07e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.897056:0:21973:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7ab400/0xfb36a14ee608d07e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.897066:0:21973:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e7ab400/0xfb36a14ee608d07e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.897070:0:21973:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e7ab400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066801.897073:0:21973:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e7ab400/0xfb36a14ee608d07e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.897078:0:21973:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e7ab400/0xfb36a14ee608d07e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.897087:0:21973:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e7ab400/0xfb36a14ee608d07e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.897093:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e7ab400/0xfb36a14ee608d07e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066801.897135:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882977197568:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 16779us (17625us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.897143:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15205 00010000:00010000:3.0:1746066801.897232:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed68800/0xfb36a14ee608cf6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ce expref: 26 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066801.897240:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed68800/0xfb36a14ee608cf6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ce expref: 26 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066801.897253:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68800/0xfb36a14ee608cf6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4ce expref: 26 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066801.897266:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.897268:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.897271:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b5e000/0xfb36a14ee608d093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897277:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b5e000/0xfb36a14ee608d093 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897292:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066801.897313:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5409450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977200000:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2779us (4437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.897318:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7829 00010000:00010000:3.0:1746066801.897361:0:8452:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e7aa600/0xfb36a14ee608d077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897368:0:8452:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e7aa600/0xfb36a14ee608d077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897382:0:8452:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e7aa600/0xfb36a14ee608d077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897392:0:8452:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e7aa600/0xfb36a14ee608d077 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897398:0:8452:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e7aa600/0xfb36a14ee608d077 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897403:0:8452:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e7aa600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066801.897406:0:8452:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e7aa600/0xfb36a14ee608d077 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897412:0:8452:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e7aa600/0xfb36a14ee608d077 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897420:0:8452:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e7aa600/0xfb36a14ee608d077 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897425:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e7aa600/0xfb36a14ee608d077 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066801.897455:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882977197312:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 17295us (17970us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.897462:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15204 00010000:00010000:3.0:1746066801.897479:0:8112:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d08c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897485:0:8112:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d08c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897500:0:8112:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d08c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897506:0:8112:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d08c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897512:0:8112:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d08c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897516:0:8112:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faf4600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066801.897520:0:8112:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d08c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897537:0:8112:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d08c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897546:0:8112:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d08c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.897552:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d08c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066801.897581:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977197440:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 16934us (18036us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066801.897586:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15207 00010000:00010000:1.0:1746066801.897687:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066801.897705:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882977200128:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1189us (2944us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.897711:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7835 00010000:00010000:1.0:1746066801.897730:0:10402:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136b5e000/0xfb36a14ee608d093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.897736:0:10402:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b5e000/0xfb36a14ee608d093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.897750:0:10402:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136b5e000/0xfb36a14ee608d093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.897756:0:10402:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136b5e000/0xfb36a14ee608d093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.897761:0:10402:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136b5e000/0xfb36a14ee608d093 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.897766:0:10402:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b5e000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066801.897769:0:10402:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136b5e000/0xfb36a14ee608d093 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.897774:0:10402:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136b5e000/0xfb36a14ee608d093 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.897782:0:10402:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136b5e000/0xfb36a14ee608d093 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.897788:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b5e000/0xfb36a14ee608d093 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066801.897818:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977197696:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 16993us (18250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.897823:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15208 00010000:00010000:0.0:1746066801.897959:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.897965:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:0.0:1746066801.897982:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066801.898095:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898102:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898106:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898121:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e0400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066801.898124:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898129:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898138:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066801.898140:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066801.898143:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 2/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898147:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0400/0xfb36a14ee608d0af lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898161:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0800/0xfb36a14ee608d0a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898165:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0800/0xfb36a14ee608d0a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898170:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0800/0xfb36a14ee608d0a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898174:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e0800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066801.898176:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0800/0xfb36a14ee608d0a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898183:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0800/0xfb36a14ee608d0a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898189:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066801.898190:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066801.898193:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0800/0xfb36a14ee608d0a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898197:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0800/0xfb36a14ee608d0a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898209:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0a00/0xfb36a14ee608d0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898214:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0a00/0xfb36a14ee608d0a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898219:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0a00/0xfb36a14ee608d0a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898223:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e0a00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066801.898225:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0a00/0xfb36a14ee608d0a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898230:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0a00/0xfb36a14ee608d0a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898236:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a73fa600) 00010000:00010000:0.0:1746066801.898237:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066801.898239:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0a00/0xfb36a14ee608d0a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898244:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0a00/0xfb36a14ee608d0a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066801.898289:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0e00/0xfb36a14ee608d09a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f55a expref: 262 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.898296:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e0e00/0xfb36a14ee608d09a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f55a expref: 262 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.898304:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e0e00, rc 0) 00000100:00100000:0.0:1746066801.898341:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:31911:x1830882977199104:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 8180us (8305us total) trans 8589944214 rc 301/301 00000100:00100000:0.0:1746066801.898347:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10134 00000100:00100000:0.0:1746066801.899268:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.900327:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977200256 00000100:00100000:1.0:1746066801.900336:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977200256 00010000:00010000:1.0:1746066801.900365:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eee5c00/0xfb36a14ee608d015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f51b expref: 27 pid: 8452 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066801.900399:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7836 00000100:00100000:1.0:1746066801.900406:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977200256:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066801.900417:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066801.900436:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eee5c00/0xfb36a14ee608d015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f51b expref: 27 pid: 8452 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066801.900447:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eee5c00/0xfb36a14ee608d015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f51b expref: 27 pid: 8452 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066801.900468:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eee5c00/0xfb36a14ee608d015 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f51b expref: 27 pid: 8452 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066801.900482:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066801.900483:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066801.900488:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e7aa000/0xfb36a14ee608d070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.900896:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7aa000/0xfb36a14ee608d070 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066801.901054:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066801.901102:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977200256:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 696us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066801.901108:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7836 00010000:00010000:0.0:1746066801.901639:0:21203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e7aa000/0xfb36a14ee608d070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.901648:0:21203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e7aa000/0xfb36a14ee608d070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.901672:0:21203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e7aa000/0xfb36a14ee608d070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.901693:0:21203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e7aa000/0xfb36a14ee608d070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.901701:0:21203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e7aa000/0xfb36a14ee608d070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.901708:0:21203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e7aa000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066801.901712:0:21203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e7aa000/0xfb36a14ee608d070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.901720:0:21203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e7aa000/0xfb36a14ee608d070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.901731:0:21203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e7aa000/0xfb36a14ee608d070 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.901737:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e7aa000/0xfb36a14ee608d070 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066801.901799:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1965:x1830882977197056:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 21890us (22350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.901808:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15203 00000100:00100000:2.0:1746066801.902491:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976952704:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066801.902511:0:20532:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.902519:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0200/0xfb36a14ee608d085 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066801.902567:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1965:x1830882977197184:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 22001us (23045us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.902574:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15206 00000100:00100000:0.0:1746066801.905131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.905183:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.905381:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977200512 00000100:00100000:1.0:1746066801.905391:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977200512 00000100:00100000:2.0:1746066801.905432:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977200768 00000100:00100000:2.0:1746066801.905436:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977200768 00002000:00100000:1.0:1746066801.905436:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88012c529180 x1830882977200512/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.905446:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c529180 with x1830882977200512 ext(1048576->2097151) 00002000:00010000:1.0:1746066801.905451:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c529180 00000100:00100000:1.0:1746066801.905465:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6907 00000100:00100000:1.0:1746066801.905471:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977200512:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066801.905562:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10135 00000100:00100000:2.0:1746066801.905568:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31908:x1830882977200768:12345-192.168.202.57@tcp:36:mirror_io.0 00010000:00010000:2.0:1746066801.905606:0:809:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066801.905630:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d069 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f553 expref: 9 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.905645:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066801.905649:0:809:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066801.905723:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31908:x1830882977200768:12345-192.168.202.57@tcp:36:mirror_io.0 Request processed in 155us (538us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746066801.905729:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10135 00000100:00100000:0.0:1746066801.908318:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.908814:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977201024 00000100:00100000:3.0:1746066801.908822:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977201024 00000100:00100000:3.0:1746066801.908872:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4251 00000100:00100000:3.0:1746066801.908880:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:31908:x1830882977201024:12345-192.168.202.57@tcp:35:mirror_io.0 00000100:00100000:3.0:1746066801.910629:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31908:x1830882977201024:12345-192.168.202.57@tcp:35:mirror_io.0 Request processed in 1744us (2311us total) trans 8589944215 rc 0/0 00000100:00100000:3.0:1746066801.910639:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4251 00000100:00100000:0.0:1746066801.911511:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.911542:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977201152 00000100:00100000:2.0:1746066801.911548:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977201152 00000100:00100000:2.0:1746066801.911598:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15210 00000100:00100000:2.0:1746066801.911605:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:31911:x1830882977201152:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066801.911622:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.911639:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d18f000/0xfb36a14ee608d0c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f568 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066801.911666:0:20532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 5090560, mtime: 0x6812dd71, atime: 0x6812dd70, ctime: 0x6812dd71, blocks: 0x1721 00010000:00010000:2.0:1746066801.911704:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.911706:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.911715:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18f000/0xfb36a14ee608d0c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3616768->3809279) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f568 expref: 34 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.911731:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d18f000/0xfb36a14ee608d0c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3616768->3809279) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f568 expref: 34 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.911741:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18f000, rc 0) 00000100:00100000:2.0:1746066801.911772:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:31911:x1830882977201152:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 168us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.911777:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15210 00000100:00100000:0.0:1746066801.917005:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.917187:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977201408 00000100:00100000:2.0:1746066801.917198:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977201408 00002000:00100000:2.0:1746066801.917242:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3616768->3620863) req@ffff88009412aa00 x1830882977201408/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.917251:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412aa00 with x1830882977201408 ext(3616768->3620863) 00002000:00010000:2.0:1746066801.917256:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009412aa00 00000100:00100000:2.0:1746066801.917290:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6908 00000100:00100000:2.0:1746066801.917297:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882977201408:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066801.917496:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.917662:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977200512:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12189us (12537us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066801.917670:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6907 00002000:00100000:1.0:1746066801.917707:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88012c529180 x1830882977200512/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066801.917715:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c529180 with x1830882977200512 ext(1048576->2097151) 00002000:00010000:1.0:1746066801.917718:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c529180 00000100:00100000:3.0:1746066801.917793:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977201664 00000100:00100000:3.0:1746066801.917800:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977201664 00000100:00100000:3.0:1746066801.917902:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4252 00000100:00100000:3.0:1746066801.917908:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:31908:x1830882977201664:12345-192.168.202.57@tcp:35:mirror_io.0 00000100:00100000:2.0:1746066801.918406:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882977201408:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 1050us (1354us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066801.918415:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6908 00002000:00100000:2.0:1746066801.918422:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3616768->3620863) req@ffff88009412aa00 x1830882977201408/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.918429:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412aa00 with x1830882977201408 ext(3616768->3620863) 00002000:00010000:2.0:1746066801.918431:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009412aa00 00000100:00100000:3.0:1746066801.918729:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31908:x1830882977201664:12345-192.168.202.57@tcp:35:mirror_io.0 Request processed in 820us (1233us total) trans 8589944216 rc 0/0 00000100:00100000:3.0:1746066801.918737:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4252 00000100:00100000:0.0:1746066801.923911:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.924764:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977201920 00000100:00100000:2.0:1746066801.924776:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977201920 00002000:00100000:2.0:1746066801.924827:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3805184->3809279) req@ffff88009412a680 x1830882977201920/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.924838:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412a680 with x1830882977201920 ext(3805184->3809279) 00002000:00010000:2.0:1746066801.924844:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009412a680 00000100:00100000:2.0:1746066801.924880:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6909 00000100:00100000:2.0:1746066801.924888:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882977201920:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066801.925318:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882977201920:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 429us (1416us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066801.925325:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6909 00002000:00100000:2.0:1746066801.925332:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3805184->3809279) req@ffff88009412a680 x1830882977201920/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/4536 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.925339:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412a680 with x1830882977201920 ext(3805184->3809279) 00002000:00010000:2.0:1746066801.925341:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009412a680 00000100:00100000:0.0:1746066801.927995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.928183:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977202048 00000100:00100000:2.0:1746066801.928193:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977202048 00000100:00100000:2.0:1746066801.928242:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15211 00000100:00100000:2.0:1746066801.928249:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+18:31907:x1830882977202048:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066801.928270:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066801.928295:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d18f800/0xfb36a14ee608d0cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f56f expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066801.928320:0:20532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd70, atime: 0x6812dd70, ctime: 0x6812dd70, blocks: 0x81d 00010000:00010000:2.0:1746066801.928340:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.928342:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066801.928350:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d18f800/0xfb36a14ee608d0cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f56f expref: 19 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.928365:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d18f800/0xfb36a14ee608d0cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f56f expref: 19 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066801.928375:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18f800, rc 0) 00000100:00100000:2.0:1746066801.928664:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+19:31907:x1830882977202048:12345-192.168.202.57@tcp:101:cat.0 Request processed in 414us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066801.928672:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15211 00000100:00100000:2.0:1746066801.929210:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.929301:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977202304 00000100:00100000:3.0:1746066801.929305:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977202304 00000100:00100000:3.0:1746066801.929563:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4253 00000100:00100000:3.0:1746066801.929570:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:31911:x1830882977202304:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066801.930033:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:31911:x1830882977202304:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 463us (823us total) trans 8589944217 rc 0/0 00000100:00100000:3.0:1746066801.930039:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4253 00000100:00100000:0.0:1746066801.939005:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066801.939884:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977202560 00000100:00100000:2.0:1746066801.939895:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977202560 00002000:00100000:2.0:1746066801.939946:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880094129500 x1830882977202560/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.939956:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094129500 with x1830882977202560 ext(1048576->2097151) 00002000:00010000:2.0:1746066801.939961:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094129500 00000100:00100000:2.0:1746066801.939993:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6910 00000100:00100000:2.0:1746066801.940001:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977202560:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066801.954207:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977202560:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14194us (15200us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066801.954224:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6910 00002000:00100000:2.0:1746066801.954237:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880094129500 x1830882977202560/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.954248:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094129500 with x1830882977202560 ext(1048576->2097151) 00002000:00010000:2.0:1746066801.954255:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094129500 00000100:00100000:0.0:1746066801.959434:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.959658:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977202816 00000100:00100000:3.0:1746066801.959667:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977202816 00000100:00100000:3.0:1746066801.959757:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10136 00000100:00100000:3.0:1746066801.959765:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+16:31917:x1830882977202816:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066801.959790:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.959808:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606800/0xfb36a14ee608d0d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f576 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.959933:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606a00/0xfb36a14ee608d0d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.959948:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606a00/0xfb36a14ee608d0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.959958:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606a00/0xfb36a14ee608d0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.959970:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606c00/0xfb36a14ee608d0e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.959975:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606c00/0xfb36a14ee608d0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.959980:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606c00/0xfb36a14ee608d0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960083:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d0e7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960091:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960097:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d0e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746066801.960105:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066801.960191:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606a00/0xfb36a14ee608d0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960197:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606a00/0xfb36a14ee608d0d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960204:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606a00/0xfb36a14ee608d0d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960208:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e606a00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066801.960212:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606a00/0xfb36a14ee608d0d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960219:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606a00/0xfb36a14ee608d0d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960230:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066801.960233:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066801.960237:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606a00/0xfb36a14ee608d0d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960242:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606a00/0xfb36a14ee608d0d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960273:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606c00/0xfb36a14ee608d0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960278:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606c00/0xfb36a14ee608d0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960283:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606c00/0xfb36a14ee608d0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960287:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e606c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066801.960289:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606c00/0xfb36a14ee608d0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960294:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606c00/0xfb36a14ee608d0e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960304:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d3b8200) 00010000:00010000:3.0:1746066801.960306:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066801.960308:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606c00/0xfb36a14ee608d0e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960313:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606c00/0xfb36a14ee608d0e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.960548:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606800/0xfb36a14ee608d0d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f576 expref: 19 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.960561:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d0e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f576 expref: 18 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.960567:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066801.960569:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066801.960571:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e606e00, rc 0) 00000100:00100000:3.0:1746066801.961171:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:31917:x1830882977202816:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 1405us (1747us total) trans 8589944218 rc 0/0 00000100:00100000:3.0:1746066801.961178:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10136 00000100:00100000:1.0:1746066801.966232:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066801.966271:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.966341:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977203200 00000100:00100000:0.0:1746066801.966351:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977203200 00000100:00100000:0.0:1746066801.966396:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15212 00000100:00100000:0.0:1746066801.966403:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+26:31907:x1830882977203200:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066801.966423:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066801.966442:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed93800/0xfb36a14ee608d0f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f584 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066801.966467:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 2097152, mtime: 0x6812dd70, atime: 0x6812dd70, ctime: 0x6812dd70, blocks: 0x821 00010000:00010000:0.0:1746066801.966487:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.966488:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.966496:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed93800/0xfb36a14ee608d0f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f584 expref: 27 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.966511:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed93800/0xfb36a14ee608d0f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f584 expref: 27 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.966537:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed93800, rc 0) 00000100:00100000:0.0:1746066801.966584:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+27:31907:x1830882977203200:12345-192.168.202.57@tcp:101:cat.0 Request processed in 180us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.966590:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15212 00000100:00100000:3.0:1746066801.966860:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977203072 00000100:00100000:3.0:1746066801.966864:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977203072 00000100:00100000:3.0:1746066801.966898:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10137 00000100:00100000:3.0:1746066801.966903:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:31918:x1830882977203072:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066801.966918:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.966930:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608d0fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f57d expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.967049:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607200/0xfb36a14ee608d103 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967061:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607200/0xfb36a14ee608d103 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967071:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607200/0xfb36a14ee608d103 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967082:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607400/0xfb36a14ee608d10a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967088:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607400/0xfb36a14ee608d10a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967093:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607400/0xfb36a14ee608d10a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967197:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608d111 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967205:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608d111 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967212:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608d111 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746066801.967219:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066801.967303:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607200/0xfb36a14ee608d103 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967309:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607200/0xfb36a14ee608d103 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967318:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607200/0xfb36a14ee608d103 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967324:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e607200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066801.967328:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607200/0xfb36a14ee608d103 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967334:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607200/0xfb36a14ee608d103 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967343:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066801.967346:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066801.967350:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607200/0xfb36a14ee608d103 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967355:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607200/0xfb36a14ee608d103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967365:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607400/0xfb36a14ee608d10a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967370:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607400/0xfb36a14ee608d10a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967374:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607400/0xfb36a14ee608d10a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967507:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e607400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066801.967509:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607400/0xfb36a14ee608d10a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967515:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607400/0xfb36a14ee608d10a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967533:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d3b8d00) 00010000:00010000:3.0:1746066801.967535:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066801.967537:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607400/0xfb36a14ee608d10a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967541:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607400/0xfb36a14ee608d10a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066801.967580:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608d0fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f57d expref: 265 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.967589:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608d111 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f57d expref: 264 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.967595:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066801.967597:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066801.967599:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e607600, rc 0) 00000100:00100000:3.0:1746066801.967626:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:31918:x1830882977203072:12345-192.168.202.57@tcp:101:cat.0 Request processed in 722us (1354us total) trans 8589944219 rc 0/0 00000100:00100000:3.0:1746066801.967632:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10137 00000100:00100000:0.0:1746066801.971176:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.971291:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977203456 00000100:00100000:3.0:1746066801.971301:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977203456 00000100:00100000:0.0:1746066801.972297:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4254 00000100:00100000:0.0:1746066801.972308:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:31918:x1830882977203456:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:0.0:1746066801.972549:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:31918:x1830882977203456:12345-192.168.202.57@tcp:35:cat.0 Request processed in 243us (1382us total) trans 8589944220 rc 0/0 00000100:00100000:0.0:1746066801.972556:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4254 00000100:00100000:0.0:1746066801.972909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.972963:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977203712 00000100:00100000:3.0:1746066801.972967:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977203712 00002000:00100000:3.0:1746066801.972996:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009a4ef480 x1830882977203712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066801.973005:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ef480 with x1830882977203712 ext(1048576->2097151) 00002000:00010000:3.0:1746066801.973010:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4ef480 00000100:00100000:3.0:1746066801.973602:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6911 00000100:00100000:3.0:1746066801.973609:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977203712:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066801.980859:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.981967:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.982008:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977203840 00000100:00100000:0.0:1746066801.982016:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977203840 00000100:00100000:0.0:1746066801.982061:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977203968 00000100:00100000:0.0:1746066801.982063:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977203968 00000100:00100000:0.0:1746066801.982082:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15213 00000100:00100000:0.0:1746066801.982090:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977203840:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066801.982111:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066801.982132:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0600/0xfb36a14ee608d11f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f58b expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066801.982158:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd71, atime: 0x6812dd71, ctime: 0x6812dd71, blocks: 0x7e1 00010000:00010000:0.0:1746066801.982178:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.982180:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.982189:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0600/0xfb36a14ee608d11f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f58b expref: 35 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.982204:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0600/0xfb36a14ee608d11f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f58b expref: 35 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.982216:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e0600, rc 0) 00000100:00100000:0.0:1746066801.982259:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1963:x1830882977203840:12345-192.168.202.57@tcp:101:cat.0 Request processed in 170us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.982265:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15213 00000100:00100000:0.0:1746066801.982281:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15214 00000100:00100000:0.0:1746066801.982286:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977203968:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066801.982293:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066801.982302:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0000/0xfb36a14ee608d126 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f592 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.982313:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.982314:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.982318:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0000/0xfb36a14ee608d126 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f592 expref: 26 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.982328:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0000/0xfb36a14ee608d126 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f592 expref: 26 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.982335:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e0000, rc 0) 00000100:00100000:0.0:1746066801.982348:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977203968:12345-192.168.202.57@tcp:101:cat.0 Request processed in 62us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.982353:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15214 00000100:00100000:0.0:1746066801.982380:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.982390:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977204224 00000100:00100000:0.0:1746066801.982393:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977204224 00000100:00100000:0.0:1746066801.982405:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15215 00000100:00100000:0.0:1746066801.982410:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882977204224:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066801.982415:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066801.982422:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1400/0xfb36a14ee608d12d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f5a0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.982432:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.982433:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.982437:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1400/0xfb36a14ee608d12d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a0 expref: 36 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.982450:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1400/0xfb36a14ee608d12d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a0 expref: 36 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.982457:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e1400, rc 0) 00000100:00100000:0.0:1746066801.982470:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882977204224:12345-192.168.202.57@tcp:101:cat.0 Request processed in 60us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.982475:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15215 00000100:00100000:0.0:1746066801.982508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.982517:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977204096 00000100:00100000:0.0:1746066801.982519:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977204096 00000100:00100000:0.0:1746066801.982548:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15216 00000100:00100000:0.0:1746066801.982552:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977204096:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066801.982558:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066801.982565:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1800/0xfb36a14ee608d134 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f599 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066801.982575:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.982576:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.982580:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1800/0xfb36a14ee608d134 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f599 expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.982589:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1800/0xfb36a14ee608d134 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f599 expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.982596:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e1800, rc 0) 00000100:00100000:0.0:1746066801.982608:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977204096:12345-192.168.202.57@tcp:101:cat.0 Request processed in 55us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.982614:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15216 00000100:00100000:0.0:1746066801.982669:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.982706:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977204352 00000100:00100000:0.0:1746066801.982709:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977204352 00000100:00100000:0.0:1746066801.982724:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15217 00000100:00100000:0.0:1746066801.982728:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977204352:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066801.982734:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066801.982743:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1a00/0xfb36a14ee608d13b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f5a7 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066801.982758:0:21973:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38f:0x0] initial LVB size: 4194304, mtime: 0x6812dd71, atime: 0x6812dd71, ctime: 0x6812dd71, blocks: 0x102b 00010000:00010000:0.0:1746066801.982766:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.982768:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066801.982772:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1a00/0xfb36a14ee608d13b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a7 expref: 28 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.982781:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1a00/0xfb36a14ee608d13b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a7 expref: 28 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066801.982788:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e1a00, rc 0) 00000100:00100000:0.0:1746066801.982802:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977204352:12345-192.168.202.57@tcp:101:cat.0 Request processed in 73us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066801.982807:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15217 00000100:00100000:0.0:1746066801.995399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066801.995475:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977204480 00000100:00100000:3.0:1746066801.995485:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977204480 00000100:00100000:3.0:1746066801.995551:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15218 00000100:00100000:3.0:1746066801.995563:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+29:31917:x1830882977204480:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066801.995583:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066801.995601:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f5ae expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.995631:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0600/0xfb36a14ee608d11f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f58b expref: 35 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.995639:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.995641:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066801.995644:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [331776->749567] (req 331776->749567) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 30 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066801.995704:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0600/0xfb36a14ee608d11f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f58b expref: 35 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066801.995717:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0600/0xfb36a14ee608d11f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f58b expref: 35 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746066801.995730:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976952832:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066801.996182:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066801.997425:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882977203712:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23810us (24510us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066801.997436:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6911 00002000:00100000:2.0:1746066801.997447:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009a4ef480 x1830882977203712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066801.997456:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a4ef480 with x1830882977203712 ext(1048576->2097151) 00002000:00010000:2.0:1746066801.997462:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a4ef480 00000100:00100000:0.0:1746066801.998309:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.998340:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.998362:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.998398:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066801.998418:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977204736 00000100:00100000:0.0:1746066801.998425:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977204736 00002000:00100000:0.0:1746066801.998461:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009ef5aa00 x1830882977204736/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.998468:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5aa00 with x1830882977204736 ext(0->1048575) 00010000:00010000:0.0:1746066801.998476:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0600/0xfb36a14ee608d11f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f58b expref: 36 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066801.998489:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0600/0xfb36a14ee608d11f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f58b expref: 36 pid: 21203 timeout: 863 lvb_type: 1 00002000:00010000:0.0:1746066801.998496:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef5aa00 00000100:00100000:0.0:1746066801.998508:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977204992 00000100:00100000:0.0:1746066801.998510:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977204992 00002000:00100000:0.0:1746066801.998537:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009ef59880 x1830882977204992/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.998545:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef59880 with x1830882977204992 ext(1048576->2097151) 00002000:00010000:0.0:1746066801.998548:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef59880 00000100:00100000:0.0:1746066801.998557:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977205248 00000100:00100000:0.0:1746066801.998558:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977205248 00002000:00100000:0.0:1746066801.998568:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009ef58000 x1830882977205248/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.998574:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef58000 with x1830882977205248 ext(1048576->2097151) 00002000:00010000:0.0:1746066801.998577:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef58000 00000100:00100000:0.0:1746066801.998584:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977205504 00000100:00100000:0.0:1746066801.998587:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977205504 00002000:00100000:0.0:1746066801.998595:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009ef58a80 x1830882977205504/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/0 e 0 to 0 dl 1746066812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066801.998601:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef58a80 with x1830882977205504 ext(1048576->2097151) 00002000:00010000:0.0:1746066801.998604:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef58a80 00000100:00100000:0.0:1746066801.998612:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2234 00000100:00100000:0.0:1746066801.998618:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1963:x1830882977204736:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066801.998894:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6912 00000100:00100000:1.0:1746066801.998902:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977204992:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066801.999297:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6913 00000100:00100000:3.0:1746066801.999305:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977205248:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066801.999945:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6914 00000100:00100000:2.0:1746066801.999953:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1963:x1830882977205504:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066802.005215:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976952832:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.005379:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [331776->749567] (req 331776->749567) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.005399:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e607c00, rc 0) 00000100:00100000:2.0:1746066802.005446:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+28:31917:x1830882977204480:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 9883us (10056us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.005454:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15218 00000100:00100000:0.0:1746066802.011513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.011575:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.011598:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977205888 00000100:00100000:0.0:1746066802.011598:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977205632 00000100:00100000:2.0:1746066802.011606:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977205888 00000100:00100000:0.0:1746066802.011606:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977205632 00000100:00100000:0.0:1746066802.011661:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15219 00000100:00100000:0.0:1746066802.011668:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+28:1966:x1830882977205632:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:2.0:1746066802.012190:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15220 00000100:00100000:2.0:1746066802.012196:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977205888:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066802.012219:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.012238:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d18fc00/0xfb36a14ee608d149 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f5c3 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.012263:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.012265:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.012273:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d18fc00/0xfb36a14ee608d149 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5c3 expref: 20 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.012288:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d18fc00/0xfb36a14ee608d149 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5c3 expref: 20 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.012300:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18fc00, rc 0) 00000100:00100000:2.0:1746066802.012347:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977205888:12345-192.168.202.57@tcp:101:cat.0 Request processed in 151us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.012353:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15220 00000100:00100000:2.0:1746066802.012448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.012462:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977205760 00000100:00100000:2.0:1746066802.012466:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977205760 00000100:00100000:2.0:1746066802.012487:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15221 00000100:00100000:2.0:1746066802.012492:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882977205760:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066802.012499:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.012509:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d18fe00/0xfb36a14ee608d150 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f5bc expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066802.012563:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976952960:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066802.012615:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746066802.012774:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.012783:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0800/0xfb36a14ee608d157 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f5b5 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.012795:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.012803:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0800/0xfb36a14ee608d157 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5b5 expref: 31 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.012811:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0800/0xfb36a14ee608d157 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5b5 expref: 31 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.012829:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e0800, rc 0) 00000100:00100000:0.0:1746066802.012970:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+30:1966:x1830882977205632:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1302us (1467us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066802.012980:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15219 00000100:00100000:2.0:1746066802.018463:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1963:x1830882977205504:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18499us (20052us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066802.018475:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6914 00002000:00100000:2.0:1746066802.018487:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009ef58a80 x1830882977205504/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.018496:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef58a80 with x1830882977205504 ext(1048576->2097151) 00002000:00010000:2.0:1746066802.018501:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef58a80 00002000:00010000:3.0:1746066802.018772:0:20532:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime: 1746066800 -> 1746066801 00000100:00100000:3.0:1746066802.018793:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976952960:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066802.018830:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d18fe00/0xfb36a14ee608d150 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5bc expref: 29 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.018844:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d18fe00/0xfb36a14ee608d150 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5bc expref: 29 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.018859:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18fe00, rc 0) 00000100:00100000:3.0:1746066802.018887:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882977205760:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6394us (6438us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066802.018893:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15221 00000100:00100000:1.0:1746066802.025347:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977204992:12345-192.168.202.57@tcp:3:cat.0 Request processed in 26139us (26698us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066802.025363:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6912 00002000:00100000:1.0:1746066802.025377:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009ef59880 x1830882977204992/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.025387:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef59880 with x1830882977204992 ext(1048576->2097151) 00002000:00010000:1.0:1746066802.025393:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef59880 00000100:00100000:0.0:1746066802.028382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.029108:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977205248:12345-192.168.202.57@tcp:3:cat.0 Request processed in 29801us (30741us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066802.029121:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6913 00002000:00100000:3.0:1746066802.029134:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009ef58000 x1830882977205248/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.029144:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef58000 with x1830882977205248 ext(1048576->2097151) 00002000:00010000:3.0:1746066802.029151:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef58000 00000100:00100000:2.0:1746066802.029263:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977206016 00000100:00100000:2.0:1746066802.029273:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977206016 00000100:00100000:2.0:1746066802.029331:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15222 00000100:00100000:2.0:1746066802.029338:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+28:31907:x1830882977206016:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066802.029354:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.029374:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d18e800/0xfb36a14ee608d15e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f5ca expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.029404:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d18f000/0xfb36a14ee608d0c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3616768->3809279) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f568 expref: 37 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.029411:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066802.029413:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066802.029416:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18e800/0xfb36a14ee608d15e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ca expref: 29 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.029453:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d18f000/0xfb36a14ee608d0c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3616768->3809279) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f568 expref: 37 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.029463:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d18f000/0xfb36a14ee608d0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3616768->3809279) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f568 expref: 37 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066802.029475:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976953088:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066802.029535:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066802.032168:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882977204736:12345-192.168.202.57@tcp:3:cat.0 Request processed in 33540us (33852us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066802.032180:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2234 00002000:00100000:3.0:1746066802.032192:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009ef5aa00 x1830882977204736/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:207/0 lens 488/440 e 0 to 0 dl 1746066812 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.032202:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5aa00 with x1830882977204736 ext(0->1048575) 00010000:00010000:3.0:1746066802.032213:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0600/0xfb36a14ee608d11f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f58b expref: 36 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746066802.032227:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0600/0xfb36a14ee608d11f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f58b expref: 36 pid: 21203 timeout: 863 lvb_type: 1 00002000:00010000:3.0:1746066802.032233:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef5aa00 00000100:00100000:2.0:1746066802.032823:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976953088:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.032852:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d18e800/0xfb36a14ee608d15e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ca expref: 29 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.032868:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18e800, rc 0) 00000100:00100000:2.0:1746066802.033657:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+29:31907:x1830882977206016:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4317us (5281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.033665:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15222 00000100:00100000:0.0:1746066802.034774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.035468:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977206144 00000100:00100000:3.0:1746066802.035479:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977206144 00002000:00100000:3.0:1746066802.035536:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3616768->3809279) req@ffff88009ef59500 x1830882977206144/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.035547:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef59500 with x1830882977206144 ext(3616768->3809279) 00010000:00010000:3.0:1746066802.035556:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d18f000/0xfb36a14ee608d0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3616768->3809279) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f568 expref: 36 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.035568:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d18f000/0xfb36a14ee608d0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3616768->3809279) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f568 expref: 36 pid: 20532 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746066802.035575:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef59500 00000100:00100000:3.0:1746066802.035607:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2235 00000100:00100000:3.0:1746066802.035614:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1965:x1830882977206144:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066802.046497:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.046808:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977206272 00000100:00100000:1.0:1746066802.046819:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977206272 00010000:00010000:1.0:1746066802.046865:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0600/0xfb36a14ee608d11f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f58b expref: 38 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066802.046909:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7837 00000100:00100000:1.0:1746066802.046917:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5409050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882977206272:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066802.046932:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066802.046956:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0600/0xfb36a14ee608d11f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f58b expref: 38 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066802.046967:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0600/0xfb36a14ee608d11f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f58b expref: 38 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066802.046992:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6e0600/0xfb36a14ee608d11f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f58b expref: 38 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066802.047023:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.047025:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.047033:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->749567) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.047041:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->749567) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.047077:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->749567) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066802.047089:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976953216:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066802.047160:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dc780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066802.048192:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1965:x1830882977206144:12345-192.168.202.57@tcp:4:cat.0 Request processed in 12573us (13418us total) trans 17179873739 rc 0/0 00000100:00100000:3.0:1746066802.048204:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2235 00002000:00100000:3.0:1746066802.048216:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3616768->3809279) req@ffff88009ef59500 x1830882977206144/t17179873739(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/448 e 0 to 0 dl 1746066813 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.048225:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef59500 with x1830882977206144 ext(3616768->3809279) 00010000:00010000:3.0:1746066802.048234:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d18f000/0xfb36a14ee608d0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3616768->3809279) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f568 expref: 38 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.048246:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d18f000/0xfb36a14ee608d0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3616768->3809279) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f568 expref: 38 pid: 20532 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746066802.048252:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef59500 00000100:00100000:1.0:1746066802.049611:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.050400:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977206400 00000100:00100000:3.0:1746066802.050410:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977206400 00000100:00100000:3.0:1746066802.050452:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15223 00000100:00100000:3.0:1746066802.050458:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:31918:x1830882977206400:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066802.050478:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.050495:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d165 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f5d1 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.050518:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066802.050533:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d165 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d1 expref: 39 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.050544:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d165 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d1 expref: 39 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.050554:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf5e00, rc 0) 00000100:00100000:3.0:1746066802.050587:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:31918:x1830882977206400:12345-192.168.202.57@tcp:101:cat.0 Request processed in 129us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.050593:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15223 00000100:00100000:0.0:1746066802.053805:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.054097:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977206528 00000100:00100000:2.0:1746066802.054107:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977206528 00010000:00010000:2.0:1746066802.054144:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18f000/0xfb36a14ee608d0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3616768->3809279) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f568 expref: 39 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066802.054191:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7838 00000100:00100000:2.0:1746066802.054199:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1965:x1830882977206528:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066802.054212:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066802.054227:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976953216:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066802.054236:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d18f000/0xfb36a14ee608d0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3616768->3809279) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f568 expref: 39 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.054248:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d18f000/0xfb36a14ee608d0c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3616768->3809279) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f568 expref: 39 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.054250:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066802.054272:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d18f000/0xfb36a14ee608d0c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3616768->3809279) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f568 expref: 39 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066802.054293:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5409050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882977206272:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7377us (7807us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066802.054294:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.054297:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066802.054301:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7837 00010000:00010000:2.0:1746066802.054304:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d18e800/0xfb36a14ee608d15e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ca expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.054314:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18e800/0xfb36a14ee608d15e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ca expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.054322:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.054324:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.054327:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d165 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d1 expref: 37 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.054334:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d165 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d1 expref: 37 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.054361:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d165 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d1 expref: 37 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066802.054374:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976953344:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066802.054424:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066802.054442:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d18e800/0xfb36a14ee608d15e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ca expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066802.054450:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093212a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976953472:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066802.054453:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977206784 00000100:00100000:3.0:1746066802.054457:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977206784 00002000:00100000:3.0:1746066802.054489:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (331776->335871) req@ffff88009ef58700 x1830882977206784/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.054498:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef58700 with x1830882977206784 ext(331776->335871) 00002000:00010000:3.0:1746066802.054502:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef58700 00000100:00100000:3.0:1746066802.054514:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6915 00000100:00100000:3.0:1746066802.054518:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882977206784:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066802.054588:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066802.055065:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882977206784:12345-192.168.202.57@tcp:3:cat.0 Request processed in 545us (640us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066802.055071:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6915 00002000:00100000:3.0:1746066802.056713:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (331776->335871) req@ffff88009ef58700 x1830882977206784/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/4536 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.056724:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef58700 with x1830882977206784 ext(331776->335871) 00002000:00010000:3.0:1746066802.056730:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef58700 00000100:00100000:2.0:1746066802.057376:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093212a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976953472:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066802.057389:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976953344:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066802.057408:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066802.057440:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1965:x1830882977206528:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3242us (3643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.057450:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7838 00000100:00100000:0.0:1746066802.069281:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.069322:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.069353:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.069370:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.069406:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.069719:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.069802:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977207040 00000100:00100000:2.0:1746066802.069813:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977207040 00002000:00100000:2.0:1746066802.069863:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009ef59c00 x1830882977207040/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.069873:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef59c00 with x1830882977207040 ext(2097152->3145727) 00002000:00010000:2.0:1746066802.069879:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef59c00 00000100:00100000:2.0:1746066802.069902:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977207296 00000100:00100000:2.0:1746066802.069905:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977207296 00002000:00100000:2.0:1746066802.069916:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009ef5ad80 x1830882977207296/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.069923:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5ad80 with x1830882977207296 ext(3145728->4194303) 00002000:00010000:2.0:1746066802.069925:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef5ad80 00000100:00100000:2.0:1746066802.069933:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977207552 00000100:00100000:2.0:1746066802.069935:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977207552 00002000:00100000:2.0:1746066802.069945:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ef5bb80 x1830882977207552/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.069950:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5bb80 with x1830882977207552 ext(2097152->3145727) 00002000:00010000:2.0:1746066802.069953:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef5bb80 00000100:00100000:2.0:1746066802.069960:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977208064 00000100:00100000:2.0:1746066802.069961:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977208064 00002000:00100000:2.0:1746066802.069969:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x38e:0x0] (745472->749567) req@ffff88009244ce00 x1830882977208064/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.069974:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244ce00 with x1830882977208064 ext(745472->749567) 00002000:00010000:2.0:1746066802.069977:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244ce00 00000100:00100000:2.0:1746066802.069983:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977207936 00000100:00100000:2.0:1746066802.069985:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977207936 00002000:00100000:2.0:1746066802.069991:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009244fb80 x1830882977207936/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.069996:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244fb80 with x1830882977207936 ext(3145728->4194303) 00002000:00010000:2.0:1746066802.069998:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009244fb80 00000100:00100000:2.0:1746066802.070005:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977208448 00000100:00100000:2.0:1746066802.070006:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977208448 00002000:00100000:2.0:1746066802.070013:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009244c000 x1830882977208448/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.070019:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244c000 with x1830882977208448 ext(3145728->4194303) 00002000:00010000:2.0:1746066802.070021:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244c000 00000100:00100000:2.0:1746066802.070033:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6916 00000100:00100000:2.0:1746066802.070040:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1965:x1830882977207040:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066802.070119:0:1992:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6917 00000100:00100000:3.0:1746066802.070127:0:1992:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1965:x1830882977207296:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066802.070909:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6918 00000100:00100000:1.0:1746066802.070919:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1965:x1830882977207552:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066802.072710:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6919 00000100:00100000:3.0:1746066802.072722:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+30:1964:x1830882977208064:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066802.072846:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+30:1964:x1830882977208064:12345-192.168.202.57@tcp:3:cat.0 Request processed in 127us (3474us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066802.072857:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6919 00002000:00100000:3.0:1746066802.072867:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (745472->749567) req@ffff88009244ce00 x1830882977208064/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/4536 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.072878:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244ce00 with x1830882977208064 ext(745472->749567) 00002000:00010000:3.0:1746066802.072883:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244ce00 00000100:00100000:3.0:1746066802.072903:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6920 00000100:00100000:3.0:1746066802.072909:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1966:x1830882977207936:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066802.075641:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6921 00000100:00100000:2.0:1746066802.075659:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882977208448:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066802.080227:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.080252:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977208320 00000100:00100000:3.0:1746066802.080261:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977208320 00000100:00100000:0.0:1746066802.080276:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.080299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:3.0:1746066802.080303:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009244d880 x1830882977208320/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.080316:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244d880 with x1830882977208320 ext(2097152->3145727) 00002000:00010000:3.0:1746066802.080322:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244d880 00000100:00100000:0.0:1746066802.080332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.080346:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977208832 00000100:00100000:3.0:1746066802.080348:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977208832 00000100:00100000:0.0:1746066802.080350:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977209088 00000100:00100000:0.0:1746066802.080354:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977209088 00002000:00100000:3.0:1746066802.080361:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009244d500 x1830882977208832/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.080367:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244d500 with x1830882977208832 ext(2097152->3145727) 00002000:00010000:3.0:1746066802.080370:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009244d500 00002000:00100000:0.0:1746066802.080370:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009244dc00 x1830882977209088/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.080377:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244dc00 with x1830882977209088 ext(3145728->4194303) 00002000:00010000:0.0:1746066802.080380:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009244dc00 00000100:00100000:3.0:1746066802.080384:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6922 00000100:00100000:0.0:1746066802.080400:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6923 00000100:00100000:0.0:1746066802.080405:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977208832:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066802.080427:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977209344 00000100:00100000:2.0:1746066802.080430:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977209344 00000100:00100000:2.0:1746066802.080453:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10138 00000100:00100000:2.0:1746066802.080458:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:31920:x1830882977209344:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066802.080471:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.080487:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d16c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f5d8 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.080581:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.080596:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d0e7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f576 expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.080602:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608d111 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f57d expref: 266 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.080607:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.080636:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608d111 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f57d expref: 266 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.080647:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608d111 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f57d expref: 266 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066802.080657:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976953600:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.080727:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d0e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f576 expref: 17 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.080735:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d0e7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f576 expref: 17 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066802.080741:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093212a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976953728:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066802.080754:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066802.080774:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6924 00000100:00100000:2.0:1746066802.080778:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977209088:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066802.082169:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+31:1963:x1830882977208320:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066802.086562:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976953600:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066802.086578:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093212a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976953728:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066802.086619:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:0.0:1746066802.096999:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.097114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.098019:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977209472 00000100:00100000:3.0:1746066802.098030:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977209472 00010000:00010000:3.0:1746066802.098073:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608d111 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f57d expref: 267 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.098106:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977209600 00000100:00100000:3.0:1746066802.098109:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977209600 00010000:00010000:3.0:1746066802.098121:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d0e7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f576 expref: 18 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.098139:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7839 00000100:00100000:3.0:1746066802.098147:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:1963:x1830882977209472:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066802.098162:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066802.098168:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608d111 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f57d expref: 267 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.098178:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608d111 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f57d expref: 267 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.098201:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608d111 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f57d expref: 267 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.098228:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066802.098233:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.098242:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.098248:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.098295:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:1963:x1830882977209472:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 148us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.098301:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7839 00000100:00100000:3.0:1746066802.098315:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7840 00000100:00100000:3.0:1746066802.098320:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977209600:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066802.098327:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066802.098331:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d0e7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f576 expref: 18 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.098338:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d0e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f576 expref: 18 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.098349:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d0e7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f576 expref: 18 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.098356:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066802.098359:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.098366:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.098373:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.098392:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.098407:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977209600:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 88us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.098414:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7840 00000100:00100000:0.0:1746066802.098561:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.098739:0:1992:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1965:x1830882977207296:12345-192.168.202.57@tcp:3:cat.0 Request processed in 28613us (29415us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066802.098748:0:1992:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6917 00002000:00100000:3.0:1746066802.098756:0:1992:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009ef5ad80 x1830882977207296/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.098765:0:1992:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5ad80 with x1830882977207296 ext(3145728->4194303) 00002000:00010000:3.0:1746066802.098769:0:1992:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef5ad80 00000100:00100000:3.0:1746066802.098790:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977209856 00000100:00100000:3.0:1746066802.098793:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977209856 00000100:00100000:3.0:1746066802.098812:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4255 00000100:00100000:3.0:1746066802.098817:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:31917:x1830882977209856:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066802.098990:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:31917:x1830882977209856:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 171us (429us total) trans 8589944221 rc 0/0 00000100:00100000:3.0:1746066802.098996:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4255 00010000:00010000:3.0:1746066802.099015:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.099022:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746066802.099038:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066802.099110:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d16c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d8 expref: 267 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.099126:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d8 expref: 266 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.099133:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066802.099135:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066802.099137:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18f200, rc 0) 00000100:00100000:3.0:1746066802.099156:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:31920:x1830882977209344:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 18697us (18880us total) trans 8589944222 rc 0/0 00000100:00100000:3.0:1746066802.099162:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10138 00000100:00100000:0.0:1746066802.111415:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1965:x1830882977207040:12345-192.168.202.57@tcp:3:cat.0 Request processed in 41357us (42129us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066802.111432:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6916 00002000:00100000:0.0:1746066802.111450:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009ef59c00 x1830882977207040/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.111461:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef59c00 with x1830882977207040 ext(2097152->3145727) 00002000:00010000:0.0:1746066802.111469:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef59c00 00000100:00100000:3.0:1746066802.114654:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+31:1963:x1830882977208448:12345-192.168.202.57@tcp:3:cat.0 Request processed in 38990us (44923us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066802.114667:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6921 00002000:00100000:3.0:1746066802.114698:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009244c000 x1830882977208448/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.114708:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244c000 with x1830882977208448 ext(3145728->4194303) 00002000:00010000:3.0:1746066802.114715:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244c000 00000100:00100000:1.0:1746066802.119925:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1965:x1830882977207552:12345-192.168.202.57@tcp:3:cat.0 Request processed in 48998us (50560us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066802.119938:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6918 00002000:00100000:1.0:1746066802.119951:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ef5bb80 x1830882977207552/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.119960:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5bb80 with x1830882977207552 ext(2097152->3145727) 00002000:00010000:1.0:1746066802.119966:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef5bb80 00000100:00100000:3.0:1746066802.125489:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882977207936:12345-192.168.202.57@tcp:3:cat.0 Request processed in 52566us (56072us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066802.125502:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6920 00002000:00100000:3.0:1746066802.125514:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009244fb80 x1830882977207936/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.125536:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244fb80 with x1830882977207936 ext(3145728->4194303) 00002000:00010000:3.0:1746066802.125542:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009244fb80 00000100:00100000:3.0:1746066802.142266:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977209088:12345-192.168.202.57@tcp:3:cat.0 Request processed in 61474us (61921us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066802.142280:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6924 00002000:00100000:3.0:1746066802.142295:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009244dc00 x1830882977209088/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.142304:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244dc00 with x1830882977209088 ext(3145728->4194303) 00002000:00010000:3.0:1746066802.142311:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009244dc00 00000100:00100000:2.0:1746066802.147513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.147860:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977208832:12345-192.168.202.57@tcp:3:cat.0 Request processed in 67452us (67557us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066802.147874:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6923 00002000:00100000:1.0:1746066802.147887:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009244d500 x1830882977208832/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.147897:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244d500 with x1830882977208832 ext(2097152->3145727) 00002000:00010000:1.0:1746066802.147904:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009244d500 00000100:00100000:0.0:1746066802.148150:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977209984 00000100:00100000:0.0:1746066802.148159:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977209984 00000100:00100000:0.0:1746066802.148358:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15224 00000100:00100000:0.0:1746066802.148365:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1963:x1830882977209984:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066802.148379:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.148396:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a53f7600/0xfb36a14ee608d181 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f5df expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.148445:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976953856:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066802.149357:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.149728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.150257:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977210112 00000100:00100000:2.0:1746066802.150263:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977210112 00000100:00100000:2.0:1746066802.150296:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10139 00000100:00100000:2.0:1746066802.150302:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:31922:x1830882977210112:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066802.150319:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.150333:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d188 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f5e6 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.150387:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fe00/0xfb36a14ee608d18f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.150400:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fe00/0xfb36a14ee608d18f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.150410:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fe00/0xfb36a14ee608d18f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.150422:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d196 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.150432:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.150437:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.150548:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.150557:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d8 expref: 265 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.150564:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.150587:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d8 expref: 265 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.150598:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d8 expref: 265 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066802.150607:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093213800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976953984:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066802.151249:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882977208320:12345-192.168.202.57@tcp:3:cat.0 Request processed in 70856us (71032us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066802.151258:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6922 00002000:00100000:3.0:1746066802.151266:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009244d880 x1830882977208320/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.151275:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009244d880 with x1830882977208320 ext(2097152->3145727) 00002000:00010000:3.0:1746066802.151279:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009244d880 00000100:00100000:2.0:1746066802.151565:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.157786:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.157884:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.157978:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977210368 00000100:00100000:1.0:1746066802.157987:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977210368 00010000:00010000:1.0:1746066802.158024:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d8 expref: 266 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066802.158051:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7841 00000100:00100000:1.0:1746066802.158057:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:1966:x1830882977210368:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066802.158070:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066802.158078:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d8 expref: 266 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.158089:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d8 expref: 266 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.158111:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066802.158117:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066802.158126:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066802.158132:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066802.158154:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066802.158212:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:1966:x1830882977210368:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 154us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.158219:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7841 00000100:00100000:3.0:1746066802.158296:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977210240 00000100:00100000:3.0:1746066802.158301:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977210240 00000100:00100000:3.0:1746066802.158330:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15225 00000100:00100000:3.0:1746066802.158336:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:31920:x1830882977210240:12345-192.168.202.57@tcp:101:multiop.0 00000100:00100000:2.0:1746066802.158348:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976953856:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066802.158352:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.158368:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f5ed expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.158376:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a53f7600/0xfb36a14ee608d181 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5df expref: 40 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.158386:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a53f7600/0xfb36a14ee608d181 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5df expref: 40 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.158389:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d18e800/0xfb36a14ee608d15e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ca expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.158397:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d165 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d1 expref: 39 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.158404:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a53f7600, rc 0) 00010000:00010000:3.0:1746066802.158409:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.158411:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.158415:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 39 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066802.158424:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1963:x1830882977209984:12345-192.168.202.57@tcp:101:cat.0 Request processed in 10060us (10922us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066802.158430:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15224 00010000:00010000:3.0:1746066802.158441:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d165 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d1 expref: 38 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.158453:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d165 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d1 expref: 38 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.158463:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f200/0xfb36a14ee608d173 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d8 expref: 265 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.158466:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976954112:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066802.158474:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093213800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976953984:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.158489:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.158496:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.158500:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.158541:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d18e800/0xfb36a14ee608d15e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ca expref: 28 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.158550:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d18e800/0xfb36a14ee608d15e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ca expref: 28 pid: 20532 timeout: 863 lvb_type: 0 00000004:00200000:2.0:1746066802.158553:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:2.0:1746066802.158558:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:3.0:1746066802.158559:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976954240:192.168.202.57@tcp:104: 00000004:00010000:2.0:1746066802.158574:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746066802.158580:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961ba80 going to sleep for 11 seconds 00010000:00010000:2.0:1746066802.158588:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.158598:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fe00/0xfb36a14ee608d18f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.158604:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fe00/0xfb36a14ee608d18f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.158612:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fe00/0xfb36a14ee608d18f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.158955:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d18fe00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066802.158959:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fe00/0xfb36a14ee608d18f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.158965:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fe00/0xfb36a14ee608d18f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.158975:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066802.158977:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066802.158980:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fe00/0xfb36a14ee608d18f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.158984:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fe00/0xfb36a14ee608d18f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.158993:0:14548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.158997:0:14548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d196 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.159001:0:14548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d196 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.159005:0:14548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d18ea00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066802.159007:0:14548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d196 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.159010:0:14548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d196 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.159018:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009d6bd100) 00010000:00010000:2.0:1746066802.159020:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066802.159022:0:14548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d196 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.159026:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d196 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.159058:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d188 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5e6 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.159066:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5e6 expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.159071:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066802.159072:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066802.159074:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18f000, rc 0) 00000100:00100000:2.0:1746066802.159098:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:31922:x1830882977210112:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 8797us (9373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.159104:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10139 00000100:00100000:0.0:1746066802.165963:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.166037:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977210496 00000100:00100000:1.0:1746066802.166048:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977210496 00000100:00100000:0.0:1746066802.166097:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.166105:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977210624 00000100:00100000:1.0:1746066802.166108:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977210624 00000100:00100000:0.0:1746066802.166119:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.167382:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977210752 00000100:00100000:1.0:1746066802.167387:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977210752 00000100:00100000:0.0:1746066802.167393:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15226 00000100:00100000:0.0:1746066802.167403:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+29:31907:x1830882977210496:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:1.0:1746066802.167415:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15227 00000100:00100000:1.0:1746066802.167421:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977210624:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066802.167432:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066802.167449:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e96f800/0xfb36a14ee608d1ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f5fb expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.167489:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.167498:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f5f4 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066802.167499:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976954368:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066802.167513:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.167519:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 38 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.167535:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066802.167538:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5f4 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.167565:0:21203:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 38 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066802.167572:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dce40 going to sleep for 11 seconds 00010000:00010000:0.0:1746066802.167577:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5f4 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.167588:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a53f6e00, rc 0) 00000100:00100000:1.0:1746066802.167596:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15228 00000100:00100000:1.0:1746066802.167601:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977210752:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066802.167610:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066802.167611:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+30:31907:x1830882977210496:12345-192.168.202.57@tcp:101:cat.0 Request processed in 211us (4563us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.167617:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15226 00010000:00010000:1.0:1746066802.167619:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e96f200/0xfb36a14ee608d1b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f602 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.167629:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.167630:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.167638:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e96f200/0xfb36a14ee608d1b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f602 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066802.167649:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e96f200/0xfb36a14ee608d1b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f602 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066802.167655:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e96f200, rc 0) 00000100:00100000:1.0:1746066802.167668:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977210752:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 67us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.167673:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15228 00000100:00100000:3.0:1746066802.167694:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976954112:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066802.167703:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976954240:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066802.167717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066802.167718:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 38 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066802.167728:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977210880 00010000:00010000:3.0:1746066802.167730:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed92a00, rc 0) 00000100:00100000:1.0:1746066802.167730:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977210880 00000100:00100000:1.0:1746066802.167741:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15229 00000100:00100000:1.0:1746066802.167745:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977210880:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:3.0:1746066802.167746:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:31920:x1830882977210240:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 9411us (9973us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066802.167750:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066802.167751:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15225 00010000:00010000:1.0:1746066802.167756:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e96f000/0xfb36a14ee608d1c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f609 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.167764:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.167765:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.167769:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e96f000/0xfb36a14ee608d1c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f609 expref: 13 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066802.167778:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e96f000/0xfb36a14ee608d1c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f609 expref: 13 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066802.167786:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e96f000, rc 0) 00000100:00100000:1.0:1746066802.167800:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977210880:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 54us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.167805:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15229 00000100:00100000:0.0:1746066802.168165:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.168191:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.168202:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.168207:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977211008 00000100:00100000:0.0:1746066802.168210:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977211136 00000100:00100000:2.0:1746066802.168211:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977211008 00000100:00100000:0.0:1746066802.168213:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977211136 00000100:00100000:2.0:1746066802.168234:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977211264 00000100:00100000:2.0:1746066802.168237:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977211264 00000100:00100000:0.0:1746066802.168501:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15230 00000100:00100000:0.0:1746066802.168509:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882977211008:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066802.168517:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.168532:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a53f7600/0xfb36a14ee608d1c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f610 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.168543:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.168545:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.168549:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a53f7600/0xfb36a14ee608d1c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f610 expref: 15 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.168559:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a53f7600/0xfb36a14ee608d1c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f610 expref: 15 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.168566:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a53f7600, rc 0) 00000100:00100000:0.0:1746066802.168895:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1964:x1830882977211008:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 387us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.168901:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15230 00000100:00100000:2.0:1746066802.168908:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15231 00000100:00100000:0.0:1746066802.168914:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15232 00000100:00100000:2.0:1746066802.168915:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882977211136:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:0.0:1746066802.168919:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977211264:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066802.168922:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.168924:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.168928:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d18e400/0xfb36a14ee608d1ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f617 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.168931:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a53f6c00/0xfb36a14ee608d1d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f61e expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.168939:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.168940:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.168941:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.168944:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a53f6c00/0xfb36a14ee608d1d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f61e expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.168947:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d18e400/0xfb36a14ee608d1ce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f617 expref: 15 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.168954:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d18e400/0xfb36a14ee608d1ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f617 expref: 15 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.168957:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a53f6c00/0xfb36a14ee608d1d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f61e expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.168964:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a53f6c00, rc 0) 00010000:00010000:2.0:1746066802.168965:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18e400, rc 0) 00000100:00100000:0.0:1746066802.168974:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882977211264:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 55us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.168977:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15232 00000100:00100000:2.0:1746066802.168982:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882977211136:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 68us (790us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066802.168987:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15231 00000100:00100000:0.0:1746066802.169592:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.170270:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.170395:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977211392 00000100:00100000:3.0:1746066802.170402:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977211392 00010000:00010000:3.0:1746066802.170428:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d165 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d1 expref: 38 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066802.170545:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977211648 00000100:00100000:1.0:1746066802.170550:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977211648 00000100:00100000:1.0:1746066802.170573:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15233 00000100:00100000:0.0:1746066802.170574:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.170579:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:31918:x1830882977211648:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066802.170591:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066802.170601:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e96ec00/0xfb36a14ee608d1dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f625 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.170620:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.170623:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.170628:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e96ec00/0xfb36a14ee608d1dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3579904->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f625 expref: 40 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.170638:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e96ec00/0xfb36a14ee608d1dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3579904->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f625 expref: 40 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.170647:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e96ec00, rc 0) 00000100:00100000:1.0:1746066802.170671:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:31918:x1830882977211648:12345-192.168.202.57@tcp:101:cat.0 Request processed in 92us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.170694:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15233 00000100:00100000:3.0:1746066802.171151:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977211520 00000100:00100000:3.0:1746066802.171155:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977211520 00000100:00100000:1.0:1746066802.171159:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7842 00000100:00100000:1.0:1746066802.171165:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1965:x1830882977211392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066802.171169:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18e800/0xfb36a14ee608d15e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ca expref: 30 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.171174:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066802.171186:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7843 00000100:00100000:3.0:1746066802.171192:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+30:1964:x1830882977211520:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066802.171196:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d165 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d1 expref: 39 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.171199:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066802.171205:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d165 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d1 expref: 39 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.171259:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d18e800/0xfb36a14ee608d15e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ca expref: 30 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.171264:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d165 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5d1 expref: 39 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.171269:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d18e800/0xfb36a14ee608d15e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ca expref: 30 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.171282:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d18e800/0xfb36a14ee608d15e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ca expref: 30 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.171288:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.171290:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.171295:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 38 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.171302:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 38 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.171339:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.171362:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977211520:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 170us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.171367:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7843 00010000:00010000:1.0:1746066802.172153:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 38 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.172164:0:7108:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x70000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 38 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066802.172180:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976954624:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066802.172252:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066802.173432:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976954368:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066802.173464:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e96f800/0xfb36a14ee608d1ab lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5fb expref: 13 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.173474:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e96f800/0xfb36a14ee608d1ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5fb expref: 13 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.173483:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e96f800, rc 0) 00000100:00100000:2.0:1746066802.173514:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977210624:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 6093us (7422us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066802.173531:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15227 00000100:00100000:0.0:1746066802.176226:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.176274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.176400:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976954624:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066802.176426:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.176475:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977211904 00000100:00100000:3.0:1746066802.176483:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977211904 00000100:00100000:1.0:1746066802.176536:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1965:x1830882977211392:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5369us (6945us total) trans 0 rc 0/0 00002000:00100000:3.0:1746066802.176543:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8801361fbb80 x1830882977211904/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066802.176547:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7842 00002000:00100000:3.0:1746066802.176552:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fbb80 with x1830882977211904 ext(4194304->5091327) 00002000:00010000:3.0:1746066802.176557:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361fbb80 00000100:00100000:3.0:1746066802.176582:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977212160 00000100:00100000:3.0:1746066802.176584:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977212160 00002000:00100000:3.0:1746066802.176596:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (3321856->3325951) req@ffff8801361fb100 x1830882977212160/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.176603:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fb100 with x1830882977212160 ext(3321856->3325951) 00010000:00010000:3.0:1746066802.176609:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 39 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.176622:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 39 pid: 20532 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746066802.176628:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801361fb100 00000100:00100000:1.0:1746066802.177010:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2236 00000100:00100000:1.0:1746066802.177019:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1963:x1830882977212160:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066802.177186:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1963:x1830882977212160:12345-192.168.202.57@tcp:3:cat.0 Request processed in 167us (910us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066802.177192:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2236 00002000:00100000:1.0:1746066802.177197:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3321856->3325951) req@ffff8801361fb100 x1830882977212160/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/4536 e 0 to 0 dl 1746066813 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.177205:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fb100 with x1830882977212160 ext(3321856->3325951) 00010000:00010000:1.0:1746066802.177210:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 39 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.177220:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 39 pid: 20532 timeout: 863 lvb_type: 0 00002000:00010000:1.0:1746066802.177226:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801361fb100 00000100:00100000:1.0:1746066802.177236:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6925 00000100:00100000:1.0:1746066802.177241:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882977211904:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066802.177474:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.177731:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977212416 00000100:00100000:2.0:1746066802.177736:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977212416 00000100:00100000:2.0:1746066802.177767:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10140 00000100:00100000:2.0:1746066802.177773:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:31922:x1830882977212416:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066802.177784:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.177801:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d1e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f62c expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.177898:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.177912:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5e6 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.177919:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.177948:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5e6 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.177958:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5e6 expref: 12 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066802.177967:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093213800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976954752:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066802.178032:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.185214:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.186695:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093213800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976954752:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.186733:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:3.0:1746066802.186797:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977212672 00000100:00100000:3.0:1746066802.186804:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977212672 00002000:00100000:3.0:1746066802.186853:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3575808->3579903) req@ffff8801361fa300 x1830882977212672/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.186864:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fa300 with x1830882977212672 ext(3575808->3579903) 00010000:00010000:3.0:1746066802.186872:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 40 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.186884:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 40 pid: 20532 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746066802.186889:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801361fa300 00000100:00100000:3.0:1746066802.186922:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2237 00000100:00100000:3.0:1746066802.186929:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1965:x1830882977212672:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066802.187120:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1965:x1830882977212672:12345-192.168.202.57@tcp:3:cat.0 Request processed in 190us (1917us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066802.187126:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2237 00002000:00100000:3.0:1746066802.187131:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3575808->3579903) req@ffff8801361fa300 x1830882977212672/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/4536 e 0 to 0 dl 1746066813 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.187138:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fa300 with x1830882977212672 ext(3575808->3579903) 00010000:00010000:3.0:1746066802.187143:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 40 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.187151:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 40 pid: 20532 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746066802.187156:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801361fa300 00000100:00100000:0.0:1746066802.187355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.187406:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977212800 00000100:00100000:1.0:1746066802.187411:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977212800 00010000:00010000:1.0:1746066802.187429:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5e6 expref: 13 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066802.187449:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7844 00000100:00100000:1.0:1746066802.187453:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5408c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977212800:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066802.187462:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066802.187468:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5e6 expref: 13 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.187476:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5e6 expref: 13 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.187498:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f000/0xfb36a14ee608d19d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5e6 expref: 13 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.187517:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066802.187531:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066802.187540:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066802.187546:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14548 initiator: MDT0 00010000:00010000:1.0:1746066802.187575:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066802.187598:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000100:00100000:1.0:1746066802.187598:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5408c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977212800:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 144us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.187604:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7844 00010000:00010000:2.0:1746066802.187605:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746066802.187626:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066802.187784:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d1e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f62c expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.187804:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f62c expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.187811:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066802.187814:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066802.187816:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18ea00, rc 0) 00000100:00100000:2.0:1746066802.187839:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31922:x1830882977212416:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 10066us (10367us total) trans 8589944223 rc 0/0 00000100:00100000:2.0:1746066802.187846:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10140 00000100:00100000:1.0:1746066802.195253:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882977211904:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17999us (19027us total) trans 0 rc 897024/897024 00000100:00100000:1.0:1746066802.195266:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6925 00002000:00100000:1.0:1746066802.195278:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8801361fbb80 x1830882977211904/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.195286:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fbb80 with x1830882977211904 ext(4194304->5091327) 00002000:00010000:1.0:1746066802.195292:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361fbb80 00000100:00100000:2.0:1746066802.195445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.195490:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.195559:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977213440 00000100:00100000:3.0:1746066802.195567:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977213440 00000100:00100000:3.0:1746066802.195605:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10141 00000100:00100000:3.0:1746066802.195611:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31922:x1830882977213440:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:1.0:1746066802.195628:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977213056 00000100:00100000:1.0:1746066802.195632:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977213056 00010000:00010000:3.0:1746066802.195633:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.195651:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93e00/0xfb36a14ee608d1f8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f633 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746066802.195657:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3321856->3579903) req@ffff880093213800 x1830882977213056/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.195664:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093213800 with x1830882977213056 ext(3321856->3579903) 00010000:00010000:1.0:1746066802.195671:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 38 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.195700:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 38 pid: 20532 timeout: 863 lvb_type: 0 00002000:00010000:1.0:1746066802.195707:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093213800 00000100:00100000:1.0:1746066802.195721:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2238 00000100:00100000:1.0:1746066802.195727:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1965:x1830882977213056:12345-192.168.202.57@tcp:4:cat.0 00010000:00010000:3.0:1746066802.195749:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.195764:0:14548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f62c expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.195770:0:14548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.195799:0:14548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f62c expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.195808:0:14548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f62c expref: 13 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.195820:0:14548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976954880:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066802.195883:0:14548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066802.196243:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.196401:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977213312 00000100:00100000:3.0:1746066802.196404:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977213312 00000100:00100000:3.0:1746066802.197050:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4256 00000100:00100000:3.0:1746066802.197057:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d05850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:31920:x1830882977213312:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066802.197643:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d05850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:31920:x1830882977213312:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 585us (1401us total) trans 8589944224 rc 0/0 00000100:00100000:3.0:1746066802.197651:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4256 00000100:00100000:0.0:1746066802.200299:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.200564:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977213568 00000100:00100000:3.0:1746066802.200573:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977213568 00010000:00010000:3.0:1746066802.200611:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f62c expref: 14 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.201409:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7845 00000100:00100000:3.0:1746066802.201418:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1965:x1830882977213568:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066802.201432:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066802.201439:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f62c expref: 14 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.201449:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f62c expref: 14 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.201473:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066802.201478:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.201487:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.201495:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.201512:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.201561:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1965:x1830882977213568:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 144us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.201568:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7845 00010000:00010000:3.0:1746066802.201622:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d1ea lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f62c expref: 13 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.201636:0:14548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14548:1830882976954880:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066802.201652:0:14548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.201659:0:14548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.201664:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746066802.201731:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066802.201735:0:14548:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066802.201750:0:14548:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.201782:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93e00/0xfb36a14ee608d1f8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f633 expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.201795:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f633 expref: 12 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.201801:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066802.201803:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066802.201806:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed93000, rc 0) 00000100:00100000:3.0:1746066802.201831:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31922:x1830882977213440:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 6220us (6340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.201838:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10141 00000100:00100000:0.0:1746066802.204669:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1965:x1830882977213056:12345-192.168.202.57@tcp:4:cat.0 Request processed in 8930us (9214us total) trans 17179873740 rc 0/0 00000100:00100000:0.0:1746066802.204693:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2238 00002000:00100000:0.0:1746066802.204708:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3321856->3579903) req@ffff880093213800 x1830882977213056/t17179873740(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/448 e 0 to 0 dl 1746066813 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.204717:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093213800 with x1830882977213056 ext(3321856->3579903) 00010000:00010000:0.0:1746066802.204728:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 40 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.204749:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 40 pid: 20532 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746066802.204755:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093213800 00000100:00100000:2.0:1746066802.205703:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.205801:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977213696 00000100:00100000:3.0:1746066802.205811:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977213696 00000100:00100000:3.0:1746066802.205861:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15234 00000100:00100000:3.0:1746066802.205868:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1964:x1830882977213696:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066802.205885:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.205901:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed92200/0xfb36a14ee608d206 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f63a expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066802.205955:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976955008:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066802.206033:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.207808:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.207963:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977213824 00000100:00100000:2.0:1746066802.207970:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977213824 00000100:00100000:2.0:1746066802.208008:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15235 00000100:00100000:2.0:1746066802.208014:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1963:x1830882977213824:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066802.208030:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.208047:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d18e000/0xfb36a14ee608d20d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f641 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.208077:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d18e000/0xfb36a14ee608d20d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f641 expref: 43 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.208087:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d18e000/0xfb36a14ee608d20d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f641 expref: 43 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.208931:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18e000, rc 0) 00000100:00100000:2.0:1746066802.208984:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1963:x1830882977213824:12345-192.168.202.57@tcp:101:cat.0 Request processed in 968us (1178us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066802.208990:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15235 00000100:00100000:0.0:1746066802.209644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.209690:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.209718:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.209736:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977214208 00000100:00100000:0.0:1746066802.209740:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977214208 00010000:00010000:0.0:1746066802.209769:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 42 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066802.209842:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977214080 00000100:00100000:1.0:1746066802.209846:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977214080 00000100:00100000:0.0:1746066802.210047:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7846 00000100:00100000:0.0:1746066802.210054:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1963:x1830882977214208:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.210068:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.210091:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 42 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.210102:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 42 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.210124:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed92a00/0xfb36a14ee608d1a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3321856->3579903] (req 3321856->3579903) gid 0 flags: 0x44801000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ed expref: 42 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.210143:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.210145:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.210968:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5f4 expref: 28 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.210978:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5f4 expref: 28 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.211017:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5f4 expref: 28 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.211031:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976955136:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066802.211104:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066802.212082:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977213952 00000100:00100000:1.0:1746066802.212088:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977213952 00000100:00100000:3.0:1746066802.212176:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976955008:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066802.212204:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed92200/0xfb36a14ee608d206 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f63a expref: 41 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.212216:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed92200/0xfb36a14ee608d206 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f63a expref: 41 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.212225:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed92200, rc 0) 00000100:00100000:3.0:1746066802.212259:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1964:x1830882977213696:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6391us (6560us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066802.212266:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15234 00000100:00100000:3.0:1746066802.212283:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15236 00000100:00100000:3.0:1746066802.212289:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882977214080:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066802.212302:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.212313:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed93400/0xfb36a14ee608d214 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f64f expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.212334:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.212335:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.212340:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed93400/0xfb36a14ee608d214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f64f expref: 14 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.212349:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed93400/0xfb36a14ee608d214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f64f expref: 14 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.212355:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed93400, rc 0) 00000100:00100000:3.0:1746066802.212369:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1963:x1830882977214080:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 81us (2729us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.212374:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15236 00000100:00100000:3.0:1746066802.212384:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15237 00000100:00100000:3.0:1746066802.212388:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882977213952:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066802.212392:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.212398:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed93600/0xfb36a14ee608d21b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f648 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066802.212419:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976955264:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066802.212459:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066802.218330:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976955136:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066802.218361:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066802.218408:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1963:x1830882977214208:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8353us (8687us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.218418:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7846 00000100:00100000:0.0:1746066802.218467:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.218885:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977214464 00000100:00100000:2.0:1746066802.218892:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977214464 00002000:00100000:2.0:1746066802.218930:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009e8c4000 x1830882977214464/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.218940:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c4000 with x1830882977214464 ext(3145728->4194303) 00002000:00010000:2.0:1746066802.218945:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c4000 00000100:00100000:2.0:1746066802.218973:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6926 00000100:00100000:2.0:1746066802.218979:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882977214464:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066802.220608:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976955264:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066802.220642:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed93600/0xfb36a14ee608d21b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f648 expref: 14 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.220654:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed93600/0xfb36a14ee608d21b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f648 expref: 14 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.220666:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed93600, rc 0) 00000100:00100000:3.0:1746066802.220725:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1963:x1830882977213952:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 8335us (11049us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066802.220732:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15237 00000100:00100000:0.0:1746066802.222016:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.222046:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.222124:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977214592 00000100:00100000:3.0:1746066802.222131:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977214592 00000100:00100000:3.0:1746066802.222173:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977214720 00000100:00100000:3.0:1746066802.222175:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977214720 00000100:00100000:3.0:1746066802.222190:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15238 00000100:00100000:3.0:1746066802.222196:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977214592:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066802.222212:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.222229:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed92800/0xfb36a14ee608d222 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f656 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066802.222293:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976955392:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066802.222351:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066802.222373:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15239 00000100:00100000:3.0:1746066802.222379:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1963:x1830882977214720:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066802.222385:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.222392:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed93c00/0xfb36a14ee608d229 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f65d expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.222403:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.222404:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.222413:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed93c00/0xfb36a14ee608d229 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f65d expref: 42 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.222429:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed93c00/0xfb36a14ee608d229 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f65d expref: 42 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.222438:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed93c00, rc 0) 00000100:00100000:3.0:1746066802.222455:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1963:x1830882977214720:12345-192.168.202.57@tcp:101:cat.0 Request processed in 77us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.222460:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15239 00000100:00100000:0.0:1746066802.223882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.223954:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977214976 00000100:00100000:3.0:1746066802.223959:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977214976 00000100:00100000:3.0:1746066802.224046:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10142 00000100:00100000:3.0:1746066802.224053:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31922:x1830882977214976:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066802.224067:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.224080:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92a00/0xfb36a14ee608d230 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f664 expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.224171:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93e00/0xfb36a14ee608d237 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.224183:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93e00/0xfb36a14ee608d237 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:3.0:1746066802.224193:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93e00/0xfb36a14ee608d237 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:3.0:1746066802.224205:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066802.224327:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed92a00/0xfb36a14ee608d230 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f664 expref: 15 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.224345:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93e00/0xfb36a14ee608d237 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f664 expref: 14 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.224353:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066802.224355:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066802.224358:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed93e00, rc 0) 00000100:00100000:3.0:1746066802.224383:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:31922:x1830882977214976:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 331us (505us total) trans 8589944225 rc 0/0 00000100:00100000:3.0:1746066802.224389:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10142 00000100:00100000:3.0:1746066802.225235:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976955392:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066802.225261:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed92800/0xfb36a14ee608d222 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f656 expref: 41 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.225269:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed92800/0xfb36a14ee608d222 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f656 expref: 41 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.225278:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed92800, rc 0) 00000100:00100000:3.0:1746066802.225304:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977214592:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3107us (3292us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066802.225310:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15238 00000100:00100000:0.0:1746066802.230619:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.230645:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.230666:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.231135:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.231310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.231340:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977215104 00000100:00100000:1.0:1746066802.231340:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977215232 00000100:00100000:1.0:1746066802.231349:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977215232 00000100:00100000:3.0:1746066802.231350:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977215104 00000100:00100000:1.0:1746066802.231439:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977215360 00000100:00100000:1.0:1746066802.231442:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977215360 00000100:00100000:1.0:1746066802.231451:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977215488 00000100:00100000:1.0:1746066802.231454:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977215488 00000100:00100000:1.0:1746066802.231468:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977215616 00000100:00100000:0.0:1746066802.231469:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.231470:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977215616 00000100:00100000:1.0:1746066802.231487:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977215744 00000100:00100000:1.0:1746066802.231490:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977215744 00000100:00100000:1.0:1746066802.231506:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15240 00000100:00100000:1.0:1746066802.231513:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1964:x1830882977215232:12345-192.168.202.57@tcp:1:lfs.0 00000100:00100000:2.0:1746066802.231538:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15241 00000100:00100000:2.0:1746066802.231545:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1963:x1830882977215104:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066802.231574:0:20532:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d18f400/0xfb36a14ee608d245 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.231574:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8400/0xfb36a14ee608d24c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.231591:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->749567) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 30 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.231592:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a08a00/0xfb36a14ee608d0b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f561 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.231598:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066802.231600:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066802.231600:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e96f200/0xfb36a14ee608d1b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f602 expref: 16 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.231603:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18f400/0xfb36a14ee608d245 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.231608:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0000/0xfb36a14ee608d126 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f592 expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066802.231615:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.231616:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.231618:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8400/0xfb36a14ee608d24c lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.231635:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->749567) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 30 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.231636:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0000/0xfb36a14ee608d126 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f592 expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.231647:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->749567) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 30 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.231647:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0000/0xfb36a14ee608d126 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f592 expref: 27 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066802.231660:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976955520:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066802.231660:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976955648:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.231738:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15242 00000100:00100000:0.0:1746066802.231745:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1964:x1830882977215488:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:1.0:1746066802.231762:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e96f200/0xfb36a14ee608d1b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f602 expref: 16 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.231765:0:21973:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6400/0xfb36a14ee608d253 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.231770:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e96f200/0xfb36a14ee608d1b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f602 expref: 16 pid: 8450 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066802.231779:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976955776:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.231779:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed93800/0xfb36a14ee608d0f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f584 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.231785:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a53f7600/0xfb36a14ee608d1c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f610 expref: 15 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.231793:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1400/0xfb36a14ee608d12d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a0 expref: 39 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.231798:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.231799:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.231801:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6400/0xfb36a14ee608d253 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.231805:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099a08a00/0xfb36a14ee608d0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f561 expref: 19 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.231812:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099a08a00/0xfb36a14ee608d0b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f561 expref: 19 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.231817:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1400/0xfb36a14ee608d12d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a0 expref: 39 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.231825:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1400/0xfb36a14ee608d12d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a0 expref: 39 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066802.231826:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976955904:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.231833:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976956032:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066802.231844:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dc540 going to sleep for 11 seconds 00010000:00010000:0.0:1746066802.231865:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a53f7600/0xfb36a14ee608d1c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f610 expref: 15 pid: 21203 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066802.231868:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15243 00010000:00010000:0.0:1746066802.231872:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a53f7600/0xfb36a14ee608d1c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f610 expref: 15 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066802.231874:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1963:x1830882977215616:12345-192.168.202.57@tcp:1:lfs.0 00000100:00100000:0.0:1746066802.231884:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976956160:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066802.231888:0:21203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e96fa00/0xfb36a14ee608d25a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.231899:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5f4 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.231905:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed93800/0xfb36a14ee608d0f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f584 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.231906:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed93c00/0xfb36a14ee608d229 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f65d expref: 39 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066802.231912:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed93400/0xfb36a14ee608d214 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f64f expref: 15 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.231913:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed93800/0xfb36a14ee608d0f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f584 expref: 30 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.231918:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e96ec00/0xfb36a14ee608d1dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3579904->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f625 expref: 39 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.231919:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976956288:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066802.231924:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066802.231925:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066802.231927:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e96fa00/0xfb36a14ee608d25a lrc: 7/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.231933:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3600 going to sleep for 11 seconds 00010000:00010000:1.0:1746066802.231941:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e96ec00/0xfb36a14ee608d1dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3579904->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f625 expref: 39 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.231948:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e96ec00/0xfb36a14ee608d1dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3579904->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f625 expref: 39 pid: 21203 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746066802.231949:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15244 00000100:00100000:0.0:1746066802.231954:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1964:x1830882977215744:12345-192.168.202.57@tcp:1:lfs.0 00000100:00100000:1.0:1746066802.231956:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976956416:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.231971:0:8452:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e607600/0xfb36a14ee608d261 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.231979:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed93400/0xfb36a14ee608d214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f64f expref: 15 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.231981:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1a00/0xfb36a14ee608d13b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a7 expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066802.231986:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed93400/0xfb36a14ee608d214 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f64f expref: 15 pid: 10402 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.231987:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a53f6c00/0xfb36a14ee608d1d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f61e expref: 16 pid: 21203 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066802.231993:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976956544:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.231993:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d18fc00/0xfb36a14ee608d149 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5c3 expref: 19 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.231998:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.232000:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.232002:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e607600/0xfb36a14ee608d261 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.232013:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed93c00/0xfb36a14ee608d229 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f65d expref: 39 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.232016:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d18fc00/0xfb36a14ee608d149 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5c3 expref: 19 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066802.232020:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed93c00/0xfb36a14ee608d229 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f65d expref: 39 pid: 8112 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.232024:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d18fc00/0xfb36a14ee608d149 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5c3 expref: 19 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066802.232027:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c529500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976956672:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.232032:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976956800:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066802.232043:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5f4 expref: 30 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.232050:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5f4 expref: 30 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.232056:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a53f6c00/0xfb36a14ee608d1d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f61e expref: 16 pid: 21203 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066802.232061:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976956928:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.232063:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a53f6c00/0xfb36a14ee608d1d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f61e expref: 16 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.232070:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976957056:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066802.232072:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dcf00 going to sleep for 11 seconds 00010000:00010000:0.0:1746066802.232088:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1a00/0xfb36a14ee608d13b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a7 expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.232094:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1a00/0xfb36a14ee608d13b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a7 expref: 27 pid: 21973 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.232101:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976957184:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.232113:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066802.232336:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066802.232351:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15245 00000100:00100000:2.0:1746066802.232357:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1963:x1830882977215360:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066802.232374:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d268 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.232383:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d18f800/0xfb36a14ee608d0cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f56f expref: 19 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.232390:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e96f000/0xfb36a14ee608d1c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f609 expref: 16 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.232397:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1800/0xfb36a14ee608d134 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f599 expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.232402:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.232404:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.232406:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d268 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.232420:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1800/0xfb36a14ee608d134 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f599 expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.232428:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1800/0xfb36a14ee608d134 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f599 expref: 27 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066802.232436:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976957312:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.232694:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e96f000/0xfb36a14ee608d1c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f609 expref: 16 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.232702:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e96f000/0xfb36a14ee608d1c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f609 expref: 16 pid: 8450 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066802.232709:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093213b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976957440:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.233281:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d18f800/0xfb36a14ee608d0cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f56f expref: 19 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.233290:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d18f800/0xfb36a14ee608d0cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f56f expref: 19 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066802.233298:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976957568:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066802.233417:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066802.233476:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882977214464:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14496us (15010us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066802.233486:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6926 00002000:00100000:2.0:1746066802.233495:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009e8c4000 x1830882977214464/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.233504:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c4000 with x1830882977214464 ext(3145728->4194303) 00010000:00010000:2.0:1746066802.233510:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5f4 expref: 29 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.233518:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5f4 expref: 29 pid: 21203 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746066802.233532:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e8c4000 00000100:00100000:2.0:1746066802.248442:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976956160:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.248618:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976956800:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.248652:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.248666:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.248695:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.248709:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.248730:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.248746:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.248767:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977215872 00000100:00100000:0.0:1746066802.248774:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977215872 00010000:00010000:0.0:1746066802.248813:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a53f7600/0xfb36a14ee608d1c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f610 expref: 16 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.248833:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977216384 00000100:00100000:0.0:1746066802.248835:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977216384 00010000:00010000:0.0:1746066802.248845:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed93400/0xfb36a14ee608d214 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f64f expref: 17 pid: 10402 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.248854:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977216256 00000100:00100000:0.0:1746066802.248856:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977216256 00010000:00010000:0.0:1746066802.248865:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0000/0xfb36a14ee608d126 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f592 expref: 28 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.248873:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977216768 00000100:00100000:0.0:1746066802.248875:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977216768 00010000:00010000:0.0:1746066802.248883:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1400/0xfb36a14ee608d12d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a0 expref: 40 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.248890:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977216128 00000100:00100000:0.0:1746066802.248892:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977216128 00010000:00010000:0.0:1746066802.248899:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e96ec00/0xfb36a14ee608d1dc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3579904->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f625 expref: 41 pid: 21203 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746066802.248907:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977216000 00000100:00100000:0.0:1746066802.248909:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977216000 00010000:00010000:0.0:1746066802.248917:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e96f200/0xfb36a14ee608d1b9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f602 expref: 17 pid: 8450 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.248928:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7847 00000100:00100000:0.0:1746066802.248934:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:1965:x1830882977215872:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.248948:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.248971:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a53f7600/0xfb36a14ee608d1c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f610 expref: 17 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.248983:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a53f7600/0xfb36a14ee608d1c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f610 expref: 17 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.249004:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a53f7600/0xfb36a14ee608d1c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f610 expref: 17 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.249026:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.249065:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1965:x1830882977215872:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 131us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.249071:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7847 00000100:00100000:0.0:1746066802.249088:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7848 00000100:00100000:0.0:1746066802.249093:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882977216384:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.249099:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.249109:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed93400/0xfb36a14ee608d214 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f64f expref: 15 pid: 10402 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.249117:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed93400/0xfb36a14ee608d214 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f64f expref: 15 pid: 10402 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.249128:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.249141:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1965:x1830882977216384:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 49us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.249147:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7848 00000100:00100000:0.0:1746066802.249156:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7849 00000100:00100000:0.0:1746066802.249160:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977216256:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.249167:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.249180:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0000/0xfb36a14ee608d126 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f592 expref: 28 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.249188:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0000/0xfb36a14ee608d126 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f592 expref: 28 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.249201:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.249215:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977216256:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 55us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.249221:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7849 00000100:00100000:0.0:1746066802.249230:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7850 00000100:00100000:0.0:1746066802.249234:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1965:x1830882977216768:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.249240:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.249247:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1400/0xfb36a14ee608d12d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a0 expref: 41 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.249256:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1400/0xfb36a14ee608d12d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a0 expref: 41 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.249265:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.249277:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1965:x1830882977216768:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 43us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.249282:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7850 00000100:00100000:0.0:1746066802.249289:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7851 00000100:00100000:0.0:1746066802.249294:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5408850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1964:x1830882977216128:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.249299:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.249305:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e96ec00/0xfb36a14ee608d1dc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3579904->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f625 expref: 40 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.249312:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e96ec00/0xfb36a14ee608d1dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3579904->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f625 expref: 40 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.249320:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.249331:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5408850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1964:x1830882977216128:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 37us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.249335:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7851 00000100:00100000:0.0:1746066802.249367:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7852 00000100:00100000:0.0:1746066802.249372:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:1963:x1830882977216000:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.249378:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.249385:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e96f200/0xfb36a14ee608d1b9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f602 expref: 17 pid: 8450 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.249392:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e96f200/0xfb36a14ee608d1b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f602 expref: 17 pid: 8450 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.249402:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.249420:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:1963:x1830882977216000:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 48us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.249425:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7852 00000100:00100000:0.0:1746066802.249471:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.249484:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977216896 00010000:00010000:1.0:1746066802.249486:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6e0000/0xfb36a14ee608d126 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f592 expref: 27 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.249487:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977216896 00010000:00010000:0.0:1746066802.249497:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed93800/0xfb36a14ee608d0f5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f584 expref: 29 pid: 21203 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066802.249502:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976955648:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.249507:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7853 00000100:00100000:0.0:1746066802.249511:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1966:x1830882977216896:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066802.249513:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e96f200/0xfb36a14ee608d1b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f602 expref: 16 pid: 8450 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.249518:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066802.249530:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976955776:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.249538:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed93800/0xfb36a14ee608d0f5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f584 expref: 29 pid: 21203 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066802.249539:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976955904:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.249545:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed93800/0xfb36a14ee608d0f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f584 expref: 29 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.249555:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.249557:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.249561:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6400/0xfb36a14ee608d253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.249565:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8400/0xfb36a14ee608d24c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.249570:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6400/0xfb36a14ee608d253 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.249586:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066802.249591:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e96ec00/0xfb36a14ee608d1dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3579904->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f625 expref: 39 pid: 21203 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066802.249599:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976956416:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.249599:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1966:x1830882977216896:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 87us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.249605:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7853 00010000:00010000:1.0:1746066802.249606:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed93400/0xfb36a14ee608d214 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f64f expref: 14 pid: 10402 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066802.249612:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976956544:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066802.249621:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c529500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976956672:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066802.249628:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976956928:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066802.249643:0:21203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e96fa00/0xfb36a14ee608d25a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.249659:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.249668:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977216512 00000100:00100000:0.0:1746066802.249670:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977216512 00000100:00100000:1.0:1746066802.249696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066802.249696:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099a08a00/0xfb36a14ee608d0b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f561 expref: 20 pid: 8450 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746066802.249705:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977216640 00000100:00100000:0.0:1746066802.249707:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977216640 00000100:00100000:1.0:1746066802.249712:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7854 00010000:00010000:0.0:1746066802.249714:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed93c00/0xfb36a14ee608d229 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f65d expref: 39 pid: 8112 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066802.249717:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977216512:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066802.249723:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7855 00010000:00010000:1.0:1746066802.249725:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066802.249727:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1964:x1830882977216640:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.249732:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066802.249735:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099a08a00/0xfb36a14ee608d0b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f561 expref: 20 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.249738:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed93c00/0xfb36a14ee608d229 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f65d expref: 39 pid: 8112 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066802.249743:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099a08a00/0xfb36a14ee608d0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f561 expref: 20 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.249750:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed93c00/0xfb36a14ee608d229 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f65d expref: 39 pid: 8112 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066802.249755:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099a08a00/0xfb36a14ee608d0b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f561 expref: 20 pid: 8450 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.249763:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.249764:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.249764:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed93c00/0xfb36a14ee608d229 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f65d expref: 39 pid: 8112 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066802.249767:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8400/0xfb36a14ee608d24c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.249772:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066802.249773:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8400/0xfb36a14ee608d24c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.249784:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882977216640:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 57us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.249788:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7855 00010000:00010000:1.0:1746066802.249789:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066802.249804:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977216512:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 87us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.249809:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7854 00000100:00100000:0.0:1746066802.249823:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976957056:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066802.249824:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8400/0xfb36a14ee608d24c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.249831:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8400/0xfb36a14ee608d24c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.249844:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976957184:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066802.249849:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8400/0xfb36a14ee608d24c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.249856:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8400/0xfb36a14ee608d24c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.249861:0:8452:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e607600/0xfb36a14ee608d261 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.249863:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8400/0xfb36a14ee608d24c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.249869:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ebc8400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066802.249873:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8400/0xfb36a14ee608d24c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.249879:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8400/0xfb36a14ee608d24c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.249882:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066802.249891:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8400/0xfb36a14ee608d24c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.249896:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8400/0xfb36a14ee608d24c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066802.249932:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1964:x1830882977215232:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 18420us (19285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.249939:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15240 00000100:00100000:1.0:1746066802.249956:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977217024 00000100:00100000:1.0:1746066802.249959:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977217024 00000100:00100000:0.0:1746066802.249964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066802.249968:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d18fc00/0xfb36a14ee608d149 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5c3 expref: 19 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.249975:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977217152 00000100:00100000:1.0:1746066802.249977:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7856 00000100:00100000:0.0:1746066802.249977:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977217152 00000100:00100000:1.0:1746066802.249980:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977217024:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066802.249985:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.249986:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a53f6c00/0xfb36a14ee608d1d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f61e expref: 15 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066802.249995:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d18fc00/0xfb36a14ee608d149 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5c3 expref: 19 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.249997:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7857 00010000:00010000:1.0:1746066802.250002:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d18fc00/0xfb36a14ee608d149 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5c3 expref: 19 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.250002:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1964:x1830882977217152:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.250007:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066802.250011:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d18fc00/0xfb36a14ee608d149 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5c3 expref: 19 pid: 20532 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.250014:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a53f6c00/0xfb36a14ee608d1d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f61e expref: 15 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066802.250024:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066802.250027:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a53f6c00/0xfb36a14ee608d1d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f61e expref: 15 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066802.250034:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977217024:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 53us (152us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066802.250038:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a53f6c00/0xfb36a14ee608d1d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f61e expref: 15 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066802.250039:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7856 00010000:00010000:0.0:1746066802.250050:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.250062:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882977217152:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 61us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.250068:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7857 00010000:00010000:2.0:1746066802.250294:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6e1400/0xfb36a14ee608d12d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a0 expref: 37 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066802.250308:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976956032:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.250316:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed93800/0xfb36a14ee608d0f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f584 expref: 28 pid: 21203 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066802.250323:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976956288:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.250341:0:21973:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6400/0xfb36a14ee608d253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.250351:0:21973:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6400/0xfb36a14ee608d253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.250356:0:21973:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6400/0xfb36a14ee608d253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.250370:0:21973:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6400/0xfb36a14ee608d253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.250375:0:21973:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6400/0xfb36a14ee608d253 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.250378:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066802.250380:0:21973:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6400/0xfb36a14ee608d253 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.250384:0:21973:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a53f6400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066802.250386:0:21973:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6400/0xfb36a14ee608d253 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.250391:0:21973:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6400/0xfb36a14ee608d253 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.250399:0:21973:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6400/0xfb36a14ee608d253 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.250404:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6400/0xfb36a14ee608d253 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.250410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.250423:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.250435:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977215488:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 18692us (19301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.250441:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15242 00000100:00100000:0.0:1746066802.250617:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977217408 00000100:00100000:0.0:1746066802.250621:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977217408 00010000:00010000:0.0:1746066802.250634:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1800/0xfb36a14ee608d134 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f599 expref: 27 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.250649:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977217536 00000100:00100000:0.0:1746066802.250651:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977217536 00010000:00010000:0.0:1746066802.250658:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e96f000/0xfb36a14ee608d1c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f609 expref: 14 pid: 8450 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.250670:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7858 00000100:00100000:0.0:1746066802.250690:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5408450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882977217408:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.250697:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.250708:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1800/0xfb36a14ee608d134 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f599 expref: 27 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.250716:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1800/0xfb36a14ee608d134 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f599 expref: 27 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.250727:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.250738:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5408450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882977217408:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 62us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.250743:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7858 00000100:00100000:0.0:1746066802.250761:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7859 00000100:00100000:0.0:1746066802.250766:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1965:x1830882977217536:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.250772:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.250778:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e96f000/0xfb36a14ee608d1c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f609 expref: 14 pid: 8450 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.250786:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e96f000/0xfb36a14ee608d1c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f609 expref: 14 pid: 8450 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.250795:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.250804:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1965:x1830882977217536:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 38us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.250809:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7859 00000100:00100000:0.0:1746066802.250840:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.250848:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977217664 00000100:00100000:0.0:1746066802.250850:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977217664 00010000:00010000:0.0:1746066802.250858:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1a00/0xfb36a14ee608d13b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a7 expref: 27 pid: 21973 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.250870:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7860 00000100:00100000:0.0:1746066802.250874:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977217664:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.250880:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.250886:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1a00/0xfb36a14ee608d13b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a7 expref: 27 pid: 21973 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.250894:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1a00/0xfb36a14ee608d13b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a7 expref: 27 pid: 21973 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.250904:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1a00/0xfb36a14ee608d13b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5a7 expref: 27 pid: 21973 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746066802.250913:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.250914:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.250917:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e607600/0xfb36a14ee608d261 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.250924:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e607600/0xfb36a14ee608d261 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.250936:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.250946:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977217664:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 71us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.250951:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7860 00010000:00010000:0.0:1746066802.250962:0:8452:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e607600/0xfb36a14ee608d261 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.250969:0:8452:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e607600/0xfb36a14ee608d261 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.250982:0:8452:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e607600/0xfb36a14ee608d261 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.250988:0:8452:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e607600/0xfb36a14ee608d261 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.250995:0:8452:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e607600/0xfb36a14ee608d261 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.251001:0:8452:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e607600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066802.251004:0:8452:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e607600/0xfb36a14ee608d261 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.251009:0:8452:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e607600/0xfb36a14ee608d261 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.251018:0:8452:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e607600/0xfb36a14ee608d261 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.251024:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e607600/0xfb36a14ee608d261 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.251051:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977215744:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 19097us (19583us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.251058:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15244 00000100:00100000:0.0:1746066802.251102:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.251111:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977217792 00000100:00100000:0.0:1746066802.251113:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977217792 00010000:00010000:0.0:1746066802.251123:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d18f800/0xfb36a14ee608d0cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f56f expref: 18 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746066802.251135:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7861 00000100:00100000:0.0:1746066802.251139:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977217792:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.251145:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.251152:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d18f800/0xfb36a14ee608d0cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f56f expref: 18 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.251159:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d18f800/0xfb36a14ee608d0cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f56f expref: 18 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.251168:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.251170:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.251173:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.251180:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d268 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.251189:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.251198:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977217792:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 59us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.251207:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7861 00000100:00100000:2.0:1746066802.251614:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882976955520:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.251629:0:20532:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d18f400/0xfb36a14ee608d245 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066802.251647:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977217280 00000100:00100000:2.0:1746066802.251649:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977217280 00002000:00100000:2.0:1746066802.251696:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (331776->749567) req@ffff88009ec2c000 x1830882977217280/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.251705:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2c000 with x1830882977217280 ext(331776->749567) 00010000:00010000:2.0:1746066802.251711:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->749567) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 28 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.251720:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->749567) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 28 pid: 20532 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746066802.251726:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ec2c000 00000100:00100000:2.0:1746066802.251748:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2239 00000100:00100000:2.0:1746066802.251754:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882977217280:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066802.251934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.251945:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977217920 00000100:00100000:0.0:1746066802.251948:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977217920 00000100:00100000:0.0:1746066802.251963:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15246 00000100:00100000:0.0:1746066802.251968:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:31907:x1830882977217920:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066802.251980:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.251990:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d26f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f66b expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066802.252002:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38f:0x0] initial LVB size: 4194304, mtime: 0x6812dd71, atime: 0x6812dd71, ctime: 0x6812dd71, blocks: 0x102b 00010000:00010000:0.0:1746066802.252013:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.252014:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.252020:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f66b expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.252031:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f66b expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.252040:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed69200, rc 0) 00000100:00100000:0.0:1746066802.252051:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:31907:x1830882977217920:12345-192.168.202.57@tcp:101:cat.0 Request processed in 83us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.252063:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15246 00010000:00010000:1.0:1746066802.252361:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6e1800/0xfb36a14ee608d134 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f599 expref: 25 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066802.252374:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976957312:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066802.252391:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e96f000/0xfb36a14ee608d1c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f609 expref: 12 pid: 8450 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066802.252399:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093213b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976957440:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066802.252412:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d18f800/0xfb36a14ee608d0cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f56f expref: 18 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066802.252422:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976957568:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066802.252439:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.252449:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.252454:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.252473:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.252480:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d268 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.252482:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746066802.252486:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d268 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.252492:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d18ea00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066802.252495:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d268 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.252501:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d268 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.252510:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d268 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.252516:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d268 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066802.252554:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977215360:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 20197us (21887us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.252560:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15245 00000100:00100000:0.0:1746066802.257611:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.257713:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977218048 00000100:00100000:3.0:1746066802.257724:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977218048 00010000:00010000:3.0:1746066802.257761:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5f4 expref: 30 pid: 21203 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.257803:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7862 00000100:00100000:3.0:1746066802.257812:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+30:1965:x1830882977218048:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066802.257828:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066802.257853:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5f4 expref: 30 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.257864:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5f4 expref: 30 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.257887:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a53f6e00/0xfb36a14ee608d1b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5f4 expref: 30 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.257923:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.257925:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.257930:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e96fa00/0xfb36a14ee608d25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.257938:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e96fa00/0xfb36a14ee608d25a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.257972:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066802.257988:0:21203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e96fa00/0xfb36a14ee608d25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.258002:0:21203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e96fa00/0xfb36a14ee608d25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066802.258015:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+29:1965:x1830882977218048:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 204us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.258022:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7862 00010000:00010000:0.0:1746066802.258024:0:21203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e96fa00/0xfb36a14ee608d25a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.258032:0:21203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e96fa00/0xfb36a14ee608d25a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.258038:0:21203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e96fa00/0xfb36a14ee608d25a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.258044:0:21203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e96fa00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066802.258047:0:21203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e96fa00/0xfb36a14ee608d25a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.258055:0:21203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e96fa00/0xfb36a14ee608d25a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.258064:0:21203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e96fa00/0xfb36a14ee608d25a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.258070:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e96fa00/0xfb36a14ee608d25a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.258111:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882977215616:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 26236us (26800us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.258120:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15243 00000100:00100000:0.0:1746066802.260917:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.261011:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977218304 00000100:00100000:3.0:1746066802.261020:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977218304 00002000:00100000:3.0:1746066802.261065:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009ec2e300 x1830882977218304/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.261075:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2e300 with x1830882977218304 ext(3145728->4194303) 00002000:00010000:3.0:1746066802.261080:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2e300 00000100:00100000:3.0:1746066802.261101:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6927 00000100:00100000:3.0:1746066802.261107:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977218304:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066802.269128:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.269207:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977218560 00000100:00100000:2.0:1746066802.269216:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977218560 00000100:00100000:2.0:1746066802.269266:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10143 00000100:00100000:2.0:1746066802.269275:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:31926:x1830882977218560:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066802.269299:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.269317:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f600/0xfb36a14ee608d276 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f672 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.269421:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066802.269436:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f633 expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.269442:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93e00/0xfb36a14ee608d237 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f664 expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.269448:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 5/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066802.269481:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93e00/0xfb36a14ee608d237 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f664 expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.269490:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93e00/0xfb36a14ee608d237 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f664 expref: 13 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066802.269501:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976957696:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.269599:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f633 expref: 13 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.269606:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f633 expref: 13 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066802.269619:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976957824:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066802.269638:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066802.272761:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+29:1965:x1830882977217280:12345-192.168.202.57@tcp:4:cat.0 Request processed in 20996us (22372us total) trans 17179873741 rc 0/0 00000100:00100000:3.0:1746066802.272777:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2239 00002000:00100000:3.0:1746066802.272790:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (331776->749567) req@ffff88009ec2c000 x1830882977217280/t17179873741(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/448 e 0 to 0 dl 1746066813 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.272799:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2c000 with x1830882977217280 ext(331776->749567) 00010000:00010000:3.0:1746066802.272809:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->749567) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 29 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.272820:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->749567) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 29 pid: 20532 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746066802.272826:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ec2c000 00000100:00100000:2.0:1746066802.275134:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977218304:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14016us (14218us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066802.275146:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6927 00002000:00100000:2.0:1746066802.275158:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009ec2e300 x1830882977218304/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.275168:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2e300 with x1830882977218304 ext(3145728->4194303) 00002000:00010000:2.0:1746066802.275174:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2e300 00000100:00100000:0.0:1746066802.276314:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.276408:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976957696:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066802.276699:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977218688 00000100:00100000:3.0:1746066802.276706:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977218688 00010000:00010000:3.0:1746066802.276741:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93e00/0xfb36a14ee608d237 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f664 expref: 14 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.276768:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7863 00000100:00100000:3.0:1746066802.276776:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1965:x1830882977218688:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066802.276792:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066802.276798:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93e00/0xfb36a14ee608d237 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f664 expref: 14 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.276809:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93e00/0xfb36a14ee608d237 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f664 expref: 14 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.276833:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93e00/0xfb36a14ee608d237 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f664 expref: 14 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.276862:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066802.276867:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.276875:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.276880:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.276916:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882977218688:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 140us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.276921:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7863 00000100:00100000:2.0:1746066802.277346:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976957824:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.277369:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:1.0:1746066802.277381:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.277483:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977218816 00000100:00100000:3.0:1746066802.277487:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977218816 00010000:00010000:3.0:1746066802.277499:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f633 expref: 13 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.277582:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7864 00000100:00100000:3.0:1746066802.278168:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977218816:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066802.278180:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066802.278560:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f633 expref: 13 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.278572:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f633 expref: 13 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.278590:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed93000/0xfb36a14ee608d1ff lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f633 expref: 13 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.278600:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066802.278604:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.278612:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.278618:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.278650:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.278701:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977218816:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 534us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.278707:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7864 00010000:00010000:2.0:1746066802.278799:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066802.278806:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:2.0:1746066802.278826:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066802.278980:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f600/0xfb36a14ee608d276 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f672 expref: 21 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.279000:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f672 expref: 20 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.279011:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066802.279013:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066802.279016:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18fa00, rc 0) 00000100:00100000:2.0:1746066802.280381:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:31926:x1830882977218560:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 11099us (11256us total) trans 8589944226 rc 0/0 00000100:00100000:2.0:1746066802.280390:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10143 00000100:00100000:2.0:1746066802.281401:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.281903:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977218944 00000100:00100000:1.0:1746066802.281914:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977218944 00010000:00010000:1.0:1746066802.281952:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 331776->749567) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 29 pid: 20532 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066802.281992:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7865 00000100:00100000:1.0:1746066802.281998:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5408050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+29:1965:x1830882977218944:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066802.282011:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066802.282034:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 331776->749567) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 29 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.282044:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 331776->749567) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 29 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.282066:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e607c00/0xfb36a14ee608d142 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 331776->749567) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f5ae expref: 29 pid: 20532 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.282095:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.282097:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.282102:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d18f400/0xfb36a14ee608d245 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.282110:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18f400/0xfb36a14ee608d245 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.282135:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066802.282172:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5408050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882977218944:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 174us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.282181:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7865 00010000:00010000:2.0:1746066802.282655:0:20532:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d18f400/0xfb36a14ee608d245 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.282664:0:20532:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d18f400/0xfb36a14ee608d245 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.282717:0:20532:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d18f400/0xfb36a14ee608d245 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.282726:0:20532:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18f400/0xfb36a14ee608d245 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.282733:0:20532:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d18f400/0xfb36a14ee608d245 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.282739:0:20532:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d18f400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066802.282742:0:20532:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d18f400/0xfb36a14ee608d245 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.282756:0:20532:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d18f400/0xfb36a14ee608d245 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.282766:0:20532:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d18f400/0xfb36a14ee608d245 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.282771:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d18f400/0xfb36a14ee608d245 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066802.282818:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977215104:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 51274us (52210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.282826:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15241 00000100:00100000:0.0:1746066802.289742:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.289836:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.289871:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.289890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.289904:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.289932:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.289966:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977219200 00000100:00100000:2.0:1746066802.289975:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977219200 00000100:00100000:2.0:1746066802.290024:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10144 00000100:00100000:2.0:1746066802.290032:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31922:x1830882977219200:12345-192.168.202.57@tcp:36:lfs.0 00000100:00100000:2.0:1746066802.290140:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31922:x1830882977219200:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 108us (408us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746066802.290146:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10144 00000100:00100000:3.0:1746066802.290212:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977219328 00000100:00100000:3.0:1746066802.290217:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977219328 00000100:00100000:0.0:1746066802.290232:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977219456 00000100:00100000:0.0:1746066802.290234:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977219456 00000100:00100000:3.0:1746066802.290239:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977219584 00000100:00100000:3.0:1746066802.290240:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977219584 00000100:00100000:3.0:1746066802.290264:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977219712 00000100:00100000:3.0:1746066802.290266:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977219712 00000100:00100000:1.0:1746066802.290299:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977219840 00000100:00100000:1.0:1746066802.290303:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977219840 00000100:00100000:0.0:1746066802.290456:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15247 00000100:00100000:0.0:1746066802.290463:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+30:1964:x1830882977219328:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066802.290474:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.290493:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed68800/0xfb36a14ee608d28b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f679 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066802.290517:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd71, atime: 0x6812dd71, ctime: 0x6812dd71, blocks: 0x7e1 00010000:00010000:0.0:1746066802.290542:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.290544:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.290553:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed68800/0xfb36a14ee608d28b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f679 expref: 31 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.290567:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed68800/0xfb36a14ee608d28b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f679 expref: 31 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.290581:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed68800, rc 0) 00000100:00100000:0.0:1746066802.290597:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+31:1964:x1830882977219328:12345-192.168.202.57@tcp:101:cat.0 Request processed in 135us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.290601:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15247 00000100:00100000:0.0:1746066802.290611:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15248 00000100:00100000:0.0:1746066802.290615:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977219584:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066802.290621:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.290631:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d292 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f687 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066802.290644:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd70, atime: 0x6812dd70, ctime: 0x6812dd70, blocks: 0x81d 00010000:00010000:0.0:1746066802.290650:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.290651:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.290654:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d292 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f687 expref: 20 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.290663:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d292 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f687 expref: 20 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.290670:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed68400, rc 0) 00000100:00100000:3.0:1746066802.290672:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15249 00000100:00100000:3.0:1746066802.290698:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977219456:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066802.290703:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066802.290703:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977219584:12345-192.168.202.57@tcp:101:cat.0 Request processed in 88us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.290708:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15248 00010000:00010000:3.0:1746066802.290712:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092183600/0xfb36a14ee608d299 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f680 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.290717:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15250 00000100:00100000:0.0:1746066802.290720:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+30:1964:x1830882977219712:12345-192.168.202.57@tcp:101:cat.0 00002000:00010000:3.0:1746066802.290724:0:20532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38d:0x0] initial LVB size: 2097152, mtime: 0x6812dd70, atime: 0x6812dd70, ctime: 0x6812dd70, blocks: 0x81f 00010000:00010000:0.0:1746066802.290726:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.290731:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.290732:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.290735:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608d2a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f68e expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.290737:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092183600/0xfb36a14ee608d299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f680 expref: 20 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.290746:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092183600/0xfb36a14ee608d299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f680 expref: 20 pid: 20532 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746066802.290746:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 2097152, mtime: 0x6812dd70, atime: 0x6812dd70, ctime: 0x6812dd70, blocks: 0x821 00010000:00010000:3.0:1746066802.290752:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092183600, rc 0) 00010000:00010000:0.0:1746066802.290752:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.290753:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.290756:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608d2a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f68e expref: 31 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.290763:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608d2a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f68e expref: 31 pid: 8452 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066802.290767:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977219456:12345-192.168.202.57@tcp:101:cat.0 Request processed in 71us (896us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066802.290769:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3d800, rc 0) 00000100:00100000:3.0:1746066802.290771:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15249 00000100:00100000:3.0:1746066802.290781:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15251 00000100:00100000:0.0:1746066802.290781:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+31:1964:x1830882977219712:12345-192.168.202.57@tcp:101:cat.0 Request processed in 60us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.290785:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+31:1964:x1830882977219840:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:0.0:1746066802.290786:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15250 00010000:00010000:3.0:1746066802.290790:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.290798:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092183800/0xfb36a14ee608d2a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f695 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066802.290808:0:20532:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 5090560, mtime: 0x6812dd71, atime: 0x6812dd71, ctime: 0x6812dd71, blocks: 0x1721 00010000:00010000:3.0:1746066802.290815:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.290817:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.290820:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092183800/0xfb36a14ee608d2a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f695 expref: 31 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.290827:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092183800/0xfb36a14ee608d2a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f695 expref: 31 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.290833:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092183800, rc 0) 00000100:00100000:3.0:1746066802.290852:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+31:1964:x1830882977219840:12345-192.168.202.57@tcp:101:cat.0 Request processed in 67us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.290856:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15251 00000100:00100000:1.0:1746066802.295449:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.295615:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977220096 00000100:00100000:3.0:1746066802.295625:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977220096 00000100:00100000:3.0:1746066802.295694:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4257 00000100:00100000:3.0:1746066802.295702:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:31922:x1830882977220096:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:3.0:1746066802.296133:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:31922:x1830882977220096:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 428us (691us total) trans 8589944227 rc 0/0 00000100:00100000:3.0:1746066802.296141:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4257 00000100:00100000:0.0:1746066802.299238:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.299270:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977220352 00000100:00100000:2.0:1746066802.299279:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977220352 00002000:00100000:2.0:1746066802.299333:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009ec2f480 x1830882977220352/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.299344:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2f480 with x1830882977220352 ext(4194304->5091327) 00002000:00010000:2.0:1746066802.299351:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2f480 00000100:00100000:2.0:1746066802.299396:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6928 00000100:00100000:2.0:1746066802.299404:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+31:1963:x1830882977220352:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066802.322170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.322801:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977220608 00000100:00100000:3.0:1746066802.322812:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977220608 00000100:00100000:3.0:1746066802.324448:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4258 00000100:00100000:3.0:1746066802.324463:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:31922:x1830882977220608:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:3.0:1746066802.324826:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:31922:x1830882977220608:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 367us (2666us total) trans 8589944228 rc 0/0 00000100:00100000:3.0:1746066802.324832:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4258 00000100:00100000:2.0:1746066802.327359:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+31:1963:x1830882977220352:12345-192.168.202.57@tcp:3:cat.0 Request processed in 27946us (28120us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066802.327371:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6928 00002000:00100000:2.0:1746066802.327384:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009ec2f480 x1830882977220352/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.327393:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2f480 with x1830882977220352 ext(4194304->5091327) 00002000:00010000:2.0:1746066802.327400:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2f480 00000100:00100000:0.0:1746066802.353113:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.353342:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977220864 00000100:00100000:2.0:1746066802.353353:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977220864 00000100:00100000:2.0:1746066802.353416:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10145 00000100:00100000:2.0:1746066802.353424:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:31929:x1830882977220864:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066802.353452:0:14548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.353474:0:14548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f600/0xfb36a14ee608d2ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f69c expref: -99 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.353607:0:14548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e600/0xfb36a14ee608d2b5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.353622:0:14548:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e600/0xfb36a14ee608d2b5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14548 initiator: MDT0 00010000:00010000:2.0:1746066802.353633:0:14548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e600/0xfb36a14ee608d2b5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14548 initiator: MDT0 00000004:00200000:2.0:1746066802.353644:0:14548:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066802.353794:0:14548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18f600/0xfb36a14ee608d2ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f69c expref: 269 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.354276:0:14548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e600/0xfb36a14ee608d2b5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f69c expref: 268 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.354285:0:14548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066802.354288:0:14548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066802.354291:0:14548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18e600, rc 0) 00000100:00100000:2.0:1746066802.354485:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:31929:x1830882977220864:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 1061us (1382us total) trans 8589944229 rc 0/0 00000100:00100000:2.0:1746066802.354492:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10145 00000100:00100000:1.0:1746066802.358012:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1830882976958208:0@lo:400:kworker.0 00000100:00100000:0.0:1746066802.358067:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980aefe6-2860-4e29-9b4a-3d9c65563e6f:3293:1830882976957952:0@lo:400:kworker.0 00000100:00100000:1.0:1746066802.358079:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066802.358102:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066802.358125:0:14544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976957952 00000100:00100000:0.0:1746066802.358132:0:14544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976957952 00000100:00100000:1.0:1746066802.358133:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746066802.358138:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976958336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746066802.358163:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066802.358169:0:14544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1746066802.358176:0:14544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980aefe6-2860-4e29-9b4a-3d9c65563e6f+18:3293:x1830882976957952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066802.358194:0:8453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976958336 00000100:00100000:1.0:1746066802.358196:0:8453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976958336 00000100:00100000:0.0:1746066802.358212:0:14544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980aefe6-2860-4e29-9b4a-3d9c65563e6f+18:3293:x1830882976957952:12345-0@lo:400:kworker.0 Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.358216:0:8453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1746066802.358218:0:14544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1746066802.358221:0:8453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+59:3295:x1830882976958336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746066802.358235:0:8453:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 602996736 pending 35782656 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746066802.358258:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980aefe6-2860-4e29-9b4a-3d9c65563e6f:3293:1830882976957952:0@lo:400:kworker.0 00000100:00100000:1.0:1746066802.358260:0:8453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+59:3295:x1830882976958336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.358264:0:8453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1746066802.358264:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976958464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746066802.358280:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066802.358432:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976958208 00000100:00100000:2.0:1746066802.358435:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976958208 00000100:00100000:2.0:1746066802.358465:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1746066802.358470:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830882976958208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066802.358502:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830882976958208:12345-0@lo:400:kworker.0 Request processed in 28us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.358507:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:2.0:1746066802.358535:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066802.358549:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1830882976958080:0@lo:400:kworker.0 00000100:00100000:2.0:1746066802.358571:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066802.358584:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976958592:0@lo:400:kworker.0 00000100:00100000:2.0:1746066802.358599:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066802.358620:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976958080 00000100:00100000:2.0:1746066802.358622:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976958080 00000100:00100000:2.0:1746066802.358639:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1746066802.358643:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830882976958080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066802.358668:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830882976958080:12345-0@lo:400:kworker.0 Request processed in 25us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.358693:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:2.0:1746066802.358704:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066802.358719:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1830882976958080:0@lo:400:kworker.0 00000100:00100000:2.0:1746066802.358744:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976958592 00000100:00100000:2.0:1746066802.358746:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976958592 00000100:00100000:3.0:1746066802.358898:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1746066802.358905:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3294:x1830882976958592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066802.358936:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3294:x1830882976958592:12345-0@lo:400:kworker.0 Request processed in 32us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.358940:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1746066802.358959:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746066802.358966:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830882976958720:0@lo:400:kworker.0 00000100:00100000:3.0:1746066802.358986:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066802.359006:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976958720 00000100:00100000:3.0:1746066802.359008:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976958720 00000100:00100000:3.0:1746066802.359024:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1746066802.359028:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830882976958720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066802.359052:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830882976958720:12345-0@lo:400:kworker.0 Request processed in 24us (65us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.359056:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1746066802.359073:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830882976958720:0@lo:400:kworker.0 00000100:00100000:2.0:1746066802.359198:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976958592:0@lo:400:kworker.0 00000100:00100000:3.0:1746066802.359245:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976958464 00000100:00100000:3.0:1746066802.359249:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976958464 00000100:00100000:3.0:1746066802.359262:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1746066802.359265:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3293:x1830882976958464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746066802.359470:0:8454:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 630390784 pending 22151168 free 3852468224 avail 3850371072 00000100:00100000:1.0:1746066802.360019:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976958336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746066802.360029:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1830882976958208:0@lo:400:kworker.0 00000100:00100000:3.0:1746066802.360338:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3293:x1830882976958464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1071us (2055us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.360348:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1746066802.360633:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976958464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746066802.373349:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.374161:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977220992 00000100:00100000:2.0:1746066802.374171:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977220992 00000100:00100000:2.0:1746066802.374306:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15252 00000100:00100000:2.0:1746066802.374314:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:31929:x1830882977220992:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066802.374329:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.374343:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f6a3 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.374369:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed68800/0xfb36a14ee608d28b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f679 expref: 30 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.374376:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.374378:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.374381:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [856064->1048575] (req 856064->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 38 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.374413:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed68800/0xfb36a14ee608d28b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f679 expref: 30 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.374429:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed68800/0xfb36a14ee608d28b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f679 expref: 30 pid: 8452 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066802.374440:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976958848:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066802.374563:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.380227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.380407:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977221120 00000100:00100000:3.0:1746066802.380416:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977221120 00010000:00010000:3.0:1746066802.380451:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed68800/0xfb36a14ee608d28b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f679 expref: 31 pid: 8452 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746066802.380486:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7866 00000100:00100000:3.0:1746066802.380495:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+31:1963:x1830882977221120:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066802.380510:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066802.380545:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed68800/0xfb36a14ee608d28b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f679 expref: 31 pid: 8452 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746066802.380557:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed68800/0xfb36a14ee608d28b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f679 expref: 31 pid: 8452 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746066802.380581:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.380583:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.380590:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 38 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.380607:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 38 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.380645:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 38 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066802.380657:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976958976:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066802.380797:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961bd80 going to sleep for 11 seconds 00010000:00010000:2.0:1746066802.380845:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed68800/0xfb36a14ee608d28b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f679 expref: 31 pid: 8452 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066802.380861:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976958848:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.380878:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 38 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.380886:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18f200, rc 0) 00000100:00100000:2.0:1746066802.380908:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:31929:x1830882977220992:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6595us (7566us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.380914:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15252 00000100:00100000:0.0:1746066802.386790:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.386936:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976958976:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066802.386957:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.387026:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+30:1963:x1830882977221120:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6530us (6805us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.387036:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7866 00000100:00100000:2.0:1746066802.387133:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977221376 00000100:00100000:2.0:1746066802.387139:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977221376 00002000:00100000:2.0:1746066802.387170:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (856064->860159) req@ffff8800924d2300 x1830882977221376/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.387178:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d2300 with x1830882977221376 ext(856064->860159) 00002000:00010000:2.0:1746066802.387181:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d2300 00000100:00100000:2.0:1746066802.387203:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6929 00000100:00100000:2.0:1746066802.387209:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882977221376:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066802.387345:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882977221376:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 136us (564us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066802.387351:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6929 00002000:00100000:2.0:1746066802.387355:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (856064->860159) req@ffff8800924d2300 x1830882977221376/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/4536 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.387361:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d2300 with x1830882977221376 ext(856064->860159) 00002000:00010000:2.0:1746066802.387364:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d2300 00000100:00100000:0.0:1746066802.393837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.393962:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977221504 00000100:00100000:2.0:1746066802.393972:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977221504 00000100:00100000:2.0:1746066802.394040:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15253 00000100:00100000:2.0:1746066802.394050:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31929:x1830882977221504:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066802.394068:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.394086:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f6aa expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.394118:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092183600/0xfb36a14ee608d299 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f680 expref: 19 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.394125:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.394127:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.394131:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->1118207] (req 1048576->1118207) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 26 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.394164:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092183600/0xfb36a14ee608d299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f680 expref: 19 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.394182:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092183600/0xfb36a14ee608d299 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f680 expref: 19 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066802.394194:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976959104:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066802.395469:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.402021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.402045:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976959104:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.402069:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->1118207] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 26 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.402082:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18e200, rc 0) 00000100:00100000:2.0:1746066802.402130:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31929:x1830882977221504:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 8082us (8302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.402137:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15253 00000100:00100000:3.0:1746066802.402313:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977221632 00000100:00100000:3.0:1746066802.402319:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977221632 00010000:00010000:3.0:1746066802.402343:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092183600/0xfb36a14ee608d299 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f680 expref: 20 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746066802.402979:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7867 00000100:00100000:3.0:1746066802.402986:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977221632:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066802.402995:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066802.403010:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092183600/0xfb36a14ee608d299 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f680 expref: 20 pid: 20532 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746066802.403020:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092183600/0xfb36a14ee608d299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f680 expref: 20 pid: 20532 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746066802.403037:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092183600/0xfb36a14ee608d299 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f680 expref: 20 pid: 20532 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746066802.403054:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.403056:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.403061:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 25 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.403068:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 25 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.403095:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 25 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066802.403105:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976959232:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066802.404800:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.407342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.407427:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976959232:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066802.407442:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.407486:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977221632:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4500us (5471us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.407495:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7867 00000100:00100000:2.0:1746066802.407858:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977221888 00000100:00100000:2.0:1746066802.407864:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977221888 00002000:00100000:2.0:1746066802.407894:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (1114112->1118207) req@ffff8800924d1180 x1830882977221888/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.407901:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d1180 with x1830882977221888 ext(1114112->1118207) 00002000:00010000:2.0:1746066802.407905:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d1180 00000100:00100000:2.0:1746066802.407918:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6930 00000100:00100000:2.0:1746066802.407923:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977221888:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066802.408048:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977221888:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 123us (711us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066802.408056:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6930 00002000:00100000:2.0:1746066802.408061:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (1114112->1118207) req@ffff8800924d1180 x1830882977221888/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/4536 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.408067:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d1180 with x1830882977221888 ext(1114112->1118207) 00002000:00010000:2.0:1746066802.408069:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d1180 00000100:00100000:0.0:1746066802.472580:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.472625:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.472700:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977222144 00000100:00100000:3.0:1746066802.472708:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977222144 00000100:00100000:3.0:1746066802.472752:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977222016 00000100:00100000:3.0:1746066802.472754:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977222016 00000100:00100000:3.0:1746066802.472777:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15254 00000100:00100000:3.0:1746066802.472784:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977222144:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066802.472800:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.472815:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092183e00/0xfb36a14ee608d2d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f6b8 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066802.472855:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976959360:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066802.472920:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066802.473069:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15255 00000100:00100000:2.0:1746066802.473076:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+30:1963:x1830882977222016:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066802.473083:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.473092:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d18ee00/0xfb36a14ee608d2d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f6b1 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066802.473113:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976959488:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066802.473137:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c480 going to sleep for 11 seconds 00002000:00010000:3.0:1746066802.475782:0:10402:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime: 1746066800 -> 1746066802 00002000:00010000:3.0:1746066802.475788:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime: 1746066800 -> 1746066801 00002000:00010000:3.0:1746066802.475790:0:10402:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime: 1746066800 -> 1746066802 00000100:00100000:3.0:1746066802.475809:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976959360:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066802.475832:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092183e00/0xfb36a14ee608d2d1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6b8 expref: 20 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.475843:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092183e00/0xfb36a14ee608d2d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6b8 expref: 20 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.475868:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092183e00, rc 0) 00000100:00100000:3.0:1746066802.475906:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977222144:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3121us (3332us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066802.475913:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15254 00002000:00010000:2.0:1746066802.477884:0:8112:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime: 1746066801 -> 1746066802 00002000:00010000:2.0:1746066802.477889:0:8112:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime: 1746066801 -> 1746066802 00000100:00100000:2.0:1746066802.477908:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976959488:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066802.477933:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d18ee00/0xfb36a14ee608d2d8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6b1 expref: 31 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.477944:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d18ee00/0xfb36a14ee608d2d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6b1 expref: 31 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.477967:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18ee00, rc 0) 00000100:00100000:2.0:1746066802.478356:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+30:1963:x1830882977222016:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5278us (5728us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066802.478364:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15255 00000100:00100000:0.0:1746066802.480111:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.480145:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.481174:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.481459:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.481489:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977222272 00000100:00100000:2.0:1746066802.481496:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977222272 00000100:00100000:2.0:1746066802.481539:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977222400 00000100:00100000:2.0:1746066802.481541:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977222400 00000100:00100000:2.0:1746066802.481560:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977222528 00000100:00100000:2.0:1746066802.481561:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977222528 00000100:00100000:2.0:1746066802.481575:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15256 00000100:00100000:2.0:1746066802.481582:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977222272:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066802.481595:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.481608:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d18f400/0xfb36a14ee608d2df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f6bf expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.481626:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.481628:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.481634:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d18f400/0xfb36a14ee608d2df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6bf expref: 27 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.481646:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d18f400/0xfb36a14ee608d2df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6bf expref: 27 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.481654:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18f400, rc 0) 00000100:00100000:2.0:1746066802.481706:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977222272:12345-192.168.202.57@tcp:101:cat.0 Request processed in 124us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.481710:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15256 00000100:00100000:2.0:1746066802.481725:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15257 00000100:00100000:2.0:1746066802.481729:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1964:x1830882977222400:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066802.481737:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.481745:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d18fe00/0xfb36a14ee608d2e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f6c6 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.481754:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.481755:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.481758:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18fe00/0xfb36a14ee608d2e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6c6 expref: 40 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.481766:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d18fe00/0xfb36a14ee608d2e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6c6 expref: 40 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.481771:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18fe00, rc 0) 00000100:00100000:2.0:1746066802.481786:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1964:x1830882977222400:12345-192.168.202.57@tcp:101:cat.0 Request processed in 57us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.481790:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15257 00000100:00100000:2.0:1746066802.481800:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15258 00000100:00100000:2.0:1746066802.481803:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1964:x1830882977222528:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066802.481807:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.481812:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d18e400/0xfb36a14ee608d2ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f6cd expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.481819:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.481820:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.481824:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18e400/0xfb36a14ee608d2ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6cd expref: 40 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.481831:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d18e400/0xfb36a14ee608d2ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6cd expref: 40 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.481837:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18e400, rc 0) 00000100:00100000:2.0:1746066802.481849:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1964:x1830882977222528:12345-192.168.202.57@tcp:101:cat.0 Request processed in 46us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.481854:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15258 00000100:00100000:0.0:1746066802.482002:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.482044:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977222656 00000100:00100000:0.0:1746066802.482047:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977222656 00000100:00100000:0.0:1746066802.482061:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977222784 00000100:00100000:0.0:1746066802.482063:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977222784 00000100:00100000:0.0:1746066802.482074:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15259 00000100:00100000:0.0:1746066802.482078:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977222656:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066802.482085:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.482092:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c600/0xfb36a14ee608d2f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f6d4 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.482101:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.482102:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.482106:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c600/0xfb36a14ee608d2f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6d4 expref: 28 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.482113:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c600/0xfb36a14ee608d2f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6d4 expref: 28 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.482119:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3c600, rc 0) 00000100:00100000:0.0:1746066802.482137:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977222656:12345-192.168.202.57@tcp:101:cat.0 Request processed in 59us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.482142:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15259 00000100:00100000:0.0:1746066802.482151:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15260 00000100:00100000:0.0:1746066802.482155:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+30:31937:x1830882977222784:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066802.482161:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.482167:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608d2fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f6db expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.482181:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 39 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.482187:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066802.482188:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066802.482191:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608d2fb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6db expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.482213:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 39 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.482223:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 39 pid: 8112 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746066802.482232:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c22ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976959616:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.482269:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42ab540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066802.487148:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c22ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976959616:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.487177:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608d2fb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6db expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.487191:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb3c400, rc 0) 00000100:00100000:2.0:1746066802.487236:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+31:31937:x1830882977222784:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5079us (5234us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.487244:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15260 00000100:00100000:0.0:1746066802.498569:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.498895:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977222912 00000100:00100000:2.0:1746066802.498904:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977222912 00002000:00100000:2.0:1746066802.498944:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (856064->1048575) req@ffff88012c22fb80 x1830882977222912/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.498952:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22fb80 with x1830882977222912 ext(856064->1048575) 00010000:00010000:2.0:1746066802.498959:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 40 pid: 8112 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.498971:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 40 pid: 8112 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746066802.498976:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c22fb80 00000100:00100000:2.0:1746066802.499005:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2240 00000100:00100000:2.0:1746066802.499011:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1964:x1830882977222912:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066802.501148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.501216:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977223424 00000100:00100000:2.0:1746066802.501222:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977223424 00002000:00100000:2.0:1746066802.501249:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (1118208->2097151) req@ffff88012c22ea00 x1830882977223424/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.501258:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22ea00 with x1830882977223424 ext(1118208->2097151) 00002000:00010000:2.0:1746066802.501262:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c22ea00 00000100:00100000:2.0:1746066802.501277:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6931 00000100:00100000:2.0:1746066802.501283:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977223424:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066802.506494:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.506530:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.506598:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977223680 00000100:00100000:3.0:1746066802.506607:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977223680 00002000:00100000:3.0:1746066802.506640:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88012c52b480 x1830882977223680/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.506648:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52b480 with x1830882977223680 ext(1048576->2097151) 00002000:00010000:3.0:1746066802.506652:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c52b480 00000100:00100000:3.0:1746066802.506665:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977223936 00000100:00100000:3.0:1746066802.506667:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977223936 00002000:00100000:3.0:1746066802.506693:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88012c528e00 x1830882977223936/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.506700:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c528e00 with x1830882977223936 ext(1048576->2097151) 00002000:00010000:3.0:1746066802.506702:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c528e00 00000100:00100000:3.0:1746066802.506713:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6932 00000100:00100000:3.0:1746066802.506719:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977223680:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066802.507638:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6933 00000100:00100000:3.0:1746066802.507644:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1963:x1830882977223936:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066802.513551:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.513920:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977223424:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12633us (12775us total) trans 0 rc 978944/978944 00000100:00100000:2.0:1746066802.513930:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6931 00002000:00100000:2.0:1746066802.513941:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (1118208->2097151) req@ffff88012c22ea00 x1830882977223424/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 978944/978944 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.513950:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22ea00 with x1830882977223424 ext(1118208->2097151) 00002000:00010000:2.0:1746066802.513955:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c22ea00 00000100:00100000:2.0:1746066802.513977:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977223168 00000100:00100000:2.0:1746066802.513983:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977223168 00002000:00100000:2.0:1746066802.514010:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (0->856063) req@ffff8800921c2d80 x1830882977223168/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.514016:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c2d80 with x1830882977223168 ext(0->856063) 00010000:00010000:2.0:1746066802.514022:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 44 pid: 8112 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.514039:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 44 pid: 8112 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746066802.514044:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800921c2d80 00000100:00100000:2.0:1746066802.514058:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2241 00000100:00100000:2.0:1746066802.514065:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+44:1964:x1830882977223168:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066802.515293:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+46:1964:x1830882977222912:12345-192.168.202.57@tcp:4:cat.0 Request processed in 16279us (16728us total) trans 17179873742 rc 0/0 00000100:00100000:0.0:1746066802.515299:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2240 00002000:00100000:0.0:1746066802.515306:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (856064->1048575) req@ffff88012c22fb80 x1830882977222912/t17179873742(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/448 e 0 to 0 dl 1746066813 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.515312:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22fb80 with x1830882977222912 ext(856064->1048575) 00010000:00010000:0.0:1746066802.515318:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 46 pid: 8112 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.515328:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 46 pid: 8112 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746066802.515333:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c22fb80 00000100:00100000:0.0:1746066802.531863:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.531895:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977224064 00000100:00100000:0.0:1746066802.531900:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977224064 00000100:00100000:0.0:1746066802.531931:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15261 00000100:00100000:0.0:1746066802.531936:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+31:31926:x1830882977224064:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066802.531949:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.531961:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f6e2 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.531981:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092183800/0xfb36a14ee608d2a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f695 expref: 32 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.531988:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d18e400/0xfb36a14ee608d2ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6cd expref: 45 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.531993:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.531994:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.531997:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3125248->3145727] (req 3125248->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 32 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.532020:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d18e400/0xfb36a14ee608d2ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6cd expref: 45 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.532029:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d18e400/0xfb36a14ee608d2ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6cd expref: 45 pid: 8451 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746066802.532030:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977223680:12345-192.168.202.57@tcp:3:cat.0 Request processed in 25310us (25543us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066802.532038:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6932 00000100:00100000:0.0:1746066802.532038:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976959744:192.168.202.57@tcp:104: 00002000:00100000:3.0:1746066802.532045:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88012c52b480 x1830882977223680/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.532052:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52b480 with x1830882977223680 ext(1048576->2097151) 00002000:00010000:3.0:1746066802.532055:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c52b480 00010000:00010000:0.0:1746066802.532100:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092183800/0xfb36a14ee608d2a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f695 expref: 32 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.532108:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092183800/0xfb36a14ee608d2a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f695 expref: 32 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746066802.532115:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976959872:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066802.532668:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+44:1963:x1830882977223936:12345-192.168.202.57@tcp:3:cat.0 Request processed in 25023us (26136us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066802.532696:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6933 00002000:00100000:2.0:1746066802.532702:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88012c528e00 x1830882977223936/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.532708:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c528e00 with x1830882977223936 ext(1048576->2097151) 00002000:00010000:2.0:1746066802.532712:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c528e00 00000100:00100000:0.0:1746066802.535416:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42abc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066802.535755:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1964:x1830882977223168:12345-192.168.202.57@tcp:3:cat.0 Request processed in 21687us (22210us total) trans 0 rc 856064/856064 00000100:00100000:2.0:1746066802.535762:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2241 00002000:00100000:2.0:1746066802.535770:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (0->856063) req@ffff8800921c2d80 x1830882977223168/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:H/200/0 rc 856064/856064 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.535777:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c2d80 with x1830882977223168 ext(0->856063) 00010000:00010000:2.0:1746066802.535785:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 42 pid: 8112 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.535826:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 42 pid: 8112 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746066802.535833:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800921c2d80 00000100:00100000:0.0:1746066802.538922:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.538963:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.539034:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977224192 00000100:00100000:1.0:1746066802.539041:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977224192 00010000:00010000:1.0:1746066802.539069:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18e400/0xfb36a14ee608d2ed lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6cd expref: 42 pid: 8451 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066802.539092:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977224320 00000100:00100000:1.0:1746066802.539094:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977224320 00010000:00010000:1.0:1746066802.539103:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092183800/0xfb36a14ee608d2a7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f695 expref: 33 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746066802.539116:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7868 00000100:00100000:1.0:1746066802.539122:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1966:x1830882977224192:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066802.539132:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066802.539151:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d18e400/0xfb36a14ee608d2ed lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6cd expref: 42 pid: 8451 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066802.539160:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d18e400/0xfb36a14ee608d2ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6cd expref: 42 pid: 8451 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066802.539180:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066802.539212:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1966:x1830882977224192:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.539217:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7868 00000100:00100000:1.0:1746066802.539229:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7869 00000100:00100000:1.0:1746066802.539234:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+33:1965:x1830882977224320:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066802.539239:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066802.539246:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092183800/0xfb36a14ee608d2a7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f695 expref: 33 pid: 20532 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066802.539257:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092183800/0xfb36a14ee608d2a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f695 expref: 33 pid: 20532 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746066802.539267:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.539269:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.539273:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 33 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.539280:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 33 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.539304:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 33 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066802.539314:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c52b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976960000:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066802.539360:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dc540 going to sleep for 11 seconds 00010000:00010000:2.0:1746066802.539747:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d18e400/0xfb36a14ee608d2ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6cd expref: 41 pid: 8451 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066802.542409:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976959744:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.542441:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092183800/0xfb36a14ee608d2a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f695 expref: 33 pid: 20532 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066802.542454:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976959872:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.542479:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 32 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.542489:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebc8600, rc 0) 00000100:00100000:2.0:1746066802.542542:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+32:31926:x1830882977224064:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 10604us (10684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.542549:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15261 00000100:00100000:0.0:1746066802.544154:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.544216:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977224448 00000100:00100000:2.0:1746066802.544224:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977224448 00010000:00010000:2.0:1746066802.544252:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 41 pid: 8112 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066802.544283:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7870 00000100:00100000:2.0:1746066802.544290:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1963:x1830882977224448:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066802.544303:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066802.544323:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 41 pid: 8112 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.544333:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 41 pid: 8112 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.544351:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d18f200/0xfb36a14ee608d2c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 856064->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6a3 expref: 41 pid: 8112 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.544362:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.544364:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.544370:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608d2fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6db expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.544377:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608d2fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6db expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.544404:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608d2fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6db expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066802.544415:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976960128:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066802.544464:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066802.544715:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c52b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976960000:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066802.544728:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066802.544753:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+31:1965:x1830882977224320:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5518us (5789us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.544759:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7869 00000100:00100000:0.0:1746066802.546302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.546437:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977224704 00000100:00100000:2.0:1746066802.546442:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977224704 00002000:00100000:2.0:1746066802.546471:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3125248->3129343) req@ffff8800921c2a00 x1830882977224704/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.546478:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c2a00 with x1830882977224704 ext(3125248->3129343) 00002000:00010000:2.0:1746066802.546482:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921c2a00 00000100:00100000:2.0:1746066802.546497:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6934 00000100:00100000:2.0:1746066802.546503:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+31:1965:x1830882977224704:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066802.547119:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976960128:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066802.547133:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066802.552399:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+31:1965:x1830882977224704:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 5884us (6087us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066802.552411:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6934 00002000:00100000:2.0:1746066802.552431:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3125248->3129343) req@ffff8800921c2a00 x1830882977224704/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/4536 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.552444:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c2a00 with x1830882977224704 ext(3125248->3129343) 00002000:00010000:2.0:1746066802.552449:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921c2a00 00000100:00100000:3.0:1746066802.552575:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977224448:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8283us (8425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.552584:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7870 00000100:00100000:0.0:1746066802.553323:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.553408:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977224960 00000100:00100000:2.0:1746066802.553414:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977224960 00002000:00100000:2.0:1746066802.553440:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff8800921c3b80 x1830882977224960/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.553447:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c3b80 with x1830882977224960 ext(0->1048575) 00002000:00010000:2.0:1746066802.553450:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921c3b80 00000100:00100000:2.0:1746066802.553471:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6935 00000100:00100000:2.0:1746066802.553477:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+31:1963:x1830882977224960:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066802.561018:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.561097:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977225088 00000100:00100000:2.0:1746066802.561103:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977225088 00000100:00100000:2.0:1746066802.561147:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15262 00000100:00100000:2.0:1746066802.561153:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:31926:x1830882977225088:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066802.561166:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.561181:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f6e9 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.561206:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d26f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f66b expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.561213:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c600/0xfb36a14ee608d2f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6d4 expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.561218:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.561220:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.561222:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3108863] (req 2097152->3108863) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 20 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.561246:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c600/0xfb36a14ee608d2f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6d4 expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.561254:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c600/0xfb36a14ee608d2f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6d4 expref: 27 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746066802.561263:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093212300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976960256:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066802.561335:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f66b expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.561342:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d26f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f66b expref: 20 pid: 8452 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066802.561348:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976960384:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066802.561363:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.564014:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.564232:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977225216 00000100:00100000:3.0:1746066802.564239:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977225216 00000100:00100000:3.0:1746066802.564274:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15263 00000100:00100000:3.0:1746066802.564280:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:31938:x1830882977225216:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066802.564294:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.564307:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac59e00/0xfb36a14ee608d310 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f6f0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.564329:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 32 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.564339:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066802.564340:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066802.564343:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac59e00/0xfb36a14ee608d310 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f0 expref: 41 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.564365:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 32 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.564373:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 32 pid: 21203 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.564381:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976960512:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066802.565881:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066802.566116:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093212300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976960256:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066802.566809:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+31:1963:x1830882977224960:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 13328us (13484us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066802.566819:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6935 00002000:00100000:2.0:1746066802.566829:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff8800921c3b80 x1830882977224960/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.566837:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c3b80 with x1830882977224960 ext(0->1048575) 00002000:00010000:2.0:1746066802.566841:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921c3b80 00000100:00100000:0.0:1746066802.568003:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.568153:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977225344 00000100:00100000:2.0:1746066802.568158:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977225344 00010000:00010000:2.0:1746066802.568183:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c600/0xfb36a14ee608d2f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6d4 expref: 28 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746066802.568259:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976960384:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066802.568279:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3108863] (req 2097152->3108863) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 20 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.568289:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e96e400, rc 0) 00000100:00100000:3.0:1746066802.568318:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:31926:x1830882977225088:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 7165us (7308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.568324:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15262 00000100:00100000:2.0:1746066802.568450:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7871 00000100:00100000:2.0:1746066802.568455:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882977225344:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066802.568465:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066802.568481:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c600/0xfb36a14ee608d2f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6d4 expref: 28 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746066802.568490:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c600/0xfb36a14ee608d2f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6d4 expref: 28 pid: 21203 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746066802.568505:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cb3c600/0xfb36a14ee608d2f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6d4 expref: 28 pid: 21203 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746066802.569079:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976960512:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066802.569093:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac59e00/0xfb36a14ee608d310 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f0 expref: 41 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.569102:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac59e00, rc 0) 00010000:00010000:2.0:1746066802.569181:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.569243:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:31938:x1830882977225216:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4962us (5235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.569249:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15263 00000100:00100000:2.0:1746066802.569316:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1966:x1830882977225344:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 860us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.569322:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7871 00000100:00100000:2.0:1746066802.573445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.573477:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.573543:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.573562:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977225600 00000100:00100000:2.0:1746066802.573568:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977225600 00010000:00010000:2.0:1746066802.573595:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d26f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f66b expref: 20 pid: 8452 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066802.573616:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7872 00000100:00100000:2.0:1746066802.573622:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977225600:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066802.573633:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066802.573649:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d26f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f66b expref: 20 pid: 8452 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.573659:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f66b expref: 20 pid: 8452 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.573697:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d26f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f66b expref: 20 pid: 8452 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.573708:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.573709:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.573714:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3108863) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.573725:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3108863) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.573750:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3108863) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066802.573759:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976960640:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066802.573818:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.573823:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977225472 00000100:00100000:0.0:1746066802.573827:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977225472 00002000:00100000:0.0:1746066802.573853:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3125248->3145727) req@ffff880093213b80 x1830882977225472/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.573861:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093213b80 with x1830882977225472 ext(3125248->3145727) 00010000:00010000:0.0:1746066802.573868:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 31 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.573877:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 31 pid: 21203 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746066802.573888:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093213b80 00000100:00100000:0.0:1746066802.573908:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2242 00000100:00100000:0.0:1746066802.573914:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+31:1964:x1830882977225472:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066802.574365:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977225728 00000100:00100000:3.0:1746066802.574369:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977225728 00000100:00100000:3.0:1746066802.574389:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15264 00000100:00100000:3.0:1746066802.574394:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+20:31937:x1830882977225728:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066802.574402:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.574411:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac59a00/0xfb36a14ee608d317 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f6f7 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.574425:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 26 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.574430:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066802.574432:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066802.574434:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac59a00/0xfb36a14ee608d317 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f7 expref: 21 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.574503:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 26 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.574512:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 26 pid: 8112 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.574536:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976960768:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066802.574574:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.577146:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+33:1964:x1830882977225472:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 3227us (3703us total) trans 17179873743 rc 0/0 00000100:00100000:0.0:1746066802.577155:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2242 00002000:00100000:0.0:1746066802.577165:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3125248->3145727) req@ffff880093213b80 x1830882977225472/t17179873743(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/448 e 0 to 0 dl 1746066813 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.577173:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093213b80 with x1830882977225472 ext(3125248->3145727) 00010000:00010000:0.0:1746066802.577182:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 33 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.577191:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 33 pid: 21203 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746066802.577196:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093213b80 00000100:00100000:0.0:1746066802.577306:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.577321:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977225856 00000100:00100000:0.0:1746066802.577325:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977225856 00000100:00100000:3.0:1746066802.577328:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976960768:192.168.202.57@tcp:104: 00002000:00100000:0.0:1746066802.577344:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->1118207) req@ffff880135df9f80 x1830882977225856/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746066802.577347:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac59a00/0xfb36a14ee608d317 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f7 expref: 21 pid: 21973 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746066802.577350:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9f80 with x1830882977225856 ext(1048576->1118207) 00010000:00010000:0.0:1746066802.577354:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 27 pid: 8112 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.577359:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac59a00, rc 0) 00010000:00010000:0.0:1746066802.577361:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 27 pid: 8112 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746066802.577366:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135df9f80 00000100:00100000:3.0:1746066802.577376:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+21:31937:x1830882977225728:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2982us (3898us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.577377:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2243 00000100:00100000:3.0:1746066802.577381:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15264 00000100:00100000:0.0:1746066802.577383:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977225856:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066802.577408:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976960640:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066802.577417:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.577431:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977225600:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3810us (3914us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.577438:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7872 00000100:00100000:0.0:1746066802.580637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.581375:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977225984 00000100:00100000:3.0:1746066802.581383:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977225984 00010000:00010000:3.0:1746066802.581409:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 33 pid: 21203 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.581847:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7873 00000100:00100000:3.0:1746066802.581854:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+33:1964:x1830882977225984:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066802.581866:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066802.581878:0:7108:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066801 -> 1746066802 00002000:00010000:3.0:1746066802.581881:0:7108:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066801 -> 1746066802 00010000:00010000:3.0:1746066802.581885:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 33 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.581895:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 33 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.581913:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8600/0xfb36a14ee608d302 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e2 expref: 33 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.582014:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.582016:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.582022:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac59e00/0xfb36a14ee608d310 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f0 expref: 40 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.582030:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac59e00/0xfb36a14ee608d310 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f0 expref: 40 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.582055:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac59e00/0xfb36a14ee608d310 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f0 expref: 40 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066802.582065:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976960896:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066802.582454:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977225856:12345-192.168.202.57@tcp:4:cat.0 Request processed in 5070us (5148us total) trans 21474841042 rc 0/0 00000100:00100000:1.0:1746066802.582461:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2243 00002000:00100000:1.0:1746066802.582468:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->1118207) req@ffff880135df9f80 x1830882977225856/t21474841042(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/448 e 0 to 0 dl 1746066813 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.582476:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9f80 with x1830882977225856 ext(1048576->1118207) 00010000:00010000:1.0:1746066802.582482:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 29 pid: 8112 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.582532:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b180 going to sleep for 11 seconds 00010000:00010000:1.0:1746066802.583201:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 29 pid: 8112 timeout: 863 lvb_type: 0 00002000:00010000:1.0:1746066802.583208:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135df9f80 00000100:00100000:1.0:1746066802.586280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.586321:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.586342:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977226368 00000100:00100000:1.0:1746066802.586348:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977226368 00002000:00100000:1.0:1746066802.586381:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88012c529f80 x1830882977226368/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.586390:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c529f80 with x1830882977226368 ext(2097152->3145727) 00002000:00010000:1.0:1746066802.586395:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c529f80 00000100:00100000:1.0:1746066802.586410:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6936 00000100:00100000:1.0:1746066802.586416:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1965:x1830882977226368:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066802.588283:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976960896:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066802.588298:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.588325:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+32:1964:x1830882977225984:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6471us (7693us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.588334:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7873 00000100:00100000:3.0:1746066802.588356:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977226112 00000100:00100000:3.0:1746066802.588359:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977226112 00010000:00010000:3.0:1746066802.588377:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 29 pid: 8112 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.588392:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7874 00000100:00100000:3.0:1746066802.588397:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977226112:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066802.588405:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066802.588418:0:7108:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066801 -> 1746066802 00010000:00010000:3.0:1746066802.588423:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 29 pid: 8112 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.588432:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 29 pid: 8112 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.588450:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d18e200/0xfb36a14ee608d2ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6aa expref: 29 pid: 8112 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.588462:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.588464:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.588470:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac59a00/0xfb36a14ee608d317 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f7 expref: 19 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.588477:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac59a00/0xfb36a14ee608d317 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f7 expref: 19 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.588503:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac59a00/0xfb36a14ee608d317 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f7 expref: 19 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066802.588514:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976961024:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066802.588574:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.590359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.590454:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977226624 00000100:00100000:2.0:1746066802.590460:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977226624 00002000:00100000:2.0:1746066802.590490:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3104768->3108863) req@ffff880135df9c00 x1830882977226624/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.590499:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9c00 with x1830882977226624 ext(3104768->3108863) 00002000:00010000:2.0:1746066802.590503:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135df9c00 00000100:00100000:2.0:1746066802.590538:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6937 00000100:00100000:2.0:1746066802.590544:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977226624:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066802.591537:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977226624:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 990us (1180us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066802.591545:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6937 00002000:00100000:2.0:1746066802.591552:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3104768->3108863) req@ffff880135df9c00 x1830882977226624/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/4536 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.591558:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9c00 with x1830882977226624 ext(3104768->3108863) 00002000:00010000:2.0:1746066802.591562:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135df9c00 00000100:00100000:1.0:1746066802.594424:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1965:x1830882977226368:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8000us (8095us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066802.594433:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6936 00002000:00100000:1.0:1746066802.594441:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88012c529f80 x1830882977226368/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.594449:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c529f80 with x1830882977226368 ext(2097152->3145727) 00002000:00010000:1.0:1746066802.594454:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c529f80 00000100:00100000:3.0:1746066802.596423:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976961024:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066802.596437:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.596464:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977226112:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8065us (10188us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.596472:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7874 00000100:00100000:0.0:1746066802.602507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.602673:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977226752 00000100:00100000:3.0:1746066802.602705:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977226752 00000100:00100000:3.0:1746066802.603305:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15265 00000100:00100000:3.0:1746066802.603313:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31938:x1830882977226752:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066802.603327:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.603341:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac59800/0xfb36a14ee608d31e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f6fe expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.603365:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3108863) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.603372:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066802.603373:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066802.603377:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac59800/0xfb36a14ee608d31e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6fe expref: 29 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.603406:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3108863) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.603416:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3108863) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 19 pid: 21203 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.603426:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976961152:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066802.603644:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.607562:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.607632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.607732:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976961152:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066802.607757:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac59800/0xfb36a14ee608d31e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6fe expref: 29 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.607772:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac59800, rc 0) 00000100:00100000:3.0:1746066802.607809:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:31938:x1830882977226752:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4498us (5310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.607817:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15265 00000100:00100000:1.0:1746066802.607844:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977227008 00000100:00100000:1.0:1746066802.607849:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977227008 00002000:00100000:1.0:1746066802.607879:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880135dfb100 x1830882977227008/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.607887:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfb100 with x1830882977227008 ext(1048576->2097151) 00002000:00010000:1.0:1746066802.607890:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135dfb100 00000100:00100000:1.0:1746066802.607910:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977227264 00000100:00100000:1.0:1746066802.607912:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977227264 00000100:00100000:2.0:1746066802.607917:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6938 00002000:00100000:1.0:1746066802.607922:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880135dfaa00 x1830882977227264/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746066802.607924:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977227008:12345-192.168.202.57@tcp:3:multiop.0 00002000:00100000:1.0:1746066802.607928:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfaa00 with x1830882977227264 ext(1048576->2097151) 00002000:00010000:1.0:1746066802.607931:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135dfaa00 00000100:00100000:1.0:1746066802.607940:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6939 00000100:00100000:1.0:1746066802.607944:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977227264:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066802.613275:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.613317:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.613759:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977227648 00000100:00100000:3.0:1746066802.613768:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977227648 00002000:00100000:3.0:1746066802.613811:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff880135dfa300 x1830882977227648/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.613821:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfa300 with x1830882977227648 ext(1048576->2097151) 00002000:00010000:3.0:1746066802.613828:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135dfa300 00000100:00100000:3.0:1746066802.613846:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977227520 00000100:00100000:3.0:1746066802.613848:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977227520 00002000:00100000:3.0:1746066802.613860:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3108863) req@ffff880135dfb800 x1830882977227520/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.613866:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfb800 with x1830882977227520 ext(2097152->3108863) 00010000:00010000:3.0:1746066802.613873:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 24 pid: 21203 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746066802.613921:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6940 00000100:00100000:1.0:1746066802.613930:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+32:1964:x1830882977227648:12345-192.168.202.57@tcp:3:multiop.0 00010000:00010000:3.0:1746066802.614060:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 24 pid: 21203 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746066802.614068:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135dfb800 00000100:00100000:3.0:1746066802.614107:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2244 00000100:00100000:3.0:1746066802.614112:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977227520:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:1.0:1746066802.626566:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977227264:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 18611us (18924us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066802.626576:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6939 00002000:00100000:1.0:1746066802.626586:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff880135dfaa00 x1830882977227264/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.626594:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfaa00 with x1830882977227264 ext(1048576->2097151) 00002000:00010000:1.0:1746066802.626599:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135dfaa00 00000100:00100000:3.0:1746066802.627451:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977227008:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 19526us (19892us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066802.627457:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6938 00002000:00100000:3.0:1746066802.627462:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880135dfb100 x1830882977227008/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.627469:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfb100 with x1830882977227008 ext(1048576->2097151) 00002000:00010000:3.0:1746066802.627472:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135dfb100 00000100:00100000:1.0:1746066802.631191:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+32:1964:x1830882977227648:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 17254us (17915us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066802.631203:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6940 00002000:00100000:1.0:1746066802.631212:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff880135dfa300 x1830882977227648/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.631221:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfa300 with x1830882977227648 ext(1048576->2097151) 00002000:00010000:1.0:1746066802.631225:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135dfa300 00000100:00100000:3.0:1746066802.642344:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977227520:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 28222us (29017us total) trans 21474841043 rc 0/0 00000100:00100000:3.0:1746066802.642356:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2244 00002000:00100000:3.0:1746066802.642367:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3108863) req@ffff880135dfb800 x1830882977227520/t21474841043(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/448 e 0 to 0 dl 1746066813 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.642382:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfb800 with x1830882977227520 ext(2097152->3108863) 00010000:00010000:3.0:1746066802.642391:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 22 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.642405:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 22 pid: 21203 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746066802.642412:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135dfb800 00000100:00100000:0.0:1746066802.642911:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.643058:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977227776 00000100:00100000:3.0:1746066802.643064:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977227776 00000100:00100000:3.0:1746066802.643099:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15266 00000100:00100000:3.0:1746066802.643104:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+32:31937:x1830882977227776:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066802.643117:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.643130:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac59000/0xfb36a14ee608d325 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f705 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.643148:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.643149:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.643155:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac59000/0xfb36a14ee608d325 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f705 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.643165:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac59000/0xfb36a14ee608d325 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f705 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.643172:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac59000, rc 0) 00000100:00100000:3.0:1746066802.643206:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+33:31937:x1830882977227776:12345-192.168.202.57@tcp:101:cat.0 Request processed in 102us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.643211:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15266 00000100:00100000:0.0:1746066802.644714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.644919:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977227904 00000100:00100000:3.0:1746066802.644925:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977227904 00010000:00010000:3.0:1746066802.644945:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 22 pid: 21203 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.644966:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7875 00000100:00100000:3.0:1746066802.644971:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977227904:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066802.644982:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066802.644996:0:7108:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066801 -> 1746066802 00002000:00010000:3.0:1746066802.644999:0:7108:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066801 -> 1746066802 00010000:00010000:3.0:1746066802.645003:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 22 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.645012:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3108863) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 22 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.645029:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e96e400/0xfb36a14ee608d309 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3108863) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6e9 expref: 22 pid: 21203 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.645056:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.645058:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.645112:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac59800/0xfb36a14ee608d31e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6fe expref: 28 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.645120:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac59800/0xfb36a14ee608d31e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6fe expref: 28 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.645146:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac59800/0xfb36a14ee608d31e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6fe expref: 28 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066802.645155:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976961280:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066802.645224:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066802.647996:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976961280:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066802.648014:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.648575:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977227904:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3601us (3862us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.648584:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7875 00000100:00100000:0.0:1746066802.660347:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.660380:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.660403:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.660437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.660646:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977228416 00000100:00100000:1.0:1746066802.660646:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977228288 00000100:00100000:3.0:1746066802.660653:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977228416 00000100:00100000:1.0:1746066802.660653:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977228288 00002000:00100000:3.0:1746066802.660710:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135df9500 x1830882977228416/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.660718:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9500 with x1830882977228416 ext(3145728->4194303) 00002000:00010000:3.0:1746066802.660722:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135df9500 00000100:00100000:0.0:1746066802.660733:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977228672 00000100:00100000:0.0:1746066802.660737:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977228672 00000100:00100000:3.0:1746066802.660742:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977228928 00000100:00100000:3.0:1746066802.660744:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977228928 00000100:00100000:0.0:1746066802.660750:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6941 00000100:00100000:0.0:1746066802.660757:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977228416:12345-192.168.202.57@tcp:3:cat.0 00002000:00100000:3.0:1746066802.661740:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880135df8000 x1830882977228928/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.661740:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880135dfa680 x1830882977228288/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.661748:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df8000 with x1830882977228928 ext(2097152->3145727) 00002000:00100000:1.0:1746066802.661749:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfa680 with x1830882977228288 ext(2097152->3145727) 00002000:00010000:3.0:1746066802.661752:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135df8000 00002000:00010000:1.0:1746066802.661752:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135dfa680 00002000:00100000:2.0:1746066802.661764:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135df8700 x1830882977228672/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066802.661765:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6942 00000100:00100000:3.0:1746066802.661769:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6943 00002000:00100000:2.0:1746066802.661771:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df8700 with x1830882977228672 ext(3145728->4194303) 00000100:00100000:1.0:1746066802.661771:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882977228288:12345-192.168.202.57@tcp:3:cat.0 00002000:00010000:2.0:1746066802.661774:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135df8700 00000100:00100000:3.0:1746066802.661775:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+33:1963:x1830882977228928:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066802.661787:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6944 00000100:00100000:2.0:1746066802.661791:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1963:x1830882977228672:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066802.680278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.680347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.680363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.680382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.680410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.680415:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977229184 00000100:00100000:0.0:1746066802.680422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.680423:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977229184 00000100:00100000:2.0:1746066802.680452:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977229440 00000100:00100000:2.0:1746066802.680454:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977229440 00000100:00100000:2.0:1746066802.680468:0:14548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977229312 00000100:00100000:2.0:1746066802.680469:0:14548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977229312 00000100:00100000:0.0:1746066802.680477:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 220 00000100:00100000:0.0:1746066802.680484:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:1966:x1830882977229184:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1746066802.680542:0:14548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 221 00000100:00100000:0.0:1746066802.680548:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:1966:x1830882977229184:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 64us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.680549:0:14548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1966:x1830882977229440:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:0.0:1746066802.680553:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 220 00000100:00100000:0.0:1746066802.680568:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 222 00000100:00100000:0.0:1746066802.680573:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977229312:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1746066802.680575:0:14548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1966:x1830882977229440:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 28us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.680581:0:14548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 221 00000100:00100000:0.0:1746066802.680594:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977229312:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 21us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.680596:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977229696 00000100:00100000:0.0:1746066802.680598:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 222 00000100:00100000:2.0:1746066802.680599:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977229696 00000100:00100000:2.0:1746066802.680614:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977229568 00000100:00100000:2.0:1746066802.680616:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977229568 00000100:00100000:2.0:1746066802.680628:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 364 00000100:00100000:1.0:1746066802.680663:0:14544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977229056 00000100:00100000:1.0:1746066802.680667:0:14544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977229056 00000100:00100000:1.0:1746066802.680705:0:14544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 223 00000100:00100000:1.0:1746066802.680709:0:14544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a530d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69ee3f12-76db-44fe-a8c9-a42ead582d61+15:1966:x1830882977229056:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1746066802.680729:0:14544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a530d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69ee3f12-76db-44fe-a8c9-a42ead582d61+15:1966:x1830882977229056:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 20us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.680734:0:14544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 223 00000100:00100000:2.0:1746066802.680787:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977229696:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1746066802.680811:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977229696:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 26us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.681036:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 365 00000100:00100000:1.0:1746066802.681043:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977229568:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:2.0:1746066802.681174:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 364 00000100:00100000:0.0:1746066802.684087:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1963:x1830882977228672:12345-192.168.202.57@tcp:3:cat.0 Request processed in 22285us (23673us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066802.684098:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6944 00002000:00100000:0.0:1746066802.684110:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880135df8700 x1830882977228672/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.684119:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df8700 with x1830882977228672 ext(3145728->4194303) 00002000:00010000:0.0:1746066802.684124:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135df8700 00000100:00100000:1.0:1746066802.684186:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977229568:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 3142us (3760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.684194:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 365 00000100:00100000:1.0:1746066802.686611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.686700:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977229824 00000100:00100000:3.0:1746066802.686709:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977229824 00000100:00100000:3.0:1746066802.686756:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10146 00000100:00100000:3.0:1746066802.686764:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:31942:x1830882977229824:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066802.686780:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.686797:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4a00/0xfb36a14ee608d32c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f70c expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.686850:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4c00/0xfb36a14ee608d333 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.686861:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4c00/0xfb36a14ee608d333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.686871:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4c00/0xfb36a14ee608d333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.686883:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4e00/0xfb36a14ee608d33a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.686888:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4e00/0xfb36a14ee608d33a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.686892:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4e00/0xfb36a14ee608d33a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.686989:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.686999:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f672 expref: 19 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.687010:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e600/0xfb36a14ee608d2b5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f69c expref: 267 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.687016:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.687046:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e600/0xfb36a14ee608d2b5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f69c expref: 267 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.687056:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e600/0xfb36a14ee608d2b5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f69c expref: 267 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.687066:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976961408:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066802.688725:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f672 expref: 19 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.688734:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f672 expref: 19 pid: 809 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.688744:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976961536:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066802.688793:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.689072:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882977228288:12345-192.168.202.57@tcp:3:cat.0 Request processed in 27300us (28729us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066802.689081:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6942 00002000:00100000:0.0:1746066802.689089:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880135dfa680 x1830882977228288/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.689097:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135dfa680 with x1830882977228288 ext(2097152->3145727) 00002000:00010000:0.0:1746066802.689101:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135dfa680 00000100:00100000:2.0:1746066802.690319:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977228416:12345-192.168.202.57@tcp:3:cat.0 Request processed in 29559us (29934us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066802.690326:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6941 00002000:00100000:2.0:1746066802.690333:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135df9500 x1830882977228416/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.690341:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9500 with x1830882977228416 ext(3145728->4194303) 00002000:00010000:2.0:1746066802.690345:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135df9500 00000100:00100000:0.0:1746066802.696615:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.696647:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.696711:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977230208 00000100:00100000:2.0:1746066802.696718:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977230208 00000100:00100000:2.0:1746066802.696754:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4259 00000100:00100000:2.0:1746066802.696760:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:7643:x1830882977230208:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066802.696957:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:7643:x1830882977230208:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 196us (347us total) trans 8589944230 rc 0/0 00000100:00100000:2.0:1746066802.696963:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4259 00000100:00100000:2.0:1746066802.696989:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977229952 00000100:00100000:2.0:1746066802.696992:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977229952 00000100:00100000:0.0:1746066802.697004:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+33:1963:x1830882977228928:12345-192.168.202.57@tcp:3:cat.0 Request processed in 35228us (36565us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746066802.697007:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e600/0xfb36a14ee608d2b5 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f69c expref: 268 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746066802.697012:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6943 00002000:00100000:0.0:1746066802.697020:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880135df8000 x1830882977228928/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746066802.697023:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7876 00000100:00100000:2.0:1746066802.697027:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:1966:x1830882977229952:12345-192.168.202.57@tcp:103:ldlm_bl.0 00002000:00100000:0.0:1746066802.697028:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df8000 with x1830882977228928 ext(2097152->3145727) 00002000:00010000:0.0:1746066802.697031:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135df8000 00010000:00010000:2.0:1746066802.697035:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066802.697039:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e600/0xfb36a14ee608d2b5 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f69c expref: 268 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.697048:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e600/0xfb36a14ee608d2b5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f69c expref: 268 pid: 14548 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.697065:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066802.697068:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066802.697075:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066802.697080:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066802.697085:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066802.697103:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:1966:x1830882977229952:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 75us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.697107:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7876 00010000:00010000:3.0:1746066802.697431:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e600/0xfb36a14ee608d2b5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f69c expref: 267 pid: 14548 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.697456:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976961408:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066802.697466:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976961536:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066802.697484:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:0.0:1746066802.700555:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.700644:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977230336 00000100:00100000:2.0:1746066802.700651:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977230336 00010000:00010000:2.0:1746066802.700694:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f672 expref: 21 pid: 809 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746066802.700713:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7877 00000100:00100000:2.0:1746066802.700718:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1965:x1830882977230336:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066802.700728:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066802.700733:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f672 expref: 21 pid: 809 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.700746:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f672 expref: 21 pid: 809 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.700764:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18fa00/0xfb36a14ee608d27d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f672 expref: 21 pid: 809 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746066802.700788:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066802.700793:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066802.700800:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066802.700806:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066802.700827:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066802.700863:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1965:x1830882977230336:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 144us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.700868:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7877 00010000:00010000:3.0:1746066802.701197:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701205:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:3.0:1746066802.701238:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066802.701242:0:809:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066802.701254:0:809:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701263:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701270:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4c00/0xfb36a14ee608d333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701275:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4c00/0xfb36a14ee608d333 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701280:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4c00/0xfb36a14ee608d333 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701284:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d0d4c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066802.701288:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4c00/0xfb36a14ee608d333 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701293:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4c00/0xfb36a14ee608d333 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701300:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066802.701302:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066802.701306:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4c00/0xfb36a14ee608d333 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701309:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4c00/0xfb36a14ee608d333 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701318:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4e00/0xfb36a14ee608d33a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701322:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4e00/0xfb36a14ee608d33a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701327:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4e00/0xfb36a14ee608d33a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701330:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d0d4e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066802.701332:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4e00/0xfb36a14ee608d33a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701336:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4e00/0xfb36a14ee608d33a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701340:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008c3c0c00) 00010000:00010000:3.0:1746066802.701342:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066802.701344:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4e00/0xfb36a14ee608d33a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701347:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4e00/0xfb36a14ee608d33a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.701374:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4a00/0xfb36a14ee608d32c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f70c expref: 16 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.701385:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f70c expref: 15 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.701391:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066802.701392:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066802.701394:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0d5000, rc 0) 00000100:00100000:3.0:1746066802.701902:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:31942:x1830882977229824:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 15137us (15298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.701909:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10146 00000100:00100000:0.0:1746066802.713424:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.714148:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977230464 00000100:00100000:1.0:1746066802.714156:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977230464 00000100:00100000:0.0:1746066802.715127:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.715216:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.715344:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977230720 00000100:00100000:1.0:1746066802.715349:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977230720 00000100:00100000:1.0:1746066802.715371:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15267 00000100:00100000:1.0:1746066802.715380:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1964:x1830882977230464:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066802.715394:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066802.715407:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed06400/0xfb36a14ee608d348 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f713 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.715423:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.715425:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.715431:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed06400/0xfb36a14ee608d348 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f713 expref: 42 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066802.715444:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed06400/0xfb36a14ee608d348 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f713 expref: 42 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066802.715453:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed06400, rc 0) 00000100:00100000:1.0:1746066802.715491:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1964:x1830882977230464:12345-192.168.202.57@tcp:101:cat.0 Request processed in 113us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.715497:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15267 00000100:00100000:1.0:1746066802.715510:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15268 00000100:00100000:1.0:1746066802.715524:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1965:x1830882977230720:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066802.715530:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066802.715535:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed06a00/0xfb36a14ee608d34f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f721 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.715544:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.715545:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.715549:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed06a00/0xfb36a14ee608d34f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f721 expref: 12 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066802.715556:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed06a00/0xfb36a14ee608d34f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f721 expref: 12 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066802.715561:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed06a00, rc 0) 00000100:00100000:1.0:1746066802.715575:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977230720:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 60us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.715579:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15268 00000100:00100000:2.0:1746066802.716042:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977230976 00000100:00100000:2.0:1746066802.716047:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977230976 00000100:00100000:2.0:1746066802.716069:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15269 00000100:00100000:2.0:1746066802.716073:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1965:x1830882977230976:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066802.716080:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066802.716089:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xfb36a14ee608d356 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f72f expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066802.716099:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.716100:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066802.716105:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xfb36a14ee608d356 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f72f expref: 12 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.716113:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xfb36a14ee608d356 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f72f expref: 12 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066802.716119:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57af200, rc 0) 00000100:00100000:2.0:1746066802.716135:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977230976:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 61us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066802.716139:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15269 00000100:00100000:2.0:1746066802.716500:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.716533:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.716933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.717067:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977231232 00000100:00100000:3.0:1746066802.717071:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977231232 00000100:00100000:0.0:1746066802.717114:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977230848 00000100:00100000:0.0:1746066802.717117:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977230848 00000100:00100000:2.0:1746066802.717136:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977231104 00000100:00100000:2.0:1746066802.717138:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977231104 00000100:00100000:3.0:1746066802.717161:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15270 00000100:00100000:3.0:1746066802.717167:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882977231232:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066802.717175:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.717183:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d0d5600/0xfb36a14ee608d35d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f73d expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.717194:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.717195:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.717199:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0d5600/0xfb36a14ee608d35d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f73d expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.717208:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d0d5600/0xfb36a14ee608d35d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f73d expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.717214:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0d5600, rc 0) 00000100:00100000:3.0:1746066802.717235:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1965:x1830882977231232:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 68us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.717240:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15270 00000100:00100000:3.0:1746066802.717250:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15271 00000100:00100000:0.0:1746066802.717497:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15272 00000100:00100000:0.0:1746066802.717503:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882977231104:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066802.717510:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066802.717526:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1965:x1830882977230848:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066802.717527:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8400/0xfb36a14ee608d364 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f736 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.717533:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.717536:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.717538:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.717540:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d0d4800/0xfb36a14ee608d36b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f728 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.717542:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8400/0xfb36a14ee608d364 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f736 expref: 14 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.717548:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.717550:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.717551:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8400/0xfb36a14ee608d364 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f736 expref: 14 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.717553:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0d4800/0xfb36a14ee608d36b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f728 expref: 13 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.717557:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebc8400, rc 0) 00010000:00010000:3.0:1746066802.717560:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d0d4800/0xfb36a14ee608d36b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f728 expref: 13 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066802.717566:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0d4800, rc 0) 00000100:00100000:0.0:1746066802.717571:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1965:x1830882977231104:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 69us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.717576:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882977230848:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 322us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.717576:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15272 00000100:00100000:3.0:1746066802.717580:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15271 00000100:00100000:0.0:1746066802.717602:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.717618:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977231360 00000100:00100000:3.0:1746066802.717621:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977231360 00000100:00100000:3.0:1746066802.717634:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15273 00000100:00100000:3.0:1746066802.717638:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882977231360:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:0.0:1746066802.717641:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066802.717643:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.717649:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d0d5200/0xfb36a14ee608d372 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f744 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.717651:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977230592 00000100:00100000:0.0:1746066802.717653:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977230592 00010000:00010000:3.0:1746066802.717657:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.717659:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.717663:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0d5200/0xfb36a14ee608d372 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f744 expref: 14 pid: 8112 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066802.717666:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15274 00010000:00010000:3.0:1746066802.717670:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d0d5200/0xfb36a14ee608d372 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f744 expref: 14 pid: 8112 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066802.717670:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009244e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977230592:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066802.717688:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.717690:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0d5200, rc 0) 00010000:00010000:0.0:1746066802.717692:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8c00/0xfb36a14ee608d379 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f71a expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.717701:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.717702:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066802.717703:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1965:x1830882977231360:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 65us (102us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066802.717705:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8c00/0xfb36a14ee608d379 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f71a expref: 30 pid: 10402 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066802.717708:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15273 00010000:00010000:0.0:1746066802.717713:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8c00/0xfb36a14ee608d379 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f71a expref: 30 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.717723:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ebc8c00, rc 0) 00000100:00100000:0.0:1746066802.717736:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009244e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977230592:12345-192.168.202.57@tcp:101:cat.0 Request processed in 65us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.717741:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15274 00000100:00100000:0.0:1746066802.726280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.726370:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977231488 00000100:00100000:1.0:1746066802.726378:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977231488 00000100:00100000:1.0:1746066802.726462:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15275 00000100:00100000:1.0:1746066802.726470:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:31937:x1830882977231488:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066802.726485:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066802.726499:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d380 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f74b expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.726527:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.726528:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.726536:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d380 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f74b expref: 22 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.726549:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d380 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f74b expref: 22 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.726558:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e606e00, rc 0) 00000100:00100000:1.0:1746066802.726608:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:31937:x1830882977231488:12345-192.168.202.57@tcp:101:cat.0 Request processed in 138us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.726613:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15275 00000100:00100000:0.0:1746066802.727906:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.728067:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977231744 00000100:00100000:3.0:1746066802.728073:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977231744 00000100:00100000:3.0:1746066802.728177:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10147 00000100:00100000:3.0:1746066802.728184:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:31942:x1830882977231744:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066802.728199:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.728210:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5400/0xfb36a14ee608d387 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f752 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.728285:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.728296:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f70c expref: 16 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.728302:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.728326:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f70c expref: 16 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.728339:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f70c expref: 16 pid: 809 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.728349:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976961664:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066802.728416:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066802.738815:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.739264:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977232000 00000100:00100000:0.0:1746066802.739271:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977232000 00002000:00100000:0.0:1746066802.739310:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88012c529c00 x1830882977232000/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.739319:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c529c00 with x1830882977232000 ext(2097152->3145727) 00002000:00010000:0.0:1746066802.739323:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c529c00 00000100:00100000:0.0:1746066802.739346:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6945 00000100:00100000:0.0:1746066802.739352:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977232000:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066802.743202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.743229:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.743258:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.743280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.743952:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977232768 00000100:00100000:1.0:1746066802.743959:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977232768 00000100:00100000:3.0:1746066802.743976:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976961664:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066802.743988:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f70c expref: 17 pid: 809 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746066802.743993:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:1.0:1746066802.744010:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7878 00000100:00100000:1.0:1746066802.744015:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:1963:x1830882977232768:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066802.744025:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066802.744030:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f70c expref: 17 pid: 809 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.744038:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f70c expref: 17 pid: 809 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.744061:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5000/0xfb36a14ee608d341 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f70c expref: 17 pid: 809 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746066802.744074:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066802.744078:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066802.744085:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066802.744090:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00000100:00100000:3.0:1746066802.744098:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977232256 00000100:00100000:3.0:1746066802.744101:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977232256 00010000:00010000:1.0:1746066802.744104:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746066802.744126:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88012c52ad80 x1830882977232256/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066802.744134:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52ad80 with x1830882977232256 ext(3145728->4194303) 00000100:00100000:1.0:1746066802.744134:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1963:x1830882977232768:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 119us (876us total) trans 0 rc 0/0 00002000:00010000:3.0:1746066802.744137:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c52ad80 00000100:00100000:1.0:1746066802.744140:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7878 00000100:00100000:3.0:1746066802.744147:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977232512 00000100:00100000:3.0:1746066802.744149:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977232512 00000100:00100000:1.0:1746066802.744157:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977232896 00002000:00100000:3.0:1746066802.744158:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8801361fa680 x1830882977232512/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066802.744160:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977232896 00002000:00100000:3.0:1746066802.744164:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fa680 with x1830882977232512 ext(3145728->4194303) 00002000:00010000:3.0:1746066802.744167:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361fa680 00002000:00100000:1.0:1746066802.744171:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8801361f9c00 x1830882977232896/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066802.744176:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6946 00002000:00100000:1.0:1746066802.744177:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f9c00 with x1830882977232896 ext(4194304->5091327) 00000100:00100000:3.0:1746066802.744180:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977232256:12345-192.168.202.57@tcp:3:cat.0 00002000:00010000:1.0:1746066802.744180:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361f9c00 00000100:00100000:1.0:1746066802.744188:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6947 00000100:00100000:1.0:1746066802.744192:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+33:1964:x1830882977232512:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066802.744209:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6948 00000100:00100000:0.0:1746066802.744218:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1963:x1830882977232896:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:3.0:1746066802.745509:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.745529:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:3.0:1746066802.745545:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066802.745645:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5400/0xfb36a14ee608d387 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f752 expref: 17 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.745662:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f752 expref: 16 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.745668:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066802.745670:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066802.745672:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0d5a00, rc 0) 00000100:00100000:3.0:1746066802.748857:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:31942:x1830882977231744:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 20666us (20946us total) trans 8589944231 rc 0/0 00000100:00100000:3.0:1746066802.748867:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10147 00000100:00100000:2.0:1746066802.781751:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977232000:12345-192.168.202.57@tcp:3:cat.0 Request processed in 42383us (42927us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066802.781767:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6945 00002000:00100000:2.0:1746066802.781782:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88012c529c00 x1830882977232000/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.781792:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c529c00 with x1830882977232000 ext(2097152->3145727) 00002000:00010000:2.0:1746066802.781799:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c529c00 00000100:00100000:0.0:1746066802.784141:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977232256:12345-192.168.202.57@tcp:3:cat.0 Request processed in 39948us (40933us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066802.784154:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6946 00002000:00100000:0.0:1746066802.784166:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88012c52ad80 x1830882977232256/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.784175:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c52ad80 with x1830882977232256 ext(3145728->4194303) 00002000:00010000:0.0:1746066802.784182:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c52ad80 00000100:00100000:2.0:1746066802.784651:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+33:1964:x1830882977232512:12345-192.168.202.57@tcp:3:cat.0 Request processed in 40455us (41419us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066802.784659:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6947 00002000:00100000:2.0:1746066802.784665:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8801361fa680 x1830882977232512/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.784673:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fa680 with x1830882977232512 ext(3145728->4194303) 00002000:00010000:2.0:1746066802.784696:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361fa680 00000100:00100000:0.0:1746066802.804175:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1963:x1830882977232896:12345-192.168.202.57@tcp:3:cat.0 Request processed in 59948us (60882us total) trans 0 rc 897024/897024 00000100:00100000:0.0:1746066802.804188:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6948 00002000:00100000:0.0:1746066802.804202:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8801361f9c00 x1830882977232896/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.804211:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f9c00 with x1830882977232896 ext(4194304->5091327) 00002000:00010000:0.0:1746066802.804217:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361f9c00 00000100:00100000:0.0:1746066802.804275:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.804308:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977233024 00000100:00100000:3.0:1746066802.804317:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977233024 00000100:00100000:0.0:1746066802.804318:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066802.804359:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10148 00000100:00100000:0.0:1746066802.804388:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977233280 00000100:00100000:0.0:1746066802.804393:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977233280 00002000:00100000:0.0:1746066802.804422:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009f16f800 x1830882977233280/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.804428:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16f800 with x1830882977233280 ext(4194304->5091327) 00002000:00010000:0.0:1746066802.804432:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16f800 00000100:00100000:0.0:1746066802.804444:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6949 00000100:00100000:0.0:1746066802.804449:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+33:1963:x1830882977233280:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066802.810170:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:31942:x1830882977233024:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066802.810229:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066802.810245:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4200/0xfb36a14ee608d39c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f759 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.810308:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.810320:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f752 expref: 17 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.810327:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066802.810351:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f752 expref: 17 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.810363:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f752 expref: 17 pid: 809 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746066802.810374:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976961792:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066802.813321:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066802.822005:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976961792:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066802.822029:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:1.0:1746066802.830152:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+33:1963:x1830882977233280:12345-192.168.202.57@tcp:3:cat.0 Request processed in 25691us (25821us total) trans 0 rc 897024/897024 00000100:00100000:1.0:1746066802.830168:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6949 00002000:00100000:1.0:1746066802.830182:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009f16f800 x1830882977233280/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.830191:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16f800 with x1830882977233280 ext(4194304->5091327) 00002000:00010000:1.0:1746066802.830197:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16f800 00000100:00100000:0.0:1746066802.837295:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.843255:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977233408 00000100:00100000:0.0:1746066802.843274:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977233408 00010000:00010000:0.0:1746066802.843334:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f752 expref: 18 pid: 809 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746066802.843378:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7879 00000100:00100000:0.0:1746066802.843391:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+18:1963:x1830882977233408:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.843411:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.843418:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f752 expref: 18 pid: 809 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.843430:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f752 expref: 18 pid: 809 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.843454:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d5a00/0xfb36a14ee608d38e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f752 expref: 18 pid: 809 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746066802.843474:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066802.843478:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.843489:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.843495:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.843534:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.843586:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:1963:x1830882977233408:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 197us (6301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.843592:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7879 00010000:00010000:0.0:1746066802.843667:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.843690:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:0.0:1746066802.844020:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:0.0:1746066802.844026:0:809:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746066802.844043:0:809:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.844073:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4200/0xfb36a14ee608d39c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f759 expref: 17 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.844086:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f759 expref: 16 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.844092:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066802.844095:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066802.844096:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0d4000, rc 0) 00000100:00100000:0.0:1746066802.844131:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:31942:x1830882977233024:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 39766us (39857us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.844138:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10148 00000100:00100000:0.0:1746066802.844247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.844309:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977233536 00000100:00100000:0.0:1746066802.844313:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977233536 00000100:00100000:0.0:1746066802.844338:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15276 00000100:00100000:0.0:1746066802.844343:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:31941:x1830882977233536:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066802.844357:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.844372:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f760 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.844394:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608d2fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6db expref: 32 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.844401:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed06a00/0xfb36a14ee608d34f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f721 expref: 13 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.844408:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed06400/0xfb36a14ee608d348 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f713 expref: 43 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.844414:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.844416:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.844419:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 6/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [434176->1048575] (req 434176->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 43 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.844443:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed06400/0xfb36a14ee608d348 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f713 expref: 43 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.844455:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed06400/0xfb36a14ee608d348 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f713 expref: 43 pid: 4614 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066802.844466:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976961920:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.844529:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed06a00/0xfb36a14ee608d34f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f721 expref: 13 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.844537:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed06a00/0xfb36a14ee608d34f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f721 expref: 13 pid: 4614 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066802.844546:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976962048:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.844570:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608d2fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6db expref: 32 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.844582:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608d2fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6db expref: 32 pid: 21203 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066802.844590:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976962176:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.844606:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42abb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.851525:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976961920:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.851541:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976962048:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.851550:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136b40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976962176:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.851598:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [434176->1048575] (req 434176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 43 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.851634:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18fc00, rc 0) 00000100:00100000:0.0:1746066802.851700:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+43:31941:x1830882977233536:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 7354us (7450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.851709:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15276 00000100:00100000:0.0:1746066802.865200:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.865225:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.865251:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.865264:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.865277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.865314:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.865341:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977233792 00000100:00100000:0.0:1746066802.865350:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977233792 00000100:00100000:0.0:1746066802.865391:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977234560 00000100:00100000:0.0:1746066802.865394:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977234560 00000100:00100000:0.0:1746066802.865408:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10149 00000100:00100000:0.0:1746066802.865415:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:31942:x1830882977233792:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066802.865435:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.865455:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d3b1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f767 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.865563:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ec00/0xfb36a14ee608d3b8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.865577:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ec00/0xfb36a14ee608d3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.865589:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ec00/0xfb36a14ee608d3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.865601:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ec00/0xfb36a14ee608d3b8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.865607:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ec00/0xfb36a14ee608d3b8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.865613:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ec00/0xfb36a14ee608d3b8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.865618:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d18ec00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066802.865622:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ec00/0xfb36a14ee608d3b8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.865627:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ec00/0xfb36a14ee608d3b8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.865638:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066802.865641:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066802.865646:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ec00/0xfb36a14ee608d3b8 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.865650:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ec00/0xfb36a14ee608d3b8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066802.865704:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d3b1 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f767 expref: 17 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.865711:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ea00/0xfb36a14ee608d3b1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f767 expref: 17 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.865719:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18ea00, rc 0) 00000100:00100000:0.0:1746066802.865742:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977233920 00000100:00100000:0.0:1746066802.865744:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977233920 00010000:00010000:0.0:1746066802.865763:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed06a00/0xfb36a14ee608d34f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f721 expref: 14 pid: 4614 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066802.865780:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977234176 00000100:00100000:0.0:1746066802.865781:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977234176 00010000:00010000:0.0:1746066802.865790:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608d2fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6db expref: 33 pid: 21203 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066802.865801:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977234048 00000100:00100000:0.0:1746066802.865803:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977234048 00010000:00010000:0.0:1746066802.865811:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed06400/0xfb36a14ee608d348 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f713 expref: 43 pid: 4614 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066802.865823:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7880 00000100:00100000:0.0:1746066802.865828:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1964:x1830882977233920:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.865838:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746066802.865855:0:9852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2017 -> 2047 00010000:00010000:0.0:1746066802.865860:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed06a00/0xfb36a14ee608d34f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f721 expref: 14 pid: 4614 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066802.865868:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed06a00/0xfb36a14ee608d34f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f721 expref: 14 pid: 4614 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066802.865884:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed06a00/0xfb36a14ee608d34f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f721 expref: 14 pid: 4614 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066802.865897:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.865934:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977233920:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 105us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.865941:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7880 00000100:00100000:0.0:1746066802.865956:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7881 00000100:00100000:0.0:1746066802.865961:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+33:1964:x1830882977234176:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.865967:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.865974:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608d2fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6db expref: 33 pid: 21203 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066802.865981:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608d2fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6db expref: 33 pid: 21203 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066802.865993:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3c400/0xfb36a14ee608d2fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6db expref: 33 pid: 21203 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066802.866005:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.866018:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+32:1964:x1830882977234176:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 57us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.866022:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7881 00000100:00100000:0.0:1746066802.866031:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7882 00000100:00100000:0.0:1746066802.866036:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+43:1965:x1830882977234048:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.866042:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.866048:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed06400/0xfb36a14ee608d348 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f713 expref: 43 pid: 4614 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066802.866056:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed06400/0xfb36a14ee608d348 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f713 expref: 43 pid: 4614 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066802.866067:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed06400/0xfb36a14ee608d348 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f713 expref: 43 pid: 4614 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066802.866075:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.866076:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.866082:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 42 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.866089:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 42 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.866116:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 42 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.866129:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976962304:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066802.866181:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42abb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.866200:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10150 00000100:00100000:0.0:1746066802.866207:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:31945:x1830882977234560:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066802.866216:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.866223:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e000/0xfb36a14ee608d3bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f775 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.866258:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066802.866267:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f759 expref: 16 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.866273:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066802.866289:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f759 expref: 16 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.866297:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f759 expref: 16 pid: 809 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066802.866305:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976962432:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.866323:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.866342:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977234304 00000100:00100000:0.0:1746066802.866345:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977234304 00000100:00100000:0.0:1746066802.866363:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15277 00000100:00100000:0.0:1746066802.866367:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+32:1964:x1830882977234304:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066802.866373:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.866380:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d18fa00/0xfb36a14ee608d3cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f76e expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.866402:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976962560:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066802.866418:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42abc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.866687:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:31942:x1830882977233792:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1258us (1483us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066802.866693:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10149 00002000:00010000:0.0:1746066802.868388:0:8451:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime: 1746066801 -> 1746066802 00000100:00100000:0.0:1746066802.868409:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976962560:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066802.868438:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d18fa00/0xfb36a14ee608d3cd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f76e expref: 33 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.868450:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d18fa00/0xfb36a14ee608d3cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f76e expref: 33 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.868461:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18fa00, rc 0) 00000100:00100000:0.0:1746066802.870087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.870172:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976962432:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.870197:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066802.870223:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976962304:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066802.870236:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.870266:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1965:x1830882977234048:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4229us (4987us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.870277:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7882 00000100:00100000:0.0:1746066802.870303:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977234688 00000100:00100000:0.0:1746066802.870308:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977234688 00010000:00010000:0.0:1746066802.870330:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f759 expref: 16 pid: 809 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066802.870348:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7883 00000100:00100000:0.0:1746066802.870354:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:1964:x1830882977234688:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.870366:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.870372:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f759 expref: 16 pid: 809 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066802.870381:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f759 expref: 16 pid: 809 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066802.870401:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d0d4000/0xfb36a14ee608d3a3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f759 expref: 16 pid: 809 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066802.870414:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066802.870418:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066802.870426:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066802.870433:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066802.870449:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.870464:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:1964:x1830882977234688:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 111us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.870469:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7883 00010000:00010000:0.0:1746066802.870487:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066802.870492:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746066802.870511:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066802.870662:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18e000/0xfb36a14ee608d3bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f775 expref: 23 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.870696:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f775 expref: 22 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.870702:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066802.870705:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066802.870707:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d18ee00, rc 0) 00000100:00100000:0.0:1746066802.870728:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:31945:x1830882977234560:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4523us (5476us total) trans 8589944232 rc 0/0 00000100:00100000:0.0:1746066802.870734:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10150 00000100:00100000:0.0:1746066802.870824:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+32:1964:x1830882977234304:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4455us (5507us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066802.870831:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15277 00000100:00100000:0.0:1746066802.872919:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.872951:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.872973:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977235200 00000100:00100000:0.0:1746066802.872979:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977235200 00002000:00100000:0.0:1746066802.873016:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (434176->438271) req@ffff88009ed08380 x1830882977235200/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.873026:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed08380 with x1830882977235200 ext(434176->438271) 00002000:00010000:0.0:1746066802.873031:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed08380 00000100:00100000:0.0:1746066802.873046:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6950 00000100:00100000:0.0:1746066802.873053:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1965:x1830882977235200:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066802.873201:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1965:x1830882977235200:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 147us (286us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066802.873207:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6950 00002000:00100000:0.0:1746066802.873212:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (434176->438271) req@ffff88009ed08380 x1830882977235200/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/4536 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.873219:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed08380 with x1830882977235200 ext(434176->438271) 00002000:00010000:0.0:1746066802.873222:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed08380 00000100:00100000:2.0:1746066802.874278:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977234944 00000100:00100000:2.0:1746066802.874284:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977234944 00000100:00100000:2.0:1746066802.874313:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4260 00000100:00100000:2.0:1746066802.874318:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+15:31942:x1830882977234944:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:2.0:1746066802.874483:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:31942:x1830882977234944:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 164us (1531us total) trans 8589944233 rc 0/0 00000100:00100000:2.0:1746066802.874489:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4260 00000100:00100000:1.0:1746066802.884873:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.884912:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977235328 00000100:00100000:1.0:1746066802.884922:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977235328 00000100:00100000:1.0:1746066802.884966:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15278 00000100:00100000:1.0:1746066802.884974:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+32:1964:x1830882977235328:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066802.884993:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066802.885012:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092183800/0xfb36a14ee608d3db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f77c expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066802.885071:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976962688:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066802.885146:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4e18f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.888729:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.888878:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976962688:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066802.888911:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092183800/0xfb36a14ee608d3db lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f77c expref: 33 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.888925:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092183800/0xfb36a14ee608d3db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f77c expref: 33 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.888935:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092183800, rc 0) 00000100:00100000:0.0:1746066802.888978:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+32:1964:x1830882977235328:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4004us (4116us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066802.888988:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15278 00000100:00100000:0.0:1746066802.889012:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977235456 00000100:00100000:0.0:1746066802.889017:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977235456 00000100:00100000:0.0:1746066802.891631:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15279 00000100:00100000:0.0:1746066802.891653:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:31941:x1830882977235456:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066802.891687:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066802.891705:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f783 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.891736:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac59a00/0xfb36a14ee608d317 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f7 expref: 21 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.891745:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8c00/0xfb36a14ee608d379 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f71a expref: 31 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.891752:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d0d4800/0xfb36a14ee608d36b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f728 expref: 13 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.891758:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.891760:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.891763:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1048576->1286143] (req 1048576->1286143) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.894326:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d0d4800/0xfb36a14ee608d36b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f728 expref: 13 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.894344:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d0d4800/0xfb36a14ee608d36b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f728 expref: 13 pid: 21203 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066802.894360:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976962816:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.894445:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8c00/0xfb36a14ee608d379 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f71a expref: 31 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066802.894453:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8c00/0xfb36a14ee608d379 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f71a expref: 31 pid: 10402 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066802.894460:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976962944:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.894484:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac59a00/0xfb36a14ee608d317 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f7 expref: 21 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.894491:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac59a00/0xfb36a14ee608d317 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f7 expref: 21 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066802.894498:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976963072:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.894512:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42abc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.925085:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.925104:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.925146:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.925196:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976962816:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.925207:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976962944:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.925215:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976963072:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.925261:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1048576->1286143] (req 1048576->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.925280:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecccc00, rc 0) 00000100:00100000:0.0:1746066802.925329:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:31941:x1830882977235456:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 33687us (36608us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.925340:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15279 00000100:00100000:0.0:1746066802.925387:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977235584 00000100:00100000:0.0:1746066802.925392:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977235584 00010000:00010000:0.0:1746066802.925420:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0d4800/0xfb36a14ee608d36b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f728 expref: 14 pid: 21203 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066802.925440:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977235712 00000100:00100000:0.0:1746066802.925443:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977235712 00010000:00010000:0.0:1746066802.925453:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8c00/0xfb36a14ee608d379 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f71a expref: 31 pid: 10402 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066802.925464:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977235840 00000100:00100000:0.0:1746066802.925466:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977235840 00010000:00010000:0.0:1746066802.925475:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac59a00/0xfb36a14ee608d317 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f7 expref: 22 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066802.925487:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7884 00000100:00100000:0.0:1746066802.925495:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+14:1966:x1830882977235584:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.925508:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746066802.925542:0:15727:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:0.0:1746066802.925547:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d0d4800/0xfb36a14ee608d36b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f728 expref: 14 pid: 21203 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066802.925557:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d0d4800/0xfb36a14ee608d36b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f728 expref: 14 pid: 21203 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066802.925581:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d0d4800/0xfb36a14ee608d36b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f728 expref: 14 pid: 21203 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066802.925593:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.925611:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1966:x1830882977235584:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 117us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.925616:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7884 00000100:00100000:0.0:1746066802.925630:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7885 00000100:00100000:0.0:1746066802.925636:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882977235712:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.925644:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.925650:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8c00/0xfb36a14ee608d379 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f71a expref: 31 pid: 10402 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066802.925658:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8c00/0xfb36a14ee608d379 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f71a expref: 31 pid: 10402 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066802.925669:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ebc8c00/0xfb36a14ee608d379 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f71a expref: 31 pid: 10402 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066802.925697:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.925712:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1966:x1830882977235712:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 77us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.925720:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7885 00000100:00100000:0.0:1746066802.925731:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7886 00000100:00100000:0.0:1746066802.925736:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977235840:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066802.925741:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066802.925748:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac59a00/0xfb36a14ee608d317 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f7 expref: 22 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066802.925756:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac59a00/0xfb36a14ee608d317 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f7 expref: 22 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066802.925767:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac59a00/0xfb36a14ee608d317 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f7 expref: 22 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066802.925775:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.925777:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066802.925784:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 29 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.925791:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 29 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.925817:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 29 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066802.925827:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976963200:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066802.928989:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b42abc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066802.940166:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976963200:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066802.940192:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066802.940240:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977235840:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 14501us (15091us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.940252:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7886 00000100:00100000:0.0:1746066802.942097:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.942123:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977236096 00000100:00100000:0.0:1746066802.942130:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977236096 00002000:00100000:0.0:1746066802.942175:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38d:0x0] (1282048->1286143) req@ffff88009bb2df80 x1830882977236096/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.942185:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2df80 with x1830882977236096 ext(1282048->1286143) 00002000:00010000:0.0:1746066802.942191:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2df80 00000100:00100000:0.0:1746066802.942210:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6951 00000100:00100000:0.0:1746066802.942218:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977236096:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066802.942379:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977236096:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 161us (285us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066802.942385:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6951 00002000:00100000:0.0:1746066802.942390:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38d:0x0] (1282048->1286143) req@ffff88009bb2df80 x1830882977236096/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/4536 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066802.942397:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2df80 with x1830882977236096 ext(1282048->1286143) 00002000:00010000:0.0:1746066802.942400:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2df80 00000100:00100000:0.0:1746066802.949358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066802.950077:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977236352 00000100:00100000:0.0:1746066802.950086:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977236352 00000100:00100000:0.0:1746066802.950126:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4261 00000100:00100000:0.0:1746066802.950135:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:31941:x1830882977236352:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:0.0:1746066802.950451:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:31941:x1830882977236352:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 316us (1101us total) trans 8589944234 rc 0/0 00000100:00100000:0.0:1746066802.950457:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4261 00000100:00100000:1.0:1746066802.970469:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.970500:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.970584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.970610:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977236608 00000100:00100000:1.0:1746066802.970619:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977236608 00000100:00100000:1.0:1746066802.970664:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15280 00000100:00100000:1.0:1746066802.970672:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+32:31945:x1830882977236608:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066802.970704:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066802.970724:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f78a expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.970753:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac59e00/0xfb36a14ee608d310 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f0 expref: 41 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.970762:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d0d5600/0xfb36a14ee608d35d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f73d expref: 12 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066802.970768:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac59000/0xfb36a14ee608d325 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f705 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.970774:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.970777:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066802.970780:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2695168->3145727] (req 2695168->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 33 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.970812:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac59000/0xfb36a14ee608d325 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f705 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.970824:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac59000/0xfb36a14ee608d325 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f705 expref: 33 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746066802.970836:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976963328:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066802.970922:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d0d5600/0xfb36a14ee608d35d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f73d expref: 12 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066802.970930:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d0d5600/0xfb36a14ee608d35d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f73d expref: 12 pid: 21203 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746066802.970938:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801361f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976963456:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066802.970966:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac59e00/0xfb36a14ee608d310 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f0 expref: 41 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066802.970972:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac59e00/0xfb36a14ee608d310 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f0 expref: 41 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746066802.970979:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092849f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976963584:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066802.970993:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066802.971009:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977236736 00000100:00100000:1.0:1746066802.971012:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977236736 00002000:00100000:1.0:1746066802.971038:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (0->434175) req@ffff8801361fb480 x1830882977236736/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.971046:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fb480 with x1830882977236736 ext(0->434175) 00002000:00010000:1.0:1746066802.971051:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361fb480 00000100:00100000:1.0:1746066802.971063:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977236992 00000100:00100000:1.0:1746066802.971065:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977236992 00002000:00100000:1.0:1746066802.971078:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38d:0x0] (1286144->2097151) req@ffff8801361f8380 x1830882977236992/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.971085:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8380 with x1830882977236992 ext(1286144->2097151) 00002000:00010000:1.0:1746066802.971088:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361f8380 00000100:00100000:1.0:1746066802.971100:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6952 00000100:00100000:1.0:1746066802.971105:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1964:x1830882977236736:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066802.971841:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6953 00000100:00100000:1.0:1746066802.971847:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977236992:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066802.987178:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.987193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.987223:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066802.987244:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977237120 00000100:00100000:2.0:1746066802.987248:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977237248 00000100:00100000:1.0:1746066802.987250:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977237120 00000100:00100000:2.0:1746066802.987258:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977237248 00010000:00010000:1.0:1746066802.987277:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0d5600/0xfb36a14ee608d35d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f73d expref: 13 pid: 21203 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066802.987286:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac59e00/0xfb36a14ee608d310 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f0 expref: 44 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746066802.987299:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977237376 00000100:00100000:1.0:1746066802.987301:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977237376 00010000:00010000:1.0:1746066802.987310:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac59000/0xfb36a14ee608d325 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f705 expref: 34 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066802.987315:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7887 00000100:00100000:2.0:1746066802.987323:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977237120:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066802.987328:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7888 00000100:00100000:1.0:1746066802.987334:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+44:1964:x1830882977237248:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066802.987341:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066802.987345:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066802.987361:0:7108:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5921 -> 5923 00010000:00010000:1.0:1746066802.987366:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac59e00/0xfb36a14ee608d310 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f0 expref: 44 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066802.987367:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d0d5600/0xfb36a14ee608d35d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f73d expref: 13 pid: 21203 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746066802.987377:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac59e00/0xfb36a14ee608d310 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f0 expref: 44 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066802.987388:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d0d5600/0xfb36a14ee608d35d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f73d expref: 13 pid: 21203 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746066802.987853:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7889 00000100:00100000:3.0:1746066802.987861:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+34:1966:x1830882977237376:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066802.987868:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066802.988044:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066802.988087:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+44:1964:x1830882977237248:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 752us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066802.988093:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7888 00000100:00100000:1.0:1746066802.988393:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1964:x1830882977236736:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17287us (17891us total) trans 0 rc 434176/434176 00000100:00100000:1.0:1746066802.988401:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6952 00002000:00100000:1.0:1746066802.988408:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (0->434175) req@ffff8801361fb480 x1830882977236736/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 434176/434176 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066802.988416:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fb480 with x1830882977236736 ext(0->434175) 00002000:00010000:1.0:1746066802.988419:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361fb480 00000100:00100000:0.0:1746066802.988438:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976963328:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066802.988449:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801361f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976963456:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.988458:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac59e00/0xfb36a14ee608d310 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6f0 expref: 41 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066802.988468:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092849f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976963584:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066802.988491:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2695168->3145727] (req 2695168->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 34 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066802.988500:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092183400, rc 0) 00000100:00100000:0.0:1746066802.988531:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+34:31945:x1830882977236608:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 17861us (18075us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066802.988537:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15280 00010000:00010000:2.0:1746066802.988548:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d0d5600/0xfb36a14ee608d35d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f73d expref: 13 pid: 21203 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066802.988570:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066802.988604:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac59000/0xfb36a14ee608d325 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f705 expref: 33 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066802.988608:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977237120:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1286us (1438us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066802.988613:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac59000/0xfb36a14ee608d325 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f705 expref: 33 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066802.988616:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7887 00010000:00010000:3.0:1746066802.988626:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac59000/0xfb36a14ee608d325 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f705 expref: 33 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066802.988638:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.988640:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066802.988646:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 32 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.988653:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 32 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066802.988704:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 32 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066802.988715:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976963712:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066802.988761:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9c00 going to sleep for 11 seconds 00000001:00080000:2.0:1746066802.991951:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873743 is committed 00000001:00080000:2.0:1746066802.991975:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873742 is committed 00000001:00080000:2.0:1746066802.991986:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873730 is committed 00000100:00100000:1.0:1746066802.991987:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977236992:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20131us (21393us total) trans 0 rc 811008/811008 00000100:00100000:1.0:1746066802.991998:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6953 00002000:00100000:1.0:1746066802.992008:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38d:0x0] (1286144->2097151) req@ffff8801361f8380 x1830882977236992/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:208/0 lens 488/440 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 811008/811008 job:'cat.0' uid:0 gid:0 00000001:00080000:2.0:1746066802.992015:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873679 is committed 00002000:00100000:1.0:1746066802.992017:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8380 with x1830882977236992 ext(1286144->2097151) 00002000:00010000:1.0:1746066802.992022:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361f8380 00000001:00080000:2.0:1746066802.992059:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873716 is committed 00000001:00080000:2.0:1746066802.992107:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873732 is committed 00000001:00080000:2.0:1746066802.992111:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873734 is committed 00000100:00100000:3.0:1746066802.992594:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976963712:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066802.992616:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066802.992706:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+8:1966:x1830882977237376:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4845us (5480us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066802.992716:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7889 00000100:00100000:1.0:1746066802.994592:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066802.995098:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977237632 00000100:00100000:2.0:1746066802.995108:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977237632 00002000:00100000:2.0:1746066802.995153:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2695168->2699263) req@ffff88009e869c00 x1830882977237632/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/0 e 0 to 0 dl 1746066813 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.995163:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e869c00 with x1830882977237632 ext(2695168->2699263) 00002000:00010000:2.0:1746066802.995167:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e869c00 00000100:00100000:2.0:1746066802.995194:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6954 00000100:00100000:2.0:1746066802.995200:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:1963:x1830882977237632:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066802.995492:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:1963:x1830882977237632:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 291us (903us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066802.995499:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6954 00002000:00100000:2.0:1746066802.995504:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2695168->2699263) req@ffff88009e869c00 x1830882977237632/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:208/0 lens 488/4536 e 0 to 0 dl 1746066813 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066802.995525:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e869c00 with x1830882977237632 ext(2695168->2699263) 00002000:00010000:2.0:1746066802.995528:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e869c00 00000001:00080000:2.0:1746066802.996859:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841034 is committed 00000001:00080000:2.0:1746066802.996879:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841020 is committed 00000001:00080000:2.0:1746066802.996907:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840979 is committed 00000001:00080000:2.0:1746066802.996915:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841042 is committed 00000001:00080000:2.0:1746066802.996923:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841022 is committed 00000001:00080000:2.0:1746066802.996926:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841010 is committed 00000001:00080000:2.0:1746066802.996945:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841041 is committed 00000001:00080000:2.0:1746066802.996957:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841038 is committed 00000001:00080000:2.0:1746066802.996989:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841043 is committed 00000100:00100000:0.0:1746066803.012060:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.012185:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.012246:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977237760 00000100:00100000:1.0:1746066803.012258:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977237760 00000100:00100000:1.0:1746066803.012314:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977237888 00000100:00100000:1.0:1746066803.012316:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977237888 00000100:00100000:1.0:1746066803.012335:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15281 00000100:00100000:1.0:1746066803.012343:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:31950:x1830882977237760:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066803.012358:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.012373:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b164e00/0xfb36a14ee608d3f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f791 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066803.012428:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15282 00000100:00100000:2.0:1746066803.012435:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+7:31945:x1830882977237888:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066803.012443:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066803.012452:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f798 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.012473:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac59800/0xfb36a14ee608d31e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6fe expref: 13 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.012480:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d380 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f74b expref: 8 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.012575:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 7 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.012581:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066803.012582:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066803.012585:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b164e00/0xfb36a14ee608d3f0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f791 expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746066803.012593:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746066803.012597:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746066803.012613:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 7 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.012627:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d0d5200/0xfb36a14ee608d372 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f744 expref: 6 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066803.012637:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.012639:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.012641:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->2355199] (req 2097152->2355199) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 8 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.012657:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d0d5200/0xfb36a14ee608d372 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f744 expref: 6 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066803.012669:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d0d5200/0xfb36a14ee608d372 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f744 expref: 6 pid: 8112 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746066803.012707:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976963968:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066803.012795:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d380 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f74b expref: 8 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.012802:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d380 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f74b expref: 8 pid: 8451 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066803.012810:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093212300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976964096:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066803.012833:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac59800/0xfb36a14ee608d31e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6fe expref: 13 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.012841:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac59800/0xfb36a14ee608d31e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6fe expref: 13 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066803.012852:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976964224:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066803.012868:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c240 going to sleep for 11 seconds 00010000:00010000:1.0:1746066803.012927:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 7 pid: 8451 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746066803.012936:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e869500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976963840:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066803.012957:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066803.016854:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976963968:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066803.017390:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e869500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976963840:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066803.017415:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b164e00/0xfb36a14ee608d3f0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f791 expref: 20 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.017430:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b164e00, rc 0) 00000100:00100000:1.0:1746066803.017475:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:31950:x1830882977237760:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5132us (5428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066803.017483:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15281 00000100:00100000:3.0:1746066803.017620:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093212300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976964096:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066803.018260:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976964224:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066803.018285:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->2355199] (req 2097152->2355199) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 8 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.018298:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57ae800, rc 0) 00000100:00100000:3.0:1746066803.018320:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+8:31945:x1830882977237888:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 5887us (6135us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.018326:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15282 00000100:00100000:0.0:1746066803.019214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.021200:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.021232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.022443:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977238144 00000100:00100000:2.0:1746066803.022452:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977238144 00002000:00100000:2.0:1746066803.022499:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2695168->3145727) req@ffff88009bb2d880 x1830882977238144/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.022509:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d880 with x1830882977238144 ext(2695168->3145727) 00010000:00010000:2.0:1746066803.022526:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 8 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.022537:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 8 pid: 8451 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746066803.022543:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2d880 00000100:00100000:2.0:1746066803.022564:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2245 00000100:00100000:2.0:1746066803.022570:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:1964:x1830882977238144:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:1.0:1746066803.023359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.025995:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977238400 00000100:00100000:3.0:1746066803.026007:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977238400 00010000:00010000:3.0:1746066803.026050:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac59800/0xfb36a14ee608d31e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6fe expref: 14 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066803.026180:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977238016 00000100:00100000:2.0:1746066803.026184:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977238016 00010000:00010000:2.0:1746066803.026200:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0d5200/0xfb36a14ee608d372 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f744 expref: 7 pid: 8112 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746066803.026218:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977238272 00000100:00100000:2.0:1746066803.026220:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977238272 00010000:00010000:2.0:1746066803.026228:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d380 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f74b expref: 8 pid: 8451 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066803.026241:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7890 00000100:00100000:2.0:1746066803.026247:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1964:x1830882977238400:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.026261:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.026278:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac59800/0xfb36a14ee608d31e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6fe expref: 14 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.026288:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac59800/0xfb36a14ee608d31e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6fe expref: 14 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.026308:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac59800/0xfb36a14ee608d31e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6fe expref: 14 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.026324:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.026363:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+13:1964:x1830882977238400:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 116us (5167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.026369:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7890 00000100:00100000:2.0:1746066803.026384:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7891 00000100:00100000:2.0:1746066803.026389:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882977238016:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.026397:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.026405:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d0d5200/0xfb36a14ee608d372 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f744 expref: 7 pid: 8112 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.026413:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d0d5200/0xfb36a14ee608d372 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f744 expref: 7 pid: 8112 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.026424:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d0d5200/0xfb36a14ee608d372 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f744 expref: 7 pid: 8112 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.026432:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.026447:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1965:x1830882977238016:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 59us (5215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.026452:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7891 00000100:00100000:2.0:1746066803.026462:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7892 00000100:00100000:2.0:1746066803.026466:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:1965:x1830882977238272:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.026473:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.026480:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d380 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f74b expref: 8 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.026487:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d380 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f74b expref: 8 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.026497:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608d380 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f74b expref: 8 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.026504:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.026506:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.026512:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2355199) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 7 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.026527:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2355199) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 7 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.026554:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2355199) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 7 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066803.026563:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976964352:192.168.202.57@tcp:105: 00000100:00080000:3.0:1746066803.028065:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746066803.028069:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066803.030075:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066803.035744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.035800:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976964352:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066803.035815:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.035849:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+7:1965:x1830882977238272:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 9382us (12491us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.035858:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7892 00000100:00100000:0.0:1746066803.036430:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977238656 00000100:00100000:0.0:1746066803.036437:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977238656 00002000:00100000:0.0:1746066803.036471:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2351104->2355199) req@ffff880093210000 x1830882977238656/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.036480:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093210000 with x1830882977238656 ext(2351104->2355199) 00002000:00010000:0.0:1746066803.036484:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093210000 00000100:00100000:0.0:1746066803.036589:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6955 00000100:00100000:0.0:1746066803.036598:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+7:1966:x1830882977238656:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066803.036767:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+7:1966:x1830882977238656:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 171us (1030us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066803.036772:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6955 00002000:00100000:0.0:1746066803.036777:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2351104->2355199) req@ffff880093210000 x1830882977238656/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/4536 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.036783:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093210000 with x1830882977238656 ext(2351104->2355199) 00002000:00010000:0.0:1746066803.036786:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093210000 00000100:00100000:1.0:1746066803.037948:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882977238144:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 15373us (18733us total) trans 17179873744 rc 0/0 00000100:00100000:1.0:1746066803.037956:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2245 00002000:00100000:1.0:1746066803.037963:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2695168->3145727) req@ffff88009bb2d880 x1830882977238144/t17179873744(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/448 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.037970:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d880 with x1830882977238144 ext(2695168->3145727) 00010000:00010000:1.0:1746066803.037978:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 10 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746066803.037990:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 10 pid: 8451 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746066803.037996:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2d880 00000100:00100000:0.0:1746066803.045258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.046010:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977238784 00000100:00100000:2.0:1746066803.046017:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977238784 00010000:00010000:2.0:1746066803.046049:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 10 pid: 8451 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066803.046086:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7893 00000100:00100000:2.0:1746066803.046094:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882977238784:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.046107:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.046125:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2695168->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 10 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.046142:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2695168->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 10 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.046167:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092183400/0xfb36a14ee608d3e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2695168->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f78a expref: 10 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.046191:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.046193:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.046200:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b164e00/0xfb36a14ee608d3f0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f791 expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.046207:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b164e00/0xfb36a14ee608d3f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f791 expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.046242:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b164e00/0xfb36a14ee608d3f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f791 expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066803.046254:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976964480:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066803.046323:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.055134:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.055219:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977239040 00000100:00100000:1.0:1746066803.055226:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977239040 00002000:00100000:1.0:1746066803.055265:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880092849f80 x1830882977239040/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.055275:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849f80 with x1830882977239040 ext(2097152->3145727) 00002000:00010000:1.0:1746066803.055279:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092849f80 00000100:00100000:1.0:1746066803.055311:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6956 00000100:00100000:1.0:1746066803.055318:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977239040:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066803.056096:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976964480:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066803.056111:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.056154:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+9:1964:x1830882977238784:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 10061us (10902us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.056162:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7893 00000100:00100000:1.0:1746066803.075100:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977239040:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19774us (19966us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066803.075111:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6956 00002000:00100000:1.0:1746066803.075121:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880092849f80 x1830882977239040/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.075130:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849f80 with x1830882977239040 ext(2097152->3145727) 00002000:00010000:1.0:1746066803.075135:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092849f80 00000100:00100000:0.0:1746066803.081748:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.082715:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977239168 00000100:00100000:3.0:1746066803.082725:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977239168 00000100:00100000:3.0:1746066803.082886:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15283 00000100:00100000:3.0:1746066803.082893:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+13:31950:x1830882977239168:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066803.082908:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.082922:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a00d6000/0xfb36a14ee608d3fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f79f expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.082945:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2355199) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 6 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.082952:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066803.082954:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066803.082956:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00d6000/0xfb36a14ee608d3fe lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f79f expref: 14 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.082984:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2355199) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 6 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.082994:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2355199) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 6 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746066803.083004:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976964608:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066803.084028:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066803.088094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.088231:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976964608:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066803.088257:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a00d6000/0xfb36a14ee608d3fe lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f79f expref: 14 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.088273:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00d6000, rc 0) 00000100:00100000:0.0:1746066803.088442:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977239296 00000100:00100000:0.0:1746066803.088448:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977239296 00002000:00100000:0.0:1746066803.088484:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->2355199) req@ffff88009e86ad80 x1830882977239296/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.088493:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e86ad80 with x1830882977239296 ext(2097152->2355199) 00010000:00010000:0.0:1746066803.088499:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 7 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066803.088510:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 7 pid: 21973 timeout: 864 lvb_type: 0 00002000:00010000:0.0:1746066803.088530:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e86ad80 00000100:00100000:0.0:1746066803.088558:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2246 00000100:00100000:0.0:1746066803.088565:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+7:1964:x1830882977239296:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066803.088648:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:31950:x1830882977239168:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5752us (6905us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.088655:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15283 00000100:00100000:0.0:1746066803.091594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.091810:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977239552 00000100:00100000:2.0:1746066803.091817:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977239552 00000100:00100000:2.0:1746066803.092304:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10151 00000100:00100000:2.0:1746066803.092311:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:31954:x1830882977239552:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066803.092331:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066803.092345:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc400/0xfb36a14ee608d405 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f7a6 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.092420:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc200/0xfb36a14ee608d40c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.092431:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc200/0xfb36a14ee608d40c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.092440:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc200/0xfb36a14ee608d40c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746066803.092448:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066803.094571:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc400/0xfb36a14ee608d405 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7a6 expref: 271 pid: 14549 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746066803.094746:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746066803.094978:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc200/0xfb36a14ee608d40c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7a6 expref: 270 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.094986:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066803.094989:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066803.094992:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eccc200, rc 0) 00000100:00100000:2.0:1746066803.095045:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+270:31954:x1830882977239552:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2734us (3457us total) trans 8589944235 rc 0/0 00000100:00100000:2.0:1746066803.095053:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10151 00000100:00100000:3.0:1746066803.095785:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+9:1964:x1830882977239296:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 7219us (7697us total) trans 21474841044 rc 0/0 00000100:00100000:3.0:1746066803.095793:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2246 00002000:00100000:3.0:1746066803.095801:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->2355199) req@ffff88009e86ad80 x1830882977239296/t21474841044(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/448 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.095809:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e86ad80 with x1830882977239296 ext(2097152->2355199) 00010000:00010000:3.0:1746066803.095816:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 9 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.095827:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 9 pid: 21973 timeout: 864 lvb_type: 0 00002000:00010000:3.0:1746066803.095833:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e86ad80 00000100:00100000:0.0:1746066803.102033:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.102114:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977239680 00000100:00100000:2.0:1746066803.102122:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977239680 00010000:00010000:2.0:1746066803.102153:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 9 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066803.102196:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7894 00000100:00100000:2.0:1746066803.102203:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+9:1965:x1830882977239680:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.102216:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.102234:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2355199) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 9 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.102244:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2355199) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 9 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.102260:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57ae800/0xfb36a14ee608d3f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2355199) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f798 expref: 9 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.102275:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.102277:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.102283:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00d6000/0xfb36a14ee608d3fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f79f expref: 13 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.102290:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00d6000/0xfb36a14ee608d3fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f79f expref: 13 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.102318:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00d6000/0xfb36a14ee608d3fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f79f expref: 13 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066803.102328:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976964736:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066803.102393:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.103734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.103800:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977239808 00000100:00100000:3.0:1746066803.103805:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977239808 00000100:00100000:3.0:1746066803.103842:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15284 00000100:00100000:3.0:1746066803.103848:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:31954:x1830882977239808:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066803.103861:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.103873:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f7ad expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.103893:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d292 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f687 expref: 8 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.103899:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xfb36a14ee608d356 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f72f expref: 5 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.103905:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d18f400/0xfb36a14ee608d2df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6bf expref: 15 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.103910:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.103911:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.103914:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 15 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.103935:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d18f400/0xfb36a14ee608d2df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6bf expref: 15 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.103944:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d18f400/0xfb36a14ee608d2df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6bf expref: 15 pid: 8451 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746066803.103952:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976964864:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066803.104024:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xfb36a14ee608d356 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f72f expref: 5 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.104036:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xfb36a14ee608d356 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f72f expref: 5 pid: 21973 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746066803.104045:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976964992:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066803.104072:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d292 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f687 expref: 8 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.104077:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d292 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f687 expref: 8 pid: 8452 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746066803.104083:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976965120:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066803.104094:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066803.112810:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976964864:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066803.112825:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976964992:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066803.112831:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976965120:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066803.112854:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 15 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.112868:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cad7e00, rc 0) 00000100:00100000:3.0:1746066803.112903:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:31954:x1830882977239808:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 9054us (9172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.112911:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15284 00000100:00100000:2.0:1746066803.113005:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976964736:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066803.113014:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.113031:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:1965:x1830882977239680:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 10830us (11006us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.113038:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7894 00000100:00100000:0.0:1746066803.116140:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.116175:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.116209:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.116264:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977240192 00000100:00100000:1.0:1746066803.116272:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977240192 00000100:00100000:2.0:1746066803.116285:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977240064 00000100:00100000:2.0:1746066803.116290:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977240064 00010000:00010000:1.0:1746066803.116300:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d292 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f687 expref: 8 pid: 8452 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.116305:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d18f400/0xfb36a14ee608d2df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6bf expref: 15 pid: 8451 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746066803.116320:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977239936 00000100:00100000:1.0:1746066803.116322:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977239936 00010000:00010000:1.0:1746066803.116330:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xfb36a14ee608d356 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f72f expref: 6 pid: 21973 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746066803.116387:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7895 00000100:00100000:2.0:1746066803.116395:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+8:1965:x1830882977240192:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.116407:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066803.116420:0:7109:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:2.0:1746066803.116425:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d292 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f687 expref: 8 pid: 8452 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.116434:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d292 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f687 expref: 8 pid: 8452 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.116452:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d292 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f687 expref: 8 pid: 8452 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.116467:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.116498:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+7:1965:x1830882977240192:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 104us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.116503:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7895 00000100:00100000:2.0:1746066803.116525:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7896 00000100:00100000:2.0:1746066803.116530:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1964:x1830882977240064:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.116536:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.116543:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d18f400/0xfb36a14ee608d2df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6bf expref: 15 pid: 8451 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.116550:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d18f400/0xfb36a14ee608d2df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6bf expref: 15 pid: 8451 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.116562:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d18f400/0xfb36a14ee608d2df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6bf expref: 15 pid: 8451 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.116570:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.116583:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1964:x1830882977240064:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 53us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.116588:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7896 00000100:00100000:2.0:1746066803.116598:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7897 00000100:00100000:2.0:1746066803.116602:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1966:x1830882977239936:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.116608:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.116614:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xfb36a14ee608d356 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f72f expref: 6 pid: 21973 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.116621:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xfb36a14ee608d356 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f72f expref: 6 pid: 21973 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.116631:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xfb36a14ee608d356 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f72f expref: 6 pid: 21973 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.116641:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.116643:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.116648:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 13 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.116654:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 13 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.116703:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 13 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066803.116715:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976965248:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066803.116759:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.122375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.122409:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.122444:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.122506:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977240576 00000100:00100000:1.0:1746066803.122522:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977240576 00000100:00100000:3.0:1746066803.122534:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977240704 00000100:00100000:3.0:1746066803.122538:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977240704 00002000:00100000:3.0:1746066803.122556:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ed08e00 x1830882977240704/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.122557:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009ed09180 x1830882977240576/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.122565:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed08e00 with x1830882977240704 ext(2097152->3145727) 00002000:00100000:1.0:1746066803.122565:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed09180 with x1830882977240576 ext(3145728->4194303) 00002000:00010000:3.0:1746066803.122570:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed08e00 00002000:00010000:1.0:1746066803.122570:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed09180 00000100:00100000:3.0:1746066803.122595:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977240832 00000100:00100000:3.0:1746066803.122597:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977240832 00002000:00100000:3.0:1746066803.122607:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a5bb0000 x1830882977240832/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.122613:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb0000 with x1830882977240832 ext(3145728->4194303) 00002000:00010000:3.0:1746066803.122615:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb0000 00000100:00100000:1.0:1746066803.122934:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6957 00000100:00100000:1.0:1746066803.122942:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1964:x1830882977240704:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066803.122963:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6958 00000100:00100000:3.0:1746066803.122970:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977240576:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066803.124252:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6959 00000100:00100000:3.0:1746066803.124260:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1963:x1830882977240832:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066803.131233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.131613:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976965248:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066803.131630:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066803.131667:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1966:x1830882977239936:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 15062us (15456us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.131694:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7897 00000100:00100000:1.0:1746066803.132116:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977241216 00000100:00100000:1.0:1746066803.132123:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977241216 00002000:00100000:1.0:1746066803.132163:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1052672->1056767) req@ffff8800a5bb1500 x1830882977241216/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.132178:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb1500 with x1830882977241216 ext(1052672->1056767) 00002000:00010000:1.0:1746066803.132182:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb1500 00000100:00100000:1.0:1746066803.132205:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6960 00000100:00100000:1.0:1746066803.132215:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1963:x1830882977241216:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066803.132339:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1963:x1830882977241216:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 124us (1113us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066803.132344:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6960 00002000:00100000:1.0:1746066803.132349:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1052672->1056767) req@ffff8800a5bb1500 x1830882977241216/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/4536 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.132355:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb1500 with x1830882977241216 ext(1052672->1056767) 00002000:00010000:1.0:1746066803.132357:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb1500 00000100:00100000:3.0:1746066803.146741:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977240576:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 23765us (24366us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066803.146752:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6958 00002000:00100000:3.0:1746066803.146763:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009ed09180 x1830882977240576/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.146772:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed09180 with x1830882977240576 ext(3145728->4194303) 00002000:00010000:3.0:1746066803.146777:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed09180 00000100:00100000:1.0:1746066803.151603:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1964:x1830882977240704:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 28652us (29183us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066803.151614:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6957 00002000:00100000:1.0:1746066803.151624:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ed08e00 x1830882977240704/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.151633:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed08e00 with x1830882977240704 ext(2097152->3145727) 00002000:00010000:1.0:1746066803.151638:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed08e00 00000100:00100000:2.0:1746066803.154351:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.154428:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977241344 00000100:00100000:3.0:1746066803.154447:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977241344 00000100:00100000:3.0:1746066803.154495:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15285 00000100:00100000:3.0:1746066803.154503:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+9:1964:x1830882977241344:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066803.154525:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.154540:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b247800/0xfb36a14ee608d421 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f7b4 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066803.154584:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976965376:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066803.154657:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.156439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.158261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.158290:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977241472 00000100:00100000:0.0:1746066803.158298:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977241472 00000100:00100000:0.0:1746066803.158355:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977241600 00000100:00100000:0.0:1746066803.158357:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977241600 00000100:00100000:0.0:1746066803.158372:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15286 00000100:00100000:0.0:1746066803.158379:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+8:1964:x1830882977241472:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066803.158397:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066803.158413:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec21c00/0xfb36a14ee608d428 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f7bb expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066803.158457:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976965504:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066803.158523:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4df9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.158547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.158562:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.158863:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977241728 00000100:00100000:1.0:1746066803.158867:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977241728 00000100:00100000:1.0:1746066803.158884:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977241856 00000100:00100000:1.0:1746066803.158887:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977241856 00000100:00100000:1.0:1746066803.158903:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15287 00000100:00100000:1.0:1746066803.158908:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882977241600:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066803.158912:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15288 00010000:00010000:1.0:1746066803.158915:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066803.158921:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977241728:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066803.158922:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faf5c00/0xfb36a14ee608d42f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f7c2 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.158930:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.158940:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cad6c00/0xfb36a14ee608d436 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f7c9 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066803.158943:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e869180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976965632:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066803.158950:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.158952:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.158958:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cad6c00/0xfb36a14ee608d436 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7c9 expref: 12 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.158970:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cad6c00/0xfb36a14ee608d436 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7c9 expref: 12 pid: 20532 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066803.158974:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746066803.158980:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cad6c00, rc 0) 00000100:00100000:1.0:1746066803.158989:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15289 00000100:00100000:1.0:1746066803.158993:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977241856:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066803.158999:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.159005:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f7d0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066803.159008:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882977241728:12345-192.168.202.57@tcp:101:cat.0 Request processed in 89us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.159013:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15288 00010000:00010000:1.0:1746066803.159015:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066803.159016:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066803.159021:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.159030:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 12 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.159037:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf4000, rc 0) 00000100:00100000:1.0:1746066803.159052:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882977241856:12345-192.168.202.57@tcp:101:cat.0 Request processed in 58us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066803.159057:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15289 00000100:00100000:0.0:1746066803.161142:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1963:x1830882977240832:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 36877us (38691us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066803.161151:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6959 00002000:00100000:0.0:1746066803.161160:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a5bb0000 x1830882977240832/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.161168:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb0000 with x1830882977240832 ext(3145728->4194303) 00002000:00010000:0.0:1746066803.161173:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb0000 00000100:00100000:3.0:1746066803.162386:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976965376:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066803.162386:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976965504:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066803.162408:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b247800/0xfb36a14ee608d421 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7b4 expref: 11 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066803.162409:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec21c00/0xfb36a14ee608d428 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7bb expref: 11 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.162419:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b247800/0xfb36a14ee608d421 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7b4 expref: 11 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066803.162419:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec21c00/0xfb36a14ee608d428 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7bb expref: 11 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066803.162439:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec21c00, rc 0) 00010000:00010000:3.0:1746066803.162440:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b247800, rc 0) 00000100:00100000:0.0:1746066803.162462:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882977241472:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4085us (6028us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066803.162463:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882977241344:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7961us (8118us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066803.162468:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15286 00000100:00100000:3.0:1746066803.162471:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15285 00002000:00010000:1.0:1746066803.165520:0:4614:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime: 1746066800 -> 1746066802 00002000:00010000:1.0:1746066803.165528:0:4614:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime: 1746066800 -> 1746066802 00002000:00010000:1.0:1746066803.165531:0:4614:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime: 1746066800 -> 1746066802 00000100:00100000:1.0:1746066803.165550:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e869180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976965632:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066803.165577:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faf5c00/0xfb36a14ee608d42f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7c2 expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.165590:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faf5c00/0xfb36a14ee608d42f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7c2 expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.165619:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf5c00, rc 0) 00000100:00100000:1.0:1746066803.165655:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+8:1964:x1830882977241600:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6746us (7401us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066803.165662:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15287 00000100:00100000:0.0:1746066803.172672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.172726:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.173096:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977242112 00000100:00100000:2.0:1746066803.173105:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977242112 00002000:00100000:2.0:1746066803.173141:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e635180 x1830882977242112/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.173149:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e635180 with x1830882977242112 ext(4194304->5091327) 00002000:00010000:2.0:1746066803.173154:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e635180 00000100:00100000:2.0:1746066803.173183:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6961 00000100:00100000:2.0:1746066803.173190:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977242112:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066803.174925:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977242240 00000100:00100000:1.0:1746066803.174932:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977242240 00000100:00100000:1.0:1746066803.174959:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15290 00000100:00100000:1.0:1746066803.174964:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:31957:x1830882977242240:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066803.174975:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.174987:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d444 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f7d7 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.175007:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.175014:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066803.175015:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066803.175018:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d444 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d7 expref: 11 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.175044:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 20 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.175053:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 20 pid: 8451 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746066803.175062:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e869180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976965760:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066803.176386:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.181396:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.181566:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e869180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976965760:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066803.181593:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d444 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d7 expref: 11 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.181608:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf4600, rc 0) 00000100:00100000:1.0:1746066803.181716:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+11:31957:x1830882977242240:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6750us (9051us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066803.181723:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15290 00000100:00100000:2.0:1746066803.181800:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977242368 00000100:00100000:2.0:1746066803.181806:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977242368 00002000:00100000:2.0:1746066803.181833:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (434176->1048575) req@ffff88009e637100 x1830882977242368/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.181841:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e637100 with x1830882977242368 ext(434176->1048575) 00010000:00010000:2.0:1746066803.181847:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 22 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.181858:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 22 pid: 8451 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746066803.181864:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e637100 00000100:00100000:2.0:1746066803.181889:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2247 00000100:00100000:2.0:1746066803.181894:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977242368:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066803.182691:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977242112:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9482us (9945us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066803.182699:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6961 00002000:00100000:3.0:1746066803.182705:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e635180 x1830882977242112/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.182712:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e635180 with x1830882977242112 ext(4194304->5091327) 00002000:00010000:3.0:1746066803.182715:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e635180 00000100:00100000:2.0:1746066803.190443:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977242368:12345-192.168.202.57@tcp:4:cat.0 Request processed in 8541us (9047us total) trans 17179873745 rc 0/0 00000100:00100000:2.0:1746066803.190453:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2247 00002000:00100000:2.0:1746066803.190462:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (434176->1048575) req@ffff88009e637100 x1830882977242368/t17179873745(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/448 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.190470:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e637100 with x1830882977242368 ext(434176->1048575) 00010000:00010000:2.0:1746066803.190479:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 22 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.190492:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 22 pid: 8451 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746066803.190499:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e637100 00000100:00100000:0.0:1746066803.191010:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.191241:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977242496 00000100:00100000:1.0:1746066803.191247:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977242496 00000100:00100000:1.0:1746066803.191288:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15291 00000100:00100000:1.0:1746066803.191294:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977242496:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066803.191305:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.191316:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d44b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f7de expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066803.191436:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e869180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976965888:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066803.191537:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066803.195577:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e869180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976965888:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066803.195606:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d44b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7de expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.195618:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d44b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7de expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.195629:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf5800, rc 0) 00000100:00100000:1.0:1746066803.196296:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977242496:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4998us (5282us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066803.196304:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15291 00000100:00100000:2.0:1746066803.196560:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.196990:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977242624 00000100:00100000:3.0:1746066803.196997:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977242624 00010000:00010000:3.0:1746066803.197021:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 22 pid: 8451 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746066803.197053:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7898 00000100:00100000:3.0:1746066803.197059:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977242624:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066803.197069:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066803.197082:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 22 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.197092:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 22 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.197107:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d18fc00/0xfb36a14ee608d3aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 434176->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f760 expref: 22 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.197413:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.197415:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.197423:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d444 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d7 expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.197430:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d444 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d7 expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.197457:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d444 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d7 expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066803.197468:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976966016:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066803.197543:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.200298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.200360:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977242752 00000100:00100000:1.0:1746066803.200367:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977242752 00000100:00100000:1.0:1746066803.200415:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15292 00000100:00100000:1.0:1746066803.200421:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977242752:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066803.200435:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.200447:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d452 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f7e5 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.200465:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066803.200467:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066803.200473:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d452 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7e5 expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.200484:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d452 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7e5 expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.200497:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf5e00, rc 0) 00000100:00100000:1.0:1746066803.200544:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1965:x1830882977242752:12345-192.168.202.57@tcp:101:cat.0 Request processed in 123us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066803.200550:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15292 00000100:00100000:2.0:1746066803.201045:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976966016:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066803.201060:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.201077:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977242624:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4018us (4518us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.201085:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7898 00000100:00100000:0.0:1746066803.206771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.207112:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977243008 00000100:00100000:2.0:1746066803.207120:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977243008 00002000:00100000:2.0:1746066803.207159:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e637800 x1830882977243008/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.207168:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e637800 with x1830882977243008 ext(0->1048575) 00002000:00010000:2.0:1746066803.207173:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e637800 00000100:00100000:2.0:1746066803.207240:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6962 00000100:00100000:2.0:1746066803.207247:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977243008:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066803.214436:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977243008:12345-192.168.202.57@tcp:3:cat.0 Request processed in 7179us (7661us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066803.214446:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6962 00002000:00100000:2.0:1746066803.214456:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e637800 x1830882977243008/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.214464:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e637800 with x1830882977243008 ext(0->1048575) 00002000:00010000:2.0:1746066803.214469:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e637800 00000100:00100000:0.0:1746066803.223185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.223269:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977243136 00000100:00100000:3.0:1746066803.223277:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977243136 00000100:00100000:3.0:1746066803.223315:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15293 00000100:00100000:3.0:1746066803.223322:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+8:31957:x1830882977243136:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066803.223338:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.223351:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed69800/0xfb36a14ee608d459 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f7ec expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.223376:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 13 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.223383:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066803.223384:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066803.223387:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69800/0xfb36a14ee608d459 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ec expref: 9 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.223440:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 13 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.223455:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 13 pid: 8451 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746066803.223466:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976966144:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066803.223557:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066803.227260:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.227273:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976966144:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066803.227452:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977243264 00000100:00100000:2.0:1746066803.227458:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977243264 00002000:00100000:2.0:1746066803.227495:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e869180 x1830882977243264/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 504/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.227504:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e869180 with x1830882977243264 ext(1048576->2097151) 00010000:00010000:2.0:1746066803.227519:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 14 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.227531:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 14 pid: 8451 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746066803.227537:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e869180 00000100:00100000:2.0:1746066803.227567:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2248 00000100:00100000:2.0:1746066803.227574:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1963:x1830882977243264:12345-192.168.202.57@tcp:4:cat.0 00010000:00010000:3.0:1746066803.227593:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed69800/0xfb36a14ee608d459 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ec expref: 9 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.227606:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed69800, rc 0) 00000100:00100000:3.0:1746066803.227652:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+9:31957:x1830882977243136:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4330us (4474us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.227658:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15293 00000100:00100000:2.0:1746066803.235850:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1963:x1830882977243264:12345-192.168.202.57@tcp:4:cat.0 Request processed in 8267us (8587us total) trans 21474841045 rc 0/0 00000100:00100000:2.0:1746066803.235860:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2248 00002000:00100000:2.0:1746066803.235870:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e869180 x1830882977243264/t21474841045(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 504/448 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.235877:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e869180 with x1830882977243264 ext(1048576->2097151) 00010000:00010000:2.0:1746066803.235886:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 16 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.235896:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 16 pid: 8451 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746066803.235902:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e869180 00000100:00100000:0.0:1746066803.243182:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.243305:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977243392 00000100:00100000:2.0:1746066803.243313:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977243392 00010000:00010000:2.0:1746066803.243343:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 16 pid: 8451 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066803.243387:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7899 00000100:00100000:2.0:1746066803.243394:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1966:x1830882977243392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.243407:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.243425:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 16 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.243435:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 16 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.243453:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecccc00/0xfb36a14ee608d3e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f783 expref: 16 pid: 8451 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.243480:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.243481:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.243487:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69800/0xfb36a14ee608d459 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ec expref: 8 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.243495:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69800/0xfb36a14ee608d459 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ec expref: 8 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.243534:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed69800/0xfb36a14ee608d459 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ec expref: 8 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066803.243545:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093212300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976966272:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066803.243624:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066803.246655:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093212300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976966272:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066803.246704:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.246738:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1966:x1830882977243392:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3344us (3578us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.246747:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7899 00000100:00100000:1.0:1746066803.252218:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.252398:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977243648 00000100:00100000:2.0:1746066803.252406:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977243648 00002000:00100000:2.0:1746066803.252441:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e869500 x1830882977243648/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.252450:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e869500 with x1830882977243648 ext(1048576->2097151) 00002000:00010000:2.0:1746066803.252455:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e869500 00000100:00100000:2.0:1746066803.252481:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6963 00000100:00100000:2.0:1746066803.252488:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+9:1963:x1830882977243648:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:1.0:1746066803.254121:0:9851:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746066803.264603:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+9:1963:x1830882977243648:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12106us (12383us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066803.264614:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6963 00002000:00100000:2.0:1746066803.264624:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e869500 x1830882977243648/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.264633:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e869500 with x1830882977243648 ext(1048576->2097151) 00002000:00010000:2.0:1746066803.264638:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e869500 00000100:00100000:0.0:1746066803.291529:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.292160:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977243776 00000100:00100000:3.0:1746066803.292168:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977243776 00000100:00100000:3.0:1746066803.292205:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15294 00000100:00100000:3.0:1746066803.292211:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+9:31957:x1830882977243776:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066803.292225:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.292240:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed68e00/0xfb36a14ee608d460 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f7f3 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.292264:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 14 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.292275:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066803.292276:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066803.292279:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed68e00/0xfb36a14ee608d460 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7f3 expref: 10 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.292302:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 14 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.292313:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 14 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746066803.292323:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976966400:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066803.305618:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066803.307161:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976966400:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066803.307184:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed68e00/0xfb36a14ee608d460 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7f3 expref: 10 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.307198:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed68e00, rc 0) 00000100:00100000:3.0:1746066803.307236:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+10:31957:x1830882977243776:12345-192.168.202.57@tcp:101:cat.0 Request processed in 15025us (15726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.307243:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15294 00000100:00100000:0.0:1746066803.308206:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.308277:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977243904 00000100:00100000:2.0:1746066803.308283:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977243904 00002000:00100000:2.0:1746066803.308312:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1056767) req@ffff88009b7f9f80 x1830882977243904/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 8680/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.308319:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f9f80 with x1830882977243904 ext(1048576->1056767) 00010000:00010000:2.0:1746066803.308325:0:21550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 15 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.308337:0:21550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 15 pid: 21973 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746066803.308342:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b7f9f80 00000100:00100000:0.0:1746066803.310453:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2249 00000100:00100000:1.0:1746066803.310549:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1963:x1830882977243904:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066803.310954:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1963:x1830882977243904:12345-192.168.202.57@tcp:4:cat.0 Request processed in 491us (2748us total) trans 21474841046 rc 0/0 00000100:00100000:1.0:1746066803.310961:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2249 00002000:00100000:1.0:1746066803.310967:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1056767) req@ffff88009b7f9f80 x1830882977243904/t21474841046(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 8680/448 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.310975:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f9f80 with x1830882977243904 ext(1048576->1056767) 00010000:00010000:1.0:1746066803.310982:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 17 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746066803.310994:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 17 pid: 21973 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746066803.311000:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b7f9f80 00000100:00100000:0.0:1746066803.312716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.312915:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977244032 00000100:00100000:2.0:1746066803.312922:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977244032 00010000:00010000:2.0:1746066803.312953:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 17 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066803.312985:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7900 00000100:00100000:2.0:1746066803.312992:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1963:x1830882977244032:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.313003:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.313018:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 17 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.313027:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 17 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.313045:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d41a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ad expref: 17 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.313071:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.313073:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.313078:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68e00/0xfb36a14ee608d460 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7f3 expref: 9 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.313090:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed68e00/0xfb36a14ee608d460 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7f3 expref: 9 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.313118:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed68e00/0xfb36a14ee608d460 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7f3 expref: 9 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066803.313128:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093212300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976966528:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066803.314974:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066803.332045:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093212300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976966528:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066803.332066:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.333222:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1963:x1830882977244032:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 20227us (20506us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.333231:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7900 00000100:00100000:0.0:1746066803.342461:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.342580:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977244288 00000100:00100000:2.0:1746066803.342587:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977244288 00002000:00100000:2.0:1746066803.342624:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009b7fbb80 x1830882977244288/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.342633:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fbb80 with x1830882977244288 ext(1048576->2097151) 00002000:00010000:2.0:1746066803.342638:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7fbb80 00000100:00100000:2.0:1746066803.345433:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6964 00000100:00100000:2.0:1746066803.345448:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882977244288:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066803.348751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.352196:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977244416 00000100:00100000:3.0:1746066803.352205:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977244416 00000100:00100000:0.0:1746066803.352284:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.355815:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977244544 00000100:00100000:3.0:1746066803.355826:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977244544 00000100:00100000:3.0:1746066803.355884:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15295 00000100:00100000:3.0:1746066803.355891:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1965:x1830882977244416:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066803.355906:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.355920:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed69a00/0xfb36a14ee608d467 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f7fa expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.355938:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.355940:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.355947:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69a00/0xfb36a14ee608d467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7fa expref: 18 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.355961:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed69a00/0xfb36a14ee608d467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7fa expref: 18 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.355970:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed69a00, rc 0) 00000100:00100000:3.0:1746066803.356014:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1965:x1830882977244416:12345-192.168.202.57@tcp:101:cat.0 Request processed in 122us (7270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.356020:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15295 00000100:00100000:3.0:1746066803.356033:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15296 00000100:00100000:3.0:1746066803.356045:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1966:x1830882977244544:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066803.356051:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.356057:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d46e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f801 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.356067:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.356068:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.356071:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d46e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f801 expref: 18 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.356083:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d46e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f801 expref: 18 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.356090:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed68400, rc 0) 00000100:00100000:3.0:1746066803.356104:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1966:x1830882977244544:12345-192.168.202.57@tcp:101:cat.0 Request processed in 60us (3823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.356108:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15296 00000100:00100000:2.0:1746066803.383211:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882977244288:12345-192.168.202.57@tcp:3:cat.0 Request processed in 37760us (40748us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066803.383224:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6964 00002000:00100000:2.0:1746066803.383234:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009b7fbb80 x1830882977244288/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.383242:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fbb80 with x1830882977244288 ext(1048576->2097151) 00002000:00010000:2.0:1746066803.383247:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7fbb80 00000100:00100000:0.0:1746066803.393954:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.393977:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.394017:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.394150:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977244800 00000100:00100000:3.0:1746066803.394159:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977244800 00002000:00100000:3.0:1746066803.394195:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009b7f9c00 x1830882977244800/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.394203:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f9c00 with x1830882977244800 ext(0->1048575) 00002000:00010000:3.0:1746066803.394207:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7f9c00 00000100:00100000:3.0:1746066803.394222:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977245056 00000100:00100000:3.0:1746066803.394224:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977245056 00002000:00100000:3.0:1746066803.394234:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8800929ce680 x1830882977245056/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.394239:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929ce680 with x1830882977245056 ext(1048576->2097151) 00002000:00010000:3.0:1746066803.394241:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929ce680 00000100:00100000:3.0:1746066803.394248:0:1993:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977245312 00000100:00100000:3.0:1746066803.394250:0:1993:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977245312 00002000:00100000:3.0:1746066803.394257:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800929cc000 x1830882977245312/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.394262:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cc000 with x1830882977245312 ext(1048576->2097151) 00002000:00010000:3.0:1746066803.394265:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929cc000 00000100:00100000:3.0:1746066803.394276:0:1993:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6965 00000100:00100000:3.0:1746066803.394282:0:1993:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977244800:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066803.394290:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6966 00000100:00100000:2.0:1746066803.394298:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1965:x1830882977245056:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066803.394506:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6967 00000100:00100000:1.0:1746066803.394540:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1965:x1830882977245312:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066803.405931:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.406761:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977245440 00000100:00100000:0.0:1746066803.406773:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977245440 00000100:00100000:0.0:1746066803.406825:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15297 00000100:00100000:0.0:1746066803.406833:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:31961:x1830882977245440:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066803.406847:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066803.406861:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f808 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.406887:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a00d6000/0xfb36a14ee608d3fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f79f expref: 21 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.406895:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066803.406906:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.406908:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.406911:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 11 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.406937:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066803.406947:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 11 pid: 8450 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066803.406957:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976966656:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066803.407044:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a00d6000/0xfb36a14ee608d3fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f79f expref: 21 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.407052:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a00d6000/0xfb36a14ee608d3fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f79f expref: 21 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066803.407060:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976966784:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066803.407077:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4df9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066803.407383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.407416:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.407465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.407485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.407501:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977245696 00000100:00100000:2.0:1746066803.407504:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977245696 00002000:00100000:2.0:1746066803.407536:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880093211f80 x1830882977245696/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.407544:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093211f80 with x1830882977245696 ext(2097152->3145727) 00002000:00010000:2.0:1746066803.407548:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093211f80 00000100:00100000:2.0:1746066803.407558:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977245824 00000100:00100000:2.0:1746066803.407560:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977245824 00002000:00100000:2.0:1746066803.407568:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880093212300 x1830882977245824/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.407573:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093212300 with x1830882977245824 ext(3145728->4194303) 00002000:00010000:2.0:1746066803.407576:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093212300 00000100:00100000:2.0:1746066803.407586:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977246208 00000100:00100000:2.0:1746066803.407589:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977246208 00002000:00100000:2.0:1746066803.407598:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880093210380 x1830882977246208/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.407603:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093210380 with x1830882977246208 ext(2097152->3145727) 00010000:00010000:2.0:1746066803.407607:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 12 pid: 8450 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.407615:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 12 pid: 8450 timeout: 864 lvb_type: 1 00002000:00010000:2.0:1746066803.407619:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093210380 00000100:00100000:2.0:1746066803.407626:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977246464 00000100:00100000:2.0:1746066803.407628:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977246464 00002000:00100000:2.0:1746066803.407635:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8801361f9500 x1830882977246464/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.407641:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f9500 with x1830882977246464 ext(3145728->4194303) 00010000:00010000:2.0:1746066803.407643:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 13 pid: 8450 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.407650:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 13 pid: 8450 timeout: 864 lvb_type: 1 00002000:00010000:2.0:1746066803.407655:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801361f9500 00000100:00100000:2.0:1746066803.407662:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2250 00000100:00100000:2.0:1746066803.407667:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977246208:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066803.407868:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2251 00000100:00100000:1.0:1746066803.407876:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977246464:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066803.407945:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6968 00000100:00100000:1.0:1746066803.407950:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882977245696:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066803.408745:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6969 00000100:00100000:2.0:1746066803.408752:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977245824:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066803.413465:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1965:x1830882977245056:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19160us (19479us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066803.413475:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6966 00002000:00100000:3.0:1746066803.413485:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8800929ce680 x1830882977245056/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.413493:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929ce680 with x1830882977245056 ext(1048576->2097151) 00002000:00010000:3.0:1746066803.413498:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929ce680 00000100:00100000:0.0:1746066803.418294:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976966656:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066803.418318:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976966784:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066803.418345:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 15 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.418365:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec21a00, rc 0) 00000100:00100000:0.0:1746066803.418395:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:31961:x1830882977245440:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 11564us (12471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.418403:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15297 00000100:00100000:1.0:1746066803.418426:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.418518:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977246592 00000100:00100000:3.0:1746066803.418524:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977246592 00010000:00010000:3.0:1746066803.418548:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00d6000/0xfb36a14ee608d3fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f79f expref: 20 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746066803.418566:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7901 00000100:00100000:3.0:1746066803.418572:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977246592:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066803.418581:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066803.418596:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00d6000/0xfb36a14ee608d3fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f79f expref: 20 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.418605:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00d6000/0xfb36a14ee608d3fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f79f expref: 20 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.418623:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00d6000/0xfb36a14ee608d3fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f79f expref: 20 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.418644:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066803.418663:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1963:x1830882977246592:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.418668:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7901 00000100:00100000:1.0:1746066803.418846:0:1993:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977244800:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24563us (24898us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066803.418853:0:1993:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6965 00002000:00100000:1.0:1746066803.418861:0:1993:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009b7f9c00 x1830882977244800/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.418868:0:1993:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f9c00 with x1830882977244800 ext(0->1048575) 00002000:00010000:1.0:1746066803.418871:0:1993:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b7f9c00 00000100:00100000:1.0:1746066803.445638:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1965:x1830882977245312:12345-192.168.202.57@tcp:3:cat.0 Request processed in 51091us (51610us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066803.445648:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6967 00002000:00100000:1.0:1746066803.445658:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800929cc000 x1830882977245312/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.445667:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cc000 with x1830882977245312 ext(1048576->2097151) 00002000:00010000:1.0:1746066803.445671:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929cc000 00000100:00100000:2.0:1746066803.447016:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977246208:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 39346us (39547us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066803.447023:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2250 00002000:00100000:2.0:1746066803.447029:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880093210380 x1830882977246208/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.447037:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093210380 with x1830882977246208 ext(2097152->3145727) 00010000:00010000:2.0:1746066803.447044:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 13 pid: 8450 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.447057:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 13 pid: 8450 timeout: 864 lvb_type: 1 00002000:00010000:2.0:1746066803.447063:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093210380 00000100:00100000:0.0:1746066803.453725:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.453786:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977246720 00000100:00100000:2.0:1746066803.453793:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977246720 00000100:00100000:2.0:1746066803.453831:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15298 00000100:00100000:2.0:1746066803.453837:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:31966:x1830882977246720:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066803.453849:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066803.453861:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608d47c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f80f expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.453879:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.453884:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 12 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.453893:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066803.453896:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608d47c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f80f expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.453923:0:4614:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 12 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.453931:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608d47c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f80f expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.453939:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af1600, rc 0) 00000100:00100000:2.0:1746066803.453970:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:31966:x1830882977246720:12345-192.168.202.57@tcp:101:cat.0 Request processed in 134us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.453975:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15298 00000100:00100000:1.0:1746066803.460018:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977245696:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 52059us (52627us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066803.460029:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6968 00002000:00100000:1.0:1746066803.460040:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff880093211f80 x1830882977245696/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.460047:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093211f80 with x1830882977245696 ext(2097152->3145727) 00002000:00010000:1.0:1746066803.460053:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093211f80 00000100:00100000:2.0:1746066803.463642:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882977245824:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 54883us (56217us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066803.463653:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6969 00002000:00100000:2.0:1746066803.463662:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff880093212300 x1830882977245824/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.463672:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093212300 with x1830882977245824 ext(3145728->4194303) 00002000:00010000:2.0:1746066803.463699:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093212300 00000100:00100000:0.0:1746066803.465569:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.465618:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977246848 00000100:00100000:3.0:1746066803.465625:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977246848 00000100:00100000:3.0:1746066803.465663:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15299 00000100:00100000:3.0:1746066803.465669:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:31957:x1830882977246848:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066803.465707:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.465720:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608d483 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f816 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.465740:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.465746:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608d483 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f816 expref: 14 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.465756:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608d483 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f816 expref: 14 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.465764:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed69c00, rc 0) 00000100:00100000:3.0:1746066803.465793:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:31957:x1830882977246848:12345-192.168.202.57@tcp:101:cat.0 Request processed in 125us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.465798:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15299 00000100:00100000:1.0:1746066803.469935:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977246464:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 62052us (62440us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066803.469944:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2251 00002000:00100000:1.0:1746066803.469953:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8801361f9500 x1830882977246464/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.469961:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f9500 with x1830882977246464 ext(3145728->4194303) 00010000:00010000:1.0:1746066803.469969:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 12 pid: 8450 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746066803.469981:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 12 pid: 8450 timeout: 864 lvb_type: 1 00002000:00010000:1.0:1746066803.469987:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801361f9500 00000100:00100000:0.0:1746066803.478162:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.478225:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977246976 00000100:00100000:3.0:1746066803.478233:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977246976 00010000:00010000:3.0:1746066803.478263:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 12 pid: 8450 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746066803.478299:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7902 00000100:00100000:3.0:1746066803.478307:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882977246976:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066803.478318:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066803.478336:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 12 pid: 8450 timeout: 864 lvb_type: 1 00010000:00010000:3.0:1746066803.478347:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 12 pid: 8450 timeout: 864 lvb_type: 1 00010000:00010000:3.0:1746066803.478364:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faf4000/0xfb36a14ee608d43d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d0 expref: 12 pid: 8450 timeout: 864 lvb_type: 1 00010000:00010000:3.0:1746066803.478390:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.478392:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.478397:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 11 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.478404:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 11 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.478430:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 11 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.478439:0:7107:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 11 pid: 4614 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746066803.478452:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976967040:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066803.478531:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.483129:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.483156:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977247232 00000100:00100000:1.0:1746066803.483163:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977247232 00002000:00100000:1.0:1746066803.483196:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2805760->2809855) req@ffff8800929cd880 x1830882977247232/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.483205:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cd880 with x1830882977247232 ext(2805760->2809855) 00010000:00010000:1.0:1746066803.483212:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 12 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746066803.483226:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 12 pid: 4614 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746066803.483232:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929cd880 00000100:00100000:3.0:1746066803.483400:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882976967040:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066803.483428:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066803.483485:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882977246976:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5177us (5327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.483504:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7902 00000100:00100000:1.0:1746066803.483728:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2252 00000100:00100000:1.0:1746066803.483736:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977247232:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066803.483857:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977247232:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 123us (739us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066803.483862:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2252 00002000:00100000:1.0:1746066803.483867:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2805760->2809855) req@ffff8800929cd880 x1830882977247232/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/4536 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.483874:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cd880 with x1830882977247232 ext(2805760->2809855) 00010000:00010000:1.0:1746066803.483879:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 11 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746066803.483888:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 11 pid: 4614 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746066803.483893:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929cd880 00000100:00100000:0.0:1746066803.505667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.506211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.506293:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977247488 00000100:00100000:2.0:1746066803.506302:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977247488 00002000:00100000:2.0:1746066803.506338:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (2805760->3145727) req@ffff8800929cdf80 x1830882977247488/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.506354:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cdf80 with x1830882977247488 ext(2805760->3145727) 00010000:00010000:2.0:1746066803.506362:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 11 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.506375:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 11 pid: 4614 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746066803.506382:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929cdf80 00000100:00100000:2.0:1746066803.506403:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2253 00000100:00100000:2.0:1746066803.506410:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+11:1965:x1830882977247488:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:3.0:1746066803.507485:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977247616 00000100:00100000:3.0:1746066803.507491:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977247616 00000100:00100000:3.0:1746066803.507539:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10152 00000100:00100000:3.0:1746066803.507544:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+16:31967:x1830882977247616:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066803.507558:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.507572:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68600/0xfb36a14ee608d48a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f81d expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.507612:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68800/0xfb36a14ee608d491 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066803.507622:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68800/0xfb36a14ee608d491 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066803.507631:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68800/0xfb36a14ee608d491 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066803.507640:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69e00/0xfb36a14ee608d498 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066803.507644:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69e00/0xfb36a14ee608d498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066803.507649:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69e00/0xfb36a14ee608d498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066803.508118:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.508142:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977247744 00000100:00100000:0.0:1746066803.508145:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977247744 00000100:00100000:0.0:1746066803.508169:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15300 00000100:00100000:0.0:1746066803.508175:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+11:31961:x1830882977247744:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066803.508183:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066803.508192:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f824 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.508209:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b164e00/0xfb36a14ee608d3f0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f791 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.508215:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cad6c00/0xfb36a14ee608d436 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7c9 expref: 12 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066803.508225:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.508226:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.508229:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->3502079] (req 3145728->3502079) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 12 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.508253:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cad6c00/0xfb36a14ee608d436 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7c9 expref: 12 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066803.508262:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cad6c00/0xfb36a14ee608d436 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7c9 expref: 12 pid: 20532 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066803.508272:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092046300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976967168:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066803.508330:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b164e00/0xfb36a14ee608d3f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f791 expref: 21 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.508338:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b164e00/0xfb36a14ee608d3f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f791 expref: 21 pid: 4614 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066803.508346:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976967296:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066803.508364:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4df9c00 going to sleep for 11 seconds 00000100:00080000:2.0:1746066803.509715:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746066803.512308:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066803.512329:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f775 expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.512336:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc200/0xfb36a14ee608d40c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7a6 expref: 269 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.512341:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066803.512372:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc200/0xfb36a14ee608d40c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7a6 expref: 269 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.512382:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc200/0xfb36a14ee608d40c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7a6 expref: 269 pid: 14549 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746066803.512394:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976967424:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066803.512467:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f775 expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.512474:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f775 expref: 21 pid: 14549 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746066803.512481:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976967552:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066803.512496:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066803.515834:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:1965:x1830882977247488:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 9415us (10165us total) trans 21474841047 rc 0/0 00000100:00100000:2.0:1746066803.515845:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2253 00002000:00100000:2.0:1746066803.515856:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (2805760->3145727) req@ffff8800929cdf80 x1830882977247488/t21474841047(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/448 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.515865:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cdf80 with x1830882977247488 ext(2805760->3145727) 00010000:00010000:2.0:1746066803.515874:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 13 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.515885:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 13 pid: 4614 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746066803.515892:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929cdf80 00000100:00100000:0.0:1746066803.518025:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092046300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976967168:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066803.518037:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976967296:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066803.518068:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->3502079] (req 3145728->3502079) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 12 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.518088:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf5800, rc 0) 00000100:00100000:0.0:1746066803.518129:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:31961:x1830882977247744:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 9954us (10011us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.518136:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15300 00000100:00100000:1.0:1746066803.518455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.518725:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977247872 00000100:00100000:2.0:1746066803.518731:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977247872 00010000:00010000:2.0:1746066803.518754:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cad6c00/0xfb36a14ee608d436 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7c9 expref: 12 pid: 20532 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746066803.518772:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7903 00000100:00100000:2.0:1746066803.518778:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882977247872:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.518788:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.518805:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cad6c00/0xfb36a14ee608d436 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7c9 expref: 12 pid: 20532 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.518813:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cad6c00/0xfb36a14ee608d436 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7c9 expref: 12 pid: 20532 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.518830:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cad6c00/0xfb36a14ee608d436 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7c9 expref: 12 pid: 20532 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066803.518995:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.519023:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.519041:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977248128 00000100:00100000:0.0:1746066803.519044:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977248128 00010000:00010000:0.0:1746066803.519062:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f775 expref: 22 pid: 14549 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746066803.519547:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976967424:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066803.519555:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135433800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976967552:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066803.519569:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00080000:3.0:1746066803.519594:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746066803.519785:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.519807:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+11:1965:x1830882977247872:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1029us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.519813:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7903 00000100:00100000:2.0:1746066803.519824:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977248000 00000100:00100000:2.0:1746066803.519826:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977248000 00010000:00010000:2.0:1746066803.519835:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc200/0xfb36a14ee608d40c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7a6 expref: 270 pid: 14549 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066803.520293:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7904 00000100:00100000:0.0:1746066803.520301:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977248128:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066803.520309:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066803.520314:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f775 expref: 22 pid: 14549 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066803.520322:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f775 expref: 22 pid: 14549 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066803.520335:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d18ee00/0xfb36a14ee608d3c6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f775 expref: 22 pid: 14549 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066803.520349:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066803.520353:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066803.520363:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066803.520368:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066803.520372:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066803.520389:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092045180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977248128:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 90us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.520395:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7904 00000100:00100000:0.0:1746066803.520407:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7905 00000100:00100000:0.0:1746066803.520412:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+270:1963:x1830882977248000:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066803.520418:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066803.520421:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc200/0xfb36a14ee608d40c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7a6 expref: 270 pid: 14549 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066803.520428:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc200/0xfb36a14ee608d40c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7a6 expref: 270 pid: 14549 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066803.520438:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eccc200/0xfb36a14ee608d40c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7a6 expref: 270 pid: 14549 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066803.520445:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066803.520448:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066803.520454:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066803.520463:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066803.520476:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066803.520488:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+269:1963:x1830882977248000:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 77us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.520493:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7905 00010000:00010000:2.0:1746066803.520792:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520802:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746066803.520834:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:2.0:1746066803.520837:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746066803.520849:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520857:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520865:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68800/0xfb36a14ee608d491 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520870:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68800/0xfb36a14ee608d491 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520874:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68800/0xfb36a14ee608d491 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520879:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed68800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066803.520882:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68800/0xfb36a14ee608d491 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520887:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68800/0xfb36a14ee608d491 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520894:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066803.520897:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066803.520899:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68800/0xfb36a14ee608d491 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520903:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68800/0xfb36a14ee608d491 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520913:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69e00/0xfb36a14ee608d498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520918:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69e00/0xfb36a14ee608d498 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520921:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69e00/0xfb36a14ee608d498 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520925:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ed69e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066803.520927:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69e00/0xfb36a14ee608d498 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520932:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69e00/0xfb36a14ee608d498 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520937:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012dc13900) 00010000:00010000:2.0:1746066803.520938:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066803.520940:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69e00/0xfb36a14ee608d498 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520944:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69e00/0xfb36a14ee608d498 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.520970:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68600/0xfb36a14ee608d48a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f81d expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.520980:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f81d expref: 17 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.520985:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066803.520987:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066803.520989:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed69000, rc 0) 00000100:00100000:2.0:1746066803.521012:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:31967:x1830882977247616:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 13468us (14801us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.521017:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10152 00000100:00100000:3.0:1746066803.522979:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.523016:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.523037:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977248256 00000100:00100000:3.0:1746066803.523042:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977248256 00010000:00010000:3.0:1746066803.523064:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 13 pid: 4614 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746066803.523092:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977248384 00000100:00100000:3.0:1746066803.523094:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977248384 00010000:00010000:3.0:1746066803.523104:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b164e00/0xfb36a14ee608d3f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f791 expref: 22 pid: 4614 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746066803.523116:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7906 00000100:00100000:3.0:1746066803.523122:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977248256:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066803.523131:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066803.523144:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066802 -> 1746066803 00002000:00010000:3.0:1746066803.523147:0:7109:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066802 -> 1746066803 00010000:00010000:3.0:1746066803.523151:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 13 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.523164:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 13 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.523179:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec21a00/0xfb36a14ee608d475 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f808 expref: 13 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.523192:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.523194:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.523199:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608d47c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f80f expref: 17 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.523206:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608d47c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f80f expref: 17 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.523212:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.523213:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.523216:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608d483 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f816 expref: 12 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.523221:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608d483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f816 expref: 12 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.523242:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608d483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f816 expref: 12 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066803.523253:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976967680:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066803.523314:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608d47c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f80f expref: 17 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066803.523321:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976967808:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066803.523335:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066803.523389:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7907 00000100:00100000:3.0:1746066803.523394:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977248384:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066803.523401:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066803.523413:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b164e00/0xfb36a14ee608d3f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f791 expref: 22 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.523421:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b164e00/0xfb36a14ee608d3f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f791 expref: 22 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.523432:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b164e00/0xfb36a14ee608d3f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f791 expref: 22 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.523441:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.523443:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.523446:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.523452:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.523469:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066803.523476:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976967936:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066803.523497:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.527457:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.527483:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.528199:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977248512 00000100:00100000:1.0:1746066803.528206:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977248512 00000100:00100000:0.0:1746066803.528218:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00080000:3.0:1746066803.528251:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066803.528310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.528322:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977248640 00000100:00100000:1.0:1746066803.528322:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977248768 00000100:00100000:1.0:1746066803.528324:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977248768 00000100:00100000:2.0:1746066803.528325:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977248640 00000100:00100000:1.0:1746066803.528345:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15301 00000100:00100000:2.0:1746066803.528349:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15302 00000100:00100000:1.0:1746066803.528351:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882977248512:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:2.0:1746066803.528353:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882977248768:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066803.528364:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.528364:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066803.528377:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d4b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f839 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.528377:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ed34800/0xfb36a14ee608d4ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f82b expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.528394:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066803.528394:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.528396:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066803.528396:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.528402:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d4b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f839 expref: 7 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.528402:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed34800/0xfb36a14ee608d4ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f82b expref: 7 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066803.528414:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d4b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f839 expref: 7 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.528414:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ed34800/0xfb36a14ee608d4ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f82b expref: 7 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066803.528422:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed69200, rc 0) 00010000:00010000:1.0:1746066803.528422:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed34800, rc 0) 00000100:00100000:1.0:1746066803.528454:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977248512:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 104us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066803.528460:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15301 00000100:00100000:3.0:1746066803.528467:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15303 00000100:00100000:3.0:1746066803.528473:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977248640:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066803.528479:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.528485:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608d4bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f832 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.528493:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.528494:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.528498:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608d4bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f832 expref: 8 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.528506:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608d4bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f832 expref: 8 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.528524:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093cf7e00, rc 0) 00000100:00100000:2.0:1746066803.528688:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977248768:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 322us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.528697:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15302 00000100:00100000:1.0:1746066803.528702:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977248896 00000100:00100000:1.0:1746066803.528705:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977248896 00000100:00100000:1.0:1746066803.528720:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15304 00000100:00100000:1.0:1746066803.528724:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977248896:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066803.528730:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.528737:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ed34200/0xfb36a14ee608d4c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f840 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066803.528767:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976968064:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066803.528804:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066803.528940:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977248640:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 467us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.528946:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15303 00000100:00100000:3.0:1746066803.528975:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976967680:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066803.529376:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.529423:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976967808:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066803.529440:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066803.529460:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882977248256:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6339us (6485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.529467:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7906 00000100:00100000:1.0:1746066803.529500:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135432a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882976967936:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066803.529519:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066803.529535:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1965:x1830882977248384:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6140us (6519us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066803.529540:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7907 00000100:00100000:2.0:1746066803.529615:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977249024 00000100:00100000:2.0:1746066803.529618:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977249024 00000100:00100000:2.0:1746066803.529636:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15305 00000100:00100000:2.0:1746066803.529641:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977249024:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066803.529647:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066803.529654:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608d4c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f847 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.529664:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.529665:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.529691:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608d4c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f847 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066803.529701:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608d4c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f847 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066803.529708:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff04e00, rc 0) 00000100:00100000:2.0:1746066803.529724:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977249024:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 83us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.529728:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15305 00000100:00100000:0.0:1746066803.535012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.535312:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977249408 00000100:00100000:2.0:1746066803.535318:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977249408 00002000:00010000:1.0:1746066803.535331:0:21203:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime: 1746066802 -> 1746066803 00002000:00010000:1.0:1746066803.535335:0:21203:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime: 1746066801 -> 1746066803 00002000:00010000:1.0:1746066803.535337:0:21203:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime: 1746066802 -> 1746066803 00002000:00100000:2.0:1746066803.535351:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880092045500 x1830882977249408/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066803.535352:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976968064:192.168.202.57@tcp:106: 00002000:00100000:2.0:1746066803.535359:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092045500 with x1830882977249408 ext(2097152->3145727) 00002000:00010000:2.0:1746066803.535363:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092045500 00010000:00010000:1.0:1746066803.535378:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ed34200/0xfb36a14ee608d4c2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f840 expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066803.535380:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6970 00000100:00100000:2.0:1746066803.535386:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1966:x1830882977249408:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:1.0:1746066803.535389:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ed34200/0xfb36a14ee608d4c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f840 expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.535401:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed34200, rc 0) 00000100:00100000:1.0:1746066803.535436:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977248896:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 6711us (7125us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066803.535442:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15304 00000100:00100000:0.0:1746066803.536189:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.537939:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977249664 00000100:00100000:1.0:1746066803.537946:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977249664 00002000:00100000:1.0:1746066803.537973:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (3497984->3502079) req@ffff880092044a80 x1830882977249664/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.537981:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092044a80 with x1830882977249664 ext(3497984->3502079) 00002000:00010000:1.0:1746066803.537986:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092044a80 00000100:00100000:1.0:1746066803.538014:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6971 00000100:00100000:1.0:1746066803.538020:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+11:1965:x1830882977249664:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066803.538120:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+11:1965:x1830882977249664:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 100us (1931us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066803.538126:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6971 00002000:00100000:1.0:1746066803.538131:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (3497984->3502079) req@ffff880092044a80 x1830882977249664/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/4536 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.538137:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092044a80 with x1830882977249664 ext(3497984->3502079) 00002000:00010000:1.0:1746066803.538140:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092044a80 00000100:00100000:0.0:1746066803.553876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.554061:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977249792 00000100:00100000:2.0:1746066803.554068:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977249792 00002000:00100000:2.0:1746066803.554106:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880092047800 x1830882977249792/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.554115:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092047800 with x1830882977249792 ext(2097152->3145727) 00002000:00010000:2.0:1746066803.554120:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092047800 00000100:00100000:2.0:1746066803.554139:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6972 00000100:00100000:2.0:1746066803.554145:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977249792:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066803.557407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.557479:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.557650:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977250304 00000100:00100000:3.0:1746066803.557658:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977250304 00000100:00100000:3.0:1746066803.557724:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4262 00000100:00100000:3.0:1746066803.557731:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d05050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+21:31961:x1830882977250304:12345-192.168.202.57@tcp:35:multiop.0 00000001:00080000:3.0:1746066803.557952:0:14551:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589944236 00000100:00100000:3.0:1746066803.558107:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d05050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:31961:x1830882977250304:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 376us (626us total) trans 8589944237 rc 0/0 00000100:00100000:3.0:1746066803.558115:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4262 00000020:00080000:3.0:1746066803.558120:0:14551:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1746066803.558163:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977250048 00000100:00100000:3.0:1746066803.558166:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977250048 00000100:00100000:3.0:1746066803.558183:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10153 00000100:00100000:3.0:1746066803.558187:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+17:31967:x1830882977250048:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066803.558195:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.558208:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d4d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f84e expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.558255:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066803.558266:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f81d expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.558273:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066803.558301:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f81d expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.558312:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f81d expref: 18 pid: 14549 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746066803.558336:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976968192:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066803.558382:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066803.558600:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1966:x1830882977249408:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23213us (23595us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066803.558607:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6970 00002000:00100000:3.0:1746066803.558616:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880092045500 x1830882977249408/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.558624:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092045500 with x1830882977249408 ext(2097152->3145727) 00002000:00010000:3.0:1746066803.558627:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092045500 00000100:00100000:2.0:1746066803.570264:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977249792:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 16109us (16386us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066803.570274:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6972 00002000:00100000:2.0:1746066803.570284:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff880092047800 x1830882977249792/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.570293:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092047800 with x1830882977249792 ext(2097152->3145727) 00002000:00010000:2.0:1746066803.570298:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092047800 00000100:00100000:3.0:1746066803.574545:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976968192:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066803.574569:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066803.575893:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.575925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.575987:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.576547:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977250816 00000100:00100000:1.0:1746066803.576554:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977250816 00000100:00100000:1.0:1746066803.576601:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15306 00000100:00100000:1.0:1746066803.576608:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:31966:x1830882977250816:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066803.576623:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.576636:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009912e400/0xfb36a14ee608d4de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f855 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.576658:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.576665:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066803.576667:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066803.576670:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009912e400/0xfb36a14ee608d4de lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f855 expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.576725:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 10 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.576734:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 10 pid: 4614 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746066803.576744:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976968320:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066803.576893:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977250688 00000100:00100000:2.0:1746066803.576898:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977250688 00002000:00100000:2.0:1746066803.576921:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (3502080->4194303) req@ffff88008efb4000 x1830882977250688/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.576929:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb4000 with x1830882977250688 ext(3502080->4194303) 00010000:00010000:2.0:1746066803.576935:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 11 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.576943:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 11 pid: 4614 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746066803.576952:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008efb4000 00000100:00100000:2.0:1746066803.576965:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2254 00000100:00100000:2.0:1746066803.576971:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977250688:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066803.578231:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066803.578689:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977250432 00000100:00100000:3.0:1746066803.578695:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977250432 00010000:00010000:3.0:1746066803.578720:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f81d expref: 19 pid: 14549 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746066803.578741:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7908 00000100:00100000:3.0:1746066803.578746:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+19:1963:x1830882977250432:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066803.578755:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066803.578759:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f81d expref: 19 pid: 14549 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.578767:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f81d expref: 19 pid: 14549 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.578783:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed69000/0xfb36a14ee608d4a6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f81d expref: 19 pid: 14549 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746066803.578797:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066803.578801:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066803.578808:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066803.578814:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066803.578828:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066803.578858:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+18:1963:x1830882977250432:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 112us (2967us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.578863:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7908 00010000:00010000:3.0:1746066803.578884:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066803.578889:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066803.578903:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066803.579014:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad7e00/0xfb36a14ee608d4d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f84e expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.579026:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f84e expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.579032:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066803.579034:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066803.579036:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cad6c00, rc 0) 00000100:00100000:3.0:1746066803.579057:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+18:31967:x1830882977250048:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 20870us (21658us total) trans 8589944238 rc 0/0 00000100:00100000:3.0:1746066803.579063:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10153 00000100:00100000:3.0:1746066803.579871:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.579890:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977251072 00000100:00100000:0.0:1746066803.579894:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977251072 00002000:00100000:3.0:1746066803.579923:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135430a80 x1830882977251072/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.579931:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135430a80 with x1830882977251072 ext(3145728->4194303) 00002000:00010000:3.0:1746066803.579934:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135430a80 00000100:00100000:3.0:1746066803.579945:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6973 00000100:00100000:3.0:1746066803.579950:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882977251072:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066803.583192:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.583878:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977251200 00000100:00100000:1.0:1746066803.583887:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977251200 00000100:00100000:1.0:1746066803.583934:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15307 00000100:00100000:1.0:1746066803.583941:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:31963:x1830882977251200:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066803.583959:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.583974:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f85c expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.583998:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69800/0xfb36a14ee608d459 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ec expref: 13 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.584007:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608d4bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f832 expref: 7 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.584013:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69a00/0xfb36a14ee608d467 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7fa expref: 19 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.584022:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066803.584024:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066803.584026:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1159168->2097151] (req 1159168->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.584049:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed69a00/0xfb36a14ee608d467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7fa expref: 19 pid: 21973 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066803.584057:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066803.584058:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed69a00/0xfb36a14ee608d467 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7fa expref: 19 pid: 21973 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746066803.584068:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976968448:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066803.584125:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977251328 00000100:00100000:2.0:1746066803.584129:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977251328 00000100:00100000:2.0:1746066803.584153:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10154 00000100:00100000:2.0:1746066803.584158:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+18:31967:x1830882977251328:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066803.584169:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066803.584178:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99e00/0xfb36a14ee608d4f3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f863 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.584236:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.584248:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f84e expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.584253:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.584269:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f84e expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.584276:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f84e expref: 19 pid: 14549 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066803.584284:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976968576:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066803.584336:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cb40 going to sleep for 11 seconds 00010000:00010000:1.0:1746066803.584399:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608d4bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f832 expref: 7 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.584408:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608d4bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f832 expref: 7 pid: 8112 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746066803.584416:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976968704:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066803.584441:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed69800/0xfb36a14ee608d459 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ec expref: 13 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.584449:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed69800/0xfb36a14ee608d459 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ec expref: 13 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746066803.584462:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976968832:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066803.584479:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.590930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.591283:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976968320:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066803.591310:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009912e400/0xfb36a14ee608d4de lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f855 expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.591326:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009912e400, rc 0) 00000100:00100000:1.0:1746066803.591375:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31966:x1830882977250816:12345-192.168.202.57@tcp:101:cat.0 Request processed in 14767us (15386us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066803.591384:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15306 00000100:00100000:2.0:1746066803.592935:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977251456 00000100:00100000:2.0:1746066803.592944:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977251456 00002000:00100000:2.0:1746066803.592984:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (3145728->3502079) req@ffff88008efb5180 x1830882977251456/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.592992:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb5180 with x1830882977251456 ext(3145728->3502079) 00010000:00010000:2.0:1746066803.592999:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 13 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.593009:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 13 pid: 4614 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746066803.593014:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008efb5180 00000100:00100000:2.0:1746066803.593039:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2255 00000100:00100000:2.0:1746066803.593046:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977251456:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066803.593711:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977250688:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 16739us (17783us total) trans 0 rc 692224/692224 00000100:00100000:0.0:1746066803.593718:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2254 00002000:00100000:0.0:1746066803.593724:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (3502080->4194303) req@ffff88008efb4000 x1830882977250688/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 692224/692224 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.593731:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb4000 with x1830882977250688 ext(3502080->4194303) 00010000:00010000:0.0:1746066803.593735:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 13 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066803.593743:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 13 pid: 4614 timeout: 864 lvb_type: 0 00002000:00010000:0.0:1746066803.593749:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008efb4000 00000100:00100000:1.0:1746066803.599666:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976968576:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066803.599707:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066803.600280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.601116:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976968448:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066803.601217:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.601235:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977251584 00000100:00100000:0.0:1746066803.601240:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977251584 00010000:00010000:0.0:1746066803.601269:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f84e expref: 20 pid: 14549 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066803.601289:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977251712 00000100:00100000:0.0:1746066803.601292:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977251712 00010000:00010000:0.0:1746066803.601303:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608d4bb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f832 expref: 8 pid: 8112 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066803.601318:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7909 00000100:00100000:0.0:1746066803.601325:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+20:1965:x1830882977251584:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066803.601334:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066803.601340:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f84e expref: 20 pid: 14549 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066803.601351:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f84e expref: 20 pid: 14549 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066803.601354:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976968704:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066803.601361:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976968832:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066803.601370:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cad6c00/0xfb36a14ee608d4d7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f84e expref: 20 pid: 14549 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.601384:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1159168->2097151] (req 1159168->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.601385:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066803.601389:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066803.601395:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.601396:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009391fe00, rc 0) 00010000:00010000:0.0:1746066803.601400:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066803.601414:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.601431:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:31963:x1830882977251200:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 17490us (18247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.601440:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15307 00000100:00100000:2.0:1746066803.601463:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7910 00000100:00100000:2.0:1746066803.601468:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977251712:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.601476:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.601492:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608d4bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f832 expref: 8 pid: 8112 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.601500:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608d4bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f832 expref: 8 pid: 8112 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.601522:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093cf7e00/0xfb36a14ee608d4bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f832 expref: 8 pid: 8112 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.601534:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066803.601577:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066803.601583:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746066803.601614:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:1.0:1746066803.601617:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746066803.601631:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066803.601653:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99e00/0xfb36a14ee608d4f3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f863 expref: 20 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.601668:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f863 expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.601687:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066803.601689:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066803.601691:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f99c00, rc 0) 00000100:00100000:0.0:1746066803.602201:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+19:1965:x1830882977251584:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 875us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.602206:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7909 00000100:00100000:0.0:1746066803.602241:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.602251:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977251840 00000100:00100000:0.0:1746066803.602253:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977251840 00010000:00010000:0.0:1746066803.602263:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69800/0xfb36a14ee608d459 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ec expref: 14 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066803.602469:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7911 00000100:00100000:0.0:1746066803.602476:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+14:1965:x1830882977251840:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066803.602485:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066803.602494:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed69800/0xfb36a14ee608d459 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ec expref: 14 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066803.602501:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed69800/0xfb36a14ee608d459 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ec expref: 14 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066803.602524:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69800/0xfb36a14ee608d459 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7ec expref: 14 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066803.602533:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066803.602548:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:1965:x1830882977251840:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 74us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.602553:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7911 00000100:00100000:0.0:1746066803.602627:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.602637:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977251968 00000100:00100000:0.0:1746066803.602639:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977251968 00010000:00010000:0.0:1746066803.602651:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69a00/0xfb36a14ee608d467 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7fa expref: 19 pid: 21973 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066803.602671:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7912 00000100:00100000:0.0:1746066803.602688:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1966:x1830882977251968:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066803.602695:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066803.602702:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed69a00/0xfb36a14ee608d467 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7fa expref: 19 pid: 21973 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066803.602714:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed69a00/0xfb36a14ee608d467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7fa expref: 19 pid: 21973 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066803.602725:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69a00/0xfb36a14ee608d467 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7fa expref: 19 pid: 21973 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066803.602732:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.602734:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.602738:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.602745:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.602766:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066803.602775:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976968960:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066803.602809:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4df9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066803.603164:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882977251712:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1694us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.603169:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7910 00000100:00100000:1.0:1746066803.603841:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+18:31967:x1830882977251328:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 19680us (19781us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066803.603849:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10154 00000100:00100000:3.0:1746066803.604596:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977251072:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 24644us (24724us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066803.604604:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6973 00002000:00100000:3.0:1746066803.604612:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880135430a80 x1830882977251072/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.604620:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135430a80 with x1830882977251072 ext(3145728->4194303) 00002000:00010000:3.0:1746066803.604625:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135430a80 00000100:00100000:2.0:1746066803.608835:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977251456:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 15780us (17904us total) trans 17179873746 rc 0/0 00000100:00100000:2.0:1746066803.608846:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2255 00002000:00100000:2.0:1746066803.608856:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (3145728->3502079) req@ffff88008efb5180 x1830882977251456/t17179873746(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/448 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.608865:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb5180 with x1830882977251456 ext(3145728->3502079) 00010000:00010000:2.0:1746066803.608874:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 13 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.608888:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 13 pid: 4614 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746066803.608895:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008efb5180 00000100:00100000:0.0:1746066803.610740:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.611436:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.612148:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977252224 00000100:00100000:2.0:1746066803.612156:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977252224 00000100:00100000:0.0:1746066803.612199:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976968960:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066803.612223:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066803.612256:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1966:x1830882977251968:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 9579us (9628us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.612267:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7912 00000100:00100000:0.0:1746066803.612358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.612865:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977252096 00000100:00100000:1.0:1746066803.612870:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977252096 00000100:00100000:2.0:1746066803.612872:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15308 00000100:00100000:2.0:1746066803.612880:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977252224:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066803.612893:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066803.612908:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093cf7e00/0xfb36a14ee608d501 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f871 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066803.612954:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976969088:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066803.612995:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066803.613007:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977252480 00000100:00100000:2.0:1746066803.613010:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977252480 00002000:00100000:2.0:1746066803.613032:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1159168->1163263) req@ffff8800a45e6680 x1830882977252480/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.613041:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e6680 with x1830882977252480 ext(1159168->1163263) 00002000:00010000:2.0:1746066803.613044:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a45e6680 00000100:00100000:1.0:1746066803.613245:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15309 00000100:00100000:1.0:1746066803.613252:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977252096:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066803.613260:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.613270:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8535e00/0xfb36a14ee608d508 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f86a expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066803.613294:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976969216:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066803.613298:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6974 00000100:00100000:2.0:1746066803.613304:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1963:x1830882977252480:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066803.613329:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066803.613646:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1963:x1830882977252480:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 341us (1286us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066803.613655:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6974 00002000:00100000:2.0:1746066803.613660:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1159168->1163263) req@ffff8800a45e6680 x1830882977252480/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/4536 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.613666:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e6680 with x1830882977252480 ext(1159168->1163263) 00002000:00010000:2.0:1746066803.613669:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a45e6680 00000100:00100000:0.0:1746066803.620192:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.620956:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.621037:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977252864 00000100:00100000:3.0:1746066803.621042:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977252608 00000100:00100000:2.0:1746066803.621044:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977252864 00000100:00100000:3.0:1746066803.621047:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977252608 00000100:00100000:3.0:1746066803.621089:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15310 00000100:00100000:3.0:1746066803.621095:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977252608:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066803.621109:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.621123:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e41a400/0xfb36a14ee608d50f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f878 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066803.621161:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976969344:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066803.621232:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066803.621257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.621450:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15311 00000100:00100000:2.0:1746066803.621456:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977252864:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066803.621463:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066803.621472:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a489fe00/0xfb36a14ee608d516 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f87f expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066803.621494:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976969472:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066803.621525:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.621625:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977252736 00000100:00100000:0.0:1746066803.621629:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977252736 00010000:00010000:0.0:1746066803.621648:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 15 pid: 4614 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746066803.621668:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7913 00000100:00100000:0.0:1746066803.621689:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882977252736:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066803.621697:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066803.621715:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 15 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066803.621725:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 15 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746066803.621740:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.621742:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.621748:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009912e400/0xfb36a14ee608d4de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f855 expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.621755:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009912e400/0xfb36a14ee608d4de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f855 expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.621774:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009912e400/0xfb36a14ee608d4de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f855 expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066803.621784:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976969600:192.168.202.57@tcp:105: 00002000:00010000:1.0:1746066803.621937:0:21203:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime: 1746066802 -> 1746066803 00002000:00010000:1.0:1746066803.621940:0:21203:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime: 1746066802 -> 1746066803 00002000:00010000:1.0:1746066803.621942:0:21203:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime: 1746066802 -> 1746066803 00000100:00100000:1.0:1746066803.621953:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976969216:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066803.621974:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8535e00/0xfb36a14ee608d508 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f86a expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066803.622135:0:8452:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.57@tcp) returned -22 from glimpse AST (req@ffff880135df9180 x1830882976969088) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 15 pid: 4614 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066803.622151:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976969088:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066803.622165:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093cf7e00/0xfb36a14ee608d501 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f871 expref: 8 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066803.622174:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093cf7e00/0xfb36a14ee608d501 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f871 expref: 8 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066803.622191:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093cf7e00, rc 0) 00000100:00100000:2.0:1746066803.622364:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977252224:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 9484us (11628us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066803.622370:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15308 00000100:00100000:0.0:1746066803.622377:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4df9c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746066803.622661:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8535e00/0xfb36a14ee608d508 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f86a expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.622673:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8535e00, rc 0) 00000100:00100000:1.0:1746066803.622707:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977252096:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 9455us (11271us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066803.622712:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15309 00010000:00010000:2.0:1746066803.628708:0:4614:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.57@tcp) returned -22 from glimpse AST (req@ffff880135df8a80 x1830882976969472) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 15 pid: 4614 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.628751:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5800/0xfb36a14ee608d49f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3502079) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f824 expref: 15 pid: 4614 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066803.628768:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976969472:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066803.628801:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a489fe00/0xfb36a14ee608d516 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f87f expref: 14 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066803.628814:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a489fe00/0xfb36a14ee608d516 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f87f expref: 14 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066803.628821:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a489fe00, rc 0) 00000100:00100000:2.0:1746066803.628866:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977252864:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7409us (8682us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066803.628879:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15311 00000100:00100000:3.0:1746066803.629024:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976969344:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066803.629041:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e41a400/0xfb36a14ee608d50f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f878 expref: 12 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.629050:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e41a400/0xfb36a14ee608d50f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f878 expref: 12 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.629059:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e41a400, rc 0) 00000100:00100000:3.0:1746066803.629076:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977252608:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7982us (8122us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066803.629081:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15310 00000100:00100000:0.0:1746066803.629145:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976969600:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066803.629159:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066803.629175:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:1966:x1830882977252736:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7503us (7920us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066803.629182:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7913 00000100:00100000:1.0:1746066803.629266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.629657:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977253120 00000100:00100000:0.0:1746066803.629663:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977253120 00000100:00100000:0.0:1746066803.629726:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10155 00000100:00100000:0.0:1746066803.629733:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+18:31967:x1830882977253120:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066803.629749:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066803.629765:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f160600/0xfb36a14ee608d51d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f886 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.630163:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d524 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.630175:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d524 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.630185:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d524 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.630195:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d524 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.631747:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d524 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.631763:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d524 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.631768:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a489f000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066803.631772:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d524 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.631778:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d524 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.631790:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066803.631793:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066803.631796:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d524 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.631801:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d524 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.631833:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f160600/0xfb36a14ee608d51d lrc: 1/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f886 expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.631839:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f160600/0xfb36a14ee608d51d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f886 expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.631854:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f160600, rc 0) 00000100:00100000:2.0:1746066803.631906:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+18:31967:x1830882977253120:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2172us (2638us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066803.631912:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10155 00000100:00100000:2.0:1746066803.633701:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.633773:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977253248 00000100:00100000:3.0:1746066803.633779:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977253248 00000100:00100000:3.0:1746066803.633866:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15312 00000100:00100000:3.0:1746066803.633873:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+12:31957:x1830882977253248:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066803.633889:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.633902:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e41ac00/0xfb36a14ee608d52b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f88d expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.633921:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.633923:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.633929:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e41ac00/0xfb36a14ee608d52b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f88d expref: 13 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.633942:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e41ac00/0xfb36a14ee608d52b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f88d expref: 13 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.633950:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e41ac00, rc 0) 00000100:00100000:3.0:1746066803.634488:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+13:31957:x1830882977253248:12345-192.168.202.57@tcp:101:cat.0 Request processed in 614us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.634493:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15312 00000100:00100000:0.0:1746066803.636479:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.636541:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.637132:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977253632 00000100:00100000:3.0:1746066803.637139:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977253632 00002000:00100000:3.0:1746066803.637176:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a45e4e00 x1830882977253632/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.637185:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e4e00 with x1830882977253632 ext(3145728->4194303) 00002000:00010000:3.0:1746066803.637189:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a45e4e00 00000100:00100000:3.0:1746066803.637212:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977253760 00000100:00100000:3.0:1746066803.637215:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977253760 00002000:00100000:3.0:1746066803.637226:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a45e7b80 x1830882977253760/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.637233:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e7b80 with x1830882977253760 ext(3145728->4194303) 00002000:00010000:3.0:1746066803.637236:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a45e7b80 00000100:00100000:0.0:1746066803.637236:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6975 00000100:00100000:0.0:1746066803.637246:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977253632:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066803.637251:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6976 00000100:00100000:3.0:1746066803.637254:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1964:x1830882977253760:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066803.640730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.641460:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.642820:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977254144 00000100:00100000:3.0:1746066803.642829:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977254144 00000100:00100000:3.0:1746066803.642880:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4263 00000100:00100000:3.0:1746066803.642887:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+18:31967:x1830882977254144:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:3.0:1746066803.643052:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+19:31967:x1830882977254144:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 164us (1592us total) trans 8589944239 rc 0/0 00000100:00100000:3.0:1746066803.643058:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4263 00000100:00100000:3.0:1746066803.643079:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977253888 00000100:00100000:3.0:1746066803.643082:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977253888 00000100:00100000:3.0:1746066803.643099:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15313 00000100:00100000:3.0:1746066803.643103:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:31963:x1830882977253888:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066803.643112:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.643124:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f894 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.643144:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68e00/0xfb36a14ee608d460 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7f3 expref: 10 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.643151:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d4b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f839 expref: 6 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.643157:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d46e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f801 expref: 21 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.643166:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.643168:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.643170:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 21 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.643193:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d46e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f801 expref: 21 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.643203:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d46e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f801 expref: 21 pid: 21973 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746066803.643213:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976969728:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066803.643263:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d4b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f839 expref: 6 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.643270:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d4b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f839 expref: 6 pid: 4614 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746066803.643277:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135433480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976969856:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066803.643300:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed68e00/0xfb36a14ee608d460 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7f3 expref: 10 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.643306:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed68e00/0xfb36a14ee608d460 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7f3 expref: 10 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746066803.643318:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135432680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976969984:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066803.643331:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.645502:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.646085:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977254400 00000100:00100000:2.0:1746066803.646092:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977254400 00002000:00100000:2.0:1746066803.646127:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a45e4000 x1830882977254400/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.646136:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e4000 with x1830882977254400 ext(4194304->5091327) 00002000:00010000:2.0:1746066803.646140:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a45e4000 00000100:00100000:2.0:1746066803.646169:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6977 00000100:00100000:2.0:1746066803.646176:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+13:1966:x1830882977254400:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066803.651066:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976969728:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066803.651216:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135433480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976969856:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066803.651225:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135432680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976969984:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066803.651253:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 21 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.651268:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e41b600, rc 0) 00000100:00100000:2.0:1746066803.653137:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:31963:x1830882977253888:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 10024us (12406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.653146:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15313 00000100:00100000:1.0:1746066803.653406:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.654710:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977254528 00000100:00100000:0.0:1746066803.654718:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977254528 00000100:00100000:1.0:1746066803.655395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.655437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.655490:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977254656 00000100:00100000:2.0:1746066803.655494:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977254656 00010000:00010000:2.0:1746066803.655519:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d46e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f801 expref: 21 pid: 21973 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746066803.655540:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977254784 00000100:00100000:2.0:1746066803.655542:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977254784 00010000:00010000:2.0:1746066803.655550:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed68e00/0xfb36a14ee608d460 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7f3 expref: 11 pid: 21973 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746066803.655561:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7914 00000100:00100000:2.0:1746066803.655567:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977254656:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.655576:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.655593:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d46e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f801 expref: 21 pid: 21973 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.655602:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d46e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f801 expref: 21 pid: 21973 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.655619:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68400/0xfb36a14ee608d46e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f801 expref: 21 pid: 21973 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746066803.655635:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.655669:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977254656:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 102us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.655692:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7914 00000100:00100000:2.0:1746066803.655704:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7915 00000100:00100000:2.0:1746066803.655708:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+11:1966:x1830882977254784:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.655717:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.655724:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed68e00/0xfb36a14ee608d460 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7f3 expref: 11 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.655731:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed68e00/0xfb36a14ee608d460 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7f3 expref: 11 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.655742:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed68e00/0xfb36a14ee608d460 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7f3 expref: 11 pid: 21973 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746066803.655749:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.655762:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+10:1966:x1830882977254784:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 54us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.655767:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7915 00010000:00010000:0.0:1746066803.655964:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d4b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f839 expref: 7 pid: 4614 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746066803.655987:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7916 00000100:00100000:0.0:1746066803.655995:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1966:x1830882977254528:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066803.656002:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066803.656009:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d4b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f839 expref: 7 pid: 4614 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066803.656017:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d4b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f839 expref: 7 pid: 4614 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066803.656028:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69200/0xfb36a14ee608d4b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f839 expref: 7 pid: 4614 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746066803.656050:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.656051:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066803.656057:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 19 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.656064:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 19 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.656090:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 19 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066803.656101:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976970112:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066803.656145:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4df9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066803.656179:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1964:x1830882977253760:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 18922us (19636us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066803.656187:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6976 00002000:00100000:3.0:1746066803.656194:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a45e7b80 x1830882977253760/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.656202:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e7b80 with x1830882977253760 ext(3145728->4194303) 00002000:00010000:3.0:1746066803.656206:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a45e7b80 00000100:00100000:2.0:1746066803.658423:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977253632:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 21175us (21943us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066803.658432:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6975 00002000:00100000:2.0:1746066803.658441:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a45e4e00 x1830882977253632/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.658449:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e4e00 with x1830882977253632 ext(3145728->4194303) 00002000:00010000:2.0:1746066803.658453:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a45e4e00 00000100:00100000:0.0:1746066803.660077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.660153:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977255040 00000100:00100000:3.0:1746066803.660161:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977255040 00002000:00100000:3.0:1746066803.660193:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1052672->1056767) req@ffff8800a45e7480 x1830882977255040/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.660201:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e7480 with x1830882977255040 ext(1052672->1056767) 00002000:00010000:3.0:1746066803.660205:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a45e7480 00000100:00100000:3.0:1746066803.660221:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6978 00000100:00100000:3.0:1746066803.660227:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1963:x1830882977255040:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066803.660300:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976970112:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066803.660319:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066803.660927:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1963:x1830882977255040:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 699us (854us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066803.660933:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6978 00002000:00100000:3.0:1746066803.660939:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1052672->1056767) req@ffff8800a45e7480 x1830882977255040/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/4536 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.660947:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e7480 with x1830882977255040 ext(1052672->1056767) 00002000:00010000:3.0:1746066803.660950:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a45e7480 00000100:00100000:2.0:1746066803.661446:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1966:x1830882977254528:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5452us (8038us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.661457:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7916 00000100:00100000:2.0:1746066803.663181:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+13:1966:x1830882977254400:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17000us (17677us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066803.663189:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6977 00002000:00100000:2.0:1746066803.663197:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a45e4000 x1830882977254400/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.663205:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e4000 with x1830882977254400 ext(4194304->5091327) 00002000:00010000:2.0:1746066803.663210:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a45e4000 00000100:00100000:0.0:1746066803.666366:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.666415:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.666470:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977255296 00000100:00100000:3.0:1746066803.666477:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977255296 00000100:00100000:3.0:1746066803.666529:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977255168 00000100:00100000:3.0:1746066803.666532:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977255168 00000100:00100000:3.0:1746066803.666549:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15314 00000100:00100000:3.0:1746066803.666555:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+11:1966:x1830882977255296:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066803.666569:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.666584:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b787800/0xfb36a14ee608d539 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f8a2 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066803.666633:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976970240:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066803.666725:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066803.666849:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15315 00000100:00100000:1.0:1746066803.666856:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+12:1966:x1830882977255168:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066803.666862:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.666869:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800925a3e00/0xfb36a14ee608d540 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f89b expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066803.667403:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976970368:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066803.667429:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.669845:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.669931:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977255552 00000100:00100000:1.0:1746066803.669939:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977255552 00000100:00100000:1.0:1746066803.669987:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4264 00000100:00100000:1.0:1746066803.669994:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+269:31963:x1830882977255552:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:1.0:1746066803.670178:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+270:31963:x1830882977255552:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 185us (339us total) trans 8589944240 rc 0/0 00000100:00100000:1.0:1746066803.670184:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4264 00002000:00010000:3.0:1746066803.673303:0:4614:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime: 1746066802 -> 1746066803 00002000:00010000:3.0:1746066803.673309:0:4614:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime: 1746066802 -> 1746066803 00002000:00010000:3.0:1746066803.673311:0:4614:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime: 1746066802 -> 1746066803 00000100:00100000:3.0:1746066803.673332:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976970240:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066803.673359:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b787800/0xfb36a14ee608d539 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8a2 expref: 13 pid: 4614 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066803.673367:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066803.673369:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b787800/0xfb36a14ee608d539 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8a2 expref: 13 pid: 4614 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066803.673474:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976970368:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066803.673487:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800925a3e00/0xfb36a14ee608d540 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f89b expref: 12 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.673494:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800925a3e00/0xfb36a14ee608d540 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f89b expref: 12 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.673500:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925a3e00, rc 0) 00000100:00100000:1.0:1746066803.673538:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+11:1966:x1830882977255168:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6683us (7123us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066803.673545:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15315 00000100:00100000:2.0:1746066803.673607:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977255808 00000100:00100000:2.0:1746066803.673612:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977255808 00002000:00100000:2.0:1746066803.673640:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a45e5180 x1830882977255808/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.673648:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e5180 with x1830882977255808 ext(4194304->5091327) 00002000:00010000:2.0:1746066803.673652:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a45e5180 00000100:00100000:2.0:1746066803.673689:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6979 00010000:00010000:3.0:1746066803.673693:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b787800, rc 0) 00000100:00100000:2.0:1746066803.673697:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977255808:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066803.673714:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:1966:x1830882977255296:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7160us (7355us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066803.673719:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15314 00000100:00100000:0.0:1746066803.680465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.680501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.680971:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977256064 00000100:00100000:3.0:1746066803.680980:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977256064 00000100:00100000:3.0:1746066803.681021:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977255936 00000100:00100000:3.0:1746066803.681024:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977255936 00000100:00100000:3.0:1746066803.681038:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15316 00000100:00100000:3.0:1746066803.681044:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+11:1966:x1830882977256064:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066803.681058:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066803.681070:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb96e00/0xfb36a14ee608d547 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f8b0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066803.681109:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976970496:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066803.681182:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066803.681332:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15317 00000100:00100000:1.0:1746066803.681339:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+12:1966:x1830882977255936:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066803.681346:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.681352:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800925a2600/0xfb36a14ee608d54e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f8a9 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066803.681373:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976970624:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066803.681392:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066803.683382:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977255808:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9681us (10010us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066803.683389:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6979 00002000:00100000:2.0:1746066803.683397:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a45e5180 x1830882977255808/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.683405:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e5180 with x1830882977255808 ext(4194304->5091327) 00002000:00010000:2.0:1746066803.683409:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a45e5180 00000100:00100000:3.0:1746066803.683718:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976970496:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066803.683742:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eb96e00/0xfb36a14ee608d547 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8b0 expref: 13 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.683753:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb96e00/0xfb36a14ee608d547 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8b0 expref: 13 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066803.683763:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb96e00, rc 0) 00000100:00100000:3.0:1746066803.683791:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1966:x1830882977256064:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2747us (3332us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066803.683797:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15316 00000100:00100000:1.0:1746066803.683869:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976970624:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066803.683963:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800925a2600/0xfb36a14ee608d54e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8a9 expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.683974:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800925a2600/0xfb36a14ee608d54e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8a9 expref: 11 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.683980:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925a2600, rc 0) 00000100:00100000:1.0:1746066803.684012:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+10:1966:x1830882977255936:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2673us (3510us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066803.684017:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15317 00000100:00100000:0.0:1746066803.835332:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.835547:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977256320 00000100:00100000:2.0:1746066803.835554:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977256320 00000100:00100000:2.0:1746066803.835595:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10156 00000100:00100000:2.0:1746066803.835602:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:31977:x1830882977256320:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066803.835623:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066803.835639:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489fe00/0xfb36a14ee608d555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f8b7 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.835739:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.835753:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f863 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.835759:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.835786:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f863 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.835796:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f863 expref: 18 pid: 14549 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066803.835806:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976970752:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066803.835890:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.845359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.845447:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976970752:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066803.845466:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066803.846653:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.846708:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977256704 00000100:00100000:2.0:1746066803.846715:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977256704 00010000:00010000:2.0:1746066803.846743:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f863 expref: 19 pid: 14549 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066803.846784:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7917 00000100:00100000:2.0:1746066803.846791:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+19:1963:x1830882977256704:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.846802:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.846808:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f863 expref: 19 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066803.846817:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f863 expref: 19 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066803.846834:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f99c00/0xfb36a14ee608d4fa lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f863 expref: 19 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066803.846848:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066803.846852:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.846859:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.846865:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066803.846889:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.846920:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+18:1963:x1830882977256704:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 130us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.846926:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7917 00000100:00100000:1.0:1746066803.847154:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977256576 00000100:00100000:1.0:1746066803.847159:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977256576 00000100:00100000:1.0:1746066803.847181:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10157 00000100:00100000:1.0:1746066803.847186:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+270:31979:x1830882977256576:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066803.847201:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.847211:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2400/0xfb36a14ee608d563 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f8be expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.847282:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608d56a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066803.847290:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608d56a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066803.847297:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608d56a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:1.0:1746066803.847306:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066803.847398:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a2400/0xfb36a14ee608d563 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8be expref: 273 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.847417:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608d56a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8be expref: 272 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.847424:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066803.847426:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066803.847428:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925a3000, rc 0) 00000100:00100000:1.0:1746066803.847449:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+272:31979:x1830882977256576:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 263us (2098us total) trans 8589944241 rc 0/0 00000100:00100000:1.0:1746066803.847454:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10157 00010000:00010000:3.0:1746066803.847537:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066803.847544:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066803.847555:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066803.847611:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489fe00/0xfb36a14ee608d555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8b7 expref: 26 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.847625:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8b7 expref: 25 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.847630:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066803.847632:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066803.847634:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a489f000, rc 0) 00000100:00100000:3.0:1746066803.847652:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+25:31977:x1830882977256320:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 12051us (12327us total) trans 8589944242 rc 0/0 00000100:00100000:3.0:1746066803.847658:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10156 00000100:00100000:0.0:1746066803.850128:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.852727:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977256960 00000100:00100000:3.0:1746066803.852737:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977256960 00002000:00100000:3.0:1746066803.852780:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->1159167) req@ffff880093212a00 x1830882977256960/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.852789:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093212a00 with x1830882977256960 ext(1048576->1159167) 00002000:00010000:3.0:1746066803.852794:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093212a00 00000100:00100000:3.0:1746066803.852816:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6980 00000100:00100000:3.0:1746066803.852823:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1965:x1830882977256960:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066803.858152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.858342:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977257088 00000100:00100000:2.0:1746066803.858350:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977257088 00002000:00100000:2.0:1746066803.858383:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1056768->2097151) req@ffff880093210e00 x1830882977257088/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.858393:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093210e00 with x1830882977257088 ext(1056768->2097151) 00002000:00010000:2.0:1746066803.858398:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093210e00 00000100:00100000:2.0:1746066803.858416:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6981 00000100:00100000:2.0:1746066803.858422:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1966:x1830882977257088:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066803.888535:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.888598:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977257344 00000100:00100000:1.0:1746066803.888605:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977257344 00000100:00100000:1.0:1746066803.888659:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15318 00000100:00100000:1.0:1746066803.888666:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31979:x1830882977257344:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066803.888703:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.888718:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f8c5 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.888742:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608d47c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f80f expref: 23 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.888749:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608d4c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f847 expref: 5 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.888755:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608d483 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f816 expref: 9 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.888764:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066803.888765:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066803.888768:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2506752->2719743] (req 2506752->2719743) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.888792:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608d483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f816 expref: 9 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.888803:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608d483 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f816 expref: 9 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746066803.888812:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976970880:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066803.888885:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608d4c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f847 expref: 5 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.888893:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608d4c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f847 expref: 5 pid: 4614 timeout: 865 lvb_type: 1 00000100:00100000:1.0:1746066803.888900:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976971008:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066803.888925:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608d47c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f80f expref: 23 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.888932:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608d47c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f80f expref: 23 pid: 4614 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746066803.888944:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976971136:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066803.888958:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066803.890923:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977256960:12345-192.168.202.57@tcp:3:cat.0 Request processed in 38095us (40795us total) trans 0 rc 110592/110592 00000100:00100000:3.0:1746066803.890933:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6980 00002000:00100000:3.0:1746066803.890943:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->1159167) req@ffff880093212a00 x1830882977256960/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 110592/110592 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.890950:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093212a00 with x1830882977256960 ext(1048576->1159167) 00002000:00010000:3.0:1746066803.890956:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093212a00 00000100:00100000:2.0:1746066803.892721:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1966:x1830882977257088:12345-192.168.202.57@tcp:3:cat.0 Request processed in 34293us (34570us total) trans 0 rc 1040384/1040384 00000100:00100000:2.0:1746066803.892729:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6981 00002000:00100000:2.0:1746066803.892737:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1056768->2097151) req@ffff880093210e00 x1830882977257088/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1040384/1040384 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.892745:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093210e00 with x1830882977257088 ext(1056768->2097151) 00002000:00010000:2.0:1746066803.892750:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093210e00 00000100:00100000:0.0:1746066803.902632:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.902698:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.902894:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976970880:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066803.902904:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976971008:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066803.902911:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976971136:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066803.902944:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2506752->2719743] (req 2506752->2719743) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066803.902958:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb6f200, rc 0) 00000100:00100000:1.0:1746066803.903006:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:31979:x1830882977257344:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 14340us (14479us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066803.903014:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15318 00000100:00100000:2.0:1746066803.903986:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977257472 00000100:00100000:2.0:1746066803.903994:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977257472 00010000:00010000:2.0:1746066803.904021:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608d4c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f847 expref: 6 pid: 4614 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746066803.904095:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977257600 00000100:00100000:3.0:1746066803.904100:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977257600 00010000:00010000:3.0:1746066803.904115:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608d47c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f80f expref: 19 pid: 4614 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066803.905119:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7918 00000100:00100000:2.0:1746066803.905128:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882977257472:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.905139:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.905157:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608d4c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f847 expref: 6 pid: 4614 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746066803.905166:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608d4c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f847 expref: 6 pid: 4614 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746066803.905185:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ff04e00/0xfb36a14ee608d4c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f847 expref: 6 pid: 4614 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746066803.905200:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.905232:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1964:x1830882977257472:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 106us (2608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.905237:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7918 00000100:00100000:2.0:1746066803.905247:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7919 00000100:00100000:2.0:1746066803.905251:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1964:x1830882977257600:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066803.905256:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066803.905263:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608d47c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f80f expref: 19 pid: 4614 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066803.905270:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608d47c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f80f expref: 19 pid: 4614 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066803.905281:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1600/0xfb36a14ee608d47c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f80f expref: 19 pid: 4614 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066803.905293:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066803.905306:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1964:x1830882977257600:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 55us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.905311:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7919 00000100:00100000:0.0:1746066803.918660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.918718:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977257728 00000100:00100000:3.0:1746066803.918726:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977257728 00010000:00010000:3.0:1746066803.918755:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608d483 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f816 expref: 10 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066803.918795:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7920 00000100:00100000:3.0:1746066803.918801:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882977257728:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066803.918813:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066803.918831:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608d483 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f816 expref: 10 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066803.918842:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608d483 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f816 expref: 10 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066803.918863:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed69c00/0xfb36a14ee608d483 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f816 expref: 10 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066803.918880:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.918883:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.918888:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.918896:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.918923:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066803.918933:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976971264:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066803.919002:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066803.931931:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976971264:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066803.931949:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066803.931984:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+9:1964:x1830882977257728:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 13181us (13330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.931994:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7920 00000100:00100000:0.0:1746066803.937664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.937725:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.937744:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977257856 00000100:00100000:1.0:1746066803.937752:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977257856 00000100:00100000:0.0:1746066803.937754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.937784:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977258112 00000100:00100000:1.0:1746066803.937786:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977258112 00000100:00100000:0.0:1746066803.937795:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.937796:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977257984 00000100:00100000:1.0:1746066803.937798:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977257984 00000100:00100000:1.0:1746066803.937819:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15319 00000100:00100000:1.0:1746066803.937825:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882977257856:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:0.0:1746066803.937829:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15320 00010000:00010000:1.0:1746066803.937839:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066803.937841:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882977258112:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066803.937848:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.937855:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a737c000/0xfb36a14ee608d586 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f8cc expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.937855:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009391e800/0xfb36a14ee608d58d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f8da expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066803.937893:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976971520:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066803.937893:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976971392:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066803.937950:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15321 00000100:00100000:1.0:1746066803.937956:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977257984:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:0.0:1746066803.937960:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4df9c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746066803.937962:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066803.937968:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931e7e00/0xfb36a14ee608d594 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f8d3 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066803.937986:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976971648:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066803.938005:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066803.938013:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066803.938032:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977258368 00000100:00100000:1.0:1746066803.938035:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977258368 00002000:00100000:1.0:1746066803.938055:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (2506752->2510847) req@ffff8800a5bb3b80 x1830882977258368/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.938062:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb3b80 with x1830882977258368 ext(2506752->2510847) 00002000:00010000:1.0:1746066803.938065:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb3b80 00000100:00100000:1.0:1746066803.938076:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6982 00000100:00100000:1.0:1746066803.938080:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1963:x1830882977258368:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066803.938192:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1963:x1830882977258368:12345-192.168.202.57@tcp:3:cat.0 Request processed in 110us (396us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066803.938198:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6982 00002000:00100000:1.0:1746066803.938204:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (2506752->2510847) req@ffff8800a5bb3b80 x1830882977258368/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/4536 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066803.938215:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb3b80 with x1830882977258368 ext(2506752->2510847) 00002000:00010000:1.0:1746066803.938218:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb3b80 00002000:00010000:2.0:1746066803.940262:0:8112:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime: 1746066801 -> 1746066803 00000100:00100000:1.0:1746066803.940273:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976971520:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066803.940276:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976971392:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066803.940296:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009391e800/0xfb36a14ee608d58d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8da expref: 14 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.940296:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a737c000/0xfb36a14ee608d586 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8cc expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066803.940305:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009391e800/0xfb36a14ee608d58d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8da expref: 14 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.940306:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a737c000/0xfb36a14ee608d586 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8cc expref: 14 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.940319:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a737c000, rc 0) 00010000:00010000:2.0:1746066803.940329:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009391e800, rc 0) 00000100:00100000:1.0:1746066803.940344:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977257856:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2518us (2685us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066803.940350:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15319 00000100:00100000:2.0:1746066803.940351:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977258112:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2516us (2625us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066803.940356:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15320 00000100:00100000:1.0:1746066803.944739:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976971648:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066803.944769:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931e7e00/0xfb36a14ee608d594 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8d3 expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.944781:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931e7e00/0xfb36a14ee608d594 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8d3 expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066803.944791:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931e7e00, rc 0) 00000100:00100000:1.0:1746066803.944828:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+9:1963:x1830882977257984:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6871us (7073us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066803.944835:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15321 00000100:00100000:1.0:1746066803.945070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.946056:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.946175:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066803.946215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.946248:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977258752 00000100:00100000:0.0:1746066803.946254:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977258752 00000100:00100000:3.0:1746066803.947575:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977258624 00000100:00100000:3.0:1746066803.947582:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977258624 00002000:00100000:3.0:1746066803.947609:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2715648->2719743) req@ffff88009ec2ce00 x1830882977258624/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.947622:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2ce00 with x1830882977258624 ext(2715648->2719743) 00002000:00010000:3.0:1746066803.947626:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2ce00 00000100:00100000:3.0:1746066803.947642:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977259136 00000100:00100000:3.0:1746066803.947644:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977259136 00002000:00100000:3.0:1746066803.947653:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009ec2dc00 x1830882977259136/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.947659:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2dc00 with x1830882977259136 ext(2097152->3145727) 00002000:00010000:3.0:1746066803.947661:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2dc00 00000100:00100000:3.0:1746066803.947668:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977259264 00000100:00100000:3.0:1746066803.947669:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977259264 00002000:00100000:3.0:1746066803.947689:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->2506751) req@ffff88009ec2d500 x1830882977259264/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.947693:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2d500 with x1830882977259264 ext(2097152->2506751) 00002000:00010000:3.0:1746066803.947696:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2d500 00000100:00100000:3.0:1746066803.947706:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6983 00000100:00100000:3.0:1746066803.947711:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1963:x1830882977258624:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066803.947837:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1963:x1830882977258624:12345-192.168.202.57@tcp:3:cat.0 Request processed in 126us (2768us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066803.947843:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6983 00002000:00100000:3.0:1746066803.947847:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (2715648->2719743) req@ffff88009ec2ce00 x1830882977258624/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/4536 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.947852:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2ce00 with x1830882977258624 ext(2715648->2719743) 00002000:00010000:3.0:1746066803.947854:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2ce00 00000100:00100000:3.0:1746066803.947864:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6984 00000100:00100000:3.0:1746066803.947868:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977259136:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066803.948854:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6985 00000100:00100000:3.0:1746066803.948859:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1966:x1830882977259264:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066803.952318:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15322 00000100:00100000:0.0:1746066803.952339:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+9:31977:x1830882977258752:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066803.952354:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066803.952368:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f8e1 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.952390:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.952396:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066803.952397:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066803.952400:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2703360->3145727] (req 2703360->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 10 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.952423:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066803.952432:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 19 pid: 21203 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746066803.952445:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976971776:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066803.952524:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4df9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.954238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.954532:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977259392 00000100:00100000:2.0:1746066803.954539:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977259392 00000100:00100000:2.0:1746066803.954623:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15323 00000100:00100000:2.0:1746066803.954630:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+11:31983:x1830882977259392:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066803.954643:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066803.954654:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608d5a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f8e8 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.954692:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.954698:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066803.954699:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066803.954703:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608d5a2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e8 expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.954724:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.954737:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 19 pid: 8452 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066803.954747:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976971904:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066803.954818:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066803.956778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.956883:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976971776:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066803.956907:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2703360->3145727] (req 2703360->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 12 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.956920:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009391f000, rc 0) 00000100:00100000:2.0:1746066803.956949:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:31977:x1830882977258752:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4621us (10894us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.956956:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15322 00000100:00100000:3.0:1746066803.957117:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977259520 00000100:00100000:3.0:1746066803.957122:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977259520 00002000:00100000:3.0:1746066803.957152:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (2506752->2719743) req@ffff88009b7fad80 x1830882977259520/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.957161:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fad80 with x1830882977259520 ext(2506752->2719743) 00010000:00010000:3.0:1746066803.957166:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 20 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066803.957175:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 20 pid: 21203 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066803.957180:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b7fad80 00000100:00100000:3.0:1746066803.957951:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2256 00000100:00100000:3.0:1746066803.957959:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1966:x1830882977259520:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066803.962959:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976971904:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066803.962982:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608d5a2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e8 expref: 11 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.962995:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a489ec00, rc 0) 00000100:00100000:3.0:1746066803.964639:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977259136:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16762us (18455us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066803.964649:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6984 00002000:00100000:3.0:1746066803.964659:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009ec2dc00 x1830882977259136/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.964667:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2dc00 with x1830882977259136 ext(2097152->3145727) 00002000:00010000:3.0:1746066803.964673:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2dc00 00000100:00100000:2.0:1746066803.965668:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+11:31983:x1830882977259392:12345-192.168.202.57@tcp:101:cat.0 Request processed in 11033us (11428us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.965685:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15323 00000100:00100000:3.0:1746066803.966829:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1966:x1830882977259264:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17967us (20610us total) trans 0 rc 409600/409600 00000100:00100000:3.0:1746066803.966836:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6985 00002000:00100000:3.0:1746066803.966844:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->2506751) req@ffff88009ec2d500 x1830882977259264/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/440 e 0 to 0 dl 1746066814 ref 1 fl Complete:/200/0 rc 409600/409600 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.966852:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2d500 with x1830882977259264 ext(2097152->2506751) 00010000:00010000:3.0:1746066803.966860:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 20 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066803.966871:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 20 pid: 21203 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066803.966876:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ec2d500 00000100:00100000:1.0:1746066803.968486:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.970458:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977259648 00000100:00100000:3.0:1746066803.970466:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977259648 00002000:00100000:3.0:1746066803.970499:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1159168->2097151) req@ffff88009ec2df80 x1830882977259648/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.970517:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2df80 with x1830882977259648 ext(1159168->2097151) 00010000:00010000:3.0:1746066803.970525:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 20 pid: 8452 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066803.970535:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 20 pid: 8452 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066803.970541:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ec2df80 00000100:00100000:3.0:1746066803.970573:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2257 00000100:00100000:3.0:1746066803.970579:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977259648:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066803.977811:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977259520:12345-192.168.202.57@tcp:4:cat.0 Request processed in 19844us (21028us total) trans 21474841048 rc 0/0 00000100:00100000:2.0:1746066803.977824:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2256 00002000:00100000:2.0:1746066803.977834:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (2506752->2719743) req@ffff88009b7fad80 x1830882977259520/t21474841048(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/448 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066803.977842:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fad80 with x1830882977259520 ext(2506752->2719743) 00010000:00010000:2.0:1746066803.977851:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 22 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066803.977861:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 22 pid: 21203 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746066803.977867:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b7fad80 00000100:00100000:0.0:1746066803.979004:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066803.979043:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977259776 00000100:00100000:2.0:1746066803.979049:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977259776 00000100:00100000:2.0:1746066803.979089:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15324 00000100:00100000:2.0:1746066803.979095:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31980:x1830882977259776:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066803.979109:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066803.979122:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed4a000/0xfb36a14ee608d5a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f8ef expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.979141:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066803.979146:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2703360->3145727] (req 2703360->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 10 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.979151:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746066803.979154:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed4a000/0xfb36a14ee608d5a9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8ef expref: 23 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.979199:0:8112:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2703360->3145727] (req 2703360->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 10 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.979210:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed4a000/0xfb36a14ee608d5a9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8ef expref: 23 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.979219:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed4a000, rc 0) 00000100:00100000:2.0:1746066803.979259:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:31980:x1830882977259776:12345-192.168.202.57@tcp:101:cat.0 Request processed in 163us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066803.979264:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15324 00000100:00100000:0.0:1746066803.983078:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.983154:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977259904 00000100:00100000:3.0:1746066803.983161:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977259904 00010000:00010000:3.0:1746066803.983189:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 23 pid: 21203 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066803.983221:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7921 00000100:00100000:3.0:1746066803.983227:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a521a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882977259904:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066803.983237:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066803.983252:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 23 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066803.983261:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 23 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066803.983278:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cb6f200/0xfb36a14ee608d57f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2506752->2719743) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8c5 expref: 23 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066803.983291:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.983292:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.983297:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 10 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.983304:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 10 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.983331:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 10 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.983339:0:7109:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 10 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066803.983348:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976972160:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066803.984691:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066803.988289:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976972160:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066803.988306:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066803.989077:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a521a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977259904:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5847us (6004us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066803.989087:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7921 00000100:00100000:2.0:1746066803.989236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.989418:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977260160 00000100:00100000:3.0:1746066803.989424:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977260160 00002000:00100000:3.0:1746066803.989452:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (2703360->2707455) req@ffff880135df9180 x1830882977260160/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.989460:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9180 with x1830882977260160 ext(2703360->2707455) 00010000:00010000:3.0:1746066803.989466:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 11 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066803.989477:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 11 pid: 10402 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066803.989487:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135df9180 00000100:00100000:3.0:1746066803.989518:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2258 00000100:00100000:3.0:1746066803.989524:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977260160:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066803.989613:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977260160:12345-192.168.202.57@tcp:3:cat.0 Request processed in 89us (378us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066803.989618:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2258 00002000:00100000:3.0:1746066803.989623:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (2703360->2707455) req@ffff880135df9180 x1830882977260160/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/4536 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066803.989630:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df9180 with x1830882977260160 ext(2703360->2707455) 00010000:00010000:3.0:1746066803.989634:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 11 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066803.989641:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 11 pid: 10402 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066803.989646:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135df9180 00000100:00100000:0.0:1746066803.992201:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977259648:12345-192.168.202.57@tcp:4:cat.0 Request processed in 21616us (23714us total) trans 21474841049 rc 0/0 00000100:00100000:0.0:1746066803.992210:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2257 00002000:00100000:0.0:1746066803.992219:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1159168->2097151) req@ffff88009ec2df80 x1830882977259648/t21474841049(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:209/0 lens 488/448 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066803.992227:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2df80 with x1830882977259648 ext(1159168->2097151) 00010000:00010000:0.0:1746066803.992234:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 22 pid: 8452 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066803.992244:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 22 pid: 8452 timeout: 865 lvb_type: 0 00002000:00010000:0.0:1746066803.992250:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ec2df80 00000100:00100000:0.0:1746066803.996580:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.996617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066803.996712:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066803.996888:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977260288 00000100:00100000:3.0:1746066803.996896:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977260288 00010000:00010000:3.0:1746066803.996926:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1159168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 22 pid: 8452 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066803.996952:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7922 00000100:00100000:3.0:1746066803.996959:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977260288:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066803.996972:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066803.996989:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 22 pid: 8452 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066803.996997:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 22 pid: 8452 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066803.997016:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009391fe00/0xfb36a14ee608d4ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f85c expref: 22 pid: 8452 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066803.997040:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.997042:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066803.997048:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608d5a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e8 expref: 10 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066803.997055:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608d5a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e8 expref: 10 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066803.997175:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977260672 00000100:00100000:1.0:1746066803.997183:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977260672 00002000:00100000:1.0:1746066803.997209:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2703360->3145727) req@ffff88009b7f9180 x1830882977260672/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/0 e 0 to 0 dl 1746066814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746066803.997215:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977260544 00002000:00100000:1.0:1746066803.997217:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f9180 with x1830882977260672 ext(2703360->3145727) 00000100:00100000:2.0:1746066803.997219:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977260544 00010000:00010000:1.0:1746066803.997223:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 11 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066803.997232:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 11 pid: 10402 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746066803.997236:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b7f9180 00000100:00100000:2.0:1746066803.997248:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15325 00000100:00100000:2.0:1746066803.997253:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+13:31977:x1830882977260544:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066803.997267:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066803.997292:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f8f6 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066803.997295:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2259 00000100:00100000:1.0:1746066803.997302:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977260672:12345-192.168.202.57@tcp:4:cat.0 00010000:00010000:2.0:1746066803.997310:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009912e400/0xfb36a14ee608d4de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f855 expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.997317:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e41ac00/0xfb36a14ee608d52b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f88d expref: 14 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.997325:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.997326:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066803.997329:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->3268607] (req 3145728->3268607) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 14 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.997346:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e41ac00/0xfb36a14ee608d52b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f88d expref: 14 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.997355:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e41ac00/0xfb36a14ee608d52b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f88d expref: 14 pid: 21973 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066803.997365:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135dfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976972288:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066803.997435:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009912e400/0xfb36a14ee608d4de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f855 expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066803.997443:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009912e400/0xfb36a14ee608d4de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f855 expref: 21 pid: 21203 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066803.997450:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976972416:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066803.997468:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ca80 going to sleep for 11 seconds 00010000:00010000:3.0:1746066803.997575:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608d5a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e8 expref: 11 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066803.997584:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976972544:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066803.997615:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066804.003782:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135dfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976972288:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066804.003794:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135df8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976972416:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.003817:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->3268607] (req 3145728->3268607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 14 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.003836:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095ff2200, rc 0) 00000100:00100000:2.0:1746066804.003884:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:31977:x1830882977260544:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6630us (7265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.003891:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15325 00000100:00100000:0.0:1746066804.003959:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.004139:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977260800 00000100:00100000:2.0:1746066804.004145:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977260800 00010000:00010000:2.0:1746066804.004164:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e41ac00/0xfb36a14ee608d52b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f88d expref: 14 pid: 21973 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.004184:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7923 00000100:00100000:2.0:1746066804.004189:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977260800:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.004198:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.004215:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e41ac00/0xfb36a14ee608d52b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f88d expref: 14 pid: 21973 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.004224:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e41ac00/0xfb36a14ee608d52b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f88d expref: 14 pid: 21973 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.004243:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e41ac00/0xfb36a14ee608d52b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f88d expref: 14 pid: 21973 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.004271:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.004290:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977260800:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 101us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.004295:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7923 00000100:00100000:2.0:1746066804.014787:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.015067:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977261056 00000100:00100000:1.0:1746066804.015074:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977261056 00010000:00010000:1.0:1746066804.015101:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009912e400/0xfb36a14ee608d4de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f855 expref: 22 pid: 21203 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746066804.015133:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7924 00000100:00100000:1.0:1746066804.015140:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977261056:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066804.015150:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976972544:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066804.015152:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.015164:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066804.015169:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009912e400/0xfb36a14ee608d4de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f855 expref: 22 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.015178:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009912e400/0xfb36a14ee608d4de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f855 expref: 22 pid: 21203 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.015196:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977260288:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 18238us (18623us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066804.015197:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009912e400/0xfb36a14ee608d4de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f855 expref: 22 pid: 21203 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.015203:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7922 00010000:00010000:1.0:1746066804.015211:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.015213:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.015218:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3268607) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.015226:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3268607) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.015249:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3268607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066804.015259:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976972672:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066804.015309:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066804.016632:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977260672:12345-192.168.202.57@tcp:4:cat.0 Request processed in 19327us (19916us total) trans 21474841050 rc 0/0 00000100:00100000:1.0:1746066804.016640:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2259 00002000:00100000:1.0:1746066804.016647:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2703360->3145727) req@ffff88009b7f9180 x1830882977260672/t21474841050(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:209/0 lens 488/448 e 0 to 0 dl 1746066814 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.016656:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f9180 with x1830882977260672 ext(2703360->3145727) 00010000:00010000:1.0:1746066804.016663:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 13 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.016692:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 13 pid: 10402 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746066804.016699:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b7f9180 00000100:00100000:0.0:1746066804.017357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.019302:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976972672:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066804.019319:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.019347:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1965:x1830882977261056:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4208us (4567us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.019356:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7924 00000100:00100000:1.0:1746066804.020636:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977261184 00000100:00100000:1.0:1746066804.020645:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977261184 00002000:00100000:1.0:1746066804.020712:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009b7fb100 x1830882977261184/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.020722:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fb100 with x1830882977261184 ext(1048576->2097151) 00002000:00010000:1.0:1746066804.020727:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7fb100 00000100:00100000:1.0:1746066804.020744:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6986 00000100:00100000:1.0:1746066804.020750:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977261184:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066804.024526:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.024565:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.024636:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977261312 00000100:00100000:0.0:1746066804.024645:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977261312 00010000:00010000:0.0:1746066804.024703:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 15 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746066804.024741:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7925 00000100:00100000:0.0:1746066804.024750:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977261312:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.024763:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.024781:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 15 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066804.024791:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 15 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066804.024811:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009391f000/0xfb36a14ee608d59b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e1 expref: 15 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066804.024838:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.024840:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.024847:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed4a000/0xfb36a14ee608d5a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8ef expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.024855:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed4a000/0xfb36a14ee608d5a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8ef expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.024885:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed4a000/0xfb36a14ee608d5a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8ef expref: 20 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.024896:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976972800:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066804.024956:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4df9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066804.025559:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977261568 00000100:00100000:1.0:1746066804.025565:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977261568 00002000:00100000:1.0:1746066804.025590:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (3264512->3268607) req@ffff880135df8a80 x1830882977261568/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.025598:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df8a80 with x1830882977261568 ext(3264512->3268607) 00002000:00010000:1.0:1746066804.025602:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135df8a80 00000100:00100000:1.0:1746066804.026900:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6987 00000100:00100000:1.0:1746066804.026909:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+13:1966:x1830882977261568:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066804.027042:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+13:1966:x1830882977261568:12345-192.168.202.57@tcp:3:cat.0 Request processed in 135us (2476us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066804.027047:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6987 00002000:00100000:1.0:1746066804.027054:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (3264512->3268607) req@ffff880135df8a80 x1830882977261568/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/4536 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.027062:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135df8a80 with x1830882977261568 ext(3264512->3268607) 00002000:00010000:1.0:1746066804.027065:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135df8a80 00000100:00100000:2.0:1746066804.029807:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976972800:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066804.029828:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066804.030970:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977261184:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10216us (13610us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066804.030980:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6986 00002000:00100000:1.0:1746066804.030990:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009b7fb100 x1830882977261184/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.031094:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7fb100 with x1830882977261184 ext(1048576->2097151) 00002000:00010000:1.0:1746066804.031098:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b7fb100 00000100:00100000:2.0:1746066804.031166:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882977261312:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6418us (6647us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.031174:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7925 00000100:00100000:0.0:1746066804.031356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.031472:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977261824 00000100:00100000:1.0:1746066804.031479:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977261824 00002000:00100000:1.0:1746066804.031512:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009e840000 x1830882977261824/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.031519:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e840000 with x1830882977261824 ext(2097152->3145727) 00002000:00010000:1.0:1746066804.031523:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e840000 00000100:00100000:1.0:1746066804.031536:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6988 00000100:00100000:1.0:1746066804.031542:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977261824:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066804.037118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.037192:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977261952 00000100:00100000:3.0:1746066804.037199:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977261952 00000100:00100000:3.0:1746066804.037231:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15326 00000100:00100000:3.0:1746066804.037237:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+12:31983:x1830882977261952:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.037250:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.037263:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb97a00/0xfb36a14ee608d5b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f8fd expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.037285:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 22 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.037291:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066804.037293:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066804.037296:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb97a00/0xfb36a14ee608d5b7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8fd expref: 13 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.037316:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 22 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.037326:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 22 pid: 21973 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.037335:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976972928:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.037403:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066804.046375:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.046405:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976972928:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.046439:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eb97a00/0xfb36a14ee608d5b7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8fd expref: 13 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.046454:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb97a00, rc 0) 00000100:00100000:2.0:1746066804.046498:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+13:31983:x1830882977261952:12345-192.168.202.57@tcp:101:cat.0 Request processed in 9261us (9386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.046514:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15326 00000100:00100000:0.0:1746066804.046572:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977262080 00000100:00100000:0.0:1746066804.046578:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977262080 00002000:00100000:0.0:1746066804.046608:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1056767) req@ffff880135431180 x1830882977262080/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 8680/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.046616:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135431180 with x1830882977262080 ext(1048576->1056767) 00010000:00010000:0.0:1746066804.046623:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 23 pid: 21973 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066804.046634:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 23 pid: 21973 timeout: 865 lvb_type: 0 00002000:00010000:0.0:1746066804.046640:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135431180 00000100:00100000:0.0:1746066804.046662:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2260 00000100:00100000:0.0:1746066804.046669:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882977262080:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066804.046868:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977261824:12345-192.168.202.57@tcp:3:cat.0 Request processed in 15324us (15510us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066804.046874:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6988 00002000:00100000:1.0:1746066804.046879:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009e840000 x1830882977261824/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.046886:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e840000 with x1830882977261824 ext(2097152->3145727) 00002000:00010000:1.0:1746066804.046889:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e840000 00000100:00100000:0.0:1746066804.047110:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882977262080:12345-192.168.202.57@tcp:4:cat.0 Request processed in 441us (740us total) trans 21474841051 rc 0/0 00000100:00100000:0.0:1746066804.047116:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2260 00002000:00100000:0.0:1746066804.047121:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1056767) req@ffff880135431180 x1830882977262080/t21474841051(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 8680/448 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.047129:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135431180 with x1830882977262080 ext(1048576->1056767) 00010000:00010000:0.0:1746066804.047133:0:8457:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 23 pid: 21973 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066804.047142:0:8457:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 23 pid: 21973 timeout: 865 lvb_type: 0 00002000:00010000:0.0:1746066804.047147:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135431180 00000100:00100000:0.0:1746066804.049879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.050120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.050187:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977262336 00000100:00100000:3.0:1746066804.050194:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977262336 00000100:00100000:2.0:1746066804.050230:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977262208 00000100:00100000:3.0:1746066804.050233:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15327 00000100:00100000:2.0:1746066804.050233:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977262208 00000100:00100000:3.0:1746066804.050239:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:31980:x1830882977262336:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066804.050252:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 23 pid: 21973 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.050253:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.050264:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608d5be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f904 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.050274:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7926 00000100:00100000:2.0:1746066804.050278:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1966:x1830882977262208:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.050285:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3268607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.050285:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.050290:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066804.050291:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066804.050294:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608d5be lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f904 expref: 22 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.050299:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 23 pid: 21973 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.050308:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 23 pid: 21973 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.050316:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3268607) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.050323:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e41b600/0xfb36a14ee608d532 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f894 expref: 23 pid: 21973 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.050324:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3268607) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 12 pid: 8112 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.050334:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976973056:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.050337:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.050338:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.050343:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb97a00/0xfb36a14ee608d5b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8fd expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.050349:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb97a00/0xfb36a14ee608d5b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8fd expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.050365:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb97a00/0xfb36a14ee608d5b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8fd expref: 12 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.050373:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976973184:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066804.050830:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066804.051020:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.054052:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.054186:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976973184:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066804.054202:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.054235:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977262208:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3954us (4361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.054244:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7926 00000100:00100000:3.0:1746066804.054484:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976973056:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066804.054498:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977262464 00010000:00010000:3.0:1746066804.054502:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608d5be lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f904 expref: 22 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066804.054514:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977262464 00010000:00010000:3.0:1746066804.054529:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb96c00, rc 0) 00002000:00100000:1.0:1746066804.054542:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (3145728->3268607) req@ffff8800924d3b80 x1830882977262464/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066804.054547:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31980:x1830882977262336:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4309us (4428us total) trans 0 rc 0/0 00002000:00100000:1.0:1746066804.054550:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d3b80 with x1830882977262464 ext(3145728->3268607) 00000100:00100000:3.0:1746066804.054553:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15327 00010000:00010000:1.0:1746066804.054555:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3268607) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 13 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.054565:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3268607) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 13 pid: 8112 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746066804.054570:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800924d3b80 00000100:00100000:1.0:1746066804.054594:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2261 00000100:00100000:1.0:1746066804.054601:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977262464:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066804.057185:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.057570:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977262720 00000100:00100000:3.0:1746066804.057583:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977262720 00002000:00100000:3.0:1746066804.057628:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009ec2d880 x1830882977262720/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.057636:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2d880 with x1830882977262720 ext(1048576->2097151) 00002000:00010000:3.0:1746066804.057640:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2d880 00000100:00100000:3.0:1746066804.057670:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6989 00000100:00100000:3.0:1746066804.057695:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977262720:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066804.059757:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977262464:12345-192.168.202.57@tcp:4:cat.0 Request processed in 5150us (5706us total) trans 17179873747 rc 0/0 00000100:00100000:0.0:1746066804.059766:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2261 00002000:00100000:0.0:1746066804.059775:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (3145728->3268607) req@ffff8800924d3b80 x1830882977262464/t17179873747(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/448 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.059783:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d3b80 with x1830882977262464 ext(3145728->3268607) 00010000:00010000:0.0:1746066804.059790:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3268607) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 15 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066804.059802:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3268607) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 15 pid: 8112 timeout: 865 lvb_type: 0 00002000:00010000:0.0:1746066804.059808:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800924d3b80 00000100:00100000:0.0:1746066804.061660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.061727:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977262848 00000100:00100000:2.0:1746066804.061734:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977262848 00010000:00010000:2.0:1746066804.061761:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3268607) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 15 pid: 8112 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.061792:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7927 00000100:00100000:2.0:1746066804.061798:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977262848:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.061808:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.061824:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3268607) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 15 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.061833:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3268607) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 15 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.061852:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095ff2200/0xfb36a14ee608d5b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3268607) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8f6 expref: 15 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.061873:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.061875:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.061881:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608d5be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f904 expref: 21 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.061892:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608d5be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f904 expref: 21 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.061918:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608d5be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f904 expref: 21 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.061928:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976973312:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066804.063147:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.067945:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976973312:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066804.067963:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.068428:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977262848:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6627us (6772us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.068436:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7927 00000100:00100000:3.0:1746066804.068741:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc98f875-2edf-4505-a13a-65f96879556b+13:1963:x1830882977262720:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11063us (11560us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066804.068749:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6989 00002000:00100000:3.0:1746066804.068758:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009ec2d880 x1830882977262720/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.068765:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2d880 with x1830882977262720 ext(1048576->2097151) 00002000:00010000:3.0:1746066804.068769:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2d880 00000100:00100000:0.0:1746066804.076032:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.076328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.076476:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977263104 00000100:00100000:3.0:1746066804.076485:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977263104 00002000:00100000:3.0:1746066804.076531:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800924d1c00 x1830882977263104/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.076545:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d1c00 with x1830882977263104 ext(3145728->4194303) 00002000:00010000:3.0:1746066804.076550:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d1c00 00000100:00100000:3.0:1746066804.076565:0:8457:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977263360 00000100:00100000:3.0:1746066804.076568:0:8457:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977263360 00002000:00100000:3.0:1746066804.076580:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800924d0700 x1830882977263360/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.076587:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d0700 with x1830882977263360 ext(3145728->4194303) 00002000:00010000:3.0:1746066804.076590:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d0700 00000100:00100000:0.0:1746066804.076598:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6990 00000100:00100000:0.0:1746066804.076609:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977263104:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066804.077026:0:8457:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6991 00000100:00100000:3.0:1746066804.077033:0:8457:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977263360:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066804.080242:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.080273:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.081422:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977263488 00000100:00100000:3.0:1746066804.081430:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977263488 00000100:00100000:3.0:1746066804.081471:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977263616 00000100:00100000:3.0:1746066804.081474:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977263616 00000100:00100000:3.0:1746066804.081492:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15328 00000100:00100000:3.0:1746066804.081498:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977263488:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.081520:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.081534:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb97e00/0xfb36a14ee608d5c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f90b expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.081551:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.081552:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.081559:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb97e00/0xfb36a14ee608d5c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f90b expref: 15 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.081573:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb97e00/0xfb36a14ee608d5c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f90b expref: 15 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.081583:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb97e00, rc 0) 00000100:00100000:0.0:1746066804.081610:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15329 00000100:00100000:3.0:1746066804.081615:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977263488:12345-192.168.202.57@tcp:101:cat.0 Request processed in 118us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.081620:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977263616:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066804.081621:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15328 00010000:00010000:0.0:1746066804.081627:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.081635:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d5cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f912 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.081645:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.081647:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.081651:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d5cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f912 expref: 14 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.081660:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d5cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f912 expref: 14 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.081666:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee0c00, rc 0) 00000100:00100000:0.0:1746066804.081698:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977263616:12345-192.168.202.57@tcp:101:cat.0 Request processed in 82us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.081703:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15329 00000100:00100000:3.0:1746066804.096785:0:8457:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977263360:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19743us (20448us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066804.096795:0:8457:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6991 00002000:00100000:3.0:1746066804.096805:0:8457:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800924d0700 x1830882977263360/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.096814:0:8457:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d0700 with x1830882977263360 ext(3145728->4194303) 00002000:00010000:3.0:1746066804.096819:0:8457:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d0700 00000100:00100000:0.0:1746066804.100776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.100810:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.100833:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.100851:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.100883:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977263872 00000100:00100000:0.0:1746066804.100889:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977263872 00002000:00100000:0.0:1746066804.100933:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800924d0e00 x1830882977263872/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.100949:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d0e00 with x1830882977263872 ext(2097152->3145727) 00002000:00010000:0.0:1746066804.100955:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d0e00 00000100:00100000:0.0:1746066804.100997:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977264128 00000100:00100000:0.0:1746066804.101001:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977264128 00002000:00100000:0.0:1746066804.101017:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800924d2d80 x1830882977264128/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.101024:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d2d80 with x1830882977264128 ext(3145728->4194303) 00002000:00010000:0.0:1746066804.101027:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d2d80 00000100:00100000:0.0:1746066804.101040:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977264384 00000100:00100000:0.0:1746066804.101044:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977264384 00002000:00100000:0.0:1746066804.101059:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800921c3480 x1830882977264384/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.101065:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c3480 with x1830882977264384 ext(2097152->3145727) 00002000:00010000:0.0:1746066804.101068:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921c3480 00000100:00100000:0.0:1746066804.101090:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977264640 00000100:00100000:0.0:1746066804.101439:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977264640 00002000:00100000:0.0:1746066804.101464:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800921c0000 x1830882977264640/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.101471:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c0000 with x1830882977264640 ext(3145728->4194303) 00002000:00010000:0.0:1746066804.101474:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921c0000 00000100:00100000:0.0:1746066804.101495:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6992 00000100:00100000:0.0:1746066804.101520:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977263872:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066804.101832:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6993 00000100:00100000:1.0:1746066804.101840:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977264128:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066804.103158:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6994 00000100:00100000:1.0:1746066804.103167:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977264384:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066804.104527:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6995 00000100:00100000:3.0:1746066804.104538:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977264640:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066804.111024:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977263104:12345-192.168.202.57@tcp:3:cat.0 Request processed in 34408us (34988us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066804.111040:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6990 00002000:00100000:0.0:1746066804.111052:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800924d1c00 x1830882977263104/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.111061:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d1c00 with x1830882977263104 ext(3145728->4194303) 00002000:00010000:0.0:1746066804.111067:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d1c00 00000100:00100000:0.0:1746066804.124125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.124173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.124195:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977264768 00000100:00100000:0.0:1746066804.124202:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977264896 00000100:00100000:0.0:1746066804.124207:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977264896 00000100:00100000:0.0:1746066804.124242:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15330 00000100:00100000:2.0:1746066804.124243:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977264768 00000100:00100000:0.0:1746066804.124250:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882977264896:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066804.125121:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15331 00000100:00100000:3.0:1746066804.125129:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882977264768:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.125137:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.125152:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecc4200/0xfb36a14ee608d5d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f919 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.125170:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.125172:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.125184:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecc4200/0xfb36a14ee608d5d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f919 expref: 24 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.125202:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecc4200/0xfb36a14ee608d5d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f919 expref: 24 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.125211:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecc4200, rc 0) 00000100:00100000:3.0:1746066804.125246:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977264768:12345-192.168.202.57@tcp:101:cat.0 Request processed in 119us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.125251:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15331 00010000:00010000:0.0:1746066804.125356:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.125412:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5800/0xfb36a14ee608d5da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f920 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.125423:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.125424:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.125428:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5800/0xfb36a14ee608d5da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f920 expref: 24 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.125436:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5800/0xfb36a14ee608d5da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f920 expref: 24 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.125442:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecc5800, rc 0) 00000100:00100000:3.0:1746066804.125457:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977264896:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1209us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.125461:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15330 00000100:00100000:1.0:1746066804.126082:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977264128:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24242us (25269us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066804.126090:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6993 00002000:00100000:1.0:1746066804.126097:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800924d2d80 x1830882977264128/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.126105:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d2d80 with x1830882977264128 ext(3145728->4194303) 00002000:00010000:1.0:1746066804.126109:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d2d80 00000100:00100000:1.0:1746066804.130609:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977264384:12345-192.168.202.57@tcp:3:cat.0 Request processed in 27434us (29764us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066804.130620:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6994 00002000:00100000:1.0:1746066804.130629:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800921c3480 x1830882977264384/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.130637:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c3480 with x1830882977264384 ext(2097152->3145727) 00002000:00010000:1.0:1746066804.130642:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921c3480 00000100:00100000:3.0:1746066804.142986:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977264640:12345-192.168.202.57@tcp:3:cat.0 Request processed in 38444us (42125us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066804.142996:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6995 00002000:00100000:3.0:1746066804.143006:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800921c0000 x1830882977264640/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.143015:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c0000 with x1830882977264640 ext(3145728->4194303) 00002000:00010000:3.0:1746066804.143019:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921c0000 00000100:00100000:0.0:1746066804.144667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.145280:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977265152 00000100:00100000:3.0:1746066804.145288:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977265152 00002000:00100000:3.0:1746066804.145322:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800921c0e00 x1830882977265152/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.145332:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c0e00 with x1830882977265152 ext(4194304->5091327) 00002000:00010000:3.0:1746066804.145336:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921c0e00 00000100:00100000:3.0:1746066804.145358:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6996 00000100:00100000:3.0:1746066804.145365:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977265152:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066804.148919:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977263872:12345-192.168.202.57@tcp:3:cat.0 Request processed in 47410us (48143us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066804.148930:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6992 00002000:00100000:2.0:1746066804.148939:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800924d0e00 x1830882977263872/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.148949:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d0e00 with x1830882977263872 ext(2097152->3145727) 00002000:00010000:2.0:1746066804.148954:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d0e00 00000100:00100000:3.0:1746066804.159428:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977265152:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14055us (14757us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066804.159438:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6996 00002000:00100000:3.0:1746066804.159447:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800921c0e00 x1830882977265152/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.159456:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c0e00 with x1830882977265152 ext(4194304->5091327) 00002000:00010000:3.0:1746066804.159460:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921c0e00 00000100:00100000:0.0:1746066804.172046:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.175960:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977265408 00000100:00100000:3.0:1746066804.175970:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977265408 00002000:00100000:3.0:1746066804.176014:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800921c0380 x1830882977265408/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.176023:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c0380 with x1830882977265408 ext(4194304->5091327) 00002000:00010000:3.0:1746066804.176029:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921c0380 00000100:00100000:3.0:1746066804.176065:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6997 00000100:00100000:3.0:1746066804.176072:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977265408:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066804.177313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.177395:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977265536 00000100:00100000:3.0:1746066804.177400:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977265536 00000100:00100000:3.0:1746066804.177554:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15332 00000100:00100000:3.0:1746066804.177560:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31987:x1830882977265536:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066804.177572:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.177585:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f927 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.177608:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608d5be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f904 expref: 23 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.177615:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eb97e00/0xfb36a14ee608d5c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f90b expref: 16 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.177620:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.177622:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.177624:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.177650:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb97e00/0xfb36a14ee608d5c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f90b expref: 16 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.177660:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eb97e00/0xfb36a14ee608d5c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f90b expref: 16 pid: 8112 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746066804.177693:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976973440:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.177759:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608d5be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f904 expref: 23 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.177766:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608d5be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f904 expref: 23 pid: 8112 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.177772:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135432680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976973568:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.178388:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066804.190924:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976973440:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.190940:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135432680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976973568:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.190974:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 23 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.190993:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecc5a00, rc 0) 00000100:00100000:3.0:1746066804.191081:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:31987:x1830882977265536:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 13518us (13768us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.191089:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15332 00000100:00100000:0.0:1746066804.194300:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.194500:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977265664 00000100:00100000:2.0:1746066804.194515:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977265664 00010000:00010000:2.0:1746066804.194543:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608d5be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f904 expref: 23 pid: 8112 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.194871:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977265408:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18795us (22829us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066804.194881:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6997 00002000:00100000:3.0:1746066804.194891:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800921c0380 x1830882977265408/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.194905:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c0380 with x1830882977265408 ext(4194304->5091327) 00010000:00010000:3.0:1746066804.194912:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009eb97e00/0xfb36a14ee608d5c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f90b expref: 15 pid: 8112 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746066804.194924:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009eb97e00/0xfb36a14ee608d5c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f90b expref: 15 pid: 8112 timeout: 865 lvb_type: 1 00002000:00010000:3.0:1746066804.194930:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800921c0380 00000100:00100000:2.0:1746066804.195884:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7928 00000100:00100000:2.0:1746066804.195892:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5219c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882977265664:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.195904:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.195920:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608d5be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f904 expref: 23 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.195930:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608d5be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f904 expref: 23 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.195947:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb96c00/0xfb36a14ee608d5be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f904 expref: 23 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.195974:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.196003:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5219c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977265664:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 113us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.196009:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7928 00000100:00100000:0.0:1746066804.201414:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.201473:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977265792 00000100:00100000:3.0:1746066804.201481:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977265792 00000100:00100000:3.0:1746066804.201544:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15333 00000100:00100000:3.0:1746066804.201552:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882977265792:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.201567:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.201581:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4c00/0xfb36a14ee608d5e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f92e expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.201599:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.201610:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4c00/0xfb36a14ee608d5e8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f92e expref: 16 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.201621:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4c00/0xfb36a14ee608d5e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f92e expref: 16 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.201658:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecc4c00, rc 0) 00000100:00100000:3.0:1746066804.201759:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882977265792:12345-192.168.202.57@tcp:101:cat.0 Request processed in 204us (348us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066804.201768:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15333 00000100:00100000:0.0:1746066804.206048:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.206162:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.206251:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977265920 00000100:00100000:2.0:1746066804.206261:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977265920 00010000:00010000:2.0:1746066804.206292:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb97e00/0xfb36a14ee608d5c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f90b expref: 15 pid: 8112 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746066804.206317:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7929 00000100:00100000:2.0:1746066804.206323:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977265920:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.206335:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.206352:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eb97e00/0xfb36a14ee608d5c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f90b expref: 15 pid: 8112 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746066804.206366:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eb97e00/0xfb36a14ee608d5c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f90b expref: 15 pid: 8112 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746066804.206386:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb97e00/0xfb36a14ee608d5c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f90b expref: 15 pid: 8112 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746066804.206784:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977266048 00000100:00100000:3.0:1746066804.206790:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977266048 00000100:00100000:3.0:1746066804.206821:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15334 00000100:00100000:3.0:1746066804.206828:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:31983:x1830882977266048:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.206843:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.206854:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4600/0xfb36a14ee608d5ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f935 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.206871:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.206873:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.206881:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4600/0xfb36a14ee608d5ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f935 expref: 16 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.206893:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4600/0xfb36a14ee608d5ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f935 expref: 16 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.206902:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.206903:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.206908:0:21203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.206915:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.206944:0:21203:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066804.206960:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135432680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976973696:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066804.207044:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a93c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066804.207304:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.207349:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977265920:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1023us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.207356:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7929 00000100:00100000:3.0:1746066804.209624:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135432680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976973696:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066804.209645:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecc4600, rc 0) 00000100:00100000:3.0:1746066804.209740:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:31983:x1830882977266048:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2910us (3577us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.209748:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15334 00000100:00100000:0.0:1746066804.210542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.210656:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977266304 00000100:00100000:3.0:1746066804.210663:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977266304 00002000:00100000:3.0:1746066804.210869:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4165632->4169727) req@ffff880094129180 x1830882977266304/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.210878:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094129180 with x1830882977266304 ext(4165632->4169727) 00002000:00010000:3.0:1746066804.210882:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094129180 00000100:00100000:3.0:1746066804.210915:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6998 00000100:00100000:3.0:1746066804.210924:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977266304:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066804.211939:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977266304:12345-192.168.202.57@tcp:3:cat.0 Request processed in 1016us (1397us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066804.211946:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6998 00002000:00100000:3.0:1746066804.211953:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (4165632->4169727) req@ffff880094129180 x1830882977266304/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/4536 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.211960:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094129180 with x1830882977266304 ext(4165632->4169727) 00002000:00010000:3.0:1746066804.211963:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094129180 00000100:00100000:0.0:1746066804.212586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.212762:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977266432 00000100:00100000:3.0:1746066804.212766:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977266432 00000100:00100000:3.0:1746066804.212800:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15335 00000100:00100000:3.0:1746066804.212805:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977266432:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.212817:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.212830:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4a00/0xfb36a14ee608d5f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f93c expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.212851:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4a00/0xfb36a14ee608d5f6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f93c expref: 16 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.212860:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4a00/0xfb36a14ee608d5f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f93c expref: 16 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.212882:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ecc4a00, rc 0) 00000100:00100000:3.0:1746066804.212906:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977266432:12345-192.168.202.57@tcp:101:cat.0 Request processed in 101us (324us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066804.212911:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15335 00000100:00100000:0.0:1746066804.215303:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.215389:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977266560 00000100:00100000:2.0:1746066804.215395:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977266560 00000100:00100000:2.0:1746066804.215798:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15336 00000100:00100000:2.0:1746066804.215805:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:31987:x1830882977266560:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066804.215818:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.215830:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f943 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.215851:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed4a000/0xfb36a14ee608d5a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8ef expref: 25 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.215859:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d5cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f912 expref: 13 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.215865:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.215867:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.215870:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.215892:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d5cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f912 expref: 13 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.215902:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d5cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f912 expref: 13 pid: 10402 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746066804.215911:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976973824:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.215975:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed4a000/0xfb36a14ee608d5a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8ef expref: 25 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.215982:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed4a000/0xfb36a14ee608d5a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8ef expref: 25 pid: 8112 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.215989:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976973952:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066804.216001:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.217448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.217522:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977266816 00000100:00100000:3.0:1746066804.217528:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977266816 00002000:00100000:3.0:1746066804.217558:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (5087232->5091327) req@ffff880094129f80 x1830882977266816/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.217567:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094129f80 with x1830882977266816 ext(5087232->5091327) 00002000:00010000:3.0:1746066804.217571:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094129f80 00000100:00100000:3.0:1746066804.217585:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 6999 00000100:00100000:3.0:1746066804.217591:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977266816:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066804.217744:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977266816:12345-192.168.202.57@tcp:3:cat.0 Request processed in 153us (299us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066804.217749:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 6999 00002000:00100000:3.0:1746066804.217753:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (5087232->5091327) req@ffff880094129f80 x1830882977266816/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/4536 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.217759:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094129f80 with x1830882977266816 ext(5087232->5091327) 00002000:00010000:3.0:1746066804.217761:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094129f80 00000100:00100000:2.0:1746066804.218643:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976973824:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066804.218651:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976973952:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.218694:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.218709:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a386e00, rc 0) 00000100:00100000:2.0:1746066804.218733:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31987:x1830882977266560:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2929us (3435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.218739:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15336 00000100:00100000:0.0:1746066804.222740:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.222780:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.222804:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977266944 00000100:00100000:2.0:1746066804.222811:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977266944 00010000:00010000:2.0:1746066804.222844:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed4a000/0xfb36a14ee608d5a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8ef expref: 25 pid: 8112 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.222877:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977267072 00000100:00100000:2.0:1746066804.222879:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977267072 00010000:00010000:2.0:1746066804.222888:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d5cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f912 expref: 14 pid: 10402 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746066804.222901:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7930 00000100:00100000:2.0:1746066804.222906:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977266944:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.222916:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.222932:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed4a000/0xfb36a14ee608d5a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8ef expref: 25 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.222941:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed4a000/0xfb36a14ee608d5a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8ef expref: 25 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.222959:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed4a000/0xfb36a14ee608d5a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8ef expref: 25 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.222974:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.223005:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7931 00000100:00100000:2.0:1746066804.223006:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977266944:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 99us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.223014:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7930 00000100:00100000:0.0:1746066804.223014:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+14:1966:x1830882977267072:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.223020:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.223028:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d5cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f912 expref: 14 pid: 10402 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746066804.223035:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d5cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f912 expref: 14 pid: 10402 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746066804.223046:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d5cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f912 expref: 14 pid: 10402 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746066804.223057:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.223059:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.223064:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.223071:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.223094:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.223104:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094128380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976974080:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066804.223148:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4df9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066804.230435:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094128380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976974080:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066804.230455:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.230514:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+13:1966:x1830882977267072:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7501us (7731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.230523:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7931 00000100:00100000:0.0:1746066804.231191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.231997:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977267328 00000100:00100000:2.0:1746066804.232004:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977267328 00002000:00100000:2.0:1746066804.232037:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3694592->3698687) req@ffff88009412b100 x1830882977267328/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.232046:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412b100 with x1830882977267328 ext(3694592->3698687) 00002000:00010000:2.0:1746066804.232050:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009412b100 00000100:00100000:2.0:1746066804.232085:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7000 00000100:00100000:2.0:1746066804.232092:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977267328:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066804.232270:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977267328:12345-192.168.202.57@tcp:3:cat.0 Request processed in 178us (1082us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066804.232276:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7000 00002000:00100000:2.0:1746066804.232281:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3694592->3698687) req@ffff88009412b100 x1830882977267328/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/4536 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.232287:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412b100 with x1830882977267328 ext(3694592->3698687) 00002000:00010000:2.0:1746066804.232289:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009412b100 00010000:00010000:1.0:1746066804.255918:0:9849:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066804.315710:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.315793:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.315876:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977267456 00000100:00100000:2.0:1746066804.315884:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977267456 00000100:00100000:2.0:1746066804.315921:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977267584 00000100:00100000:2.0:1746066804.315923:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977267584 00000100:00100000:2.0:1746066804.315940:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15337 00000100:00100000:2.0:1746066804.315946:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977267456:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066804.315961:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.315977:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8200/0xfb36a14ee608d604 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f94a expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.316001:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8200/0xfb36a14ee608d604 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f94a expref: 23 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.316010:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8200/0xfb36a14ee608d604 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f94a expref: 23 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.316022:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5e8200, rc 0) 00000100:00100000:2.0:1746066804.316067:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1965:x1830882977267456:12345-192.168.202.57@tcp:101:cat.0 Request processed in 121us (401us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066804.316073:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15337 00000100:00100000:2.0:1746066804.316084:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15338 00000100:00100000:2.0:1746066804.316089:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:31989:x1830882977267584:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066804.316096:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.316103:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f951 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.316117:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.316123:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066804.316125:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066804.316128:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3792896->4194303] (req 3792896->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 14 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.316150:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.316159:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 23 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.316168:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976974208:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066804.316221:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066804.318993:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976974208:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.319016:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3792896->4194303] (req 3792896->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 14 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.319029:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5e8e00, rc 0) 00000100:00100000:2.0:1746066804.319072:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:31989:x1830882977267584:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2981us (3278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.319080:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15338 00000100:00100000:0.0:1746066804.325615:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.325856:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977267712 00000100:00100000:2.0:1746066804.325863:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977267712 00002000:00100000:2.0:1746066804.325902:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3698687) req@ffff88012c0ffb80 x1830882977267712/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.325915:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0ffb80 with x1830882977267712 ext(3145728->3698687) 00010000:00010000:2.0:1746066804.325924:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 24 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.325937:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 24 pid: 10402 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746066804.325943:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c0ffb80 00000100:00100000:2.0:1746066804.325977:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2262 00000100:00100000:2.0:1746066804.325983:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977267712:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066804.332436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.332458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.332514:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977267968 00000100:00100000:0.0:1746066804.332522:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977267968 00002000:00100000:0.0:1746066804.332558:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88012c0fed80 x1830882977267968/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.332567:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fed80 with x1830882977267968 ext(1048576->2097151) 00002000:00010000:0.0:1746066804.332571:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fed80 00000100:00100000:0.0:1746066804.332585:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977268096 00000100:00100000:0.0:1746066804.332587:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977268096 00002000:00100000:0.0:1746066804.332598:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800996da680 x1830882977268096/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.332604:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996da680 with x1830882977268096 ext(1048576->2097151) 00002000:00010000:0.0:1746066804.332606:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996da680 00000100:00100000:0.0:1746066804.332618:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7001 00000100:00100000:0.0:1746066804.332625:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882977267968:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066804.333574:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7002 00000100:00100000:0.0:1746066804.333582:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977268096:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066804.346234:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977267712:12345-192.168.202.57@tcp:4:cat.0 Request processed in 20244us (20619us total) trans 21474841052 rc 0/0 00000100:00100000:2.0:1746066804.346246:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2262 00002000:00100000:2.0:1746066804.346256:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3698687) req@ffff88012c0ffb80 x1830882977267712/t21474841052(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/448 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.346264:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0ffb80 with x1830882977267712 ext(3145728->3698687) 00010000:00010000:2.0:1746066804.346273:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 30 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.346285:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 30 pid: 10402 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746066804.346291:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c0ffb80 00000100:00100000:0.0:1746066804.348079:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977267968:12345-192.168.202.57@tcp:3:cat.0 Request processed in 15448us (15644us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066804.348089:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7001 00002000:00100000:0.0:1746066804.348098:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88012c0fed80 x1830882977267968/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.348111:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0fed80 with x1830882977267968 ext(1048576->2097151) 00002000:00010000:0.0:1746066804.348115:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0fed80 00000100:00100000:1.0:1746066804.353160:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.356066:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977268352 00000100:00100000:2.0:1746066804.356076:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977268352 00010000:00010000:2.0:1746066804.356110:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 28 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.356156:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7932 00000100:00100000:2.0:1746066804.356163:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977268352:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.356174:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.356193:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 28 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.356202:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 28 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.356227:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a386e00/0xfb36a14ee608d5fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3698687) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f943 expref: 28 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.356252:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.356254:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.356259:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 13 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.356266:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 13 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.356299:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 13 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.356312:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976974336:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066804.356380:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.357176:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1965:x1830882977268096:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23594us (24715us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066804.357185:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7002 00002000:00100000:0.0:1746066804.357192:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8800996da680 x1830882977268096/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.357200:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996da680 with x1830882977268096 ext(1048576->2097151) 00002000:00010000:0.0:1746066804.357203:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996da680 00000100:00100000:2.0:1746066804.368048:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976974336:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066804.368067:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.368129:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977268352:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 11965us (14974us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.368139:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7932 00000100:00100000:0.0:1746066804.368973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.369003:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.369026:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.369048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.369081:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977268608 00000100:00100000:0.0:1746066804.369086:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977268608 00000100:00100000:0.0:1746066804.369115:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977268864 00000100:00100000:0.0:1746066804.369117:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977268864 00000100:00100000:0.0:1746066804.369126:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977268992 00000100:00100000:0.0:1746066804.369127:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977268992 00000100:00100000:0.0:1746066804.369142:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15339 00000100:00100000:0.0:1746066804.369147:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977268608:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066804.369160:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.369173:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dee0800/0xfb36a14ee608d612 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f958 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.369197:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008dee0800/0xfb36a14ee608d612 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f958 expref: 16 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.369205:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dee0800/0xfb36a14ee608d612 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f958 expref: 16 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.369215:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee0800, rc 0) 00000100:00100000:0.0:1746066804.369235:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977268608:12345-192.168.202.57@tcp:101:cat.0 Request processed in 89us (232us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066804.369240:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15339 00000100:00100000:0.0:1746066804.369250:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15340 00000100:00100000:0.0:1746066804.369254:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977268864:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066804.369260:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.369264:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dee0c00/0xfb36a14ee608d619 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f95f expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.369276:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008dee0c00/0xfb36a14ee608d619 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f95f expref: 23 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.369282:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dee0c00/0xfb36a14ee608d619 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f95f expref: 23 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.369289:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee0c00, rc 0) 00000100:00100000:0.0:1746066804.369302:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977268864:12345-192.168.202.57@tcp:101:cat.0 Request processed in 47us (275us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066804.369306:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15340 00000100:00100000:0.0:1746066804.369315:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15341 00000100:00100000:0.0:1746066804.369320:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1966:x1830882977268992:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066804.369326:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.369334:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dee0400/0xfb36a14ee608d620 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f966 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.369364:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976974464:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066804.369409:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4df9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066804.369545:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977268736 00000100:00100000:2.0:1746066804.369549:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977268736 00002000:00100000:2.0:1746066804.369572:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (3792896->3796991) req@ffff8800996d8380 x1830882977268736/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.369579:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8380 with x1830882977268736 ext(3792896->3796991) 00002000:00010000:2.0:1746066804.369583:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996d8380 00000100:00100000:2.0:1746066804.369594:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7003 00000100:00100000:2.0:1746066804.369598:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977268736:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066804.369729:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+14:1963:x1830882977268736:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 130us (758us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066804.369735:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7003 00002000:00100000:2.0:1746066804.369739:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (3792896->3796991) req@ffff8800996d8380 x1830882977268736/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/4536 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.369746:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8380 with x1830882977268736 ext(3792896->3796991) 00002000:00010000:2.0:1746066804.369748:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996d8380 00000100:00100000:0.0:1746066804.377394:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.378231:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977269120 00000100:00100000:1.0:1746066804.378239:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977269120 00000100:00100000:1.0:1746066804.378290:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15342 00000100:00100000:1.0:1746066804.378297:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+15:31989:x1830882977269120:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066804.378313:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.378329:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f96d expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.378351:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4600/0xfb36a14ee608d5ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f935 expref: 16 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.378358:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066804.378359:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066804.378362:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->4698111] (req 4194304->4698111) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 16 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.378387:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4600/0xfb36a14ee608d5ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f935 expref: 16 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.378398:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4600/0xfb36a14ee608d5ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f935 expref: 16 pid: 21203 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746066804.378409:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976974592:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066804.378470:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066804.381834:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976974464:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066804.381869:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dee0400/0xfb36a14ee608d620 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f966 expref: 26 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.381888:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dee0400/0xfb36a14ee608d620 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f966 expref: 26 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.381915:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee0400, rc 0) 00000100:00100000:2.0:1746066804.381964:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1966:x1830882977268992:12345-192.168.202.57@tcp:101:cat.0 Request processed in 12643us (12914us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066804.381972:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15341 00000100:00100000:1.0:1746066804.389051:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.389126:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977269248 00000100:00100000:2.0:1746066804.389133:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977269248 00000100:00100000:2.0:1746066804.389180:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15343 00000100:00100000:2.0:1746066804.389187:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:31995:x1830882977269248:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066804.389201:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.389215:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1a00/0xfb36a14ee608d62e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f974 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.389236:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.389239:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.389245:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1a00/0xfb36a14ee608d62e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f974 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.389256:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1a00/0xfb36a14ee608d62e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f974 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.389265:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f9a1a00, rc 0) 00000100:00100000:2.0:1746066804.389302:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:31995:x1830882977269248:12345-192.168.202.57@tcp:101:cat.0 Request processed in 116us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.389311:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15343 00000100:00100000:1.0:1746066804.390180:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976974592:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066804.390202:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->4698111] (req 4194304->4698111) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 16 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.390211:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092490600, rc 0) 00000100:00100000:1.0:1746066804.390244:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+16:31989:x1830882977269120:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 11947us (12857us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.390254:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15342 00000100:00100000:0.0:1746066804.392176:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.392246:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977269376 00000100:00100000:2.0:1746066804.392253:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977269376 00010000:00010000:2.0:1746066804.392279:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4600/0xfb36a14ee608d5ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f935 expref: 16 pid: 21203 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.392310:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7933 00000100:00100000:2.0:1746066804.392316:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882977269376:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.392326:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.392344:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4600/0xfb36a14ee608d5ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f935 expref: 16 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.392355:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4600/0xfb36a14ee608d5ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f935 expref: 16 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.392373:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ecc4600/0xfb36a14ee608d5ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 5087232->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f935 expref: 16 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.392390:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.392391:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.392397:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4698111) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 15 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.392403:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4698111) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 15 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.392433:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4698111) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 15 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.392442:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976974720:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066804.392520:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.399337:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.399378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.399405:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977269632 00000100:00100000:2.0:1746066804.399413:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977269632 00002000:00100000:2.0:1746066804.399451:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009bfe2680 x1830882977269632/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.399460:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2680 with x1830882977269632 ext(2097152->3145727) 00002000:00010000:2.0:1746066804.399465:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2680 00000100:00100000:2.0:1746066804.399484:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7004 00000100:00100000:2.0:1746066804.399491:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1965:x1830882977269632:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066804.399558:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976974720:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066804.399574:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.399607:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1965:x1830882977269376:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7292us (7437us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.399616:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7933 00000100:00100000:1.0:1746066804.399701:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977269760 00000100:00100000:1.0:1746066804.399705:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977269760 00000100:00100000:1.0:1746066804.399734:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15344 00000100:00100000:1.0:1746066804.399739:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+15:32000:x1830882977269760:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066804.399750:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.399764:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608d635 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f97b expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.399783:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.399784:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.399790:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608d635 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f97b expref: 16 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.399802:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608d635 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f97b expref: 16 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.399809:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed4600, rc 0) 00000100:00100000:1.0:1746066804.399826:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+16:32000:x1830882977269760:12345-192.168.202.57@tcp:101:cat.0 Request processed in 87us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.399831:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15344 00000100:00100000:1.0:1746066804.406414:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.410363:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977270016 00000100:00100000:2.0:1746066804.410375:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977270016 00002000:00100000:2.0:1746066804.410423:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4694016->4698111) req@ffff88009ec2fb80 x1830882977270016/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.410433:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2fb80 with x1830882977270016 ext(4694016->4698111) 00002000:00010000:2.0:1746066804.410437:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2fb80 00000100:00100000:2.0:1746066804.410466:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7005 00000100:00100000:2.0:1746066804.410472:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882977270016:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066804.410634:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882977270016:12345-192.168.202.57@tcp:3:cat.0 Request processed in 161us (4225us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066804.410642:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7005 00002000:00100000:2.0:1746066804.410647:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4694016->4698111) req@ffff88009ec2fb80 x1830882977270016/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/4536 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.410653:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2fb80 with x1830882977270016 ext(4694016->4698111) 00002000:00010000:2.0:1746066804.410656:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2fb80 00000100:00100000:0.0:1746066804.415911:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.415953:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.416032:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977270272 00000100:00100000:2.0:1746066804.416039:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977270272 00002000:00100000:2.0:1746066804.416073:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009bfe3100 x1830882977270272/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.416082:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3100 with x1830882977270272 ext(2097152->3145727) 00002000:00010000:2.0:1746066804.416087:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3100 00000100:00100000:2.0:1746066804.416113:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977270528 00000100:00100000:2.0:1746066804.416116:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977270528 00002000:00100000:2.0:1746066804.416129:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a590df80 x1830882977270528/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.416135:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590df80 with x1830882977270528 ext(2097152->3145727) 00002000:00010000:2.0:1746066804.416138:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590df80 00000100:00100000:2.0:1746066804.416160:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7006 00000100:00100000:2.0:1746066804.416176:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882977270272:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066804.416511:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7007 00000100:00100000:1.0:1746066804.416518:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+14:1966:x1830882977270528:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066804.419949:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1965:x1830882977269632:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20450us (20611us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066804.419959:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7004 00002000:00100000:3.0:1746066804.419968:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009bfe2680 x1830882977269632/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.419977:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2680 with x1830882977269632 ext(2097152->3145727) 00002000:00010000:3.0:1746066804.419988:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2680 00000100:00100000:0.0:1746066804.429922:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.430258:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977270656 00000100:00100000:3.0:1746066804.430265:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977270656 00000100:00100000:3.0:1746066804.430312:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15345 00000100:00100000:3.0:1746066804.430319:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31995:x1830882977270656:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.430335:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.430351:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f982 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.430375:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 15 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.430382:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066804.430384:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066804.430387:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f982 expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.430413:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 15 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.430423:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 15 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.431298:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135432680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976974848:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.431379:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066804.437535:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882977270272:12345-192.168.202.57@tcp:3:cat.0 Request processed in 21356us (21619us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066804.437546:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7006 00002000:00100000:2.0:1746066804.437561:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009bfe3100 x1830882977270272/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.437578:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3100 with x1830882977270272 ext(2097152->3145727) 00002000:00010000:2.0:1746066804.437584:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3100 00000100:00100000:2.0:1746066804.438606:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135432680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976974848:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.438629:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f982 expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.438642:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ec21800, rc 0) 00000100:00100000:2.0:1746066804.438666:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31995:x1830882977270656:12345-192.168.202.57@tcp:101:cat.0 Request processed in 8348us (8752us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.438672:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15345 00000100:00100000:0.0:1746066804.439720:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.439782:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977270784 00000100:00100000:3.0:1746066804.439787:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977270784 00002000:00100000:3.0:1746066804.439814:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3792896->4194303) req@ffff8800a590c380 x1830882977270784/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.439822:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590c380 with x1830882977270784 ext(3792896->4194303) 00010000:00010000:3.0:1746066804.439827:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 16 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.439838:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 16 pid: 10402 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066804.439844:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a590c380 00000100:00100000:3.0:1746066804.439861:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2263 00000100:00100000:3.0:1746066804.439866:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977270784:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066804.439941:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882977270528:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23423us (23986us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066804.439950:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7007 00002000:00100000:1.0:1746066804.439955:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a590df80 x1830882977270528/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.439962:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590df80 with x1830882977270528 ext(2097152->3145727) 00010000:00010000:1.0:1746066804.439966:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 15 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.439974:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 15 pid: 10402 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746066804.439980:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a590df80 00000100:00100000:0.0:1746066804.451656:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.451716:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977270912 00000100:00100000:0.0:1746066804.451723:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977270912 00000100:00100000:0.0:1746066804.451777:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15346 00000100:00100000:0.0:1746066804.451786:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:32000:x1830882977270912:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066804.451802:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.451832:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f989 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.451856:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066804.451861:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f989 expref: 17 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.451871:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f989 expref: 17 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.451880:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093678c00, rc 0) 00000100:00100000:1.0:1746066804.451917:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:32000:x1830882977270912:12345-192.168.202.57@tcp:101:cat.0 Request processed in 133us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.451923:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15346 00000100:00100000:3.0:1746066804.454534:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977270784:12345-192.168.202.57@tcp:4:cat.0 Request processed in 14660us (14808us total) trans 21474841053 rc 0/0 00000100:00100000:3.0:1746066804.454544:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2263 00002000:00100000:3.0:1746066804.454555:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3792896->4194303) req@ffff8800a590c380 x1830882977270784/t21474841053(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/448 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.454565:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590c380 with x1830882977270784 ext(3792896->4194303) 00010000:00010000:3.0:1746066804.454572:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 17 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.454584:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 17 pid: 10402 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066804.454591:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a590c380 00000100:00100000:0.0:1746066804.460865:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.465574:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977271040 00000100:00100000:3.0:1746066804.465586:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977271040 00010000:00010000:3.0:1746066804.465625:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 17 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.466743:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7934 00000100:00100000:3.0:1746066804.466754:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977271040:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.466769:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066804.466785:0:15727:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066803 -> 1746066804 00002000:00010000:3.0:1746066804.466788:0:15727:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066803 -> 1746066804 00010000:00010000:3.0:1746066804.466793:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 17 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.466805:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 17 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.466824:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d60b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3792896->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f951 expref: 17 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.466850:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.466851:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.466857:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f982 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.466865:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f982 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.466871:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.466872:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.466875:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f989 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.466881:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f989 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.466914:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f989 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066804.466924:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976974976:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066804.467012:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f982 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066804.467020:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135433480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976975104:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066804.467036:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066804.469666:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976974976:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066804.474049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.474156:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977271296 00000100:00100000:2.0:1746066804.474164:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977271296 00002000:00100000:2.0:1746066804.474201:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a590c700 x1830882977271296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.474210:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590c700 with x1830882977271296 ext(2097152->3145727) 00002000:00010000:2.0:1746066804.474215:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590c700 00000100:00100000:2.0:1746066804.474235:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7008 00000100:00100000:2.0:1746066804.474241:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977271296:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066804.474938:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135433480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882976975104:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066804.474957:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.474992:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977271040:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8241us (14133us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.474999:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7934 00000100:00100000:0.0:1746066804.479087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.479222:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977271552 00000100:00100000:2.0:1746066804.479229:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977271552 00002000:00100000:2.0:1746066804.479265:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a590ed80 x1830882977271552/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.479275:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590ed80 with x1830882977271552 ext(2097152->3145727) 00002000:00010000:2.0:1746066804.479280:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590ed80 00000100:00100000:2.0:1746066804.480256:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7009 00000100:00100000:2.0:1746066804.480264:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1965:x1830882977271552:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066804.485741:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.487426:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977271680 00000100:00100000:2.0:1746066804.489143:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977271680 00000100:00100000:2.0:1746066804.489209:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10158 00000100:00100000:2.0:1746066804.489216:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+18:32002:x1830882977271680:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066804.489235:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.489251:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608d64a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f990 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.489303:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608d651 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.489314:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608d651 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.489323:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608d651 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.489334:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d658 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.489339:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.489344:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.489430:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.489444:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8b7 expref: 24 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.489451:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608d56a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8be expref: 271 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.489456:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 5/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.489481:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608d56a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8be expref: 271 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.489491:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608d56a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8be expref: 271 pid: 809 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.489512:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976975232:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.489604:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8b7 expref: 24 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.489611:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8b7 expref: 24 pid: 14549 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.489619:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976975360:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066804.489636:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066804.492260:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977271296:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18014us (18690us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066804.492269:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7008 00002000:00100000:3.0:1746066804.492279:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a590c700 x1830882977271296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.492287:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590c700 with x1830882977271296 ext(2097152->3145727) 00002000:00010000:3.0:1746066804.492291:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590c700 00000100:00100000:0.0:1746066804.495239:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.495280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.495315:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977272064 00000100:00100000:0.0:1746066804.495321:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977272064 00010000:00010000:0.0:1746066804.495349:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608d56a lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8be expref: 272 pid: 809 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746066804.495385:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7935 00000100:00100000:0.0:1746066804.495392:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5219850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+272:1964:x1830882977272064:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.495401:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.495406:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608d56a lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8be expref: 272 pid: 809 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066804.495415:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608d56a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8be expref: 272 pid: 809 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746066804.495433:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066804.495437:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.495443:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.495447:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.495451:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.495481:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5219850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+272:1964:x1830882977272064:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 91us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.495487:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7935 00010000:00010000:2.0:1746066804.495750:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925a3000/0xfb36a14ee608d56a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8be expref: 271 pid: 809 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.495765:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976975232:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066804.495774:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976975360:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.495790:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746066804.495951:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977271936 00000100:00100000:3.0:1746066804.495956:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977271936 00000100:00100000:3.0:1746066804.495979:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4265 00000100:00100000:3.0:1746066804.495984:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:13378:x1830882977271936:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746066804.496162:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+26:13378:x1830882977271936:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 176us (929us total) trans 8589944243 rc 0/0 00000100:00100000:3.0:1746066804.496168:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4265 00000100:00100000:3.0:1746066804.498418:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1965:x1830882977271552:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18148us (19331us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066804.498427:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7009 00002000:00100000:3.0:1746066804.498435:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a590ed80 x1830882977271552/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.498443:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590ed80 with x1830882977271552 ext(2097152->3145727) 00002000:00010000:3.0:1746066804.498447:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a590ed80 00000100:00100000:0.0:1746066804.498966:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.499137:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977272192 00000100:00100000:1.0:1746066804.499144:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977272192 00010000:00010000:1.0:1746066804.499168:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8b7 expref: 26 pid: 14549 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746066804.499188:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7936 00000100:00100000:1.0:1746066804.499193:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977272192:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066804.499203:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066804.499207:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8b7 expref: 26 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.499216:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8b7 expref: 26 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.499233:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a489f000/0xfb36a14ee608d55c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8b7 expref: 26 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.499245:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066804.499249:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066804.499256:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066804.499262:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066804.499278:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066804.499299:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977272192:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 105us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.499303:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7936 00010000:00010000:2.0:1746066804.499556:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499563:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746066804.499594:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:2.0:1746066804.499598:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746066804.499611:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499619:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499626:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608d651 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499631:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608d651 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499636:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608d651 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499641:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f208000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066804.499644:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608d651 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499650:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608d651 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499660:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066804.499662:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066804.499665:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608d651 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499669:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208000/0xfb36a14ee608d651 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499700:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499705:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d658 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499709:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d658 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499713:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f209400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066804.499715:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d658 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499718:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d658 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499724:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebeba00) 00010000:00010000:2.0:1746066804.499726:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066804.499728:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d658 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499731:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d658 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.499758:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209000/0xfb36a14ee608d64a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f990 expref: 20 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.499769:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f990 expref: 19 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.499774:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066804.499776:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066804.499778:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f208800, rc 0) 00000100:00100000:2.0:1746066804.499800:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+19:32002:x1830882977271680:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 10585us (14067us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.499806:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10158 00000100:00100000:0.0:1746066804.500245:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.500307:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977272320 00000100:00100000:1.0:1746066804.500310:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977272320 00000100:00100000:1.0:1746066804.500330:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15347 00000100:00100000:1.0:1746066804.500334:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:32000:x1830882977272320:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066804.500345:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.500356:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d666 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f997 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.500373:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.500379:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066804.500381:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066804.500383:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d666 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f997 expref: 17 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.500405:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.500414:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 22 pid: 21203 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746066804.500423:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976975488:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066804.500467:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.507121:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.507202:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882976975488:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066804.507231:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d666 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f997 expref: 17 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.507250:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5e8e00, rc 0) 00000100:00100000:1.0:1746066804.507285:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:32000:x1830882977272320:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6950us (7041us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.507292:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15347 00000100:00100000:3.0:1746066804.510989:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977272448 00000100:00100000:3.0:1746066804.511001:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977272448 00002000:00100000:3.0:1746066804.511041:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (4165632->4194303) req@ffff8800a590e300 x1830882977272448/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.511051:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590e300 with x1830882977272448 ext(4165632->4194303) 00010000:00010000:3.0:1746066804.511059:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 23 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.511074:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 23 pid: 21203 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066804.511080:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a590e300 00000100:00100000:3.0:1746066804.511114:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2264 00000100:00100000:3.0:1746066804.511121:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882977272448:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066804.517158:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977272448:12345-192.168.202.57@tcp:4:cat.0 Request processed in 6027us (10033us total) trans 17179873748 rc 0/0 00000100:00100000:3.0:1746066804.517170:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2264 00002000:00100000:3.0:1746066804.517180:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (4165632->4194303) req@ffff8800a590e300 x1830882977272448/t17179873748(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/448 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.517189:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590e300 with x1830882977272448 ext(4165632->4194303) 00010000:00010000:3.0:1746066804.517198:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 25 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.517211:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 25 pid: 21203 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066804.517217:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a590e300 00000100:00100000:0.0:1746066804.517393:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.517832:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.518055:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.518145:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.518174:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977272704 00000100:00100000:1.0:1746066804.518180:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977272704 00000100:00100000:1.0:1746066804.518215:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977272576 00000100:00100000:1.0:1746066804.518217:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977272576 00000100:00100000:1.0:1746066804.518229:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977272832 00000100:00100000:1.0:1746066804.518231:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977272832 00000100:00100000:1.0:1746066804.518242:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15348 00000100:00100000:1.0:1746066804.518248:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31995:x1830882977272704:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066804.518262:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.518274:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b19b000/0xfb36a14ee608d66d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f9a5 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.518296:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066804.518301:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b19b000/0xfb36a14ee608d66d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9a5 expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.518310:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b19b000/0xfb36a14ee608d66d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9a5 expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.518318:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19b000, rc 0) 00000100:00100000:1.0:1746066804.518349:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31995:x1830882977272704:12345-192.168.202.57@tcp:101:cat.0 Request processed in 101us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.518356:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15348 00000100:00100000:1.0:1746066804.518367:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15349 00000100:00100000:1.0:1746066804.518372:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882977272576:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066804.518378:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.518386:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b19bc00/0xfb36a14ee608d674 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f99e expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.518397:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.518399:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.518405:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19bc00/0xfb36a14ee608d674 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f99e expref: 7 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.518415:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b19bc00/0xfb36a14ee608d674 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f99e expref: 7 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.518421:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19bc00, rc 0) 00000100:00100000:1.0:1746066804.518436:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977272576:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 64us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.518441:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15349 00000100:00100000:1.0:1746066804.518450:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15350 00000100:00100000:1.0:1746066804.518455:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882977272832:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066804.518460:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.518465:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608d67b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f9ac expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.518473:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.518475:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.518479:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608d67b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ac expref: 7 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.518486:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608d67b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ac expref: 7 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.518493:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19a000, rc 0) 00000100:00100000:1.0:1746066804.518520:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977272832:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 65us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.518524:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15350 00000100:00100000:0.0:1746066804.522010:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977272960 00000100:00100000:0.0:1746066804.522020:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977272960 00000100:00100000:0.0:1746066804.522085:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15351 00000100:00100000:0.0:1746066804.522094:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977272960:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066804.522108:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.522122:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57afa00/0xfb36a14ee608d682 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f9b3 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.522166:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8694000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976975616:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066804.522226:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b7653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.522310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.522335:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977273088 00000100:00100000:0.0:1746066804.522338:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977273088 00000100:00100000:0.0:1746066804.524236:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15352 00000100:00100000:0.0:1746066804.524246:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977273088:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066804.524340:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.524352:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608d689 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f9ba expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.524386:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.524387:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.524397:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608d689 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ba expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.524414:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608d689 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ba expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.524423:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093678600, rc 0) 00000100:00100000:0.0:1746066804.524454:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977273088:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 211us (2146us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.524459:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15352 00000100:00100000:0.0:1746066804.525188:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.525250:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977273216 00000100:00100000:2.0:1746066804.525256:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977273216 00010000:00010000:2.0:1746066804.525277:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 26 pid: 21203 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.525295:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7937 00000100:00100000:2.0:1746066804.525300:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977273216:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.525309:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066804.525322:0:15727:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066803 -> 1746066804 00010000:00010000:2.0:1746066804.525327:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 9 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 26 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.525335:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 9 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 26 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.525351:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ecc5a00/0xfb36a14ee608d5e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 9 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f927 expref: 26 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.525383:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.525384:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.525389:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d666 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f997 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.525396:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f997 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.525402:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.525403:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.525405:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b19b000/0xfb36a14ee608d66d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9a5 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.525411:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b19b000/0xfb36a14ee608d66d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9a5 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.525433:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b19b000/0xfb36a14ee608d66d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9a5 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.525443:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976975744:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066804.525508:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f997 expref: 16 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.525516:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976975872:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066804.525533:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066804.531900:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976975744:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066804.531912:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976975872:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066804.531931:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.531975:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977273216:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6672us (6786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.531984:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7937 00002000:00010000:2.0:1746066804.533023:0:4614:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime: 1746066803 -> 1746066804 00002000:00010000:2.0:1746066804.533028:0:4614:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime: 1746066803 -> 1746066804 00000100:00100000:2.0:1746066804.533126:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8694000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976975616:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066804.533155:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57afa00/0xfb36a14ee608d682 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9b3 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.533166:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57afa00/0xfb36a14ee608d682 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9b3 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.533333:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57afa00, rc 0) 00000100:00100000:2.0:1746066804.533438:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977272960:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 11345us (15291us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066804.533445:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15351 00000100:00100000:0.0:1746066804.537118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.537164:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.537477:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977273472 00000100:00100000:3.0:1746066804.537486:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977273472 00002000:00100000:3.0:1746066804.537533:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a8695c00 x1830882977273472/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.537542:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695c00 with x1830882977273472 ext(3145728->4194303) 00002000:00010000:3.0:1746066804.537547:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8695c00 00000100:00100000:3.0:1746066804.537572:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977273728 00000100:00100000:3.0:1746066804.537575:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977273728 00002000:00100000:3.0:1746066804.537588:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a8697b80 x1830882977273728/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.537600:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8697b80 with x1830882977273728 ext(3145728->4194303) 00002000:00010000:3.0:1746066804.537603:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8697b80 00000100:00100000:3.0:1746066804.537625:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7010 00000100:00100000:3.0:1746066804.537632:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1966:x1830882977273472:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066804.537642:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7011 00000100:00100000:0.0:1746066804.537652:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1965:x1830882977273728:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066804.540722:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.544711:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977273984 00000100:00100000:2.0:1746066804.544722:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977273984 00000100:00100000:2.0:1746066804.544779:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10159 00000100:00100000:2.0:1746066804.544786:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+19:32002:x1830882977273984:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066804.544802:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.544819:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608d690 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f9c1 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.544902:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.544914:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f990 expref: 20 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.544919:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.544950:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f990 expref: 20 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.544960:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f990 expref: 20 pid: 14549 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.544970:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976976000:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066804.545050:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.546081:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.550074:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.550529:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977274368 00000100:00100000:2.0:1746066804.550539:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977274368 00002000:00100000:2.0:1746066804.550580:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a8694000 x1830882977274368/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.550589:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8694000 with x1830882977274368 ext(3145728->4194303) 00002000:00010000:2.0:1746066804.550593:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8694000 00000100:00100000:2.0:1746066804.550621:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977274496 00000100:00100000:2.0:1746066804.550624:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977274496 00002000:00100000:2.0:1746066804.550636:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880092708e00 x1830882977274496/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.550648:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092708e00 with x1830882977274496 ext(3145728->4194303) 00002000:00010000:2.0:1746066804.550651:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092708e00 00000100:00100000:2.0:1746066804.550669:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7012 00000100:00100000:2.0:1746066804.550693:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977274368:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066804.551736:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7013 00000100:00100000:2.0:1746066804.551743:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882977274496:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066804.552969:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976976000:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.552990:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066804.553299:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.553860:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977274624 00000100:00100000:3.0:1746066804.553866:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977274624 00010000:00010000:3.0:1746066804.553891:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f990 expref: 21 pid: 14549 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.553912:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7938 00000100:00100000:3.0:1746066804.553919:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+21:1966:x1830882977274624:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.553929:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.553934:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f990 expref: 21 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.553941:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f990 expref: 21 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.553959:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208800/0xfb36a14ee608d65f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f990 expref: 21 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.553974:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066804.553978:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066804.553986:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066804.553991:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066804.554005:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.554033:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+20:1966:x1830882977274624:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 114us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.554039:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7938 00010000:00010000:3.0:1746066804.554060:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066804.554065:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066804.554079:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066804.554187:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608d690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c1 expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.554197:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c1 expref: 20 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.554203:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066804.554205:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066804.554207:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f209e00, rc 0) 00000100:00100000:3.0:1746066804.554229:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+20:32002:x1830882977273984:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 9445us (13515us total) trans 8589944244 rc 0/0 00000100:00100000:3.0:1746066804.554238:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10159 00000100:00100000:3.0:1746066804.559736:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.560557:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977274752 00000100:00100000:2.0:1746066804.560563:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977274752 00000100:00100000:2.0:1746066804.560599:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15353 00000100:00100000:2.0:1746066804.560606:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:31999:x1830882977274752:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066804.560619:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.560632:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f9c8 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.560654:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f982 expref: 29 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.560661:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608d689 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ba expref: 7 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.560667:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f989 expref: 17 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.560672:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.560688:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.560691:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2863104->3145727] (req 2863104->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 29 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.560713:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f989 expref: 17 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.560723:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f989 expref: 17 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.560732:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976976128:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066804.560887:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1966:x1830882977273472:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23255us (23774us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066804.560895:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7010 00002000:00100000:0.0:1746066804.560902:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a8695c00 x1830882977273472/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.560910:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695c00 with x1830882977273472 ext(3145728->4194303) 00002000:00010000:0.0:1746066804.560913:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8695c00 00010000:00010000:2.0:1746066804.561371:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608d689 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ba expref: 7 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.561379:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608d689 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ba expref: 7 pid: 21203 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746066804.561386:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976976256:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.561412:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f982 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.561418:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f982 expref: 28 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.561425:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b7f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976976384:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066804.561439:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066804.562327:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977273728:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24676us (25160us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066804.562335:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7011 00002000:00100000:1.0:1746066804.562342:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a8697b80 x1830882977273728/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.562350:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8697b80 with x1830882977273728 ext(3145728->4194303) 00010000:00010000:1.0:1746066804.562356:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f982 expref: 28 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.562366:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f982 expref: 28 pid: 10402 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746066804.562372:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a8697b80 00000100:00100000:2.0:1746066804.569051:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977274368:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18366us (22962us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066804.569062:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7012 00002000:00100000:2.0:1746066804.569072:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a8694000 x1830882977274368/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.569081:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8694000 with x1830882977274368 ext(3145728->4194303) 00002000:00010000:2.0:1746066804.569085:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8694000 00000100:00100000:0.0:1746066804.570300:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.570437:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977274880 00000100:00100000:3.0:1746066804.570443:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977274880 00000100:00100000:3.0:1746066804.570477:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10160 00000100:00100000:3.0:1746066804.570483:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+20:32002:x1830882977274880:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066804.570510:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.570525:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2de00/0xfb36a14ee608d6ac lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f9cf expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.570588:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066804.570600:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c1 expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.570606:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066804.570630:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c1 expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.570639:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c1 expref: 21 pid: 14549 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.570649:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976976512:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.570733:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066804.571486:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976976128:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066804.571496:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976976256:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066804.571532:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b7f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882976976384:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.571560:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [2863104->3145727] (req 2863104->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 27 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.571572:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f208400, rc 0) 00000100:00100000:2.0:1746066804.571594:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:31999:x1830882977274752:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 10989us (11865us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.571601:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15353 00000100:00100000:0.0:1746066804.574550:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.574643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.574702:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.574760:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977275008 00000100:00100000:2.0:1746066804.574767:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977275008 00010000:00010000:2.0:1746066804.574793:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608d689 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ba expref: 8 pid: 21203 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746066804.574824:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7939 00000100:00100000:2.0:1746066804.574831:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977275008:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.574843:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066804.574847:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977275136 00000100:00100000:1.0:1746066804.574852:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977275136 00010000:00010000:2.0:1746066804.574858:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608d689 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ba expref: 8 pid: 21203 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746066804.574867:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608d689 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ba expref: 8 pid: 21203 timeout: 865 lvb_type: 1 00000100:00100000:1.0:1746066804.574870:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977275264 00000100:00100000:1.0:1746066804.574873:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977275264 00010000:00010000:2.0:1746066804.574884:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093678600/0xfb36a14ee608d689 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ba expref: 8 pid: 21203 timeout: 865 lvb_type: 1 00000100:00100000:1.0:1746066804.574887:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15354 00000100:00100000:1.0:1746066804.574892:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1966:x1830882977275136:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066804.574903:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.574914:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee608d6ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f9d6 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066804.574950:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976976640:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066804.574996:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066804.575010:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15355 00000100:00100000:1.0:1746066804.575015:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882977275264:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066804.575022:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.575028:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009025d400/0xfb36a14ee608d6c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f9dd expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.575040:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.575046:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009025d400/0xfb36a14ee608d6c1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9dd expref: 28 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.575054:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009025d400/0xfb36a14ee608d6c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9dd expref: 28 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.575066:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025d400, rc 0) 00000100:00100000:1.0:1746066804.575084:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882977275264:12345-192.168.202.57@tcp:101:cat.0 Request processed in 69us (382us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066804.575090:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15355 00010000:00010000:2.0:1746066804.575369:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.575565:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977275008:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 734us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.575566:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882977274496:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23823us (25497us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066804.575572:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7939 00000100:00100000:3.0:1746066804.575574:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7013 00002000:00100000:3.0:1746066804.575581:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880092708e00 x1830882977274496/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.575588:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092708e00 with x1830882977274496 ext(3145728->4194303) 00010000:00010000:3.0:1746066804.575593:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f989 expref: 16 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.575602:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f989 expref: 16 pid: 10402 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066804.575607:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092708e00 00000100:00100000:0.0:1746066804.575921:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.575968:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977275392 00000100:00100000:2.0:1746066804.575971:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977275392 00010000:00010000:2.0:1746066804.575982:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f982 expref: 27 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.576004:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7940 00000100:00100000:2.0:1746066804.576009:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977275392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.576015:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.576023:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f982 expref: 27 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.576031:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f982 expref: 27 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.576043:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ec21800/0xfb36a14ee608d63c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f982 expref: 27 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.576051:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.576065:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977275392:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 56us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.576070:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7940 00000100:00100000:3.0:1746066804.577063:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976976512:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.577080:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746066804.577950:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976976640:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066804.577972:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee608d6ba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9d6 expref: 26 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.577983:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee608d6ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9d6 expref: 26 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.577993:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025d600, rc 0) 00000100:00100000:2.0:1746066804.578021:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1966:x1830882977275136:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3128us (3377us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066804.578027:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15354 00000100:00100000:0.0:1746066804.580305:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.580735:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977275648 00000100:00100000:2.0:1746066804.580743:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977275648 00000100:00100000:2.0:1746066804.580785:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10161 00000100:00100000:2.0:1746066804.580792:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:32004:x1830882977275648:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066804.580811:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.580826:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e600/0xfb36a14ee608d6c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f9e4 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.580901:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066804.580912:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.580917:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066804.580931:0:14550:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.580938:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066804.582712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.582767:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977275904 00000100:00100000:2.0:1746066804.582773:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977275904 00010000:00010000:2.0:1746066804.582795:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f989 expref: 16 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746066804.582795:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.582850:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977275776 00000100:00100000:2.0:1746066804.582853:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977275776 00000100:00100000:1.0:1746066804.582860:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7941 00010000:00010000:2.0:1746066804.582865:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c1 expref: 22 pid: 14549 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746066804.582868:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882977275904:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066804.582878:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066804.582879:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7942 00000100:00100000:2.0:1746066804.582883:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5219450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+22:1964:x1830882977275776:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.582888:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.582892:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c1 expref: 22 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.582895:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f989 expref: 16 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.582901:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c1 expref: 22 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.582902:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f989 expref: 16 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.582918:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d697 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c1 expref: 22 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.582918:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093678c00/0xfb36a14ee608d643 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f989 expref: 16 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.582929:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066804.582932:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.582933:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066804.582934:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.582939:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066804.582939:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 25 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.582944:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066804.582946:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 25 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.582950:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066804.582954:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066804.582970:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 25 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066804.582980:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976976768:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066804.583083:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390300 going to sleep for 11 seconds 00010000:00010000:2.0:1746066804.583819:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.583880:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5219450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+21:1964:x1830882977275776:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 994us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.583888:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7942 00010000:00010000:3.0:1746066804.584008:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066804.584015:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066804.584048:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066804.584051:0:14549:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066804.584062:0:14549:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066804.584087:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2de00/0xfb36a14ee608d6ac lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9cf expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.584158:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9cf expref: 20 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.584165:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9cf expref: 20 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.584171:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed2d400, rc 0) 00000100:00100000:3.0:1746066804.584239:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+20:32002:x1830882977274880:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 13755us (13942us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.584245:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10160 00000100:00100000:0.0:1746066804.584404:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.584442:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977276032 00000100:00100000:3.0:1746066804.584451:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977276032 00000100:00100000:3.0:1746066804.584475:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15356 00000100:00100000:3.0:1746066804.584481:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:32000:x1830882977276032:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.584492:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.584513:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee608d6d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f9eb expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.584529:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 25 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.584535:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066804.584536:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066804.584539:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee608d6d6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9eb expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.584561:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 25 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.584569:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 25 pid: 4614 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.584578:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976976896:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.584623:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066804.592188:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.592234:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.592235:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977276288 00000100:00100000:3.0:1746066804.592242:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977276288 00000100:00100000:2.0:1746066804.592258:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.592270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:3.0:1746066804.592280:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2863104->2867199) req@ffff88009b7f8000 x1830882977276288/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.592289:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f8000 with x1830882977276288 ext(2863104->2867199) 00010000:00010000:3.0:1746066804.592297:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 26 pid: 4614 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.592308:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 26 pid: 4614 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066804.592315:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b7f8000 00000100:00100000:0.0:1746066804.592343:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977276416 00000100:00100000:0.0:1746066804.592347:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977276416 00000100:00100000:3.0:1746066804.592349:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976976896:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.592365:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee608d6d6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9eb expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.592368:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977276544 00000100:00100000:0.0:1746066804.592370:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977276544 00000100:00100000:0.0:1746066804.592378:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977276800 00000100:00100000:0.0:1746066804.592379:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977276800 00010000:00010000:3.0:1746066804.592381:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed2c800, rc 0) 00000100:00100000:0.0:1746066804.592390:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15357 00000100:00100000:0.0:1746066804.592396:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977276416:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066804.592405:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066804.592415:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:32000:x1830882977276032:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7934us (8012us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066804.592417:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608d6dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f9f2 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066804.592422:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15358 00000100:00100000:3.0:1746066804.592427:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15356 00000100:00100000:1.0:1746066804.592431:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977276544:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:3.0:1746066804.592442:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15359 00010000:00010000:1.0:1746066804.592442:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066804.592447:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:31995:x1830882977276800:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066804.592451:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009025d200/0xfb36a14ee608d6e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97f9f9 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.592451:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976977024:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066804.592454:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.592461:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed2ca00/0xfb36a14ee608d6eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa00 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.592475:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4698111) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 16 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066804.592475:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976977152:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066804.592481:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066804.592483:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066804.592485:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed2ca00/0xfb36a14ee608d6eb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [4194304->5091327] (req 4194304->5091327) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa00 expref: 26 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.592485:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b765f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066804.592495:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390600 going to sleep for 11 seconds 00010000:00010000:3.0:1746066804.592510:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4698111) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 16 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.592519:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4698111) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 16 pid: 8112 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.592526:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976977280:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066804.592533:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976976768:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066804.592538:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2265 00010000:00010000:1.0:1746066804.592543:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.592544:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977276288:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066804.592547:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066804.592558:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:1966:x1830882977275904:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 9691us (9853us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.592565:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7941 00000100:00100000:2.0:1746066804.592643:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977276288:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 100us (462us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066804.592648:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2265 00002000:00100000:2.0:1746066804.592652:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (2863104->2867199) req@ffff88009b7f8000 x1830882977276288/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/4536 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.592659:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b7f8000 with x1830882977276288 ext(2863104->2867199) 00010000:00010000:2.0:1746066804.592663:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 26 pid: 4614 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.592670:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 26 pid: 4614 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746066804.592689:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b7f8000 00000100:00100000:0.0:1746066804.593998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.594081:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977276672 00000100:00100000:1.0:1746066804.594087:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977276672 00010000:00010000:1.0:1746066804.594104:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9cf expref: 20 pid: 14549 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746066804.594134:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7943 00000100:00100000:1.0:1746066804.594140:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+20:1963:x1830882977276672:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066804.594149:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066804.594153:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9cf expref: 20 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.594162:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9cf expref: 20 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.594177:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2d400/0xfb36a14ee608d6b3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9cf expref: 20 pid: 14549 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.594193:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066804.594197:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066804.594204:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066804.594209:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066804.594813:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066804.595005:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.595012:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:3.0:1746066804.595027:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066804.595129:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e600/0xfb36a14ee608d6c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9e4 expref: 28 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.595143:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9e4 expref: 27 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.595148:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066804.595150:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066804.595152:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cb4e200, rc 0) 00000100:00100000:1.0:1746066804.595183:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+19:1963:x1830882977276672:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1043us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.595189:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7943 00000100:00100000:3.0:1746066804.597963:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+27:32004:x1830882977275648:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 17163us (17656us total) trans 8589944245 rc 0/0 00000100:00100000:3.0:1746066804.597973:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10161 00002000:00010000:1.0:1746066804.598545:0:8112:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime: 1746066803 -> 1746066804 00000100:00100000:1.0:1746066804.598563:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976977152:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066804.598587:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009025d200/0xfb36a14ee608d6e4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9f9 expref: 8 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.598598:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009025d200/0xfb36a14ee608d6e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9f9 expref: 8 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.598607:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025d200, rc 0) 00000100:00100000:2.0:1746066804.599310:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976977024:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066804.599332:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608d6dd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9f2 expref: 8 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.599346:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608d6dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9f2 expref: 8 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.599354:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19b600, rc 0) 00000100:00100000:1.0:1746066804.599401:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977276544:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 6971us (7141us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066804.599408:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15358 00000100:00100000:2.0:1746066804.599795:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977276416:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 7397us (7559us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066804.599804:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15357 00000100:00100000:0.0:1746066804.600024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.600154:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976977280:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.600170:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed2ca00/0xfb36a14ee608d6eb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->5091327] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa00 expref: 26 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.600180:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed2ca00, rc 0) 00000100:00100000:3.0:1746066804.600201:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31995:x1830882977276800:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7754us (7929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.600206:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15359 00000100:00100000:2.0:1746066804.600319:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977276928 00000100:00100000:2.0:1746066804.600325:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977276928 00002000:00100000:2.0:1746066804.600354:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4698111) req@ffff88009a0d0000 x1830882977276928/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.600363:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d0000 with x1830882977276928 ext(4194304->4698111) 00010000:00010000:2.0:1746066804.600368:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4698111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 17 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.600378:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4698111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 17 pid: 8112 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746066804.600383:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a0d0000 00000100:00100000:2.0:1746066804.600396:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2266 00000100:00100000:2.0:1746066804.600402:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977276928:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066804.601098:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.601119:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.601159:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977277312 00000100:00100000:3.0:1746066804.601163:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977277312 00000100:00100000:3.0:1746066804.601183:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15360 00000100:00100000:3.0:1746066804.601188:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:31999:x1830882977277312:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066804.601196:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.601207:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa07 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.601225:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d666 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f997 expref: 17 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.601232:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b19b000/0xfb36a14ee608d66d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9a5 expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.601238:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746066804.601240:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746066804.601243:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 27 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.601263:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b19b000/0xfb36a14ee608d66d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9a5 expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.601272:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b19b000/0xfb36a14ee608d66d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9a5 expref: 27 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.601282:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976977408:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.601342:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f997 expref: 17 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.601350:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d666 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f997 expref: 17 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.601358:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976977536:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.601373:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066804.601384:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977277184 00000100:00100000:3.0:1746066804.601386:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977277184 00002000:00100000:3.0:1746066804.601400:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2863104->3145727) req@ffff88009a0d0a80 x1830882977277184/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.601408:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d0a80 with x1830882977277184 ext(2863104->3145727) 00010000:00010000:3.0:1746066804.601413:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 26 pid: 4614 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.601421:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 26 pid: 4614 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066804.601427:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a0d0a80 00000100:00100000:3.0:1746066804.601438:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2267 00000100:00100000:3.0:1746066804.601443:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977277184:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066804.605797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.605890:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977277440 00000100:00100000:3.0:1746066804.605898:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977277440 00000100:00100000:3.0:1746066804.605939:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10162 00000100:00100000:3.0:1746066804.605946:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+19:32002:x1830882977277440:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066804.605963:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.605979:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2ce00/0xfb36a14ee608d700 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa0e expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.606032:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2ce00/0xfb36a14ee608d700 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa0e expref: 20 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.606043:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2ce00/0xfb36a14ee608d700 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa0e expref: 20 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.606059:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066804.606062:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066804.606065:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed2ce00, rc 0) 00000100:00100000:3.0:1746066804.606120:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+20:32002:x1830882977277440:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 174us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.606126:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10162 00000100:00100000:3.0:1746066804.610537:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976977408:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.610549:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976977536:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.610572:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 27 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.610587:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed2c400, rc 0) 00000100:00100000:3.0:1746066804.610635:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:31999:x1830882977277312:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 9445us (9513us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.610643:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15360 00000100:00100000:0.0:1746066804.611859:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.612069:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.612129:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977277696 00000100:00100000:2.0:1746066804.612135:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977277696 00010000:00010000:2.0:1746066804.612158:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b19b000/0xfb36a14ee608d66d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9a5 expref: 27 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.612382:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977277184:12345-192.168.202.57@tcp:4:cat.0 Request processed in 10938us (11284us total) trans 21474841054 rc 0/0 00000100:00100000:3.0:1746066804.612389:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2267 00002000:00100000:3.0:1746066804.612398:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2863104->3145727) req@ffff88009a0d0a80 x1830882977277184/t21474841054(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/448 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.612406:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d0a80 with x1830882977277184 ext(2863104->3145727) 00010000:00010000:3.0:1746066804.612411:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 28 pid: 4614 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.612420:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 28 pid: 4614 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066804.612425:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a0d0a80 00000100:00100000:2.0:1746066804.612486:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977277568 00000100:00100000:2.0:1746066804.612488:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977277568 00010000:00010000:2.0:1746066804.612511:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d666 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f997 expref: 19 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.612622:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7944 00000100:00100000:2.0:1746066804.612629:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977277696:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.612639:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.612652:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b19b000/0xfb36a14ee608d66d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9a5 expref: 27 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.612660:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b19b000/0xfb36a14ee608d66d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 9 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9a5 expref: 27 pid: 10402 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746066804.612728:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7945 00000100:00100000:1.0:1746066804.612739:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977277568:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066804.612746:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066804.612807:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d666 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 10 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f997 expref: 19 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.612815:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 10 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f997 expref: 19 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.612833:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5e8e00/0xfb36a14ee608d666 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 10 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f997 expref: 19 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.612848:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066804.612866:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977277568:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 128us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.612871:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7945 00010000:00010000:2.0:1746066804.612935:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b19b000/0xfb36a14ee608d66d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9a5 expref: 27 pid: 10402 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746066804.612957:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.612973:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977277696:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 344us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.612978:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7944 00000100:00100000:2.0:1746066804.613576:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.613663:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977277952 00000100:00100000:0.0:1746066804.613666:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977277952 00000100:00100000:0.0:1746066804.613716:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10163 00000100:00100000:0.0:1746066804.613721:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+20:32002:x1830882977277952:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066804.613733:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.613743:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a600/0xfb36a14ee608d707 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa15 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.613803:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.613814:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9e4 expref: 26 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.613819:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 4/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.613840:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9e4 expref: 26 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.613848:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9e4 expref: 26 pid: 14550 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746066804.613858:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976977664:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066804.613907:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b765f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066804.616269:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977276928:12345-192.168.202.57@tcp:4:cat.0 Request processed in 15860us (16239us total) trans 17179873749 rc 0/0 00000100:00100000:3.0:1746066804.616279:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2266 00002000:00100000:3.0:1746066804.616288:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4698111) req@ffff88009a0d0000 x1830882977276928/t17179873749(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/448 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.616296:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a0d0000 with x1830882977276928 ext(4194304->4698111) 00010000:00010000:3.0:1746066804.616303:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4698111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 18 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.616313:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4698111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 18 pid: 8112 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066804.616319:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a0d0000 00000100:00100000:0.0:1746066804.619169:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.619235:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976977664:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.619257:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066804.619310:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.619327:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977278080 00000100:00100000:3.0:1746066804.619332:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977278080 00010000:00010000:3.0:1746066804.619359:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9e4 expref: 27 pid: 14550 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746066804.619399:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977278208 00000100:00100000:1.0:1746066804.619403:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977278208 00000100:00100000:3.0:1746066804.619447:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7946 00010000:00010000:1.0:1746066804.619448:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 28 pid: 4614 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.619453:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977278080:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.619463:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066804.619466:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7947 00010000:00010000:3.0:1746066804.619468:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9e4 expref: 27 pid: 14550 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746066804.619470:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977278208:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.619476:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9e4 expref: 27 pid: 14550 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.619477:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066804.619492:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 28 pid: 4614 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.619493:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb4e200/0xfb36a14ee608d6cf lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9e4 expref: 27 pid: 14550 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.619515:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 28 pid: 4614 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.619528:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066804.619530:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f208400/0xfb36a14ee608d6a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9c8 expref: 28 pid: 4614 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.619533:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066804.619540:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066804.619541:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.619543:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.619546:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066804.619548:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee608d6d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9eb expref: 15 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.619554:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee608d6d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9eb expref: 15 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.619559:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066804.619568:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066804.619573:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee608d6d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9eb expref: 15 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.619575:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746066804.619582:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882977278080:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 129us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.619582:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976977792:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066804.619587:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7946 00010000:00010000:2.0:1746066804.619590:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.619599:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.619604:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.619608:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b19ba00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066804.619611:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.619617:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00000100:00100000:1.0:1746066804.619620:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390600 going to sleep for 11 seconds 00010000:00010000:2.0:1746066804.619626:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066804.619628:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066804.619631:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.619636:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19ba00/0xfb36a14ee608d70e lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.619668:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a600/0xfb36a14ee608d707 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa15 expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.619698:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b19a600/0xfb36a14ee608d707 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa15 expref: 21 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.619706:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19a600, rc 0) 00000100:00100000:2.0:1746066804.619733:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+20:32002:x1830882977277952:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 6012us (6157us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066804.619738:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10163 00000100:00100000:0.0:1746066804.621279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.621412:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977278336 00000100:00100000:3.0:1746066804.621416:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977278336 00010000:00010000:3.0:1746066804.621430:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4698111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 18 pid: 8112 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.621456:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7948 00000100:00100000:3.0:1746066804.621461:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977278336:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.621468:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.621481:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4698111) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 18 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.621488:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4698111) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 18 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.621511:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092490600/0xfb36a14ee608d627 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4698111) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f96d expref: 18 pid: 8112 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.621521:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.621523:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.621527:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed2ca00/0xfb36a14ee608d6eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3698688->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa00 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.621537:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed2ca00/0xfb36a14ee608d6eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3698688->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa00 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.621543:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.621545:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.621548:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.621558:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.621582:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066804.621590:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976977920:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066804.621657:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed2ca00/0xfb36a14ee608d6eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3698688->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa00 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066804.621664:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976978048:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066804.621721:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066804.622644:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976977792:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066804.622657:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066804.622694:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977278208:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3223us (3383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.622701:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7947 00000100:00100000:0.0:1746066804.623865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.623952:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977278592 00000100:00100000:1.0:1746066804.623958:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977278592 00000100:00100000:1.0:1746066804.623998:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4266 00000100:00100000:1.0:1746066804.624004:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+20:32002:x1830882977278592:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:1.0:1746066804.624155:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+21:32002:x1830882977278592:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 150us (292us total) trans 8589944246 rc 0/0 00000100:00100000:1.0:1746066804.624160:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4266 00000100:00100000:3.0:1746066804.630060:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976977920:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066804.630070:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15727:1830882976978048:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066804.630087:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.630132:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977278336:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8670us (8854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.630142:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7948 00000100:00100000:0.0:1746066804.639464:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.639508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.639550:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.639761:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977278848 00000100:00100000:3.0:1746066804.639771:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977278848 00002000:00100000:3.0:1746066804.639816:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880092044700 x1830882977278848/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.639825:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092044700 with x1830882977278848 ext(3145728->4194303) 00002000:00010000:3.0:1746066804.639831:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092044700 00000100:00100000:3.0:1746066804.639844:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977279104 00000100:00100000:3.0:1746066804.639847:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977279104 00000100:00100000:2.0:1746066804.639891:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977279360 00000100:00100000:2.0:1746066804.639896:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977279360 00002000:00100000:2.0:1746066804.639911:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3694592->3698687) req@ffff880092044380 x1830882977279360/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.639919:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092044380 with x1830882977279360 ext(3694592->3698687) 00002000:00010000:2.0:1746066804.639922:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092044380 00000100:00100000:2.0:1746066804.639940:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7014 00000100:00100000:2.0:1746066804.639946:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977278848:12345-192.168.202.57@tcp:3:cat.0 00002000:00100000:3.0:1746066804.640082:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880092046a00 x1830882977279104/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.640089:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092046a00 with x1830882977279104 ext(4194304->5091327) 00002000:00010000:3.0:1746066804.640091:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092046a00 00000100:00100000:3.0:1746066804.640110:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7015 00000100:00100000:3.0:1746066804.640116:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977279360:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066804.640233:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977279360:12345-192.168.202.57@tcp:3:cat.0 Request processed in 117us (682us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066804.640240:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7015 00002000:00100000:3.0:1746066804.640245:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (3694592->3698687) req@ffff880092044380 x1830882977279360/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/4536 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.640251:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092044380 with x1830882977279360 ext(3694592->3698687) 00002000:00010000:3.0:1746066804.640254:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092044380 00000100:00100000:3.0:1746066804.640266:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7016 00000100:00100000:3.0:1746066804.640271:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977279104:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066804.651738:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.653275:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977279616 00000100:00100000:3.0:1746066804.653283:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977279616 00000100:00100000:3.0:1746066804.653336:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4267 00000100:00100000:3.0:1746066804.653343:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+271:31999:x1830882977279616:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066804.656418:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+272:31999:x1830882977279616:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 3067us (4680us total) trans 8589944247 rc 0/0 00000100:00100000:3.0:1746066804.656431:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4267 00000100:00100000:3.0:1746066804.657330:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977278848:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17382us (17872us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066804.657338:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7014 00002000:00100000:3.0:1746066804.657347:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880092044700 x1830882977278848/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.657354:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092044700 with x1830882977278848 ext(3145728->4194303) 00002000:00010000:3.0:1746066804.657359:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092044700 00000100:00100000:2.0:1746066804.668508:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.669039:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977279104:12345-192.168.202.57@tcp:3:cat.0 Request processed in 28765us (29536us total) trans 0 rc 897024/897024 00000100:00100000:0.0:1746066804.669050:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7016 00002000:00100000:0.0:1746066804.669061:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880092046a00 x1830882977279104/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.669069:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092046a00 with x1830882977279104 ext(4194304->5091327) 00002000:00010000:0.0:1746066804.669075:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092046a00 00000100:00100000:3.0:1746066804.669936:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977279744 00000100:00100000:3.0:1746066804.669943:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977279744 00000100:00100000:3.0:1746066804.669971:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15361 00000100:00100000:3.0:1746066804.669977:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977279744:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.669990:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.670002:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135ec3600/0xfb36a14ee608d715 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa1c expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.670026:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135ec3600/0xfb36a14ee608d715 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa1c expref: 18 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.670035:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135ec3600/0xfb36a14ee608d715 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa1c expref: 18 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.670046:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ec3600, rc 0) 00000100:00100000:3.0:1746066804.670067:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977279744:12345-192.168.202.57@tcp:101:cat.0 Request processed in 90us (1576us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066804.670076:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15361 00000100:00100000:0.0:1746066804.679343:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.679496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.679807:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.680559:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977279872 00000100:00100000:2.0:1746066804.680568:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977279872 00000100:00100000:2.0:1746066804.680604:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977280000 00000100:00100000:2.0:1746066804.680606:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977280000 00000100:00100000:2.0:1746066804.680628:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977280128 00000100:00100000:2.0:1746066804.680630:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977280128 00000100:00100000:2.0:1746066804.680645:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15362 00000100:00100000:2.0:1746066804.680652:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+17:32000:x1830882977279872:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066804.680667:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.680695:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d71c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa23 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.680717:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.680719:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.680726:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d71c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa23 expref: 18 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.680738:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d71c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa23 expref: 18 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.680753:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c3ca00, rc 0) 00000100:00100000:2.0:1746066804.680789:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+18:32000:x1830882977279872:12345-192.168.202.57@tcp:101:cat.0 Request processed in 137us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.680795:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15362 00000100:00100000:2.0:1746066804.680808:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15363 00000100:00100000:2.0:1746066804.680812:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977280000:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066804.680818:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.680823:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093c3c000/0xfb36a14ee608d723 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa2a expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.680838:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093c3c000/0xfb36a14ee608d723 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa2a expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.680845:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c3c000/0xfb36a14ee608d723 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa2a expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.680856:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c3c000, rc 0) 00000100:00100000:2.0:1746066804.680869:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977280000:12345-192.168.202.57@tcp:101:cat.0 Request processed in 57us (1374us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066804.680874:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15363 00000100:00100000:2.0:1746066804.680883:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15364 00000100:00100000:2.0:1746066804.680887:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977280128:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066804.680893:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.680901:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d72a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa31 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.680910:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.680912:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.680916:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d72a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa31 expref: 28 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.680925:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d72a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa31 expref: 28 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.680931:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c3c600, rc 0) 00000100:00100000:2.0:1746066804.680943:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977280128:12345-192.168.202.57@tcp:101:cat.0 Request processed in 56us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.680948:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15364 00000100:00100000:0.0:1746066804.685314:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.686302:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977280256 00000100:00100000:3.0:1746066804.686310:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977280256 00000100:00100000:3.0:1746066804.686360:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15365 00000100:00100000:3.0:1746066804.686367:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977280256:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.686382:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.686397:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135ec2c00/0xfb36a14ee608d731 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa38 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.686423:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135ec2c00/0xfb36a14ee608d731 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa38 expref: 27 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.686433:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135ec2c00/0xfb36a14ee608d731 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa38 expref: 27 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.686455:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ec2c00, rc 0) 00000100:00100000:3.0:1746066804.686493:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977280256:12345-192.168.202.57@tcp:101:cat.0 Request processed in 126us (1187us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066804.686512:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15365 00000100:00100000:0.0:1746066804.687058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.687149:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977280512 00000100:00100000:1.0:1746066804.687154:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977280512 00002000:00100000:1.0:1746066804.687176:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009f16c700 x1830882977280512/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.687184:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16c700 with x1830882977280512 ext(4194304->5091327) 00002000:00010000:1.0:1746066804.687188:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16c700 00000100:00100000:1.0:1746066804.687200:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7017 00000100:00100000:1.0:1746066804.687205:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f16c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977280512:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066804.693410:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.693596:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977280640 00000100:00100000:2.0:1746066804.693603:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977280640 00000100:00100000:2.0:1746066804.693651:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15366 00000100:00100000:2.0:1746066804.693659:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:32004:x1830882977280640:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066804.693689:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.693703:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa3f expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.693728:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee608d6d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9eb expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.693735:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d72a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa31 expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.693744:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.693746:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.693748:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3039232->3145727] (req 3039232->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.693772:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d72a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa31 expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.693782:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d72a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa31 expref: 27 pid: 21973 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746066804.693792:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976978176:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.694141:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee608d6d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9eb expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.694149:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee608d6d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9eb expref: 17 pid: 21203 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746066804.694155:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976978304:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066804.694189:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066804.700690:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976978176:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066804.701485:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f16c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977280512:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14277us (14425us total) trans 0 rc 897024/897024 00000100:00100000:1.0:1746066804.701494:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7017 00002000:00100000:1.0:1746066804.701512:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009f16c700 x1830882977280512/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.701521:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f16c700 with x1830882977280512 ext(4194304->5091327) 00002000:00010000:1.0:1746066804.701526:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f16c700 00000100:00100000:2.0:1746066804.701628:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976978304:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.701653:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3039232->3145727] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.701673:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c3cc00, rc 0) 00000100:00100000:2.0:1746066804.701717:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:32004:x1830882977280640:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 8059us (8315us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.701722:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15366 00000100:00100000:1.0:1746066804.702397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.702457:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977280768 00000100:00100000:3.0:1746066804.702463:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977280768 00010000:00010000:3.0:1746066804.702485:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d72a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa31 expref: 28 pid: 21973 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746066804.702515:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7949 00000100:00100000:3.0:1746066804.702521:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5219050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977280768:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.702532:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.702547:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d72a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa31 expref: 28 pid: 21973 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746066804.702556:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d72a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa31 expref: 28 pid: 21973 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746066804.702573:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d72a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa31 expref: 28 pid: 21973 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746066804.702585:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.702604:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5219050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977280768:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.702609:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7949 00000100:00100000:0.0:1746066804.703843:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.703900:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977280896 00000100:00100000:1.0:1746066804.703904:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977280896 00010000:00010000:1.0:1746066804.703921:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee608d6d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9eb expref: 17 pid: 21203 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746066804.703947:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7950 00000100:00100000:1.0:1746066804.703952:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977280896:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066804.703960:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066804.703971:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee608d6d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9eb expref: 17 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.703979:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee608d6d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9eb expref: 17 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.703993:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed2c800/0xfb36a14ee608d6d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9eb expref: 17 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.704004:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.704005:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.704010:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 16 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.704017:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 16 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.704041:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 16 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066804.704050:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976978432:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066804.704107:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.710130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.710180:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.710234:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.711067:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977281408 00000100:00100000:1.0:1746066804.711075:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977281408 00002000:00100000:1.0:1746066804.711113:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (3039232->3043327) req@ffff88008efb6a00 x1830882977281408/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.711122:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb6a00 with x1830882977281408 ext(3039232->3043327) 00002000:00010000:1.0:1746066804.711127:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb6a00 00000100:00100000:1.0:1746066804.712624:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7018 00000100:00100000:1.0:1746066804.712635:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977281408:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066804.712791:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977281408:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 158us (2609us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066804.712797:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7018 00002000:00100000:1.0:1746066804.712802:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (3039232->3043327) req@ffff88008efb6a00 x1830882977281408/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/4536 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.712810:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb6a00 with x1830882977281408 ext(3039232->3043327) 00002000:00010000:1.0:1746066804.712814:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb6a00 00000100:00100000:1.0:1746066804.712851:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882976978432:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066804.712865:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.713028:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977281024 00000100:00100000:2.0:1746066804.713033:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977281024 00000100:00100000:2.0:1746066804.713057:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977281152 00000100:00100000:2.0:1746066804.713059:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977281152 00000100:00100000:2.0:1746066804.713077:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15367 00000100:00100000:2.0:1746066804.713082:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977281024:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066804.713091:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.713213:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b54c000/0xfb36a14ee608d73f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa46 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066804.713245:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15368 00000100:00100000:3.0:1746066804.713254:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977281152:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.713261:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.713269:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135ec3a00/0xfb36a14ee608d746 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa4d expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066804.713305:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976978560:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066804.713371:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b54c000/0xfb36a14ee608d73f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa46 expref: 19 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.713380:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b54c000/0xfb36a14ee608d73f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa46 expref: 19 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.713391:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b54c000, rc 0) 00000100:00100000:1.0:1746066804.714091:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977280896:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 10137us (10249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.714099:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7950 00000100:00100000:3.0:1746066804.714298:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066804.714388:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977281024:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1305us (4263us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066804.714394:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15367 00000100:00100000:3.0:1746066804.717701:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976978560:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066804.717704:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066804.717731:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135ec3a00/0xfb36a14ee608d746 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa4d expref: 17 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.717749:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135ec3a00/0xfb36a14ee608d746 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa4d expref: 17 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.717774:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ec3a00, rc 0) 00000100:00100000:3.0:1746066804.717810:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882977281152:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4558us (7575us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066804.717817:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15368 00000100:00100000:3.0:1746066804.717838:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977281536 00000100:00100000:3.0:1746066804.717843:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977281536 00000100:00100000:3.0:1746066804.717874:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15369 00000100:00100000:3.0:1746066804.717880:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:32004:x1830882977281536:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066804.717892:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.717902:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa54 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.717920:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.717927:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066804.717929:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066804.717932:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.717954:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.717967:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 25 pid: 21203 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746066804.717977:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976978688:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.718020:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.724252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.724556:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977281664 00000100:00100000:1.0:1746066804.724563:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977281664 00000100:00100000:1.0:1746066804.724611:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15370 00000100:00100000:1.0:1746066804.724617:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977281664:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066804.724632:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.724647:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009025c400/0xfb36a14ee608d754 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa5b expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.724692:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009025c400/0xfb36a14ee608d754 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa5b expref: 21 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.724701:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009025c400/0xfb36a14ee608d754 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa5b expref: 21 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.724717:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025c400, rc 0) 00000100:00100000:1.0:1746066804.724752:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977281664:12345-192.168.202.57@tcp:101:cat.0 Request processed in 135us (508us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066804.724758:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15370 00000100:00100000:0.0:1746066804.724857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.724919:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976978688:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.724939:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.724948:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ec2a00, rc 0) 00000100:00100000:3.0:1746066804.724981:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:32004:x1830882977281536:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 7100us (7278us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.724986:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15369 00000100:00100000:3.0:1746066804.725190:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977281792 00000100:00100000:3.0:1746066804.725194:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977281792 00002000:00100000:3.0:1746066804.725215:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->3698687) req@ffff88008efb6680 x1830882977281792/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.725222:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb6680 with x1830882977281792 ext(3145728->3698687) 00010000:00010000:3.0:1746066804.725228:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 26 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.725238:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 26 pid: 21203 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066804.725249:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008efb6680 00000100:00100000:3.0:1746066804.725272:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2268 00000100:00100000:3.0:1746066804.725277:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977281792:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066804.736877:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977281792:12345-192.168.202.57@tcp:4:cat.0 Request processed in 11591us (12011us total) trans 17179873750 rc 0/0 00000100:00100000:3.0:1746066804.736890:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2268 00002000:00100000:3.0:1746066804.736900:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->3698687) req@ffff88008efb6680 x1830882977281792/t17179873750(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/448 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.736909:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb6680 with x1830882977281792 ext(3145728->3698687) 00010000:00010000:3.0:1746066804.736919:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 28 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746066804.736935:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 28 pid: 21203 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746066804.736941:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008efb6680 00000100:00100000:0.0:1746066804.745765:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.745807:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977281920 00000100:00100000:1.0:1746066804.745815:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977281920 00010000:00010000:1.0:1746066804.745848:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 28 pid: 21203 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746066804.745885:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7951 00000100:00100000:1.0:1746066804.745891:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1966:x1830882977281920:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066804.745903:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066804.745920:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 28 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.745931:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 28 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.745954:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed2c400/0xfb36a14ee608d6f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->3698687] (req 3145728->3698687) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa07 expref: 28 pid: 21203 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746066804.745979:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.745981:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.745987:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.745995:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.746020:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066804.746030:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976978816:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066804.746107:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066804.752058:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882976978816:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066804.752077:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066804.752124:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1966:x1830882977281920:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6232us (6366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.752134:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7951 00000100:00100000:0.0:1746066804.759209:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.759270:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977282176 00000100:00100000:3.0:1746066804.759278:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977282176 00002000:00100000:3.0:1746066804.759321:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3665920->3670015) req@ffff88008efb7800 x1830882977282176/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.759330:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb7800 with x1830882977282176 ext(3665920->3670015) 00002000:00010000:3.0:1746066804.759335:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb7800 00000100:00100000:3.0:1746066804.759439:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7019 00000100:00100000:3.0:1746066804.759447:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977282176:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066804.759725:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977282176:12345-192.168.202.57@tcp:3:cat.0 Request processed in 208us (454us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066804.759742:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7019 00002000:00100000:3.0:1746066804.759748:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3665920->3670015) req@ffff88008efb7800 x1830882977282176/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/4536 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.759755:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb7800 with x1830882977282176 ext(3665920->3670015) 00002000:00010000:3.0:1746066804.759757:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb7800 00000100:00100000:0.0:1746066804.763522:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.763611:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977282432 00000100:00100000:3.0:1746066804.763620:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977282432 00000100:00100000:1.0:1746066804.763788:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4268 00000100:00100000:1.0:1746066804.763797:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d07050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+26:32004:x1830882977282432:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:1.0:1746066804.763967:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d07050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+27:32004:x1830882977282432:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 172us (451us total) trans 8589944248 rc 0/0 00000100:00100000:1.0:1746066804.763974:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4268 00000100:00100000:0.0:1746066804.799974:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.800597:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977282688 00000100:00100000:2.0:1746066804.800605:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977282688 00000100:00100000:2.0:1746066804.800656:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10164 00000100:00100000:2.0:1746066804.800663:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+272:32011:x1830882977282688:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066804.800702:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.800717:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a200/0xfb36a14ee608d75b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa62 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.800795:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d762 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.800807:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d762 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066804.800817:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d762 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746066804.800825:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066804.800917:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed4a200/0xfb36a14ee608d75b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa62 expref: 275 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.800951:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d762 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa62 expref: 274 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.800958:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066804.800960:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066804.800963:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c3c600, rc 0) 00000100:00100000:2.0:1746066804.801000:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+274:32011:x1830882977282688:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 337us (1034us total) trans 8589944249 rc 0/0 00000100:00100000:2.0:1746066804.801005:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10164 00000100:00100000:0.0:1746066804.824583:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.824633:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.824712:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977282816 00000100:00100000:1.0:1746066804.824720:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977282816 00000100:00100000:1.0:1746066804.824768:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977282944 00000100:00100000:1.0:1746066804.824770:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977282944 00000100:00100000:3.0:1746066804.824815:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15371 00000100:00100000:2.0:1746066804.824822:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15372 00000100:00100000:3.0:1746066804.824824:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882977282816:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:2.0:1746066804.824828:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882977282944:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.824838:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.824838:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.824852:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b08b400/0xfb36a14ee608d777 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa69 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.824852:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608d770 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa70 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.824876:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b08b400/0xfb36a14ee608d777 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa69 expref: 28 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.824884:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b08b400/0xfb36a14ee608d777 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa69 expref: 28 pid: 8452 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066804.824891:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976978944:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066804.824906:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b08b400, rc 0) 00000100:00100000:2.0:1746066804.824948:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066804.825641:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1965:x1830882977282816:12345-192.168.202.57@tcp:101:cat.0 Request processed in 816us (1064us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066804.825647:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15371 00000100:00100000:0.0:1746066804.828301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.828552:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977283072 00000100:00100000:3.0:1746066804.828558:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977283072 00000100:00100000:2.0:1746066804.828562:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976978944:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066804.828586:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608d770 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa70 expref: 29 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.828598:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608d770 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa70 expref: 29 pid: 8112 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066804.828600:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15373 00000100:00100000:3.0:1746066804.828606:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:32011:x1830882977283072:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066804.828620:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c3dc00, rc 0) 00000100:00100000:2.0:1746066804.828651:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977282944:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3823us (4018us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066804.828656:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15372 00010000:00010000:3.0:1746066804.828741:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.828754:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa77 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.828774:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608d5a2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e8 expref: 15 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.828781:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b19bc00/0xfb36a14ee608d674 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f99e expref: 6 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.828787:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ecc4200/0xfb36a14ee608d5d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f919 expref: 28 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.828793:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.828794:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.828797:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1200128->1527807] (req 1200128->1527807) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 28 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.828819:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ecc4200/0xfb36a14ee608d5d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f919 expref: 28 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.828828:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ecc4200/0xfb36a14ee608d5d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f919 expref: 28 pid: 10402 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746066804.828842:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976979072:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.828891:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b19bc00/0xfb36a14ee608d674 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f99e expref: 6 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.828899:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b19bc00/0xfb36a14ee608d674 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f99e expref: 6 pid: 10402 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746066804.828906:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976979200:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.828926:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608d5a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e8 expref: 15 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.828933:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608d5a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e8 expref: 15 pid: 8112 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.828940:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135433b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976979328:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.828955:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066804.835050:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976979072:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.835063:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976979200:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.835070:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135433b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976979328:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.835098:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1200128->1527807] (req 1200128->1527807) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 28 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.835117:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b596400, rc 0) 00000100:00100000:3.0:1746066804.835150:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:32011:x1830882977283072:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6543us (6855us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.835157:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15373 00000100:00100000:0.0:1746066804.836475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.838994:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977283200 00000100:00100000:3.0:1746066804.839004:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977283200 00000100:00100000:3.0:1746066804.839061:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15374 00000100:00100000:3.0:1746066804.839069:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:32015:x1830882977283200:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.839083:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.839098:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa7e expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.839119:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.839125:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [1200128->1527807] (req 1200128->1527807) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 29 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.839130:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066804.839133:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa7e expref: 29 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.839165:0:8452:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [1200128->1527807] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 29 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.839176:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa7e expref: 29 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.839189:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094196c00, rc 0) 00000100:00100000:3.0:1746066804.839239:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:32015:x1830882977283200:12345-192.168.202.57@tcp:101:cat.0 Request processed in 170us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.839245:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15374 00000100:00100000:0.0:1746066804.840185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.840283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.840318:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.840334:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977283456 00000100:00100000:0.0:1746066804.840338:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977283456 00010000:00010000:0.0:1746066804.840360:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19bc00/0xfb36a14ee608d674 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f99e expref: 7 pid: 10402 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746066804.840388:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977283328 00000100:00100000:0.0:1746066804.840391:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977283328 00010000:00010000:0.0:1746066804.840400:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecc4200/0xfb36a14ee608d5d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f919 expref: 29 pid: 10402 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746066804.840411:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977283584 00000100:00100000:0.0:1746066804.840413:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977283584 00010000:00010000:0.0:1746066804.840420:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608d5a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e8 expref: 16 pid: 8112 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746066804.840508:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7952 00000100:00100000:0.0:1746066804.840516:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977283456:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.840524:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.840541:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b19bc00/0xfb36a14ee608d674 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f99e expref: 7 pid: 10402 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746066804.840550:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b19bc00/0xfb36a14ee608d674 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f99e expref: 7 pid: 10402 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746066804.840574:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b19bc00/0xfb36a14ee608d674 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f99e expref: 7 pid: 10402 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746066804.840588:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.840618:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882977283456:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 104us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.840623:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7952 00000100:00100000:0.0:1746066804.840633:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7953 00000100:00100000:0.0:1746066804.840637:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977283328:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.840642:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.840648:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ecc4200/0xfb36a14ee608d5d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f919 expref: 29 pid: 10402 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746066804.840656:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ecc4200/0xfb36a14ee608d5d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f919 expref: 29 pid: 10402 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746066804.840666:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecc4200/0xfb36a14ee608d5d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f919 expref: 29 pid: 10402 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746066804.840689:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.840703:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977283328:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 66us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.840715:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7953 00000100:00100000:0.0:1746066804.840725:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7954 00000100:00100000:0.0:1746066804.840730:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977283584:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.840735:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.840742:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608d5a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e8 expref: 16 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.840749:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608d5a2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e8 expref: 16 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.840759:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608d5a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8e8 expref: 16 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.840765:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.840767:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.840771:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.840778:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60080000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.840794:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.840802:0:9852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x70000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 27 pid: 8452 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746066804.840816:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ed0b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976979584:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066804.840851:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b7653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.856299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.856529:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ed0b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976979584:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066804.856552:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.858841:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977283840 00000100:00100000:3.0:1746066804.858849:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977283840 00002000:00100000:3.0:1746066804.858888:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1200128->1204223) req@ffff88009ed0aa00 x1830882977283840/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.858897:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed0aa00 with x1830882977283840 ext(1200128->1204223) 00010000:00010000:3.0:1746066804.858905:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 28 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.858916:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 28 pid: 8452 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746066804.858923:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed0aa00 00000100:00100000:3.0:1746066804.858943:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2269 00000100:00100000:3.0:1746066804.858949:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977283840:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066804.861397:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977283584:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 20656us (21067us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.861408:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7954 00000100:00100000:3.0:1746066804.861464:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977283840:12345-192.168.202.57@tcp:3:cat.0 Request processed in 2513us (5169us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066804.861472:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2269 00002000:00100000:3.0:1746066804.861480:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1200128->1204223) req@ffff88009ed0aa00 x1830882977283840/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/4536 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.861494:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed0aa00 with x1830882977283840 ext(1200128->1204223) 00010000:00010000:3.0:1746066804.861509:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 28 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.861521:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 28 pid: 8452 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746066804.861527:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed0aa00 00000100:00100000:0.0:1746066804.865058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.865106:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.865135:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977283968 00000100:00100000:1.0:1746066804.865143:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977283968 00000100:00100000:0.0:1746066804.865147:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.865150:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977284096 00000100:00100000:3.0:1746066804.865153:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977284096 00000100:00100000:0.0:1746066804.865165:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977284224 00000100:00100000:0.0:1746066804.865168:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977284224 00000100:00100000:3.0:1746066804.865188:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15375 00000100:00100000:1.0:1746066804.865193:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15376 00000100:00100000:3.0:1746066804.865194:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977284096:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:0.0:1746066804.865196:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10165 00000100:00100000:1.0:1746066804.865197:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882977283968:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:0.0:1746066804.865202:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+21:32019:x1830882977284224:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066804.865208:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.865208:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.865220:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135ec3e00/0xfb36a14ee608d793 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa8c expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.865220:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009025ce00/0xfb36a14ee608d78c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa85 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.865226:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.865236:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5c00/0xfb36a14ee608d79a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa93 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.865243:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135ec3e00/0xfb36a14ee608d793 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa8c expref: 20 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.865251:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135ec3e00/0xfb36a14ee608d793 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa8c expref: 20 pid: 8452 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066804.865259:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976979712:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066804.865264:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135ec3e00, rc 0) 00010000:00010000:0.0:1746066804.865280:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d7a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066804.865294:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d7a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00000100:00100000:3.0:1746066804.865300:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977284096:12345-192.168.202.57@tcp:101:cat.0 Request processed in 105us (193us total) trans 0 rc 301/301 00010000:00010000:0.0:1746066804.865304:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d7a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:3.0:1746066804.865305:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15375 00000100:00100000:1.0:1746066804.865315:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390000 going to sleep for 11 seconds 00010000:00010000:0.0:1746066804.865316:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608d7a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066804.865321:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608d7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066804.865330:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608d7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066804.865445:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066804.865454:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d762 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa62 expref: 273 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.865459:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066804.865476:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d762 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa62 expref: 273 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.865484:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d762 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa62 expref: 273 pid: 14549 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066804.865504:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976979840:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066804.865524:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390e40 going to sleep for 11 seconds 00002000:00010000:1.0:1746066804.870298:0:10402:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime: 1746066803 -> 1746066804 00002000:00010000:1.0:1746066804.870305:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime: 1746066803 -> 1746066804 00002000:00010000:1.0:1746066804.870307:0:10402:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime: 1746066803 -> 1746066804 00000100:00100000:1.0:1746066804.870327:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976979712:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066804.870358:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009025ce00/0xfb36a14ee608d78c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa85 expref: 16 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.870371:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009025ce00/0xfb36a14ee608d78c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa85 expref: 16 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.870392:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025ce00, rc 0) 00000100:00100000:2.0:1746066804.870532:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976979840:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.870545:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066804.870594:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.870659:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977284352 00000100:00100000:2.0:1746066804.870664:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977284352 00010000:00010000:2.0:1746066804.870713:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d762 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa62 expref: 274 pid: 14549 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066804.870744:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7955 00000100:00100000:2.0:1746066804.870750:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+274:1963:x1830882977284352:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.870761:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.870765:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d762 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa62 expref: 274 pid: 14549 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.870775:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d762 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa62 expref: 274 pid: 14549 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.870791:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c600/0xfb36a14ee608d762 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa62 expref: 274 pid: 14549 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.870802:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066804.870806:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066804.870814:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066804.870819:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066804.870834:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066804.870841:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.870846:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:2.0:1746066804.870854:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+273:1963:x1830882977284352:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 104us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.870859:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7955 00000004:00200000:3.0:1746066804.870878:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066804.870881:0:14550:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066804.870894:0:14550:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.870902:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.870909:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d7a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.870914:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d7a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.870919:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d7a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.870924:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faf4800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066804.870927:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d7a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.870933:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d7a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.870941:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066804.870943:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066804.870946:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d7a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.870953:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4800/0xfb36a14ee608d7a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.870963:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608d7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00000100:00100000:1.0:1746066804.870967:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+15:1966:x1830882977283968:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5769us (5916us total) trans 0 rc 301/301 00010000:00010000:3.0:1746066804.870968:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608d7a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.870972:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608d7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00000100:00100000:1.0:1746066804.870973:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15376 00010000:00010000:3.0:1746066804.870976:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faf5800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066804.870978:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608d7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.870982:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608d7a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.870988:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d3b8200) 00010000:00010000:3.0:1746066804.870990:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066804.870992:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608d7a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.870996:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5800/0xfb36a14ee608d7a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.871023:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5c00/0xfb36a14ee608d79a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa93 expref: 23 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.871033:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa93 expref: 22 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.871042:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066804.871044:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066804.871046:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025c600, rc 0) 00000100:00100000:3.0:1746066804.871081:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+22:32019:x1830882977284224:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 5879us (5933us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.871087:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10165 00000100:00100000:3.0:1746066804.876008:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.876031:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.876057:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.876088:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.876147:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977284736 00000100:00100000:1.0:1746066804.876147:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977284992 00000100:00100000:2.0:1746066804.876154:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977284736 00000100:00100000:1.0:1746066804.876154:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977284992 00000100:00100000:1.0:1746066804.876180:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977284864 00000100:00100000:1.0:1746066804.876182:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977284864 00000100:00100000:0.0:1746066804.876402:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977284608 00000100:00100000:0.0:1746066804.876406:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977284608 00002000:00100000:0.0:1746066804.876444:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1523712->1527807) req@ffff880135433b80 x1830882977284608/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.876456:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135433b80 with x1830882977284608 ext(1523712->1527807) 00010000:00010000:0.0:1746066804.876464:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 28 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.876478:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 28 pid: 8452 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746066804.876488:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135433b80 00000100:00100000:0.0:1746066804.876513:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2270 00000100:00100000:0.0:1746066804.876519:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977284608:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066804.876697:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977284608:12345-192.168.202.57@tcp:3:cat.0 Request processed in 177us (695us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066804.876703:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2270 00002000:00100000:0.0:1746066804.876711:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1523712->1527807) req@ffff880135433b80 x1830882977284608/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/4536 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.876717:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135433b80 with x1830882977284608 ext(1523712->1527807) 00010000:00010000:0.0:1746066804.876724:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 28 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.876733:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 28 pid: 8452 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746066804.876741:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135433b80 00000100:00100000:2.0:1746066804.876848:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15377 00000100:00100000:2.0:1746066804.876854:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977284992:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066804.876862:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066804.876867:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15378 00000100:00100000:1.0:1746066804.876872:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977284736:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066804.876874:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608d7b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97faa8 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.876877:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.876882:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d7bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fa9a expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.876908:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976980096:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066804.876908:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976979968:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066804.876948:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.876956:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15379 00000100:00100000:0.0:1746066804.876962:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977284864:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066804.876969:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.876977:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faf5c00/0xfb36a14ee608d7c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97faa1 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.876991:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faf5c00/0xfb36a14ee608d7c4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faa1 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.877004:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5c00/0xfb36a14ee608d7c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faa1 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.877015:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf5c00, rc 0) 00000100:00100000:2.0:1746066804.877049:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066804.879862:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977284864:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 2893us (3765us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066804.879870:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15379 00000100:00100000:3.0:1746066804.880003:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.880021:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977285120 00000100:00100000:1.0:1746066804.880027:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977285120 00000100:00100000:3.0:1746066804.880037:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.880058:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15380 00000100:00100000:1.0:1746066804.880064:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+15:32018:x1830882977285120:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066804.880076:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.880087:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97faaf expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.880105:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066804.880110:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.880120:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 16 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.880129:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025c200, rc 0) 00000100:00100000:1.0:1746066804.880152:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+16:32018:x1830882977285120:12345-192.168.202.57@tcp:101:cat.0 Request processed in 88us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.880157:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15380 00000100:00100000:0.0:1746066804.880856:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976979968:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066804.880879:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d7bd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa9a expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.880887:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d7bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa9a expref: 9 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066804.880898:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025c400, rc 0) 00000100:00100000:2.0:1746066804.881014:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977285632 00000100:00100000:2.0:1746066804.881018:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977285632 00000100:00100000:0.0:1746066804.881270:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977284736:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 4397us (5237us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066804.881276:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15378 00000100:00100000:3.0:1746066804.881409:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.881489:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977285376 00000100:00100000:0.0:1746066804.881492:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977285376 00002000:00100000:0.0:1746066804.881529:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1200128->1527807) req@ffff880135432680 x1830882977285376/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066804.881537:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135432680 with x1830882977285376 ext(1200128->1527807) 00010000:00010000:0.0:1746066804.881542:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 28 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.881552:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 28 pid: 8452 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746066804.881558:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135432680 00000100:00100000:0.0:1746066804.881569:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2271 00000100:00100000:0.0:1746066804.881575:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977285376:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066804.881976:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4269 00000100:00100000:2.0:1746066804.881983:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+273:32011:x1830882977285632:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066804.882131:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+274:32011:x1830882977285632:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 149us (2092us total) trans 8589944250 rc 0/0 00000100:00100000:2.0:1746066804.882136:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4269 00000100:00100000:2.0:1746066804.882168:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976980096:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066804.882183:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608d7b6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faa8 expref: 7 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.882196:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c3dc00/0xfb36a14ee608d7b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faa8 expref: 7 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066804.882203:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c3dc00, rc 0) 00000100:00100000:2.0:1746066804.882218:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882977284992:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 5365us (6161us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066804.882223:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15377 00000100:00100000:0.0:1746066804.884346:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.884476:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977285888 00000100:00100000:3.0:1746066804.884482:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977285888 00000100:00100000:3.0:1746066804.884535:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10166 00000100:00100000:3.0:1746066804.884542:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+22:32019:x1830882977285888:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066804.884557:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.884570:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b08b400/0xfb36a14ee608d7d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fab6 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.884635:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596e00/0xfb36a14ee608d7d9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.884647:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa93 expref: 23 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.884657:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596e00/0xfb36a14ee608d7d9 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.884709:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa93 expref: 23 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.884718:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa93 expref: 23 pid: 14550 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.884728:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976980224:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.884798:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066804.886862:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977285376:12345-192.168.202.57@tcp:4:cat.0 Request processed in 5282us (5447us total) trans 21474841055 rc 0/0 00000100:00100000:1.0:1746066804.886871:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2271 00002000:00100000:1.0:1746066804.886880:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1200128->1527807) req@ffff880135432680 x1830882977285376/t21474841055(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/448 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.886888:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135432680 with x1830882977285376 ext(1200128->1527807) 00010000:00010000:1.0:1746066804.886895:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 30 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746066804.886905:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 30 pid: 8452 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746066804.886911:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135432680 00000100:00100000:3.0:1746066804.889288:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976980224:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.889310:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596e00/0xfb36a14ee608d7d9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066804.891307:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.891459:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977286016 00000100:00100000:2.0:1746066804.891467:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977286016 00010000:00010000:2.0:1746066804.891494:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa93 expref: 24 pid: 14550 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066804.891554:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7956 00000100:00100000:2.0:1746066804.891560:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5218c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+24:1964:x1830882977286016:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.891572:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.891577:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa93 expref: 24 pid: 14550 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.891585:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa93 expref: 24 pid: 14550 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.891602:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009025c600/0xfb36a14ee608d7af lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa93 expref: 24 pid: 14550 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.891615:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066804.891619:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596e00/0xfb36a14ee608d7d9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066804.891627:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596e00/0xfb36a14ee608d7d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066804.891633:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596e00/0xfb36a14ee608d7d9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066804.891654:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066804.891695:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596e00/0xfb36a14ee608d7d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.891702:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596e00/0xfb36a14ee608d7d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:2.0:1746066804.891709:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5218c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+23:1964:x1830882977286016:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 149us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.891715:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7956 00000004:00200000:3.0:1746066804.891719:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066804.891839:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b08b400/0xfb36a14ee608d7d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fab6 expref: 24 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.891856:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596e00/0xfb36a14ee608d7d9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fab6 expref: 23 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.891862:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066804.891865:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066804.891867:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b596e00, rc 0) 00000100:00100000:3.0:1746066804.891888:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+23:32019:x1830882977285888:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 7347us (7547us total) trans 8589944251 rc 0/0 00000100:00100000:3.0:1746066804.891894:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10166 00000100:00100000:0.0:1746066804.893846:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.893886:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977286144 00000100:00100000:2.0:1746066804.893892:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977286144 00010000:00010000:2.0:1746066804.893910:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 30 pid: 8452 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066804.893939:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7957 00000100:00100000:2.0:1746066804.893944:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977286144:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.893953:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.893968:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x60000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 30 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.893977:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 30 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.893992:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b596400/0xfb36a14ee608d77e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1200128->1527807) gid 0 flags: 0x44801000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa77 expref: 30 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.894009:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.894011:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.894016:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa7e expref: 29 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.894023:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa7e expref: 29 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.894029:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.894030:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.894033:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.894039:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.894060:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.894069:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976980352:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066804.894138:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa7e expref: 29 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.894145:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976980480:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066804.894157:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.894828:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.895637:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977286400 00000100:00100000:3.0:1746066804.895642:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977286400 00000100:00100000:3.0:1746066804.895671:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10167 00000100:00100000:3.0:1746066804.895690:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+23:32019:x1830882977286400:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066804.895706:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.895708:0:14550:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066804.895723:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596e00/0xfb36a14ee608d7d9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fab6 expref: 23 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.895735:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066804.895738:0:14550:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066804.895747:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b597800/0xfb36a14ee608d7e7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fabd expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.895806:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596a00/0xfb36a14ee608d7ee lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.895816:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596a00/0xfb36a14ee608d7ee lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.895822:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596a00/0xfb36a14ee608d7ee lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:3.0:1746066804.895831:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066804.895905:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b597800/0xfb36a14ee608d7e7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fabd expref: 25 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.895916:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596a00/0xfb36a14ee608d7ee lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fabd expref: 24 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.895921:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066804.895924:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066804.895926:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b596a00, rc 0) 00000100:00100000:3.0:1746066804.895952:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+24:32019:x1830882977286400:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 263us (1125us total) trans 8589944252 rc 0/0 00000100:00100000:3.0:1746066804.896506:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10167 00000100:00100000:0.0:1746066804.899725:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.899742:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.899822:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976980480:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066804.899867:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977286656 00000100:00100000:1.0:1746066804.899872:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977286656 00002000:00100000:1.0:1746066804.899907:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e636a00 x1830882977286656/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.899915:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e636a00 with x1830882977286656 ext(1048576->2097151) 00002000:00010000:1.0:1746066804.899919:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e636a00 00000100:00100000:1.0:1746066804.899934:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7020 00000100:00100000:1.0:1746066804.899940:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977286656:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066804.901588:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.903210:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977286784 00000100:00100000:3.0:1746066804.903218:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977286784 00000100:00100000:3.0:1746066804.903249:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977286912 00000100:00100000:3.0:1746066804.903251:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977286912 00000100:00100000:3.0:1746066804.903277:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15381 00000100:00100000:3.0:1746066804.903284:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882977286784:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:3.0:1746066804.903319:0:8112:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d369e00/0xfb36a14ee608d7fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.903334:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d444 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d7 expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.903342:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ed34800/0xfb36a14ee608d4ad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f82b expref: 7 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.903348:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d452 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7e5 expref: 26 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.903359:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.903360:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.903363:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d369e00/0xfb36a14ee608d7fc lrc: 6/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.903387:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d452 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7e5 expref: 26 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.903397:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d452 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7e5 expref: 26 pid: 4614 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746066804.903408:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976980608:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066804.903700:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15382 00000100:00100000:0.0:1746066804.903711:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1965:x1830882977286912:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066804.903728:0:10402:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d803 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.903738:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa7e expref: 31 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.903746:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.903751:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.903753:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.903755:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d803 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.903769:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 15 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.903776:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 15 pid: 8450 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746066804.903785:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e634380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976980736:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.904817:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ed34800/0xfb36a14ee608d4ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f82b expref: 7 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066804.904826:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ed34800/0xfb36a14ee608d4ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f82b expref: 7 pid: 10402 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746066804.904835:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976980864:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066804.905138:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.905152:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977287040 00000100:00100000:1.0:1746066804.905156:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977287040 00000100:00100000:1.0:1746066804.905179:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15383 00000100:00100000:1.0:1746066804.905184:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882977287040:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066804.905207:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d80a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.905218:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb97a00/0xfb36a14ee608d5b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8fd expref: 15 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.905224:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608d67b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ac expref: 7 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.905229:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5800/0xfb36a14ee608d5da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f920 expref: 31 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.905233:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.905234:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.905236:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d80a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.905249:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5800/0xfb36a14ee608d5da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f920 expref: 31 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.905255:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5800/0xfb36a14ee608d5da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f920 expref: 31 pid: 21203 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746066804.905262:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976980992:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066804.905292:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.905302:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977287168 00000100:00100000:1.0:1746066804.905305:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977287168 00000100:00100000:1.0:1746066804.905318:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15384 00000100:00100000:1.0:1746066804.905322:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1965:x1830882977287168:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066804.905334:0:21203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009025ca00/0xfb36a14ee608d811 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.905342:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608d2a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f68e expref: 18 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.905348:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8400/0xfb36a14ee608d364 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f736 expref: 8 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.905354:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d18fe00/0xfb36a14ee608d2e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6c6 expref: 26 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.905358:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.905358:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066804.905360:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009025ca00/0xfb36a14ee608d811 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.905373:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d18fe00/0xfb36a14ee608d2e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6c6 expref: 26 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.905386:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d18fe00/0xfb36a14ee608d2e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6c6 expref: 26 pid: 8451 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746066804.905393:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976981120:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.905485:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d444 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d7 expref: 18 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.905493:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d444 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d7 expref: 18 pid: 4614 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.905515:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e869f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976981248:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.905534:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746066804.905875:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8400/0xfb36a14ee608d364 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f736 expref: 8 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.905884:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8400/0xfb36a14ee608d364 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f736 expref: 8 pid: 10402 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746066804.905891:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976981376:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066804.905934:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608d2a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f68e expref: 18 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.905941:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608d2a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f68e expref: 18 pid: 8452 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746066804.905948:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976981504:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066804.905962:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066804.906021:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.906042:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.906073:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.906136:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977287680 00000100:00100000:2.0:1746066804.906139:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977287680 00000100:00100000:2.0:1746066804.906161:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977287552 00000100:00100000:2.0:1746066804.906163:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977287552 00000100:00100000:2.0:1746066804.906181:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15385 00000100:00100000:2.0:1746066804.906188:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1966:x1830882977287680:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066804.906204:0:21973:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3d600/0xfb36a14ee608d818 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.906217:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 15 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.906222:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066804.906223:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066804.906225:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3d600/0xfb36a14ee608d818 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.906237:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 15 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.906243:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 15 pid: 21203 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066804.906249:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976981632:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066804.906414:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15386 00000100:00100000:0.0:1746066804.906423:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882977287552:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066804.906444:0:4614:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135a08800/0xfb36a14ee608d81f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.906454:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.906461:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1a00/0xfb36a14ee608d62e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f974 expref: 26 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.906569:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608d635 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f97b expref: 18 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.906576:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed2ca00/0xfb36a14ee608d6eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3698688->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa00 expref: 26 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.906581:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d71c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa23 expref: 18 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.906586:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 5 00010000:00010000:0.0:1746066804.906588:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 5 00010000:00010000:0.0:1746066804.906590:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a08800/0xfb36a14ee608d81f lrc: 8/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.906607:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d71c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa23 expref: 18 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.906615:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d71c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa23 expref: 18 pid: 21973 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746066804.906623:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976981760:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066804.906757:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa7e expref: 31 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.906765:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa7e expref: 31 pid: 8452 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066804.906773:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976981888:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.907065:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976980352:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066804.907078:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.907101:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977286144:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 13156us (13259us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.907107:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7957 00000100:00100000:2.0:1746066804.907171:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4b6c000 going to sleep for 11 seconds 00010000:00010000:0.0:1746066804.907182:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed2ca00/0xfb36a14ee608d6eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3698688->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa00 expref: 26 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.907192:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed2ca00/0xfb36a14ee608d6eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3698688->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa00 expref: 26 pid: 21203 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066804.907194:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977287424 00000100:00100000:2.0:1746066804.907197:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977287424 00000100:00100000:0.0:1746066804.907200:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976982016:192.168.202.57@tcp:104: 00002000:00100000:2.0:1746066804.907218:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880092046680 x1830882977287424/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746066804.907220:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608d635 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f97b expref: 18 pid: 8112 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746066804.907226:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092046680 with x1830882977287424 ext(1048576->2097151) 00010000:00010000:0.0:1746066804.907226:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608d635 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f97b expref: 18 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.907232:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 16 pid: 8450 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746066804.907232:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976982144:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.907240:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 16 pid: 8450 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746066804.907246:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092046680 00010000:00010000:0.0:1746066804.907250:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1a00/0xfb36a14ee608d62e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f974 expref: 26 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.907257:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2272 00010000:00010000:0.0:1746066804.907257:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1a00/0xfb36a14ee608d62e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f974 expref: 26 pid: 8452 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066804.907262:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977287424:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066804.907264:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976982272:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066804.907281:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 18 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.907289:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 18 pid: 8452 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746066804.907302:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976982400:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066804.907317:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b765f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066804.907813:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b7653c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066804.907977:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608d67b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ac expref: 8 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066804.907988:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608d67b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ac expref: 8 pid: 10402 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746066804.907997:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8697800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976982528:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066804.908033:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb97a00/0xfb36a14ee608d5b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8fd expref: 16 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.908040:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009eb97a00/0xfb36a14ee608d5b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8fd expref: 16 pid: 8112 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066804.908047:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092709180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976982656:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066804.908058:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.909225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.909731:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e634380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976980736:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.909809:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976980608:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.909815:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976980864:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066804.910791:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977286656:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10847us (11069us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066804.910799:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7020 00002000:00100000:1.0:1746066804.910808:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e636a00 x1830882977286656/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.910816:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e636a00 with x1830882977286656 ext(1048576->2097151) 00010000:00010000:1.0:1746066804.910825:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa7e expref: 29 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746066804.910836:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa7e expref: 29 pid: 8452 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746066804.910844:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e636a00 00000100:00100000:1.0:1746066804.910880:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976980992:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066804.911029:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977287808 00000100:00100000:2.0:1746066804.911034:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977287808 00010000:00010000:2.0:1746066804.911057:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed34800/0xfb36a14ee608d4ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f82b expref: 10 pid: 10402 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746066804.911075:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7958 00000100:00100000:2.0:1746066804.911081:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977287808:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.911090:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.911107:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ed34800/0xfb36a14ee608d4ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f82b expref: 10 pid: 10402 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746066804.911116:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ed34800/0xfb36a14ee608d4ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f82b expref: 10 pid: 10402 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746066804.911140:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ed34800/0xfb36a14ee608d4ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f82b expref: 10 pid: 10402 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746066804.911155:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.911172:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977287808:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 92us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.911177:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7958 00000100:00100000:0.0:1746066804.913405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.913432:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.913512:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e869f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976981248:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066804.913540:0:8112:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d369e00/0xfb36a14ee608d7fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066804.913638:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977287936 00000100:00100000:3.0:1746066804.913642:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977287936 00000100:00100000:0.0:1746066804.913644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.913658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066804.913664:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d452 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7e5 expref: 27 pid: 4614 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746066804.913672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.913702:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977288192 00000100:00100000:3.0:1746066804.913705:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977288192 00010000:00010000:3.0:1746066804.913715:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8400/0xfb36a14ee608d364 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f736 expref: 9 pid: 10402 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746066804.913724:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977288064 00000100:00100000:3.0:1746066804.913726:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977288064 00010000:00010000:3.0:1746066804.913733:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d18fe00/0xfb36a14ee608d2e6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6c6 expref: 28 pid: 8451 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746066804.913736:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976981760:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.913740:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977288448 00000100:00100000:3.0:1746066804.913742:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977288448 00010000:00010000:3.0:1746066804.913749:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608d2a0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f68e expref: 19 pid: 8452 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746066804.913756:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977288320 00000100:00100000:3.0:1746066804.913758:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977288320 00000100:00100000:0.0:1746066804.913762:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976982016:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.913764:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d444 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d7 expref: 20 pid: 4614 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.913773:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7959 00000100:00100000:3.0:1746066804.913779:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977287936:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.913789:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.913807:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d452 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7e5 expref: 28 pid: 4614 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746066804.913814:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976982144:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.913816:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d452 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7e5 expref: 28 pid: 4614 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746066804.913834:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5e00/0xfb36a14ee608d452 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7e5 expref: 28 pid: 4614 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746066804.913846:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.913875:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977287936:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 96us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.913880:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7959 00000100:00100000:3.0:1746066804.913891:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7960 00000100:00100000:3.0:1746066804.913895:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977288192:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.913903:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.913912:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8400/0xfb36a14ee608d364 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f736 expref: 9 pid: 10402 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746066804.913919:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8400/0xfb36a14ee608d364 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f736 expref: 9 pid: 10402 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746066804.913928:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.913939:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977288192:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 44us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.913943:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7960 00000100:00100000:3.0:1746066804.913951:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7961 00000100:00100000:3.0:1746066804.913955:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977288064:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.913960:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.913965:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d18fe00/0xfb36a14ee608d2e6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6c6 expref: 26 pid: 8451 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746066804.913971:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d18fe00/0xfb36a14ee608d2e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6c6 expref: 26 pid: 8451 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746066804.913977:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.913985:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977288064:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 31us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.913990:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7961 00000100:00100000:3.0:1746066804.913996:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7962 00000100:00100000:3.0:1746066804.914000:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977288448:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.914004:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.914009:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608d2a0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f68e expref: 20 pid: 8452 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746066804.914015:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608d2a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f68e expref: 20 pid: 8452 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746066804.914022:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.914024:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.914027:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009025ca00/0xfb36a14ee608d811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.914034:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009025ca00/0xfb36a14ee608d811 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.914046:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.914055:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977288448:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 55us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.914059:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7962 00000100:00100000:3.0:1746066804.914066:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7963 00000100:00100000:3.0:1746066804.914069:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5218850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977288320:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.914074:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.914080:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d444 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d7 expref: 19 pid: 4614 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.914086:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d444 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d7 expref: 19 pid: 4614 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.914098:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faf4600/0xfb36a14ee608d444 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f7d7 expref: 19 pid: 4614 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.914104:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.914105:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.914107:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d369e00/0xfb36a14ee608d7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.914112:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d369e00/0xfb36a14ee608d7fc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.914897:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d18fe00/0xfb36a14ee608d2e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f6c6 expref: 25 pid: 8451 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746066804.914914:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976981120:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066804.914925:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebc8400/0xfb36a14ee608d364 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f736 expref: 8 pid: 10402 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746066804.914932:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976981376:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066804.914940:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cb3d800/0xfb36a14ee608d2a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f68e expref: 18 pid: 8452 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746066804.914947:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976981504:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066804.914973:0:21203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009025ca00/0xfb36a14ee608d811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.914987:0:21203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009025ca00/0xfb36a14ee608d811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.914993:0:21203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009025ca00/0xfb36a14ee608d811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.915017:0:21203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009025ca00/0xfb36a14ee608d811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.915024:0:21203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009025ca00/0xfb36a14ee608d811 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.915029:0:21203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009025ca00/0xfb36a14ee608d811 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.915035:0:21203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009025ca00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066804.915038:0:21203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009025ca00/0xfb36a14ee608d811 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.915044:0:21203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009025ca00/0xfb36a14ee608d811 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.915230:0:21203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009025ca00/0xfb36a14ee608d811 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.915236:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009025ca00/0xfb36a14ee608d811 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.915267:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.915288:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5218850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977288320:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1215us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.915288:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882977287168:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 9962us (9993us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.915294:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7963 00000100:00100000:1.0:1746066804.915295:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15384 00010000:00010000:2.0:1746066804.915387:0:8112:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d369e00/0xfb36a14ee608d7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.915395:0:8112:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d369e00/0xfb36a14ee608d7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.915408:0:8112:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d369e00/0xfb36a14ee608d7fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.915414:0:8112:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d369e00/0xfb36a14ee608d7fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.915420:0:8112:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d369e00/0xfb36a14ee608d7fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.915429:0:8112:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d369e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066804.915432:0:8112:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d369e00/0xfb36a14ee608d7fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.915437:0:8112:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d369e00/0xfb36a14ee608d7fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.915447:0:8112:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d369e00/0xfb36a14ee608d7fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.915452:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d369e00/0xfb36a14ee608d7fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.915487:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1965:x1830882977286784:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 12203us (15743us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.915493:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15381 00000100:00100000:0.0:1746066804.916153:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976982272:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066804.916160:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976982400:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066804.916183:0:4614:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135a08800/0xfb36a14ee608d81f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066804.916731:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8697800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976982528:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066804.916740:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092709180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976982656:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066804.916755:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d80a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066804.916771:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a590d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882976981888:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066804.916781:0:10402:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d803 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.916897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.916920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.916933:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.916947:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977288704 00000100:00100000:2.0:1746066804.916952:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977288704 00010000:00010000:2.0:1746066804.916973:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed2ca00/0xfb36a14ee608d6eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3698688->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa00 expref: 25 pid: 21203 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066804.916991:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977289088 00000100:00100000:2.0:1746066804.916993:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977289088 00010000:00010000:2.0:1746066804.917003:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608d67b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ac expref: 9 pid: 10402 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746066804.917014:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977288960 00000100:00100000:2.0:1746066804.917015:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977288960 00010000:00010000:2.0:1746066804.917023:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1a00/0xfb36a14ee608d62e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f974 expref: 26 pid: 8452 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066804.917035:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7964 00000100:00100000:2.0:1746066804.917041:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1966:x1830882977288704:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.917050:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.917065:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed2ca00/0xfb36a14ee608d6eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3698688->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa00 expref: 26 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.917073:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed2ca00/0xfb36a14ee608d6eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3698688->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa00 expref: 26 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.917090:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed2ca00/0xfb36a14ee608d6eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3698688->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa00 expref: 26 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.917099:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.917122:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1966:x1830882977288704:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.917127:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7964 00000100:00100000:2.0:1746066804.917138:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7965 00000100:00100000:2.0:1746066804.917143:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882977289088:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.917150:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.917162:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608d67b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ac expref: 9 pid: 10402 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746066804.917169:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608d67b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ac expref: 9 pid: 10402 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746066804.917180:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b19a000/0xfb36a14ee608d67b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f9ac expref: 9 pid: 10402 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746066804.917188:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.917201:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1966:x1830882977289088:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 58us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.917206:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7965 00000100:00100000:2.0:1746066804.917216:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7966 00000100:00100000:2.0:1746066804.917220:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1966:x1830882977288960:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.917226:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.917233:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1a00/0xfb36a14ee608d62e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f974 expref: 24 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.917240:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1a00/0xfb36a14ee608d62e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f974 expref: 24 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.917250:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f9a1a00/0xfb36a14ee608d62e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f974 expref: 24 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.917256:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.917267:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1966:x1830882977288960:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 47us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.917272:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7966 00000100:00100000:2.0:1746066804.917336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.917366:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977288576 00000100:00100000:2.0:1746066804.917369:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977288576 00010000:00010000:2.0:1746066804.917380:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d71c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa23 expref: 17 pid: 21973 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066804.917397:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7967 00000100:00100000:2.0:1746066804.917401:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977288576:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.917407:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.917413:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d71c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa23 expref: 17 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.917420:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d71c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa23 expref: 17 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.917430:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d71c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa23 expref: 17 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.917437:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066804.917454:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977288576:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 52us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.917458:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7967 00000100:00100000:3.0:1746066804.917661:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976981632:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.917697:0:21973:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3d600/0xfb36a14ee608d818 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.917922:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.918291:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.919018:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.919163:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977289216 00000100:00100000:1.0:1746066804.919169:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977289216 00002000:00100000:1.0:1746066804.919201:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (3145728->3670015) req@ffff88008efb4700 x1830882977289216/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066804.919209:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb4700 with x1830882977289216 ext(3145728->3670015) 00010000:00010000:1.0:1746066804.919216:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 16 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746066804.919226:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 16 pid: 8452 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746066804.919232:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008efb4700 00000100:00100000:2.0:1746066804.919338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.919356:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.919605:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977287424:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12341us (13560us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066804.919611:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2272 00002000:00100000:2.0:1746066804.919616:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff880092046680 x1830882977287424/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.919622:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092046680 with x1830882977287424 ext(1048576->2097151) 00010000:00010000:2.0:1746066804.919627:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 16 pid: 8450 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.919634:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 16 pid: 8450 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746066804.919639:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092046680 00000100:00100000:2.0:1746066804.919651:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977289344 00000100:00100000:2.0:1746066804.919653:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977289344 00002000:00100000:2.0:1746066804.919666:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3039232->3145727) req@ffff88009ed0a300 x1830882977289344/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.919673:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed0a300 with x1830882977289344 ext(3039232->3145727) 00010000:00010000:2.0:1746066804.919692:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 16 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.919703:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 16 pid: 21203 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746066804.919713:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed0a300 00000100:00100000:0.0:1746066804.919732:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977288832 00000100:00100000:0.0:1746066804.919735:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977288832 00010000:00010000:0.0:1746066804.919755:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608d635 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f97b expref: 17 pid: 8112 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066804.919756:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2273 00000100:00100000:1.0:1746066804.919762:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977289216:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066804.919776:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977289472 00000100:00100000:0.0:1746066804.919778:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977289472 00010000:00010000:0.0:1746066804.919786:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb97a00/0xfb36a14ee608d5b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8fd expref: 17 pid: 8112 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746066804.919802:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977289600 00000100:00100000:0.0:1746066804.919804:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977289600 00010000:00010000:0.0:1746066804.919812:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5800/0xfb36a14ee608d5da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f920 expref: 29 pid: 21203 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746066804.919822:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7968 00000100:00100000:0.0:1746066804.919827:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977288832:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.919835:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.919846:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608d635 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f97b expref: 17 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.919854:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608d635 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f97b expref: 17 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.919870:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ed4600/0xfb36a14ee608d635 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f97b expref: 17 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.919884:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.919901:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977288832:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 74us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.919907:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7968 00000100:00100000:0.0:1746066804.919926:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7969 00000100:00100000:0.0:1746066804.919931:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977289472:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.919937:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.919948:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eb97a00/0xfb36a14ee608d5b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8fd expref: 17 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.919955:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eb97a00/0xfb36a14ee608d5b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8fd expref: 17 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.919979:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb97a00/0xfb36a14ee608d5b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f8fd expref: 17 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.919987:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.920001:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:1965:x1830882977289472:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 70us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.920006:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7969 00000100:00100000:0.0:1746066804.920016:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7970 00000100:00100000:0.0:1746066804.920021:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5218450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977289600:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.920028:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.920035:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5800/0xfb36a14ee608d5da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f920 expref: 29 pid: 21203 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746066804.920042:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5800/0xfb36a14ee608d5da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f920 expref: 29 pid: 21203 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746066804.920052:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ecc5800/0xfb36a14ee608d5da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f920 expref: 29 pid: 21203 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746066804.920060:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.920061:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066804.920065:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d80a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.920072:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d80a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.920092:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.920111:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5218450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977289600:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 90us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.920116:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7970 00000100:00100000:3.0:1746066804.920205:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2274 00000100:00100000:3.0:1746066804.920212:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+15:1963:x1830882977289344:12345-192.168.202.57@tcp:4:cat.0 00010000:00010000:1.0:1746066804.920829:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d80a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.920841:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d80a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.920857:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d80a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.920863:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d80a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.920869:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d80a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.920873:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009025c400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066804.920876:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d80a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.920883:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d80a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.920892:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d80a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.920898:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608d80a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066804.920933:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882977287040:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 15748us (15795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.920940:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15383 00000100:00100000:1.0:1746066804.921866:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.921898:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.921999:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977289728 00000100:00100000:2.0:1746066804.922006:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977289728 00000100:00100000:2.0:1746066804.922032:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15387 00000100:00100000:2.0:1746066804.922037:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:32015:x1830882977289728:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066804.922048:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.922058:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50a3200/0xfb36a14ee608d826 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fac4 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066804.922071:0:8450:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd73, atime: 0x6812dd73, ctime: 0x6812dd73, blocks: 0x821 00010000:00010000:2.0:1746066804.922084:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.922085:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.922090:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50a3200/0xfb36a14ee608d826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fac4 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.922100:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50a3200/0xfb36a14ee608d826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fac4 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.922107:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50a3200, rc 0) 00000100:00100000:2.0:1746066804.922126:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:32015:x1830882977289728:12345-192.168.202.57@tcp:101:cat.0 Request processed in 89us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.922131:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15387 00000100:00100000:3.0:1746066804.922272:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977289856 00000100:00100000:3.0:1746066804.922275:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977289856 00010000:00010000:3.0:1746066804.922288:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa7e expref: 29 pid: 8452 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.922307:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7971 00000100:00100000:3.0:1746066804.922311:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1965:x1830882977289856:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.922317:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.922327:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa7e expref: 29 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.922334:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa7e expref: 29 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.922345:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094196c00/0xfb36a14ee608d785 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa7e expref: 29 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.922354:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.922368:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977289856:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 57us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.922372:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7971 00000100:00100000:1.0:1746066804.924555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.924761:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977289984 00000100:00100000:2.0:1746066804.924768:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977289984 00000100:00100000:2.0:1746066804.924812:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15388 00000100:00100000:2.0:1746066804.924888:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+17:32018:x1830882977289984:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:1.0:1746066804.924897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066804.924905:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066804.924917:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801350bcc00/0xfb36a14ee608d82d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97facb expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.924935:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.924936:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066804.924941:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801350bcc00/0xfb36a14ee608d82d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97facb expref: 18 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.924953:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801350bcc00/0xfb36a14ee608d82d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97facb expref: 18 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.924961:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801350bcc00, rc 0) 00000100:00100000:2.0:1746066804.924994:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+18:32018:x1830882977289984:12345-192.168.202.57@tcp:101:cat.0 Request processed in 176us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.925000:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15388 00000100:00100000:3.0:1746066804.925078:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977290112 00000100:00100000:3.0:1746066804.925082:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977290112 00010000:00010000:3.0:1746066804.925099:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 18 pid: 8450 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.925114:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7972 00000100:00100000:3.0:1746066804.925118:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977290112:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.925125:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.925141:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 18 pid: 8450 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.925150:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 18 pid: 8450 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.925164:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009025c200/0xfb36a14ee608d7cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faaf expref: 18 pid: 8450 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.925173:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.925175:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.925177:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.925183:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d803 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.925212:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.925231:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977290112:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 112us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.925236:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7972 00010000:00010000:0.0:1746066804.925609:0:10402:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.925617:0:10402:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.925635:0:10402:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.925641:0:10402:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d803 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.925648:0:10402:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d803 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.925659:0:10402:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135a08e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066804.925662:0:10402:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d803 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.925668:0:10402:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d803 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.925706:0:10402:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d803 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.925712:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d803 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.925761:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1965:x1830882977286912:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 22054us (24177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.925767:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15382 00000100:00100000:2.0:1746066804.929530:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977289216:12345-192.168.202.57@tcp:4:cat.0 Request processed in 9759us (11600us total) trans 17179873751 rc 0/0 00000100:00100000:2.0:1746066804.929541:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2273 00002000:00100000:2.0:1746066804.929552:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (3145728->3670015) req@ffff88008efb4700 x1830882977289216/t17179873751(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/448 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.929560:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb4700 with x1830882977289216 ext(3145728->3670015) 00010000:00010000:2.0:1746066804.929569:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 17 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.929580:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 17 pid: 8452 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746066804.929586:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008efb4700 00000100:00100000:3.0:1746066804.930257:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977289344:12345-192.168.202.57@tcp:4:cat.0 Request processed in 10044us (11964us total) trans 21474841056 rc 0/0 00000100:00100000:3.0:1746066804.930264:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2274 00002000:00100000:3.0:1746066804.930269:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3039232->3145727) req@ffff88009ed0a300 x1830882977289344/t21474841056(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/448 e 0 to 0 dl 1746066815 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.930277:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed0a300 with x1830882977289344 ext(3039232->3145727) 00010000:00010000:3.0:1746066804.930283:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 17 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.930290:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 17 pid: 21203 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746066804.930296:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ed0a300 00000100:00100000:0.0:1746066804.930557:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.930585:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.930627:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977290368 00000100:00100000:3.0:1746066804.930632:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977290368 00002000:00100000:3.0:1746066804.930654:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009bb2f100 x1830882977290368/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.930661:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f100 with x1830882977290368 ext(1048576->2097151) 00002000:00010000:3.0:1746066804.930664:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2f100 00000100:00100000:3.0:1746066804.930689:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977290624 00000100:00100000:3.0:1746066804.930691:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977290624 00002000:00100000:3.0:1746066804.930699:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009bb2c380 x1830882977290624/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.930705:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c380 with x1830882977290624 ext(1048576->2097151) 00002000:00010000:3.0:1746066804.930707:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2c380 00000100:00100000:3.0:1746066804.930715:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7021 00000100:00100000:3.0:1746066804.930720:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977290368:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066804.931699:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7022 00000100:00100000:0.0:1746066804.931710:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977290624:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066804.932726:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.933226:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977290752 00000100:00100000:3.0:1746066804.933232:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977290752 00010000:00010000:3.0:1746066804.933258:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 17 pid: 8452 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.933422:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7973 00000100:00100000:3.0:1746066804.933430:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977290752:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.933439:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.933455:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 17 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.933464:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 17 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.933482:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135ec2a00/0xfb36a14ee608d74d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->3670015] (req 3145728->3670015) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa54 expref: 17 pid: 8452 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.933494:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.933508:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.933512:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135a08800/0xfb36a14ee608d81f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.933520:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135a08800/0xfb36a14ee608d81f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.933549:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.933577:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977290752:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 148us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.933583:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7973 00010000:00010000:2.0:1746066804.933598:0:4614:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135a08800/0xfb36a14ee608d81f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.933606:0:4614:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135a08800/0xfb36a14ee608d81f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.933622:0:4614:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135a08800/0xfb36a14ee608d81f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.933629:0:4614:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135a08800/0xfb36a14ee608d81f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.933635:0:4614:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135a08800/0xfb36a14ee608d81f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.933640:0:4614:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135a08800 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066804.933643:0:4614:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a08800/0xfb36a14ee608d81f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.933649:0:4614:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135a08800/0xfb36a14ee608d81f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.933657:0:4614:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135a08800/0xfb36a14ee608d81f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066804.933667:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135a08800/0xfb36a14ee608d81f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066804.933748:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1966:x1830882977287552:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 27326us (27673us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.933755:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15386 00000100:00100000:1.0:1746066804.934159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.935064:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977290880 00000100:00100000:3.0:1746066804.935070:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977290880 00010000:00010000:3.0:1746066804.935087:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 19 pid: 21203 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.935120:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7974 00000100:00100000:3.0:1746066804.935126:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977290880:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066804.935135:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.935148:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 19 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.935157:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 19 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.935171:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608d738 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa3f expref: 19 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.935181:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.935182:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.935184:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3d600/0xfb36a14ee608d818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.935190:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3d600/0xfb36a14ee608d818 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.935205:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066804.935218:0:21973:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3d600/0xfb36a14ee608d818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.935224:0:21973:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3d600/0xfb36a14ee608d818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.935241:0:21973:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3d600/0xfb36a14ee608d818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.935247:0:21973:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3d600/0xfb36a14ee608d818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.935253:0:21973:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3d600/0xfb36a14ee608d818 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.935257:0:21973:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e3d600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066804.935260:0:21973:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3d600/0xfb36a14ee608d818 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.935266:0:21973:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3d600/0xfb36a14ee608d818 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.935273:0:21973:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3d600/0xfb36a14ee608d818 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.935278:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e3d600/0xfb36a14ee608d818 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066804.936346:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1966:x1830882977287680:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 30153us (30321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.936354:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15385 00000100:00100000:3.0:1746066804.936384:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977290880:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1259us (2226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.936390:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7974 00000100:00100000:0.0:1746066804.941108:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.942161:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977291136 00000100:00100000:3.0:1746066804.942169:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977291136 00000100:00100000:3.0:1746066804.942213:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10168 00000100:00100000:3.0:1746066804.942220:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+24:32019:x1830882977291136:12345-192.168.202.57@tcp:36:mirror_io.0 00010000:00010000:3.0:1746066804.942258:0:14550:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066804.942278:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed2ce00/0xfb36a14ee608d700 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fa0e expref: 24 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.942291:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066804.942294:0:14550:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066804.942315:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.942325:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3bd expref: 26 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.942332:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b40aa00/0xfb36a14ee608ce40 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e7 expref: 273 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.942337:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cf51 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b9 expref: 273 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.942342:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68200/0xfb36a14ee608cfa5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4e3 expref: 273 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.942347:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608cfd6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f8 expref: 26 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.942356:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.942377:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608cfd6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f8 expref: 26 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.942386:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608cfd6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f8 expref: 26 pid: 14548 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.942396:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976982784:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.942465:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68200/0xfb36a14ee608cfa5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4e3 expref: 273 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.942473:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68200/0xfb36a14ee608cfa5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4e3 expref: 273 pid: 809 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.942480:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e869f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976982912:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066804.942976:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977290368:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12253us (12418us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066804.942984:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7021 00002000:00100000:2.0:1746066804.942992:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009bb2f100 x1830882977290368/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066804.943000:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f100 with x1830882977290368 ext(1048576->2097151) 00002000:00010000:2.0:1746066804.943003:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2f100 00010000:00010000:3.0:1746066804.943449:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cf51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b9 expref: 273 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.943459:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cf51 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b9 expref: 273 pid: 809 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.943467:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976983040:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.944250:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b40aa00/0xfb36a14ee608ce40 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e7 expref: 273 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.944263:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b40aa00/0xfb36a14ee608ce40 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e7 expref: 273 pid: 809 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.944273:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976983168:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.944337:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3bd expref: 26 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.944345:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3bd expref: 26 pid: 14549 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.944352:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976983296:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.944377:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.946936:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.947043:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977291264 00000100:00100000:2.0:1746066804.947051:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977291264 00010000:00010000:2.0:1746066804.947096:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608cfd6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f8 expref: 27 pid: 14548 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066804.947119:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7975 00000100:00100000:2.0:1746066804.947125:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977291264:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066804.947135:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.947139:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608cfd6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f8 expref: 27 pid: 14548 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.947152:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608cfd6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f8 expref: 27 pid: 14548 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.947169:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066804.947173:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066804.947180:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066804.947611:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608cfd6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4f8 expref: 27 pid: 14548 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.947624:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976982784:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066804.948940:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977291264:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1809us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.948949:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7975 00000100:00100000:2.0:1746066804.949772:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977290624:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18065us (19184us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066804.949779:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7022 00002000:00100000:2.0:1746066804.949787:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009bb2c380 x1830882977290624/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066804.949790:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e869f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976982912:192.168.202.57@tcp:104: 00002000:00100000:2.0:1746066804.949796:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c380 with x1830882977290624 ext(1048576->2097151) 00000100:00100000:3.0:1746066804.949798:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976983040:192.168.202.57@tcp:104: 00002000:00010000:2.0:1746066804.949799:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2c380 00000100:00100000:1.0:1746066804.949988:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.950012:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.950099:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976983168:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066804.950107:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882976983296:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066804.950133:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066804.950330:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977291392 00000100:00100000:0.0:1746066804.950335:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977291392 00010000:00010000:0.0:1746066804.950359:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cf51 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b9 expref: 274 pid: 809 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746066804.950385:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977291520 00000100:00100000:0.0:1746066804.950388:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977291520 00010000:00010000:0.0:1746066804.950396:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68200/0xfb36a14ee608cfa5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4e3 expref: 275 pid: 809 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746066804.950409:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7976 00000100:00100000:0.0:1746066804.950415:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+275:1965:x1830882977291392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.950424:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.950428:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cf51 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b9 expref: 275 pid: 809 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.950437:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cf51 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b9 expref: 275 pid: 809 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.950454:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cb3ce00/0xfb36a14ee608cf51 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4b9 expref: 275 pid: 809 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.950467:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066804.950471:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066804.950477:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.950507:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+274:1965:x1830882977291392:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 81us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.950513:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7976 00000100:00100000:0.0:1746066804.950525:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7977 00000100:00100000:0.0:1746066804.950531:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5218050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+273:1966:x1830882977291520:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066804.950538:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.950541:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68200/0xfb36a14ee608cfa5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4e3 expref: 273 pid: 809 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.950548:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68200/0xfb36a14ee608cfa5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4e3 expref: 273 pid: 809 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.950558:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed68200/0xfb36a14ee608cfa5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f4e3 expref: 273 pid: 809 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066804.950566:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066804.950568:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066804.950573:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.950585:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5218050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+272:1966:x1830882977291520:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 56us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.950590:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7977 00000100:00100000:0.0:1746066804.952778:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066804.952831:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977291776 00000100:00100000:2.0:1746066804.952838:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977291776 00010000:00010000:2.0:1746066804.952865:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3bd expref: 26 pid: 14549 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066804.952885:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7978 00000100:00100000:2.0:1746066804.952890:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977291776:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066804.952899:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066804.952903:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066804.952907:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3bd expref: 26 pid: 14549 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.952916:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3bd expref: 26 pid: 14549 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.952932:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ed06000/0xfb36a14ee608cdc2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3bd expref: 26 pid: 14549 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066804.952957:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00000100:00100000:3.0:1746066804.952959:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977291648 00010000:00010000:2.0:1746066804.952961:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:3.0:1746066804.952962:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977291648 00010000:00010000:2.0:1746066804.952967:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066804.952976:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b40aa00/0xfb36a14ee608ce40 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e7 expref: 272 pid: 809 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066804.952991:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7979 00000100:00100000:3.0:1746066804.952995:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+272:1966:x1830882977291648:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066804.952997:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+25:1966:x1830882977291776:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 107us (1326us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066804.953001:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066804.953002:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7978 00010000:00010000:3.0:1746066804.953004:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b40aa00/0xfb36a14ee608ce40 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e7 expref: 272 pid: 809 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.953010:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b40aa00/0xfb36a14ee608ce40 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e7 expref: 272 pid: 809 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.953020:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b40aa00/0xfb36a14ee608ce40 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3e7 expref: 272 pid: 809 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066804.953029:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066804.953032:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.953042:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.953048:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066804.953064:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066804.953080:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+271:1966:x1830882977291648:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 84us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.953085:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7979 00010000:00010000:2.0:1746066804.953184:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066804.953190:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000040:00080000:2.0:1746066804.953865:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3198, 88 off270688 00000004:00080000:2.0:1746066804.953872:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766131195927ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066804.953924:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3203, 88 off271040 00000004:00080000:2.0:1746066804.953928:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766131252475ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066804.953939:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3204, 88 off271128 00000004:00080000:2.0:1746066804.953942:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766131265910ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066804.953948:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3199, 88 off270776 00000004:00080000:2.0:1746066804.953951:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766131274809ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066804.953958:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3200, 88 off270864 00000004:00080000:2.0:1746066804.953961:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766131284950ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066804.953968:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3205, 88 off271216 00000004:00080000:2.0:1746066804.953971:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766131294734ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066804.953977:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3206, 88 off271304 00000004:00080000:2.0:1746066804.953979:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766131303104ns, next at 749511475809ns, rc = 0 00000100:00100000:0.0:1746066804.954865:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.954921:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977291904 00000100:00100000:3.0:1746066804.954926:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977291904 00000100:00100000:3.0:1746066804.954957:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15389 00000100:00100000:3.0:1746066804.954962:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:32015:x1830882977291904:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.954974:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.954986:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d83b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fad2 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066804.955002:0:21973:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 2097152, mtime: 0x6812dd70, atime: 0x6812dd70, ctime: 0x6812dd70, blocks: 0x81d 00010000:00010000:3.0:1746066804.955018:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.955020:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.955025:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad2 expref: 24 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.955036:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad2 expref: 24 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.955043:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed4a000, rc 0) 00000100:00100000:3.0:1746066804.955341:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:32015:x1830882977291904:12345-192.168.202.57@tcp:101:cat.0 Request processed in 378us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.955345:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15389 00000040:00080000:2.0:1746066804.955777:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3207, 88 off271392 00000004:00080000:2.0:1746066804.955787:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766133110680ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066804.955845:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3201, 88 off270952 00000004:00080000:2.0:1746066804.955849:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766133173065ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066804.955861:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3208, 88 off271480 00000004:00080000:2.0:1746066804.955864:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766133187620ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066804.956012:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3202, 88 off271040 00000004:00080000:2.0:1746066804.956016:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766133340420ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066804.956028:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3209, 88 off271568 00000004:00080000:2.0:1746066804.956031:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766133354980ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066804.956040:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3203, 88 off271128 00000004:00080000:2.0:1746066804.956042:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766133366262ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066804.956049:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3204, 88 off271216 00000004:00080000:2.0:1746066804.956052:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766133375910ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066804.956058:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3205, 88 off271304 00000004:00080000:2.0:1746066804.956061:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766133384738ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066804.956067:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3206, 88 off271392 00000004:00080000:2.0:1746066804.956070:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766133393758ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066804.956077:0:14550:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3210, 88 off271656 00000004:00080000:2.0:1746066804.956079:0:14550:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766133403012ns, next at 749511475809ns, rc = 0 00000100:00100000:1.0:1746066804.958012:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.958033:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977292032 00000100:00100000:1.0:1746066804.958039:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977292032 00000100:00100000:1.0:1746066804.958069:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10169 00000100:00100000:1.0:1746066804.958075:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+271:32015:x1830882977292032:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066804.958090:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.958103:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fad9 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.958142:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066804.958149:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 272 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.958163:0:14549:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066804.958172:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 272 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.958183:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066804.958185:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066804.958188:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 272 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.958193:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a08e00, rc 0) 00000100:00100000:1.0:1746066804.958225:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+272:32015:x1830882977292032:12345-192.168.202.57@tcp:101:cat.0 Request processed in 151us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.958230:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10169 00000100:00100000:1.0:1746066804.960288:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066804.960520:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977292160 00000100:00100000:3.0:1746066804.960580:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977292160 00000100:00100000:3.0:1746066804.960612:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15390 00000100:00100000:3.0:1746066804.960618:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+16:32018:x1830882977292160:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066804.960630:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066804.960641:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d849 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fae0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.960659:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.960661:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066804.960668:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d849 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae0 expref: 17 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.960694:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d849 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae0 expref: 17 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066804.960702:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c3ca00, rc 0) 00000100:00100000:3.0:1746066804.960731:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:32018:x1830882977292160:12345-192.168.202.57@tcp:101:cat.0 Request processed in 113us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066804.960737:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15390 00000100:00100000:0.0:1746066804.962986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.963163:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977292288 00000100:00100000:1.0:1746066804.963168:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977292288 00000100:00100000:1.0:1746066804.963193:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10170 00000100:00100000:1.0:1746066804.963198:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:32018:x1830882977292288:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066804.963212:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066804.963222:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135a09a00/0xfb36a14ee608d850 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fae7 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.963262:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135a09a00/0xfb36a14ee608d850 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae7 expref: 26 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.963271:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a09a00/0xfb36a14ee608d850 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae7 expref: 26 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.963280:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066804.963283:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066804.963287:0:809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 271 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066804.963292:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135a09a00, rc 0) 00000100:00100000:1.0:1746066804.963319:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+26:32018:x1830882977292288:12345-192.168.202.57@tcp:101:cat.0 Request processed in 121us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.963324:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10170 00000001:00080000:0.0:1746066804.976831:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944234 is committed 00000004:00010000:2.0:1746066804.976838:0:14550:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009bb2f480 reply state ffff8800a7240800 transno 8589944253 ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14550 initiator: MDT0 00000001:00080000:0.0:1746066804.976842:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944232 is committed 00000100:00100000:2.0:1746066804.976848:0:14550:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746066804.976856:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944248 is committed 00000001:00080000:0.0:1746066804.976863:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944246 is committed 00000001:00080000:0.0:1746066804.976866:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944241 is committed 00000001:00080000:0.0:1746066804.976873:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944253 is committed 00000004:00080000:0.0:1746066804.976876:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2483 committed 00000004:00080000:0.0:1746066804.976882:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2478 committed 00000004:00080000:0.0:1746066804.976888:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2477 committed 00000004:00080000:0.0:1746066804.976889:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2476 committed 00000004:00080000:0.0:1746066804.976890:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2475 committed 00000004:00080000:0.0:1746066804.976892:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2482 committed 00000004:00080000:0.0:1746066804.976893:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2474 committed 00000004:00080000:0.0:1746066804.976894:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2481 committed 00000004:00080000:0.0:1746066804.976895:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2473 committed 00000004:00080000:0.0:1746066804.976896:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2480 committed 00000004:00080000:0.0:1746066804.976898:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2479 committed 00000004:00080000:0.0:1746066804.976899:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2478 committed 00000004:00080000:0.0:1746066804.976900:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2472 committed 00000004:00080000:0.0:1746066804.976901:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2471 committed 00000004:00080000:0.0:1746066804.976903:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2477 committed 00000004:00080000:0.0:1746066804.976904:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2476 committed 00000004:00080000:0.0:1746066804.976905:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2470 committed 00000001:00080000:0.0:1746066804.976908:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944250 is committed 00010000:00080000:2.0:1746066804.976926:0:14550:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746066804.976938:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+21:32019:x1830882977291136:12345-192.168.202.57@tcp:36:mirror_io.0 Request processed in 34715us (35834us total) trans 8589944253 rc 0/0 00000100:00100000:2.0:1746066804.976945:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10168 00010000:00010000:0.0:1746066804.976990:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066804.976997:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066804.977002:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066804.977006:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800935c1800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066804.977010:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066804.977016:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066804.977028:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066804.977031:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066804.977036:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 250 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.977209:0:3280:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 250 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.977218:0:3280:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 250 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.977226:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135a09a00/0xfb36a14ee608d850 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae7 expref: 7 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.977232:0:3280:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a09a00/0xfb36a14ee608d850 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae7 expref: 7 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.977237:0:3280:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135a09a00/0xfb36a14ee608d850 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae7 expref: 7 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.977257:0:3280:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135a09a00/0xfb36a14ee608d850 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae7 expref: 7 pid: 809 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.977266:0:3280:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830882976984448:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066804.977342:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976983808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066804.977378:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066804.977436:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976983424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066804.977457:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066804.977470:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976983680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066804.977482:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746066804.977857:0:3280:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 250 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066804.977865:0:3280:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830882976985600:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066804.977932:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976983808 00000100:00100000:3.0:1746066804.977937:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976983808 00000100:00100000:3.0:1746066804.977966:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976983424 00000100:00100000:3.0:1746066804.977968:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976983424 00000100:00100000:3.0:1746066804.977977:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976983680 00000100:00100000:3.0:1746066804.977979:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976983680 00000100:00100000:3.0:1746066804.977988:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15391 00000100:00100000:3.0:1746066804.977993:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3295:x1830882976983808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066804.978141:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3295:x1830882976983808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 148us (764us total) trans 17179873752 rc 0/0 00000100:00100000:3.0:1746066804.978146:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15391 00000100:00100000:1.0:1746066804.978518:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15392 00000100:00100000:1.0:1746066804.978525:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3296:x1830882976983424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066804.978621:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1830882976983424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (1162us total) trans 17179873753 rc 0/0 00000100:00100000:1.0:1746066804.978626:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15392 00000100:00100000:1.0:1746066804.978635:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15393 00000100:00100000:1.0:1746066804.978639:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3294:x1830882976983680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066804.979085:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3294:x1830882976983680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 444us (1601us total) trans 17179873754 rc 0/0 00000100:00100000:1.0:1746066804.979091:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15393 00000100:00100000:0.0:1746066804.979551:0:3280:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52dc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066804.979566:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976983552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.979589:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.979617:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976984064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.979630:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066804.979632:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976983552 00000100:00100000:2.0:1746066804.979637:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976983552 00000100:00100000:0.0:1746066804.979640:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976984704:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066804.979653:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976984064 00000100:00100000:0.0:1746066804.979653:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066804.979655:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976984064 00000100:00100000:0.0:1746066804.979662:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976985216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066804.979664:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976984704 00000100:00100000:2.0:1746066804.979666:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976984704 00000100:00100000:0.0:1746066804.979672:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066804.979693:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976985216 00000100:00100000:2.0:1746066804.979695:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976985216 00000100:00100000:0.0:1746066804.979705:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15394 00000100:00100000:0.0:1746066804.979740:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3293:x1830882976983552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066804.979860:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066804.979863:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066804.979866:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066804.979867:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:0.0:1746066804.979869:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746066804.979890:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3293:x1830882976983552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (300us total) trans 17179873755 rc 0/0 00000100:00100000:2.0:1746066804.979915:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15395 00000100:00100000:2.0:1746066804.979922:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3293:x1830882976984064:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1746066804.979949:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746066804.979952:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066804.979963:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15396 00000100:00100000:3.0:1746066804.979968:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1830882976984704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066804.980016:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3293:x1830882976984064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (384us total) trans 17179873756 rc 0/0 00000100:00100000:2.0:1746066804.980021:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15395 00000100:00100000:2.0:1746066804.980030:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15397 00000100:00100000:2.0:1746066804.980034:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3293:x1830882976985216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066804.980051:0:8450:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066804.980053:0:8450:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066803 -> 1746066803 00002000:00010000:3.0:1746066804.980055:0:8450:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066803 -> 1746066803 00002000:00010000:3.0:1746066804.980057:0:8450:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066803 -> 1746066803 00002000:00010000:3.0:1746066804.980059:0:8450:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746066804.980077:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3293:x1830882976984704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (423us total) trans 21474841057 rc 0/0 00000100:00100000:3.0:1746066804.980082:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15396 00000100:00100000:2.0:1746066804.980107:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3293:x1830882976985216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (433us total) trans 21474841058 rc 0/0 00000100:00100000:2.0:1746066804.980111:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15397 00000100:00100000:1.0:1746066804.980234:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873734 gen 2 00000004:00080000:1.0:1746066804.980241:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e93f480, transno 17179873670 00000004:00080000:1.0:1746066804.980247:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009244d180, transno 17179873671 00000004:00080000:1.0:1746066804.980249:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e852680, transno 17179873672 00000004:00080000:1.0:1746066804.980251:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009244f800, transno 17179873673 00000004:00080000:1.0:1746066804.980253:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e851180, transno 17179873674 00000004:00080000:1.0:1746066804.980255:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e93d180, transno 17179873675 00000004:00080000:1.0:1746066804.980258:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e851c00, transno 17179873676 00000004:00080000:1.0:1746066804.980259:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009244c700, transno 17179873677 00000004:00080000:1.0:1746066804.980261:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136b41f80, transno 17179873678 00000004:00080000:1.0:1746066804.980263:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136b43800, transno 17179873682 00000004:00080000:1.0:1746066804.980265:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e852a00, transno 17179873683 00000004:00080000:1.0:1746066804.980267:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136b40a80, transno 17179873684 00000004:00080000:1.0:1746066804.980270:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5e680, transno 17179873685 00000004:00080000:1.0:1746066804.980271:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136b42d80, transno 17179873686 00000004:00080000:1.0:1746066804.980273:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136b43100, transno 17179873687 00000004:00080000:1.0:1746066804.980275:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136b41c00, transno 17179873688 00000100:00100000:0.0:1746066804.980276:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15394 00000004:00080000:1.0:1746066804.980277:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e850700, transno 17179873689 00000004:00080000:1.0:1746066804.980279:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a4ec000, transno 17179873690 00000004:00080000:1.0:1746066804.980281:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8696680, transno 17179873691 00000004:00080000:1.0:1746066804.980283:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8696d80, transno 17179873692 00000004:00080000:1.0:1746066804.980285:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed73800, transno 17179873693 00000004:00080000:1.0:1746066804.980286:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8694e00, transno 17179873694 00000004:00080000:1.0:1746066804.980289:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed71f80, transno 17179873695 00000004:00080000:1.0:1746066804.980291:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8697480, transno 17179873696 00000004:00080000:1.0:1746066804.980292:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ed71880, transno 17179873697 00000004:00080000:1.0:1746066804.980294:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8694700, transno 17179873698 00000004:00080000:1.0:1746066804.980296:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8696a00, transno 17179873699 00000004:00080000:1.0:1746066804.980298:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c394000, transno 17179873705 00000004:00080000:1.0:1746066804.980303:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c395880, transno 17179873706 00000004:00080000:1.0:1746066804.980305:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c396d80, transno 17179873707 00000004:00080000:1.0:1746066804.980619:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c396300, transno 17179873708 00000004:00080000:1.0:1746066804.980622:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c395500, transno 17179873709 00000004:00080000:1.0:1746066804.980624:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c397b80, transno 17179873710 00000004:00080000:1.0:1746066804.980626:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c394e00, transno 17179873711 00000004:00080000:1.0:1746066804.980628:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c395f80, transno 17179873712 00000004:00080000:1.0:1746066804.980630:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c395c00, transno 17179873713 00000004:00080000:1.0:1746066804.980636:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e86b800, transno 17179873717 00000004:00080000:1.0:1746066804.980638:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e868e00, transno 17179873718 00000004:00080000:1.0:1746066804.980640:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e869880, transno 17179873719 00000004:00080000:1.0:1746066804.980642:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e86b480, transno 17179873720 00000004:00080000:1.0:1746066804.980644:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e86a300, transno 17179873721 00000004:00080000:1.0:1746066804.980649:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e868700, transno 17179873722 00000004:00080000:1.0:1746066804.980650:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e86bb80, transno 17179873723 00000004:00080000:1.0:1746066804.980652:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e86b100, transno 17179873724 00000004:00080000:1.0:1746066804.980654:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e868000, transno 17179873725 00000004:00080000:1.0:1746066804.980656:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099713480, transno 17179873726 00000004:00080000:1.0:1746066804.980658:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099711180, transno 17179873727 00000004:00080000:1.0:1746066804.980660:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099712300, transno 17179873728 00000004:00080000:1.0:1746066804.980661:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e868380, transno 17179873729 00000004:00080000:1.0:1746066804.980663:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099712d80, transno 17179873730 00000004:00080000:1.0:1746066804.980664:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099713b80, transno 17179873731 00000004:00080000:1.0:1746066804.980668:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099710380, transno 17179873732 00000004:00080000:1.0:1746066804.980670:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099711500, transno 17179873733 00000004:00080000:1.0:1746066804.980672:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a45e7800, transno 17179873734 00000100:00100000:1.0:1746066804.980697:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800a5bb2680 x1830882976983808/t17179873752(17179873752) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066820 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746066804.980709:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5bb2680/2, rc 0, transno 17179873752 00000100:00100000:1.0:1746066804.980744:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976983808:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.980782:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5bb0700/2, rc 0, transno 17179873755 00000100:00100000:0.0:1746066804.980789:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976983552:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066804.980798:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5bb1f80/2, rc 0, transno 17179873753 00000100:00100000:2.0:1746066804.980801:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976983424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066804.980806:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976983936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066804.980826:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066804.980838:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976984576:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066804.980849:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066804.980857:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976985088:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066804.980867:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066804.980882:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976983936 00000100:00100000:2.0:1746066804.980885:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976983936 00000100:00100000:2.0:1746066804.980896:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976984576 00000100:00100000:2.0:1746066804.980897:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976984576 00000100:00100000:2.0:1746066804.980904:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976985088 00000100:00100000:2.0:1746066804.980906:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976985088 00000100:00100000:2.0:1746066804.980914:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15398 00000100:00100000:2.0:1746066804.980919:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3296:x1830882976983936:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066804.980976:0:14590:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 32 in progress, 5 in flight, 30 done 00000100:00100000:2.0:1746066804.980998:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3296:x1830882976983936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (171us total) trans 17179873757 rc 0/0 00000100:00100000:2.0:1746066804.981003:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15398 00000100:00100000:2.0:1746066804.981012:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15399 00000100:00100000:2.0:1746066804.981016:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3296:x1830882976984576:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066804.981076:0:14590:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 5 in flight, 24 done 00000100:00100000:2.0:1746066804.981087:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3296:x1830882976984576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (236us total) trans 21474841059 rc 0/0 00000100:00100000:2.0:1746066804.981092:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15399 00000100:00100000:2.0:1746066804.981100:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15400 00000100:00100000:2.0:1746066804.981104:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3296:x1830882976985088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066804.981548:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976984320:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.982390:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e868a80/2, rc 0, transno 17179873756 00000100:00100000:0.0:1746066804.982394:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976984064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.982403:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841038 gen 2 00000004:00080000:0.0:1746066804.982405:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5f100, transno 21474840980 00000004:00080000:0.0:1746066804.982411:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5fb80, transno 21474840981 00000004:00080000:0.0:1746066804.982413:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5c380, transno 21474840982 00000004:00080000:0.0:1746066804.982415:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5ed80, transno 21474840983 00000004:00080000:0.0:1746066804.982416:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5d880, transno 21474840984 00000004:00080000:0.0:1746066804.982418:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5ea00, transno 21474840985 00000004:00080000:0.0:1746066804.982420:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5c700, transno 21474840986 00000004:00080000:0.0:1746066804.982422:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ef5c000, transno 21474840987 00000004:00080000:0.0:1746066804.982424:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135f80000, transno 21474840991 00000004:00080000:0.0:1746066804.982426:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135f83480, transno 21474840992 00000004:00080000:0.0:1746066804.982428:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135f82a00, transno 21474840993 00000004:00080000:0.0:1746066804.982430:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135f83800, transno 21474840994 00000004:00080000:0.0:1746066804.982431:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135f82d80, transno 21474840995 00000004:00080000:0.0:1746066804.982433:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135f80a80, transno 21474840996 00000004:00080000:0.0:1746066804.982435:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135f81c00, transno 21474840997 00000004:00080000:0.0:1746066804.982437:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135f81180, transno 21474840998 00000004:00080000:0.0:1746066804.982439:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e840e00, transno 21474840999 00000004:00080000:0.0:1746066804.982441:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e840380, transno 21474841000 00000004:00080000:0.0:1746066804.982443:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e842680, transno 21474841001 00000004:00080000:0.0:1746066804.982445:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e842300, transno 21474841002 00000004:00080000:0.0:1746066804.982447:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e841c00, transno 21474841003 00000004:00080000:0.0:1746066804.982449:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e841500, transno 21474841004 00000004:00080000:0.0:1746066804.982451:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e840700, transno 21474841005 00000004:00080000:0.0:1746066804.982452:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e843100, transno 21474841006 00000004:00080000:0.0:1746066804.982454:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099711880, transno 21474841012 00000004:00080000:0.0:1746066804.982457:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099711c00, transno 21474841013 00000004:00080000:0.0:1746066804.982458:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099710000, transno 21474841014 00000004:00080000:0.0:1746066804.982460:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099711f80, transno 21474841015 00000004:00080000:0.0:1746066804.982462:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099713100, transno 21474841016 00000004:00080000:0.0:1746066804.982464:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099713800, transno 21474841017 00000004:00080000:0.0:1746066804.982465:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099712680, transno 21474841018 00000004:00080000:0.0:1746066804.982468:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099710700, transno 21474841019 00000100:00100000:1.0:1746066804.982469:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066804.982470:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929ce300, transno 21474841023 00000004:00080000:0.0:1746066804.982472:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e841f80, transno 21474841024 00000004:00080000:0.0:1746066804.982475:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16f480, transno 21474841025 00000004:00080000:0.0:1746066804.982476:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e843b80, transno 21474841026 00000004:00080000:0.0:1746066804.982478:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e841180, transno 21474841027 00000004:00080000:0.0:1746066804.982480:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e840a80, transno 21474841028 00000004:00080000:0.0:1746066804.982481:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e841880, transno 21474841029 00000004:00080000:0.0:1746066804.982483:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e843800, transno 21474841030 00000004:00080000:0.0:1746066804.982485:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16f100, transno 21474841031 00000004:00080000:0.0:1746066804.982487:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16d500, transno 21474841032 00000004:00080000:0.0:1746066804.982489:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16d180, transno 21474841033 00000004:00080000:0.0:1746066804.982491:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16c380, transno 21474841034 00000004:00080000:0.0:1746066804.982493:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16ce00, transno 21474841035 00000004:00080000:0.0:1746066804.982503:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16c000, transno 21474841036 00000004:00080000:0.0:1746066804.982505:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16d880, transno 21474841037 00000004:00080000:0.0:1746066804.982507:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f16ea00, transno 21474841038 00000100:00100000:0.0:1746066804.982512:0:3293:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800a45e4a80 x1830882976984704/t21474841057(21474841057) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066820 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000100:00100000:2.0:1746066804.982518:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3296:x1830882976985088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1413us (1650us total) trans 21474841060 rc 0/0 00000004:00080000:0.0:1746066804.982518:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e4a80/2, rc 0, transno 21474841057 00000100:00100000:0.0:1746066804.982521:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976984704:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066804.982525:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15400 00000100:00100000:1.0:1746066804.982547:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976984960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066804.982565:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066804.982567:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e7100/2, rc 0, transno 21474841058 00000100:00100000:0.0:1746066804.982570:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976985216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066804.982589:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976985472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066804.982604:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066804.982614:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746066804.982618:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976985728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066804.982630:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066804.982643:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.982658:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976984320 00000100:00100000:1.0:1746066804.982662:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976984320 00000100:00100000:0.0:1746066804.982689:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.982691:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976984960 00000100:00100000:1.0:1746066804.982693:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976984960 00000100:00100000:1.0:1746066804.982701:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976985472 00000100:00100000:1.0:1746066804.982702:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976985472 00000100:00100000:1.0:1746066804.982707:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976985728 00000100:00100000:1.0:1746066804.982709:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976985728 00000100:00100000:1.0:1746066804.982715:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15401 00000100:00100000:0.0:1746066804.982716:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.982719:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830882976984320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066804.982730:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977292416 00000100:00100000:0.0:1746066804.982733:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977292416 00000100:00100000:0.0:1746066804.982755:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10171 00000100:00100000:0.0:1746066804.982760:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009270aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32019:x1830882977292416:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066804.982771:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.982783:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d857 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97faee expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.982821:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d857 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faee expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066804.982827:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830882976984320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (358us total) trans 17179873758 rc 0/0 00010000:00010000:0.0:1746066804.982831:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d857 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faee expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066804.982832:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15401 00000100:00100000:1.0:1746066804.982841:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15402 00000100:00100000:1.0:1746066804.982844:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3295:x1830882976984960:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746066804.982846:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066804.982849:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066804.982852:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f209400, rc 0) 00000100:00100000:0.0:1746066804.982875:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009270aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:32019:x1830882977292416:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 115us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.982880:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10171 00000100:00100000:1.0:1746066804.982930:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3295:x1830882976984960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (363us total) trans 21474841061 rc 0/0 00000100:00100000:1.0:1746066804.982934:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15402 00000100:00100000:1.0:1746066804.982942:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15403 00000100:00100000:1.0:1746066804.982945:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3295:x1830882976985472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066804.982971:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15404 00000100:00100000:0.0:1746066804.982977:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1830882976985728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066804.983016:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3295:x1830882976985472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (411us total) trans 21474841062 rc 0/0 00000100:00100000:1.0:1746066804.983020:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15403 00000100:00100000:1.0:1746066804.983033:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977292544 00000100:00100000:1.0:1746066804.983036:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977292544 00000100:00100000:0.0:1746066804.983054:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830882976985728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (423us total) trans 17179873759 rc 0/0 00000100:00100000:0.0:1746066804.983059:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15404 00000100:00100000:0.0:1746066804.983080:0:3280:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830882976984448:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066804.983087:0:3280:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3280:1830882976985600:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066804.983102:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066804.983109:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800935c1800/0xfb36a14ee608d834 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066804.985258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.985279:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977292800 00000100:00100000:0.0:1746066804.985283:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977292800 00000100:00100000:0.0:1746066804.985724:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 723 00000100:00100000:0.0:1746066804.985732:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32019:x1830882977292800:12345-192.168.202.57@tcp:103:mirror_io.0 00010000:00010000:0.0:1746066804.985743:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066804.985761:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b596a00/0xfb36a14ee608d7ee lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fabd expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.985774:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066804.985776:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066804.985802:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:32019:x1830882977292800:12345-192.168.202.57@tcp:103:mirror_io.0 Request processed in 72us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066804.985806:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 723 00000100:00100000:2.0:1746066804.985880:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977292672 00000100:00100000:2.0:1746066804.985885:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977292672 00000004:00080000:0.0:1746066804.986287:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e86b800/2, rc 0, transno 17179873759 00000100:00100000:0.0:1746066804.986292:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976985728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.986300:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e86aa00/2, rc 0, transno 17179873758 00000100:00100000:0.0:1746066804.986302:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976984320:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066804.986310:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e5c00/2, rc 0, transno 21474841061 00000100:00100000:0.0:1746066804.986313:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976984960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066804.986318:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e4380/2, rc 0, transno 21474841062 00000100:00100000:0.0:1746066804.986320:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976985472:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066804.986373:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e86a680/2, rc 0, transno 17179873757 00000100:00100000:3.0:1746066804.986377:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976983936:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066804.986386:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ec2c700/2, rc 0, transno 21474841059 00000100:00100000:3.0:1746066804.986388:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976984576:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066804.986394:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e5500/2, rc 0, transno 21474841060 00000100:00100000:3.0:1746066804.986397:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976985088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066804.986424:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4270 00000100:00100000:1.0:1746066804.986431:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:32015:x1830882977292544:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:1.0:1746066804.986510:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:32015:x1830882977292544:12345-192.168.202.57@tcp:49:cat.0 Request processed in 80us (3833us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066804.986516:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4270 00000100:00100000:2.0:1746066804.986562:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4271 00000100:00100000:2.0:1746066804.986568:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+8:32018:x1830882977292672:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:2.0:1746066804.986604:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+8:32018:x1830882977292672:12345-192.168.202.57@tcp:49:cat.0 Request processed in 37us (3888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066804.986609:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4271 00000004:00080000:2.0:1746066804.986638:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5bb1c00/2, rc 0, transno 17179873754 00000100:00100000:2.0:1746066804.986642:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976983680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066804.986648:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976984192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066804.986692:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066804.986708:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976984832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066804.986723:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066804.986731:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976985344:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066804.986742:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066804.986759:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976984192 00000100:00100000:2.0:1746066804.986762:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976984192 00000100:00100000:2.0:1746066804.986773:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976984832 00000100:00100000:2.0:1746066804.986776:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976984832 00000100:00100000:2.0:1746066804.986784:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976985344 00000100:00100000:2.0:1746066804.986786:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976985344 00000100:00100000:2.0:1746066804.986795:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15405 00000100:00100000:2.0:1746066804.986799:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3294:x1830882976984192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066804.986943:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746066804.986945:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746066804.986947:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066804.986949:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746066804.986950:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746066804.986971:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3294:x1830882976984192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (296us total) trans 17179873760 rc 0/0 00000100:00100000:2.0:1746066804.986977:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15405 00000100:00100000:2.0:1746066804.986985:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15406 00000100:00100000:2.0:1746066804.986989:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3294:x1830882976984832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066804.987086:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3294:x1830882976984832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (363us total) trans 21474841063 rc 0/0 00000100:00100000:2.0:1746066804.987091:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15406 00000100:00100000:2.0:1746066804.987100:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15407 00000100:00100000:2.0:1746066804.987103:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3294:x1830882976985344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066804.987173:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3294:x1830882976985344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (430us total) trans 21474841064 rc 0/0 00000100:00100000:2.0:1746066804.987178:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15407 00000004:00080000:2.0:1746066804.987197:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e869f80/2, rc 0, transno 17179873760 00000100:00100000:2.0:1746066804.987201:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976984192:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066804.987206:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e6a00/2, rc 0, transno 21474841063 00000100:00100000:2.0:1746066804.987209:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976984832:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066804.987214:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e4700/2, rc 0, transno 21474841064 00000100:00100000:2.0:1746066804.987216:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976985344:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066804.987593:0:14588:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 48 done 00000100:00100000:0.0:1746066804.994996:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.995078:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.995118:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.995154:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977293568 00000100:00100000:0.0:1746066804.995161:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977293568 00000100:00100000:0.0:1746066804.995199:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10172 00000100:00100000:0.0:1746066804.995206:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+8:32022:x1830882977293568:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066804.995222:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066804.995236:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608d85e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97faf5 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066804.995321:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977293312 00000100:00100000:3.0:1746066804.995325:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977293312 00002000:00100000:3.0:1746066804.995349:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff8800a590f480 x1830882977293312/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066804.995358:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590f480 with x1830882977293312 ext(1048576->2097151) 00002000:00010000:3.0:1746066804.995362:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590f480 00000100:00100000:3.0:1746066804.995373:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7023 00000100:00100000:3.0:1746066804.995378:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977293312:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066804.996672:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977293056 00000100:00100000:1.0:1746066804.996697:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977293056 00000100:00100000:1.0:1746066804.996727:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4272 00000100:00100000:1.0:1746066804.996732:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:32019:x1830882977293056:12345-192.168.202.57@tcp:35:mirror_io.0 00000100:00100000:1.0:1746066804.996909:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32019:x1830882977293056:12345-192.168.202.57@tcp:35:mirror_io.0 Request processed in 176us (1920us total) trans 8589944254 rc 0/0 00000100:00100000:1.0:1746066804.996916:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4272 00010000:00010000:0.0:1746066804.997018:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608d865 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997028:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608d865 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997037:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608d865 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997046:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608d86c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997050:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608d86c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997055:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608d86c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997130:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209a00/0xfb36a14ee608d873 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997140:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209a00/0xfb36a14ee608d873 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997145:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209a00/0xfb36a14ee608d873 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:0.0:1746066804.997152:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066804.997196:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608d865 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997201:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608d865 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997206:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608d865 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997210:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f208400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066804.997213:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608d865 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997218:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608d865 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997226:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066804.997228:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066804.997231:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608d865 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997236:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208400/0xfb36a14ee608d865 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997246:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608d86c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997253:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608d86c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997257:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608d86c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997261:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f208c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066804.997263:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608d86c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997266:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608d86c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997272:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a4c34c00) 00010000:00010000:0.0:1746066804.997274:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066804.997276:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608d86c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997280:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f208c00/0xfb36a14ee608d86c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066804.997310:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608d85e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faf5 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.999323:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209a00/0xfb36a14ee608d873 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faf5 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066804.999332:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066804.999334:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066804.999336:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f209a00, rc 0) 00000100:00100000:1.0:1746066804.999476:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:32022:x1830882977293568:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4268us (4395us total) trans 8589944255 rc 0/0 00000100:00100000:1.0:1746066804.999483:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10172 00000100:00100000:0.0:1746066804.999825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066804.999859:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066804.999918:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977294080 00000100:00100000:1.0:1746066804.999924:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977294080 00000100:00100000:1.0:1746066804.999949:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4273 00000100:00100000:1.0:1746066804.999954:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32019:x1830882977294080:12345-192.168.202.57@tcp:35:mirror_io.0 00000100:00100000:1.0:1746066805.000077:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:32019:x1830882977294080:12345-192.168.202.57@tcp:35:mirror_io.0 Request processed in 122us (217us total) trans 8589944256 rc 0/0 00000100:00100000:1.0:1746066805.000083:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4273 00000100:00100000:0.0:1746066805.000828:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977293824 00000100:00100000:0.0:1746066805.000833:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977293824 00002000:00100000:0.0:1746066805.000872:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff8800a590ca80 x1830882977293824/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/0 e 0 to 0 dl 1746066815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066805.000881:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590ca80 with x1830882977293824 ext(1048576->2097151) 00002000:00010000:0.0:1746066805.000885:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590ca80 00000100:00100000:0.0:1746066805.000898:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7024 00000100:00100000:0.0:1746066805.000907:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977293824:12345-192.168.202.57@tcp:3:cat.0 00000100:00080000:3.0:1746066805.001320:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066805.007452:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.008220:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977294336 00000100:00100000:1.0:1746066805.008228:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977294336 00000100:00100000:1.0:1746066805.008901:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10173 00000100:00100000:1.0:1746066805.008909:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+10:32022:x1830882977294336:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066805.008930:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.008932:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746066805.008954:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209a00/0xfb36a14ee608d873 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faf5 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.008975:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a09a00/0xfb36a14ee608d850 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae7 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.008982:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066805.008986:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066805.008994:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d881 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fafc expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.009032:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.009042:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 250 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.009048:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d857 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faee expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.009053:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.009075:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d857 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faee expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.009085:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d857 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faee expref: 8 pid: 14550 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066805.009094:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976985856:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066805.009162:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 250 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.009169:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 250 pid: 14549 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066805.009175:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976985984:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066805.009190:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390d80 going to sleep for 11 seconds 00000100:00080000:3.0:1746066805.009321:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066805.011636:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977293312:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16252us (16511us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066805.011647:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7023 00002000:00100000:3.0:1746066805.011656:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff8800a590f480 x1830882977293312/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.011665:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590f480 with x1830882977293312 ext(1048576->2097151) 00002000:00010000:3.0:1746066805.011669:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590f480 00000100:00100000:0.0:1746066805.014039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.014559:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977293824:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13654us (14732us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066805.014569:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7024 00002000:00100000:1.0:1746066805.014579:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff8800a590ca80 x1830882977293824/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:210/0 lens 488/440 e 0 to 0 dl 1746066815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.014587:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a590ca80 with x1830882977293824 ext(1048576->2097151) 00002000:00010000:1.0:1746066805.014592:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a590ca80 00000100:00100000:1.0:1746066805.014635:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976985856:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066805.014644:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976985984:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066805.014662:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746066805.014740:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977294464 00000100:00100000:3.0:1746066805.014746:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977294464 00010000:00010000:3.0:1746066805.014784:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d857 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faee expref: 9 pid: 14550 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066805.014803:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7980 00000100:00100000:3.0:1746066805.014809:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882977294464:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066805.014819:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066805.014823:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d857 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faee expref: 9 pid: 14550 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.014831:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d857 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faee expref: 9 pid: 14550 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.014848:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209400/0xfb36a14ee608d857 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97faee expref: 9 pid: 14550 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.014863:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066805.014868:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.014874:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.014879:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066805.014895:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1966:x1830882977294464:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 87us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.014901:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7980 00000100:00080000:2.0:1746066805.014956:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066805.017165:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.017242:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.017321:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977294592 00000100:00100000:1.0:1746066805.017327:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977294592 00010000:00010000:1.0:1746066805.017370:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 251 pid: 14549 timeout: 866 lvb_type: 0 00000100:00080000:3.0:1746066805.017382:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746066805.017391:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7981 00000100:00100000:2.0:1746066805.017473:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977294720 00000100:00100000:2.0:1746066805.017477:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977294720 00000100:00100000:2.0:1746066805.017509:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10174 00000100:00100000:2.0:1746066805.017514:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:32015:x1830882977294720:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066805.017527:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.017539:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb03 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.017580:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.017586:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 4/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 253 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.017599:0:14550:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.017608:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 253 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.017617:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066805.017620:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066805.017622:0:14550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.017630:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b46c00, rc 0) 00000100:00100000:2.0:1746066805.017659:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32015:x1830882977294720:12345-192.168.202.57@tcp:101:cat.0 Request processed in 145us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.017664:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10174 00000100:00100000:1.0:1746066805.017807:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:1964:x1830882977294592:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066805.017817:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066805.017822:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 252 pid: 14549 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746066805.017830:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 252 pid: 14549 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746066805.017844:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135a08e00/0xfb36a14ee608d842 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad9 expref: 252 pid: 14549 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746066805.017853:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066805.017856:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.017862:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.017866:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.017873:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 251 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.017890:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066805.017907:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:1964:x1830882977294592:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 510us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.017912:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7981 00010000:00010000:2.0:1746066805.018217:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.018224:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14549 initiator: MDT0 00000040:00080000:2.0:1746066805.018722:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3207, 88 off271480 00000004:00080000:2.0:1746066805.018729:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766196052792ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066805.018766:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3211, 88 off271744 00000004:00080000:2.0:1746066805.018770:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766196094203ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066805.018790:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3212, 88 off271832 00000004:00080000:2.0:1746066805.018793:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766196116834ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066805.018799:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3208, 88 off271568 00000004:00080000:2.0:1746066805.018801:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766196125444ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066805.018809:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3209, 88 off271656 00000004:00080000:2.0:1746066805.018811:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766196135564ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066805.018819:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3213, 88 off271920 00000004:00080000:2.0:1746066805.018821:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766196145581ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066805.018827:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3214, 88 off272008 00000004:00080000:2.0:1746066805.018830:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766196153691ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066805.019178:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3215, 88 off272096 00000004:00080000:2.0:1746066805.019182:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766196505962ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066805.019336:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3210, 88 off271744 00000004:00080000:2.0:1746066805.019340:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766196664034ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066805.019359:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3216, 88 off272184 00000004:00080000:2.0:1746066805.019361:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766196685294ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066805.019368:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3211, 88 off271832 00000004:00080000:2.0:1746066805.019370:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766196694051ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066805.019377:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3217, 88 off272272 00000004:00080000:2.0:1746066805.019380:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766196703597ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066805.019386:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3212, 88 off271920 00000004:00080000:2.0:1746066805.019388:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766196712207ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066805.019395:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3213, 88 off272008 00000004:00080000:2.0:1746066805.019397:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766196721447ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066805.019404:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3214, 88 off272096 00000004:00080000:2.0:1746066805.019406:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766196730438ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066805.019413:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3215, 88 off272184 00000004:00080000:2.0:1746066805.019416:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766196739471ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066805.019422:0:14549:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3218, 88 off272360 00000004:00080000:2.0:1746066805.019425:0:14549:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766196748737ns, next at 749511475809ns, rc = 0 00000100:00100000:0.0:1746066805.021027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.021047:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977294848 00000100:00100000:0.0:1746066805.021053:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977294848 00000100:00100000:0.0:1746066805.021090:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10175 00000100:00100000:0.0:1746066805.021096:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+11:32018:x1830882977294848:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066805.021109:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066805.021120:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d896 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb0a expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.021217:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d896 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb0a expref: 12 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.021226:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d896 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb0a expref: 12 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.021239:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066805.021242:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066805.021246:0:809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 250 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.021251:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f209e00, rc 0) 00000100:00100000:0.0:1746066805.021280:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:32018:x1830882977294848:12345-192.168.202.57@tcp:101:cat.0 Request processed in 185us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.021609:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10175 00000001:00080000:1.0:1746066805.042483:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944255 is committed 00000001:00080000:1.0:1746066805.042507:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944256 is committed 00000001:00080000:1.0:1746066805.042516:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944257 is committed 00000004:00080000:1.0:1746066805.042519:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2491 committed 00000004:00080000:1.0:1746066805.042527:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2487 committed 00000004:00080000:1.0:1746066805.042531:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2486 committed 00000004:00080000:1.0:1746066805.042532:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2485 committed 00000004:00080000:1.0:1746066805.042534:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2484 committed 00000004:00080000:1.0:1746066805.042536:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2490 committed 00000004:00080000:1.0:1746066805.042537:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2483 committed 00000004:00080000:1.0:1746066805.042538:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2489 committed 00000004:00080000:1.0:1746066805.042539:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2482 committed 00000004:00080000:1.0:1746066805.042541:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2488 committed 00000004:00080000:1.0:1746066805.042542:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2487 committed 00000004:00080000:1.0:1746066805.042543:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2486 committed 00000004:00080000:1.0:1746066805.042544:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2481 committed 00000004:00080000:1.0:1746066805.042546:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2480 committed 00000004:00080000:1.0:1746066805.042547:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2485 committed 00000004:00080000:1.0:1746066805.042548:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2484 committed 00000004:00080000:1.0:1746066805.042549:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2479 committed 00000100:00100000:1.0:1746066805.042708:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976986112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.042755:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066805.042778:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976986624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.042792:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066805.042806:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746066805.042810:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976986240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.042822:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066805.042831:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976986752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.042843:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066805.042857:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976986368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.042869:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066805.042878:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009412b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976986880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.042889:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066805.042898:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746066805.042901:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976986496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.042913:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066805.042922:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009412a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976987008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.042931:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066805.042948:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976986112 00000100:00100000:1.0:1746066805.042954:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976986112 00000100:00100000:1.0:1746066805.042979:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976986624 00000100:00100000:1.0:1746066805.042981:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976986624 00000100:00100000:1.0:1746066805.042988:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976986240 00000100:00100000:1.0:1746066805.042989:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976986240 00000100:00100000:1.0:1746066805.042994:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976986752 00000100:00100000:1.0:1746066805.042995:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976986752 00000100:00100000:1.0:1746066805.042999:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976986368 00000100:00100000:1.0:1746066805.043001:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976986368 00000100:00100000:1.0:1746066805.043005:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976986880 00000100:00100000:1.0:1746066805.043006:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976986880 00000100:00100000:1.0:1746066805.043011:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976986496 00000100:00100000:1.0:1746066805.043012:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976986496 00000100:00100000:1.0:1746066805.043017:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976987008 00000100:00100000:1.0:1746066805.043018:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976987008 00000100:00100000:1.0:1746066805.043025:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15408 00000100:00100000:1.0:1746066805.043030:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3293:x1830882976986112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.043178:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882976986112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (422us total) trans 21474841065 rc 0/0 00000100:00100000:1.0:1746066805.043183:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15408 00000100:00100000:1.0:1746066805.043198:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15409 00000100:00100000:1.0:1746066805.043201:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3293:x1830882976986624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.043267:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882976986624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (473us total) trans 21474841066 rc 0/0 00000100:00100000:1.0:1746066805.043271:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15409 00000100:00100000:1.0:1746066805.043279:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15410 00000100:00100000:1.0:1746066805.043283:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3293:x1830882976986240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066805.043340:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066805.043343:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066803 -> 1746066803 00002000:00010000:1.0:1746066805.043344:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066803 -> 1746066803 00002000:00010000:1.0:1746066805.043346:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066803 -> 1746066803 00002000:00010000:1.0:1746066805.043348:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746066805.043363:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882976986240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (539us total) trans 21474841067 rc 0/0 00000100:00100000:1.0:1746066805.043367:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15410 00000100:00100000:1.0:1746066805.043376:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15411 00000100:00100000:1.0:1746066805.043379:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3293:x1830882976986752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.043437:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882976986752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (593us total) trans 21474841068 rc 0/0 00000100:00100000:1.0:1746066805.043441:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15411 00000100:00100000:1.0:1746066805.043449:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15412 00000100:00100000:1.0:1746066805.043452:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3295:x1830882976986368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.043531:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3295:x1830882976986368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (660us total) trans 21474841069 rc 0/0 00000100:00100000:1.0:1746066805.043536:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15412 00000100:00100000:1.0:1746066805.043545:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15413 00000100:00100000:1.0:1746066805.043549:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3295:x1830882976986880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.043615:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3295:x1830882976986880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (724us total) trans 21474841070 rc 0/0 00000100:00100000:1.0:1746066805.043620:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15413 00000100:00100000:1.0:1746066805.043628:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15414 00000100:00100000:1.0:1746066805.043631:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3295:x1830882976986496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.043715:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3295:x1830882976986496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (800us total) trans 21474841071 rc 0/0 00000100:00100000:1.0:1746066805.043719:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15414 00000100:00100000:1.0:1746066805.043730:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15415 00000100:00100000:1.0:1746066805.043734:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3295:x1830882976987008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066805.043799:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3295:x1830882976987008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (866us total) trans 21474841072 rc 0/0 00000100:00100000:1.0:1746066805.043803:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15415 00000004:00080000:1.0:1746066805.043837:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092709180/2, rc 0, transno 21474841071 00000100:00100000:1.0:1746066805.043841:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976986496:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066805.043848:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009412a300/2, rc 0, transno 21474841072 00000100:00100000:1.0:1746066805.043850:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009412a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976987008:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066805.043855:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092708000/2, rc 0, transno 21474841069 00000100:00100000:1.0:1746066805.043858:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976986368:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066805.043862:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009412b480/2, rc 0, transno 21474841070 00000100:00100000:1.0:1746066805.043865:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009412b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882976986880:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066805.043876:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921c1c00/2, rc 0, transno 21474841067 00000100:00100000:1.0:1746066805.043879:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976986240:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066805.043884:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094128e00/2, rc 0, transno 21474841068 00000100:00100000:1.0:1746066805.043886:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976986752:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066805.043891:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921c1180/2, rc 0, transno 21474841065 00000100:00100000:1.0:1746066805.043893:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976986112:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066805.043898:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bb2ea00/2, rc 0, transno 21474841066 00000100:00100000:1.0:1746066805.043900:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882976986624:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066805.043982:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fafc expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.043992:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066805.043995:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746066805.043999:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 250 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.044006:0:14549:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 250 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.044016:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 250 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.044022:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d896 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb0a expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.044028:0:14549:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d896 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb0a expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.044033:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d896 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb0a expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.044052:0:14549:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d896 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb0a expref: 10 pid: 809 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.044061:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976987136:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066805.044114:0:14549:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 250 pid: 14550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.044121:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976987264:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066805.044138:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dabf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.044789:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976987776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066805.044813:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066805.044827:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976988288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066805.044854:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066805.044866:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746066805.044870:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976987648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066805.044881:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066805.044889:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976988160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066805.044899:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066805.044916:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976987776 00000100:00100000:3.0:1746066805.044920:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976987776 00000100:00100000:3.0:1746066805.044939:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976988288 00000100:00100000:3.0:1746066805.044941:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976988288 00000100:00100000:3.0:1746066805.044949:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976987648 00000100:00100000:3.0:1746066805.044950:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976987648 00000100:00100000:3.0:1746066805.044957:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976988160 00000100:00100000:3.0:1746066805.044959:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976988160 00000100:00100000:3.0:1746066805.044967:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15416 00000100:00100000:3.0:1746066805.044972:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3296:x1830882976987776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066805.045079:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3296:x1830882976987776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (265us total) trans 17179873761 rc 0/0 00000100:00100000:3.0:1746066805.045084:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15416 00000100:00100000:3.0:1746066805.045094:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15417 00000100:00100000:3.0:1746066805.045098:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3296:x1830882976988288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066805.045168:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3296:x1830882976988288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (312us total) trans 17179873762 rc 0/0 00000100:00100000:3.0:1746066805.045172:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15417 00000100:00100000:3.0:1746066805.045180:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15418 00000100:00100000:3.0:1746066805.045184:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3296:x1830882976987648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066805.045257:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3296:x1830882976987648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (374us total) trans 17179873763 rc 0/0 00000100:00100000:3.0:1746066805.045261:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15418 00000100:00100000:3.0:1746066805.045268:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15419 00000100:00100000:3.0:1746066805.045272:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3296:x1830882976988160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066805.045329:0:21973:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746066805.045332:0:21973:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746066805.045333:0:21973:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066805.045335:0:21973:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746066805.045336:0:21973:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746066805.045352:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3296:x1830882976988160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (452us total) trans 17179873764 rc 0/0 00000100:00100000:3.0:1746066805.045356:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15419 00000004:00080000:3.0:1746066805.045385:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e86b480/2, rc 0, transno 17179873763 00000100:00100000:3.0:1746066805.045391:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976987648:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066805.045398:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e86b100/2, rc 0, transno 17179873764 00000100:00100000:3.0:1746066805.045400:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976988160:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066805.045406:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e86a300/2, rc 0, transno 17179873761 00000100:00100000:3.0:1746066805.045408:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976987776:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066805.045413:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e868000/2, rc 0, transno 17179873762 00000100:00100000:3.0:1746066805.045415:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882976988288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066805.045541:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e869880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976987520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066805.045562:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066805.045574:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976988032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066805.045585:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066805.045596:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1746066805.045599:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976987392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066805.045611:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066805.045619:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976987904:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066805.045630:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066805.045638:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976988416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066805.045649:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066805.045663:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976987520 00000100:00100000:2.0:1746066805.045666:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976987520 00000100:00100000:2.0:1746066805.045697:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976988032 00000100:00100000:2.0:1746066805.045700:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976988032 00000100:00100000:2.0:1746066805.045710:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976987392 00000100:00100000:2.0:1746066805.045711:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976987392 00000100:00100000:2.0:1746066805.045716:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976987904 00000100:00100000:2.0:1746066805.045718:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976987904 00000100:00100000:2.0:1746066805.045723:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882976988416 00000100:00100000:2.0:1746066805.045724:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882976988416 00000100:00100000:2.0:1746066805.045732:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15420 00000100:00100000:2.0:1746066805.045737:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3294:x1830882976987520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066805.045810:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066805.045813:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066800 -> 1746066800 00002000:00010000:2.0:1746066805.045814:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066800 -> 1746066800 00002000:00010000:2.0:1746066805.045816:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066800 -> 1746066800 00002000:00010000:2.0:1746066805.045817:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746066805.045836:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3294:x1830882976987520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (274us total) trans 17179873765 rc 0/0 00000100:00100000:2.0:1746066805.045841:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15420 00000100:00100000:2.0:1746066805.045853:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15421 00000100:00100000:2.0:1746066805.045857:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3294:x1830882976988032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066805.045923:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3294:x1830882976988032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (336us total) trans 17179873766 rc 0/0 00000100:00100000:2.0:1746066805.045928:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15421 00000100:00100000:2.0:1746066805.045936:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15422 00000100:00100000:2.0:1746066805.045940:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3294:x1830882976987392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066805.046009:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3294:x1830882976987392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (397us total) trans 17179873767 rc 0/0 00000100:00100000:2.0:1746066805.046014:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15422 00000100:00100000:2.0:1746066805.046025:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15423 00000100:00100000:2.0:1746066805.046029:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3294:x1830882976987904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066805.046095:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3294:x1830882976987904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (463us total) trans 17179873768 rc 0/0 00000100:00100000:2.0:1746066805.046099:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15423 00000100:00100000:2.0:1746066805.046108:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15424 00000100:00100000:2.0:1746066805.046111:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3294:x1830882976988416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066805.046176:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3294:x1830882976988416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (525us total) trans 17179873769 rc 0/0 00000100:00100000:2.0:1746066805.046181:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15424 00000004:00080000:2.0:1746066805.046252:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e868e00/2, rc 0, transno 17179873767 00000100:00100000:2.0:1746066805.046255:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976987392:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066805.046260:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e868700/2, rc 0, transno 17179873768 00000100:00100000:2.0:1746066805.046262:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976987904:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066805.046266:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092046d80/2, rc 0, transno 17179873769 00000100:00100000:2.0:1746066805.046269:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976988416:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066805.046273:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e869880/2, rc 0, transno 17179873765 00000100:00100000:2.0:1746066805.046275:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e869880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976987520:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066805.046279:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e86bb80/2, rc 0, transno 17179873766 00000100:00100000:2.0:1746066805.046281:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e86bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882976988032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066805.048747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.048764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.048780:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977294976 00000100:00100000:1.0:1746066805.048785:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977294976 00000100:00100000:1.0:1746066805.048810:0:14552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977295104 00000100:00100000:1.0:1746066805.048811:0:14552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977295104 00000100:00100000:1.0:1746066805.048822:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4274 00000100:00100000:1.0:1746066805.048827:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:32015:x1830882977294976:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:1.0:1746066805.048901:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:32015:x1830882977294976:12345-192.168.202.57@tcp:49:cat.0 Request processed in 74us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.048906:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4274 00000100:00100000:1.0:1746066805.048916:0:14552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4275 00000100:00100000:1.0:1746066805.048919:0:14552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:32018:x1830882977295104:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:1.0:1746066805.048941:0:14552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:32018:x1830882977295104:12345-192.168.202.57@tcp:49:cat.0 Request processed in 21us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.048945:0:14552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4275 00000100:00100000:2.0:1746066805.049053:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976987136:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066805.049060:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976987264:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066805.049087:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d881 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fafc expref: 10 pid: 14549 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746066805.049101:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fafc expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.049115:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1e600, rc 0) 00000100:00100000:2.0:1746066805.049131:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a590f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+9:32022:x1830882977294336:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 40224us (41687us total) trans 8589944257 rc 0/0 00000100:00100000:2.0:1746066805.049136:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10173 00000100:00100000:0.0:1746066805.055930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.056364:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977295232 00000100:00100000:3.0:1746066805.056372:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977295232 00000100:00100000:3.0:1746066805.056827:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15425 00000100:00100000:3.0:1746066805.056835:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:32015:x1830882977295232:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.056849:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.056864:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e881200/0xfb36a14ee608d89d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb11 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066805.056885:0:8112:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 5090560, mtime: 0x6812dd74, atime: 0x6812dd74, ctime: 0x6812dd74, blocks: 0x1723 00010000:00010000:3.0:1746066805.056903:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.056905:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.056910:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881200/0xfb36a14ee608d89d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb11 expref: 25 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.056922:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e881200/0xfb36a14ee608d89d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb11 expref: 25 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.056932:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e881200, rc 0) 00000100:00100000:3.0:1746066805.056979:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:32015:x1830882977295232:12345-192.168.202.57@tcp:101:cat.0 Request processed in 145us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.056988:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15425 00000100:00080000:0.0:1746066805.057825:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066805.063764:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.063978:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977295360 00000100:00100000:2.0:1746066805.063985:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977295360 00000100:00100000:2.0:1746066805.067100:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15426 00000100:00100000:2.0:1746066805.067116:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:32018:x1830882977295360:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066805.067134:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.067233:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608d8a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb18 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.067259:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.067261:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.067267:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608d8a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb18 expref: 18 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.067279:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608d8a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb18 expref: 18 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.067288:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e41b600, rc 0) 00000100:00100000:2.0:1746066805.067337:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:32018:x1830882977295360:12345-192.168.202.57@tcp:101:cat.0 Request processed in 227us (3580us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.067343:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15426 00000100:00100000:0.0:1746066805.067545:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.067653:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.067718:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977295744 00000100:00100000:1.0:1746066805.067725:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977295744 00002000:00100000:1.0:1746066805.067754:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800a8696a00 x1830882977295744/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.067762:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8696a00 with x1830882977295744 ext(2097152->3145727) 00002000:00010000:1.0:1746066805.067766:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8696a00 00000100:00100000:1.0:1746066805.067781:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7025 00000100:00100000:1.0:1746066805.067786:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1966:x1830882977295744:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066805.069596:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977295488 00000100:00100000:2.0:1746066805.069605:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977295488 00000100:00100000:2.0:1746066805.069636:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15427 00000100:00100000:2.0:1746066805.069642:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:32022:x1830882977295488:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066805.069655:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.069670:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb1f expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.069711:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d83b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad2 expref: 26 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.069718:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d849 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae0 expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.069728:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.069730:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.069733:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 5/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [2015232->2097151] (req 2015232->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.069755:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d849 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae0 expref: 19 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.069764:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d849 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae0 expref: 19 pid: 4614 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066805.069774:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976988544:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066805.069827:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad2 expref: 26 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.069834:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d83b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad2 expref: 26 pid: 21973 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066805.069842:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976988672:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066805.069856:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dabf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066805.071795:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.071871:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977296000 00000100:00100000:3.0:1746066805.071877:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977296000 00002000:00100000:3.0:1746066805.071909:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800a8695880 x1830882977296000/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.071917:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695880 with x1830882977296000 ext(2097152->3145727) 00002000:00010000:3.0:1746066805.071921:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8695880 00000100:00100000:3.0:1746066805.071946:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7026 00000100:00100000:3.0:1746066805.071952:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977296000:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066805.080907:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1966:x1830882977295744:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13111us (13244us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066805.080918:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7025 00002000:00100000:1.0:1746066805.080928:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800a8696a00 x1830882977295744/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.080936:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8696a00 with x1830882977295744 ext(2097152->3145727) 00002000:00010000:1.0:1746066805.080940:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8696a00 00000100:00100000:2.0:1746066805.084156:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976988544:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066805.084541:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.084588:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977296128 00000100:00100000:0.0:1746066805.084589:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.084594:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977296128 00010000:00010000:1.0:1746066805.084621:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d849 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae0 expref: 22 pid: 4614 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066805.084701:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976988672:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066805.084727:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [2015232->2097151] (req 2015232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.084747:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800934eae00, rc 0) 00000100:00100000:2.0:1746066805.084784:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+22:32022:x1830882977295488:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 15142us (17239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.084792:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15427 00000100:00100000:1.0:1746066805.084929:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977296256 00000100:00100000:1.0:1746066805.084933:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977296256 00010000:00010000:1.0:1746066805.084944:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d83b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad2 expref: 25 pid: 21973 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066805.085095:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7982 00000100:00100000:3.0:1746066805.085103:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977296128:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066805.085113:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066805.085131:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d849 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae0 expref: 21 pid: 4614 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.085139:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d849 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae0 expref: 21 pid: 4614 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.085160:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c3ca00/0xfb36a14ee608d849 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fae0 expref: 21 pid: 4614 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.085173:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066805.085188:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977296128:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 87us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.085197:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7982 00000100:00100000:3.0:1746066805.085207:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7983 00000100:00100000:3.0:1746066805.085211:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977296256:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066805.085216:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066805.085222:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d83b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad2 expref: 25 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.085230:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad2 expref: 25 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.085239:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d83b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fad2 expref: 25 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.085247:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.085248:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.085255:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.085261:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.085288:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066805.085296:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092046300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976988800:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066805.085887:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.086748:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977296000:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14793us (14954us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066805.086757:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7026 00002000:00100000:3.0:1746066805.086765:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800a8695880 x1830882977296000/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.086773:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8695880 with x1830882977296000 ext(2097152->3145727) 00002000:00010000:3.0:1746066805.086777:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8695880 00000100:00100000:3.0:1746066805.089987:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092046300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976988800:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066805.090005:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066805.090039:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977296256:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4826us (5448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.090048:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7983 00000100:00100000:0.0:1746066805.090435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.090576:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977296512 00000100:00100000:3.0:1746066805.090582:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977296512 00002000:00100000:3.0:1746066805.090614:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (2015232->2019327) req@ffff8800a8696300 x1830882977296512/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.090623:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8696300 with x1830882977296512 ext(2015232->2019327) 00002000:00010000:3.0:1746066805.090627:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8696300 00000100:00100000:3.0:1746066805.090652:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7027 00000100:00100000:3.0:1746066805.090658:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977296512:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066805.090809:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977296512:12345-192.168.202.57@tcp:3:cat.0 Request processed in 150us (374us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066805.090814:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7027 00002000:00100000:3.0:1746066805.090819:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (2015232->2019327) req@ffff8800a8696300 x1830882977296512/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/4536 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.090831:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8696300 with x1830882977296512 ext(2015232->2019327) 00002000:00010000:3.0:1746066805.090833:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8696300 00000100:00100000:0.0:1746066805.091750:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.091901:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977296640 00000100:00100000:3.0:1746066805.091905:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977296640 00000100:00100000:3.0:1746066805.091933:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15428 00000100:00100000:3.0:1746066805.091938:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:32015:x1830882977296640:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.091947:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.091958:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d8b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb26 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066805.091975:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38f:0x0] initial LVB size: 4194304, mtime: 0x6812dd74, atime: 0x6812dd74, ctime: 0x6812dd74, blocks: 0x1029 00010000:00010000:3.0:1746066805.091989:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.091990:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.091996:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d8b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb26 expref: 29 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.092008:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d8b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb26 expref: 29 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.092015:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e880000, rc 0) 00000100:00100000:3.0:1746066805.092035:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:32015:x1830882977296640:12345-192.168.202.57@tcp:101:cat.0 Request processed in 98us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.092040:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15428 00000100:00080000:0.0:1746066805.092265:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066805.093047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.094037:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977296768 00000100:00100000:3.0:1746066805.094042:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977296768 00000100:00100000:3.0:1746066805.094083:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15429 00000100:00100000:3.0:1746066805.094089:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+16:32018:x1830882977296768:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.094101:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.094110:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608d8b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb2d expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.094124:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.094125:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.094129:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608d8b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb2d expref: 17 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.094138:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608d8b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb2d expref: 17 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.094144:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e880a00, rc 0) 00000100:00100000:3.0:1746066805.094167:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+17:32018:x1830882977296768:12345-192.168.202.57@tcp:101:cat.0 Request processed in 78us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.094171:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15429 00000100:00080000:0.0:1746066805.095070:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066805.098800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.098835:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.098853:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.098891:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.098961:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977297152 00000100:00100000:2.0:1746066805.098969:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977297152 00002000:00100000:2.0:1746066805.099003:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a8694a80 x1830882977297152/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.099012:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8694a80 with x1830882977297152 ext(2097152->3145727) 00002000:00010000:2.0:1746066805.099017:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8694a80 00000100:00100000:2.0:1746066805.099029:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977297408 00000100:00100000:2.0:1746066805.099031:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977297408 00002000:00100000:2.0:1746066805.099040:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a8697480 x1830882977297408/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.099045:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8697480 with x1830882977297408 ext(3145728->4194303) 00002000:00010000:2.0:1746066805.099047:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8697480 00000100:00100000:2.0:1746066805.099054:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977297664 00000100:00100000:2.0:1746066805.099056:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977297664 00002000:00100000:2.0:1746066805.099064:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a8694700 x1830882977297664/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.099070:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8694700 with x1830882977297664 ext(3145728->4194303) 00002000:00010000:2.0:1746066805.099072:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8694700 00000100:00100000:2.0:1746066805.099081:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7028 00000100:00100000:2.0:1746066805.099087:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1965:x1830882977297152:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066805.100036:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977296896 00000100:00100000:2.0:1746066805.100040:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977296896 00000100:00100000:2.0:1746066805.100062:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15430 00000100:00100000:2.0:1746066805.100067:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:32022:x1830882977296896:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066805.100076:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.100089:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb34 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.100107:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e881200/0xfb36a14ee608d89d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb11 expref: 24 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.100113:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608d8a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb18 expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.100119:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.100120:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.100124:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->2117631] (req 2097152->2117631) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.100147:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608d8a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb18 expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.100157:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608d8a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb18 expref: 19 pid: 21203 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066805.100166:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976988928:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066805.100227:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e881200/0xfb36a14ee608d89d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb11 expref: 24 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.100235:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e881200/0xfb36a14ee608d89d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb11 expref: 24 pid: 8112 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066805.100241:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976989056:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066805.100257:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dabf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.101038:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2275 00000100:00100000:3.0:1746066805.101047:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1965:x1830882977297664:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066805.102026:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7029 00000100:00100000:3.0:1746066805.102033:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1965:x1830882977297408:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066805.105863:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.105884:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.105937:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.106076:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977297920 00000100:00100000:1.0:1746066805.106085:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977297920 00002000:00100000:1.0:1746066805.106117:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88008efb5500 x1830882977297920/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.106125:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb5500 with x1830882977297920 ext(2097152->3145727) 00002000:00010000:1.0:1746066805.106130:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb5500 00000100:00100000:1.0:1746066805.106143:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977298176 00000100:00100000:1.0:1746066805.106145:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977298176 00002000:00100000:1.0:1746066805.106153:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88008efb5f80 x1830882977298176/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.106158:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb5f80 with x1830882977298176 ext(3145728->4194303) 00002000:00010000:1.0:1746066805.106160:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb5f80 00000100:00100000:1.0:1746066805.106166:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977298432 00000100:00100000:1.0:1746066805.106168:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977298432 00002000:00100000:1.0:1746066805.106176:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88008efb6300 x1830882977298432/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.106181:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb6300 with x1830882977298432 ext(3145728->4194303) 00010000:00010000:1.0:1746066805.106188:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608d8a4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb18 expref: 20 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746066805.106202:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608d8a4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb18 expref: 20 pid: 21203 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746066805.106207:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008efb6300 00000100:00100000:1.0:1746066805.106217:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2276 00000100:00100000:1.0:1746066805.106223:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977298432:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066805.107233:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7031 00000100:00100000:1.0:1746066805.107240:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977297920:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066805.108859:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7032 00000100:00100000:2.0:1746066805.108868:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977298176:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066805.118273:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.118713:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977298688 00000100:00100000:2.0:1746066805.118720:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977298688 00000100:00100000:2.0:1746066805.118756:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10176 00000100:00100000:2.0:1746066805.118763:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:32025:x1830882977298688:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066805.118779:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.118799:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4200/0xfb36a14ee608d8c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb3b expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.118886:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608d8ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.118897:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608d8ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.118905:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608d8ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.118918:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608d8d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.118926:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608d8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.118931:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608d8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119010:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d8dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119016:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d8dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119021:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d8dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:2.0:1746066805.119028:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066805.119125:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608d8ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119131:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608d8ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119136:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608d8ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119140:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faf5400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066805.119143:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608d8ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119149:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608d8ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119157:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066805.119160:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066805.119164:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608d8ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119168:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5400/0xfb36a14ee608d8ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119198:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608d8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119203:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608d8d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119208:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608d8d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119211:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faf4600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066805.119213:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608d8d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119217:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608d8d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119222:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec74e00) 00010000:00010000:2.0:1746066805.119224:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066805.119226:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608d8d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119230:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4600/0xfb36a14ee608d8d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066805.119266:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4200/0xfb36a14ee608d8c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb3b expref: 254 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.119280:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d8dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb3b expref: 253 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.119285:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066805.119286:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066805.119288:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf5e00, rc 0) 00000100:00100000:2.0:1746066805.119322:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32025:x1830882977298688:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 559us (1056us total) trans 8589944258 rc 0/0 00000100:00100000:2.0:1746066805.119328:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10176 00000100:00100000:3.0:1746066805.120429:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976988928:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066805.120441:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976989056:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066805.120465:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->2117631] (req 2097152->2117631) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 21 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.120482:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ed4a000, rc 0) 00000100:00100000:3.0:1746066805.120526:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:32022:x1830882977296896:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 20459us (21733us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.120533:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15430 00000100:00100000:2.0:1746066805.125261:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1965:x1830882977297152:12345-192.168.202.57@tcp:3:cat.0 Request processed in 26166us (26417us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066805.125271:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7028 00002000:00100000:2.0:1746066805.125280:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a8694a80 x1830882977297152/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.125288:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8694a80 with x1830882977297152 ext(2097152->3145727) 00002000:00010000:2.0:1746066805.125293:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8694a80 00000100:00100000:3.0:1746066805.132212:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1965:x1830882977297664:12345-192.168.202.57@tcp:3:cat.0 Request processed in 31159us (33312us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066805.132222:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2275 00002000:00100000:3.0:1746066805.132232:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a8694700 x1830882977297664/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.132240:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8694700 with x1830882977297664 ext(3145728->4194303) 00010000:00010000:3.0:1746066805.132248:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e881200/0xfb36a14ee608d89d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb11 expref: 24 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.132260:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e881200/0xfb36a14ee608d89d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb11 expref: 24 pid: 8112 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746066805.132266:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a8694700 00000100:00100000:2.0:1746066805.132453:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.133083:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977298816 00000100:00100000:3.0:1746066805.133090:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977298816 00000100:00100000:3.0:1746066805.133131:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15431 00000100:00100000:3.0:1746066805.133138:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:32015:x1830882977298816:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.133150:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.133162:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0a4000/0xfb36a14ee608d8ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb42 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.133184:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.133186:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.133192:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0a4000/0xfb36a14ee608d8ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb42 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.133204:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0a4000/0xfb36a14ee608d8ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb42 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.133214:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0a4000, rc 0) 00000100:00100000:3.0:1746066805.133243:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:32015:x1830882977298816:12345-192.168.202.57@tcp:101:cat.0 Request processed in 106us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.133248:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15431 00000100:00100000:3.0:1746066805.133453:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1965:x1830882977297408:12345-192.168.202.57@tcp:3:cat.0 Request processed in 31420us (34597us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066805.133459:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7029 00002000:00100000:3.0:1746066805.133465:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a8697480 x1830882977297408/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.133473:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8697480 with x1830882977297408 ext(3145728->4194303) 00002000:00010000:3.0:1746066805.133476:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8697480 00000100:00100000:1.0:1746066805.137317:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977298432:12345-192.168.202.57@tcp:3:cat.0 Request processed in 31084us (31369us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066805.137327:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2276 00002000:00100000:1.0:1746066805.137336:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88008efb6300 x1830882977298432/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.137345:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb6300 with x1830882977298432 ext(3145728->4194303) 00010000:00010000:1.0:1746066805.137353:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608d8a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb18 expref: 19 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746066805.137364:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608d8a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb18 expref: 19 pid: 21203 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746066805.137370:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008efb6300 00000100:00100000:0.0:1746066805.147166:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.147939:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.147987:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977297920:12345-192.168.202.57@tcp:3:cat.0 Request processed in 40746us (42130us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066805.147998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.147999:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7031 00002000:00100000:1.0:1746066805.148010:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88008efb5500 x1830882977297920/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066805.148017:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977299072 00002000:00100000:1.0:1746066805.148018:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb5500 with x1830882977297920 ext(2097152->3145727) 00002000:00010000:1.0:1746066805.148022:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb5500 00000100:00100000:0.0:1746066805.148022:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977299072 00000100:00100000:1.0:1746066805.148037:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977299328 00000100:00100000:1.0:1746066805.148039:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977299328 00010000:00010000:0.0:1746066805.148044:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608d8a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb18 expref: 19 pid: 21203 timeout: 866 lvb_type: 0 00002000:00100000:1.0:1746066805.148053:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88008efb4a80 x1830882977299328/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.148059:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb4a80 with x1830882977299328 ext(3145728->4194303) 00000100:00100000:0.0:1746066805.148059:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977298944 00002000:00010000:1.0:1746066805.148061:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb4a80 00000100:00100000:0.0:1746066805.148061:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977298944 00010000:00010000:0.0:1746066805.148068:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e881200/0xfb36a14ee608d89d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb11 expref: 26 pid: 8112 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066805.149333:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7033 00000100:00100000:1.0:1746066805.149343:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977299328:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066805.149614:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7984 00000100:00100000:3.0:1746066805.149622:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977299072:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066805.149631:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066805.149645:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608d8a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb18 expref: 19 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.149659:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608d8a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb18 expref: 19 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.149687:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e41b600/0xfb36a14ee608d8a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb18 expref: 19 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.149703:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066805.149727:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977299072:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 107us (2570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.149732:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7984 00000100:00100000:3.0:1746066805.149744:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7985 00000100:00100000:3.0:1746066805.149747:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1966:x1830882977298944:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066805.149753:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066805.149758:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e881200/0xfb36a14ee608d89d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb11 expref: 26 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.149765:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e881200/0xfb36a14ee608d89d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb11 expref: 26 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.149775:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e881200/0xfb36a14ee608d89d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb11 expref: 26 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.149782:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.149784:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.149789:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2117631) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.149796:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2117631) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.149819:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2117631) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 17 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066805.149828:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092046300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976989184:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066805.149867:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066805.151537:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977298176:12345-192.168.202.57@tcp:3:cat.0 Request processed in 42665us (45646us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066805.151545:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7032 00002000:00100000:2.0:1746066805.151554:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88008efb5f80 x1830882977298176/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.151561:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb5f80 with x1830882977298176 ext(3145728->4194303) 00002000:00010000:2.0:1746066805.151565:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008efb5f80 00000100:00100000:2.0:1746066805.154910:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.154931:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977299584 00000100:00100000:2.0:1746066805.154937:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977299584 00002000:00100000:2.0:1746066805.154974:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (2113536->2117631) req@ffff88009e842680 x1830882977299584/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.154983:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e842680 with x1830882977299584 ext(2113536->2117631) 00002000:00010000:2.0:1746066805.154988:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e842680 00000100:00100000:2.0:1746066805.155005:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7034 00000100:00100000:2.0:1746066805.155011:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977299584:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066805.155150:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977299584:12345-192.168.202.57@tcp:3:cat.0 Request processed in 139us (247us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066805.155156:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7034 00002000:00100000:2.0:1746066805.155161:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (2113536->2117631) req@ffff88009e842680 x1830882977299584/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/4536 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.155167:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e842680 with x1830882977299584 ext(2113536->2117631) 00002000:00010000:2.0:1746066805.155169:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e842680 00000100:00100000:2.0:1746066805.155207:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.155223:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977299712 00000100:00100000:2.0:1746066805.155226:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977299712 00000100:00100000:2.0:1746066805.155243:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15432 00000100:00100000:2.0:1746066805.155247:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+18:32018:x1830882977299712:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066805.155255:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.155268:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faf5600/0xfb36a14ee608d8f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb49 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.155290:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.155292:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.155298:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5600/0xfb36a14ee608d8f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb49 expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.155310:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faf5600/0xfb36a14ee608d8f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb49 expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.155318:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf5600, rc 0) 00000100:00100000:1.0:1746066805.156447:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092046300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976989184:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066805.156466:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066805.156502:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1966:x1830882977298944:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6744us (8494us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.156511:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7985 00000100:00100000:2.0:1746066805.156659:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+19:32018:x1830882977299712:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1410us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.156666:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15432 00000100:00100000:1.0:1746066805.163867:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977299328:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14518us (15920us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066805.163876:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7033 00002000:00100000:1.0:1746066805.163886:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88008efb4a80 x1830882977299328/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.163899:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb4a80 with x1830882977299328 ext(3145728->4194303) 00002000:00010000:1.0:1746066805.163904:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb4a80 00000100:00100000:2.0:1746066805.165402:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.165531:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977299968 00000100:00100000:1.0:1746066805.165537:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977299968 00000100:00100000:1.0:1746066805.166271:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4276 00000100:00100000:1.0:1746066805.166279:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+9:32022:x1830882977299968:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:1.0:1746066805.168839:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:32022:x1830882977299968:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 2552us (3431us total) trans 8589944259 rc 0/0 00000100:00100000:1.0:1746066805.168852:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4276 00000100:00100000:0.0:1746066805.169823:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.169884:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977300224 00000100:00100000:1.0:1746066805.169891:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977300224 00002000:00100000:1.0:1746066805.169925:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88008efb4e00 x1830882977300224/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.169934:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb4e00 with x1830882977300224 ext(3145728->4194303) 00002000:00010000:1.0:1746066805.169938:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb4e00 00000100:00100000:1.0:1746066805.169951:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7035 00000100:00100000:1.0:1746066805.169956:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977300224:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066805.182108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.182167:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.182215:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.182265:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.182546:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977300352 00000100:00100000:1.0:1746066805.182556:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977300352 00000100:00100000:1.0:1746066805.182598:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977300480 00000100:00100000:1.0:1746066805.182602:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977300480 00000100:00100000:1.0:1746066805.182619:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977300608 00000100:00100000:1.0:1746066805.182622:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977300608 00000100:00100000:1.0:1746066805.182638:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977300736 00000100:00100000:1.0:1746066805.182641:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977300736 00000100:00100000:1.0:1746066805.182660:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15433 00000100:00100000:1.0:1746066805.182668:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977300352:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.182729:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.182750:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee608d8f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb50 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066805.182776:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd72, atime: 0x6812dd72, ctime: 0x6812dd72, blocks: 0x7ff 00010000:00010000:1.0:1746066805.182797:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066805.182799:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066805.182809:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee608d8f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb50 expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.182824:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee608d8f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb50 expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.182834:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025d600, rc 0) 00000100:00100000:1.0:1746066805.182882:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977300352:12345-192.168.202.57@tcp:101:cat.0 Request processed in 213us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.182888:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15433 00000100:00100000:1.0:1746066805.182907:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15434 00000100:00100000:1.0:1746066805.182913:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977300480:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.182922:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.182933:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009025da00/0xfb36a14ee608d8ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb57 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066805.182949:0:21203:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38d:0x0] initial LVB size: 2097152, mtime: 0x6812dd74, atime: 0x6812dd73, ctime: 0x6812dd74, blocks: 0x821 00010000:00010000:1.0:1746066805.182959:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066805.182961:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066805.182967:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009025da00/0xfb36a14ee608d8ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb57 expref: 30 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.182977:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009025da00/0xfb36a14ee608d8ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb57 expref: 30 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.182985:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025da00, rc 0) 00000100:00100000:1.0:1746066805.183007:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977300480:12345-192.168.202.57@tcp:101:cat.0 Request processed in 93us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.183012:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15434 00000100:00100000:1.0:1746066805.183026:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15435 00000100:00100000:1.0:1746066805.183031:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977300608:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.183039:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.183046:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009025c200/0xfb36a14ee608d906 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb5e expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066805.183084:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976989312:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066805.183148:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066805.183515:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977300224:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13555us (13692us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066805.183522:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7035 00002000:00100000:1.0:1746066805.183532:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88008efb4e00 x1830882977300224/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.183539:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb4e00 with x1830882977300224 ext(3145728->4194303) 00002000:00010000:1.0:1746066805.183544:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb4e00 00000100:00100000:3.0:1746066805.183646:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15436 00000100:00100000:3.0:1746066805.183656:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977300736:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.183664:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.183673:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0a4200/0xfb36a14ee608d90d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb65 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.183724:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0a4200/0xfb36a14ee608d90d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb65 expref: 28 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.183733:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0a4200/0xfb36a14ee608d90d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb65 expref: 28 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.183751:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0a4200, rc 0) 00000100:00100000:3.0:1746066805.183778:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977300736:12345-192.168.202.57@tcp:101:cat.0 Request processed in 124us (1513us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066805.183783:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15436 00002000:00010000:1.0:1746066805.191889:0:21203:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime: 1746066800 -> 1746066804 00002000:00010000:1.0:1746066805.191897:0:21203:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime: 1746066800 -> 1746066804 00002000:00010000:1.0:1746066805.191899:0:21203:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime: 1746066800 -> 1746066804 00000100:00100000:1.0:1746066805.191922:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976989312:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066805.191955:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009025c200/0xfb36a14ee608d906 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb5e expref: 26 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.191968:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009025c200/0xfb36a14ee608d906 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb5e expref: 26 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.192706:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025c200, rc 0) 00000100:00100000:1.0:1746066805.193098:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977300608:12345-192.168.202.57@tcp:101:cat.0 Request processed in 10061us (10879us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066805.193107:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15435 00000100:00100000:1.0:1746066805.194298:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.194425:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.194465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.194529:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977300864 00000100:00100000:1.0:1746066805.194538:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977300864 00000100:00100000:1.0:1746066805.194572:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977301120 00000100:00100000:1.0:1746066805.194576:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977301120 00000100:00100000:1.0:1746066805.194593:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977300992 00000100:00100000:1.0:1746066805.194597:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977300992 00000100:00100000:1.0:1746066805.194615:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15437 00000100:00100000:1.0:1746066805.194623:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977300864:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.194640:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.194656:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009025d400/0xfb36a14ee608d914 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb6c expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.194707:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066805.194709:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066805.194718:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009025d400/0xfb36a14ee608d914 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb6c expref: 21 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.194733:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009025d400/0xfb36a14ee608d914 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb6c expref: 21 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.194744:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025d400, rc 0) 00000100:00100000:1.0:1746066805.194781:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977300864:12345-192.168.202.57@tcp:101:cat.0 Request processed in 158us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.194787:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15437 00000100:00100000:1.0:1746066805.194804:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15438 00000100:00100000:1.0:1746066805.194811:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977301120:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.194818:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.194827:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009025ce00/0xfb36a14ee608d91b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb7a expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.194845:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009025ce00/0xfb36a14ee608d91b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb7a expref: 21 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.194854:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009025ce00/0xfb36a14ee608d91b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb7a expref: 21 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.194862:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025ce00, rc 0) 00000100:00100000:1.0:1746066805.194885:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977301120:12345-192.168.202.57@tcp:101:cat.0 Request processed in 74us (461us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066805.194889:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15438 00000100:00100000:1.0:1746066805.194903:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15439 00000100:00100000:1.0:1746066805.194909:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977300992:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.194917:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.194927:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009025d200/0xfb36a14ee608d922 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb73 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.194937:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066805.194939:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066805.194944:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009025d200/0xfb36a14ee608d922 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb73 expref: 18 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.194953:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009025d200/0xfb36a14ee608d922 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb73 expref: 18 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.194960:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025d200, rc 0) 00000100:00100000:1.0:1746066805.194982:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977300992:12345-192.168.202.57@tcp:101:cat.0 Request processed in 73us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.194987:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15439 00000100:00100000:0.0:1746066805.208476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.208545:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.208659:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977301504 00000100:00100000:2.0:1746066805.208670:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977301504 00002000:00100000:2.0:1746066805.208754:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880135f82d80 x1830882977301504/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.208763:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f82d80 with x1830882977301504 ext(4194304->5091327) 00002000:00010000:2.0:1746066805.208769:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135f82d80 00000100:00100000:2.0:1746066805.208809:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977301632 00000100:00100000:2.0:1746066805.208813:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977301632 00002000:00100000:2.0:1746066805.208833:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880135f80a80 x1830882977301632/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.208840:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f80a80 with x1830882977301632 ext(4194304->5091327) 00002000:00010000:2.0:1746066805.208843:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135f80a80 00000100:00100000:2.0:1746066805.208863:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7036 00000100:00100000:2.0:1746066805.208872:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977301504:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066805.210221:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7037 00000100:00100000:1.0:1746066805.210232:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977301632:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066805.222029:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977301504:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13146us (13550us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066805.222043:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7036 00002000:00100000:2.0:1746066805.222056:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880135f82d80 x1830882977301504/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.222065:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f82d80 with x1830882977301504 ext(4194304->5091327) 00002000:00010000:2.0:1746066805.222071:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135f82d80 00000100:00100000:1.0:1746066805.228830:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977301632:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18592us (20277us total) trans 0 rc 897024/897024 00000100:00100000:1.0:1746066805.228841:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7037 00002000:00100000:1.0:1746066805.228852:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880135f80a80 x1830882977301632/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.228861:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135f80a80 with x1830882977301632 ext(4194304->5091327) 00002000:00010000:1.0:1746066805.228866:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135f80a80 00000100:00100000:0.0:1746066805.240450:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.240509:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.240594:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977301888 00000100:00100000:2.0:1746066805.240602:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977301888 00000100:00100000:2.0:1746066805.240646:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977301760 00000100:00100000:2.0:1746066805.240648:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977301760 00000100:00100000:2.0:1746066805.240664:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15440 00000100:00100000:2.0:1746066805.240670:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977301888:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066805.240705:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.240719:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dee0200/0xfb36a14ee608d929 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb88 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.240744:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008dee0200/0xfb36a14ee608d929 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb88 expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.240753:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dee0200/0xfb36a14ee608d929 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb88 expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.240765:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee0200, rc 0) 00000100:00100000:2.0:1746066805.240816:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977301888:12345-192.168.202.57@tcp:101:cat.0 Request processed in 146us (373us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066805.240821:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15440 00000100:00100000:2.0:1746066805.240834:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15441 00000100:00100000:2.0:1746066805.240838:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977301760:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066805.240844:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.240850:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dee1a00/0xfb36a14ee608d930 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb81 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.240879:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976989440:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066805.240928:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dab840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066805.245105:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976989440:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066805.245133:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008dee1a00/0xfb36a14ee608d930 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb81 expref: 26 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.245149:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dee1a00/0xfb36a14ee608d930 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb81 expref: 26 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.245170:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee1a00, rc 0) 00000100:00100000:0.0:1746066805.245219:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977301760:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4378us (4708us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066805.245227:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15441 00000100:00100000:0.0:1746066805.245981:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.246035:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977302016 00000100:00100000:2.0:1746066805.246041:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977302016 00000100:00100000:2.0:1746066805.246077:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15442 00000100:00100000:2.0:1746066805.246083:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977302016:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066805.246095:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.246106:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dee0a00/0xfb36a14ee608d937 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb8f expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.246125:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008dee0a00/0xfb36a14ee608d937 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb8f expref: 21 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.246133:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dee0a00/0xfb36a14ee608d937 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb8f expref: 21 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.246151:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee0a00, rc 0) 00000100:00100000:2.0:1746066805.246180:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977302016:12345-192.168.202.57@tcp:101:cat.0 Request processed in 96us (199us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066805.246184:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15442 00000100:00100000:0.0:1746066805.249170:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.249417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.249762:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.249904:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977302272 00000100:00100000:0.0:1746066805.249911:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977302272 00000100:00100000:0.0:1746066805.250449:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977302144 00000100:00100000:0.0:1746066805.250452:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977302144 00000100:00100000:1.0:1746066805.250476:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977302400 00000100:00100000:1.0:1746066805.250478:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977302400 00000100:00100000:1.0:1746066805.250505:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15443 00000100:00100000:1.0:1746066805.250512:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977302272:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.250525:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.250539:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093678e00/0xfb36a14ee608d93e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb9d expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.250562:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093678e00/0xfb36a14ee608d93e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb9d expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.250570:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093678e00/0xfb36a14ee608d93e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb9d expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.250581:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093678e00, rc 0) 00000100:00100000:1.0:1746066805.250614:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977302272:12345-192.168.202.57@tcp:101:cat.0 Request processed in 103us (1451us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066805.250618:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15443 00000100:00100000:1.0:1746066805.250630:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15444 00000100:00100000:1.0:1746066805.250633:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977302144:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.250638:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.250643:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093678c00/0xfb36a14ee608d945 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fb96 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066805.250669:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976989568:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066805.250717:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066805.250732:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15445 00000100:00100000:1.0:1746066805.250735:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977302400:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.250740:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.250744:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f000/0xfb36a14ee608d94c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fba4 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.250755:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f000/0xfb36a14ee608d94c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fba4 expref: 21 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.250761:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f000/0xfb36a14ee608d94c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fba4 expref: 21 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.250767:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1f000, rc 0) 00000100:00100000:1.0:1746066805.250779:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977302400:12345-192.168.202.57@tcp:101:cat.0 Request processed in 44us (1018us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066805.250783:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15445 00000100:00100000:1.0:1746066805.252315:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976989568:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066805.252337:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093678c00/0xfb36a14ee608d945 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb96 expref: 26 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.252347:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093678c00/0xfb36a14ee608d945 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb96 expref: 26 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.252356:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093678c00, rc 0) 00000100:00100000:1.0:1746066805.252393:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977302144:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1757us (2975us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066805.252399:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15444 00010000:00010000:2.0:1746066805.257825:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066805.261450:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.261662:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977302656 00000100:00100000:1.0:1746066805.261671:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977302656 00000100:00100000:1.0:1746066805.261727:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4277 00000100:00100000:1.0:1746066805.261734:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32015:x1830882977302656:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:1.0:1746066805.261902:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:32015:x1830882977302656:12345-192.168.202.57@tcp:35:cat.0 Request processed in 168us (460us total) trans 8589944260 rc 0/0 00000100:00100000:1.0:1746066805.261908:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4277 00000100:00100000:0.0:1746066805.291658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.292187:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977302912 00000100:00100000:2.0:1746066805.292196:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977302912 00000100:00100000:2.0:1746066805.292613:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10177 00000100:00100000:2.0:1746066805.292621:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:32031:x1830882977302912:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066805.292639:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.292655:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1600/0xfb36a14ee608d953 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fbab expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.292761:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1e00/0xfb36a14ee608d95a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.292772:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1e00/0xfb36a14ee608d95a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.292781:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1e00/0xfb36a14ee608d95a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.292793:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0800/0xfb36a14ee608d961 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.292799:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0800/0xfb36a14ee608d961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.292804:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0800/0xfb36a14ee608d961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.292883:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d968 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.292894:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d968 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.292899:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d968 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:2.0:1746066805.292906:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066805.292968:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1e00/0xfb36a14ee608d95a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.292974:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1e00/0xfb36a14ee608d95a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.292979:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1e00/0xfb36a14ee608d95a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.292983:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dee1e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066805.292986:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1e00/0xfb36a14ee608d95a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.292992:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1e00/0xfb36a14ee608d95a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.293000:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066805.293002:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066805.293006:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1e00/0xfb36a14ee608d95a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.293010:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1e00/0xfb36a14ee608d95a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.293329:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0800/0xfb36a14ee608d961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.293337:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0800/0xfb36a14ee608d961 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.293342:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0800/0xfb36a14ee608d961 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.293346:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dee0800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066805.293348:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0800/0xfb36a14ee608d961 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.293352:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0800/0xfb36a14ee608d961 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.293359:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec74e00) 00010000:00010000:2.0:1746066805.293361:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066805.293363:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0800/0xfb36a14ee608d961 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.293367:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0800/0xfb36a14ee608d961 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.293396:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee1600/0xfb36a14ee608d953 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbab expref: 13 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.293406:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d968 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbab expref: 12 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.293411:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066805.293413:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066805.293415:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee0c00, rc 0) 00000100:00100000:2.0:1746066805.295210:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:32031:x1830882977302912:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2584us (3553us total) trans 8589944261 rc 0/0 00000100:00100000:2.0:1746066805.295220:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10177 00000100:00100000:0.0:1746066805.317623:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.317868:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977303040 00000100:00100000:1.0:1746066805.317881:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977303040 00000100:00100000:1.0:1746066805.317934:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15446 00000100:00100000:1.0:1746066805.317941:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+20:32031:x1830882977303040:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066805.317956:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.317971:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fbb2 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.317994:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee608d8f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb50 expref: 24 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.318001:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009025d400/0xfb36a14ee608d914 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb6c expref: 21 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.318011:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066805.318013:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066805.318016:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [516096->761855] (req 516096->761855) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 21 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.318041:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009025d400/0xfb36a14ee608d914 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb6c expref: 21 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.318050:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009025d400/0xfb36a14ee608d914 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb6c expref: 21 pid: 8451 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746066805.318060:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976989696:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066805.318138:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee608d8f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb50 expref: 24 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.318146:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee608d8f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb50 expref: 24 pid: 21203 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746066805.318152:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976989824:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066805.318169:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066805.320961:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.321096:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977303168 00000100:00100000:2.0:1746066805.321103:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977303168 00010000:00010000:2.0:1746066805.321133:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009025d400/0xfb36a14ee608d914 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb6c expref: 22 pid: 8451 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746066805.321171:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7986 00000100:00100000:2.0:1746066805.321178:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977303168:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066805.321189:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066805.321214:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009025d400/0xfb36a14ee608d914 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb6c expref: 22 pid: 8451 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746066805.321224:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009025d400/0xfb36a14ee608d914 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb6c expref: 22 pid: 8451 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746066805.321245:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066805.321279:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977303168:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 101us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.321284:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7986 00010000:00010000:1.0:1746066805.321637:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009025d400/0xfb36a14ee608d914 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb6c expref: 21 pid: 8451 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746066805.321657:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976989696:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066805.321667:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976989824:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066805.321715:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [516096->761855] (req 516096->761855) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 20 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.321725:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1f400, rc 0) 00000100:00100000:1.0:1746066805.321756:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+20:32031:x1830882977303040:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3817us (4141us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.321762:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15446 00000100:00100000:1.0:1746066805.321815:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.321832:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977303296 00000100:00100000:3.0:1746066805.321836:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977303296 00010000:00010000:3.0:1746066805.321851:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee608d8f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb50 expref: 25 pid: 21203 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746066805.321868:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7987 00000100:00100000:3.0:1746066805.321872:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977303296:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066805.321880:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066805.321889:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee608d8f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb50 expref: 25 pid: 21203 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746066805.321895:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee608d8f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb50 expref: 25 pid: 21203 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746066805.321906:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009025d600/0xfb36a14ee608d8f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb50 expref: 25 pid: 21203 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746066805.321915:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.321917:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.321922:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->761855) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 19 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.321928:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->761855) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 19 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.321950:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->761855) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 19 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066805.321965:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976989952:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066805.322006:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a9180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.324143:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976989952:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066805.324162:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066805.324198:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977303296:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2324us (2381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.324205:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7987 00000100:00100000:0.0:1746066805.325118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.325189:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977303552 00000100:00100000:1.0:1746066805.325196:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977303552 00002000:00100000:1.0:1746066805.325229:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (516096->520191) req@ffff88009e8c5180 x1830882977303552/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.325238:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c5180 with x1830882977303552 ext(516096->520191) 00002000:00010000:1.0:1746066805.325242:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c5180 00000100:00100000:1.0:1746066805.325271:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7038 00000100:00100000:1.0:1746066805.325278:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977303552:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066805.325842:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977303552:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 563us (723us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066805.325848:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7038 00002000:00100000:1.0:1746066805.325854:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (516096->520191) req@ffff88009e8c5180 x1830882977303552/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/4536 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.325861:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c5180 with x1830882977303552 ext(516096->520191) 00002000:00010000:1.0:1746066805.325863:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c5180 00000100:00100000:0.0:1746066805.329334:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.329403:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977303808 00000100:00100000:1.0:1746066805.329411:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977303808 00002000:00100000:1.0:1746066805.329444:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (757760->761855) req@ffff88009e8c7100 x1830882977303808/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.329453:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c7100 with x1830882977303808 ext(757760->761855) 00002000:00010000:1.0:1746066805.329457:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c7100 00000100:00100000:1.0:1746066805.329669:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7039 00000100:00100000:1.0:1746066805.329698:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977303808:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066805.329827:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977303808:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 151us (507us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066805.329833:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7039 00002000:00100000:1.0:1746066805.329838:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (757760->761855) req@ffff88009e8c7100 x1830882977303808/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/4536 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.329844:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c7100 with x1830882977303808 ext(757760->761855) 00002000:00010000:1.0:1746066805.329847:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c7100 00000100:00100000:0.0:1746066805.337825:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.337909:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977304064 00000100:00100000:3.0:1746066805.337916:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977304064 00000100:00100000:3.0:1746066805.338332:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4278 00000100:00100000:3.0:1746066805.338339:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+12:32031:x1830882977304064:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066805.339126:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:32031:x1830882977304064:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 786us (1307us total) trans 8589944262 rc 0/0 00000100:00100000:3.0:1746066805.339132:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4278 00000100:00100000:0.0:1746066805.347380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.347485:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977304192 00000100:00100000:1.0:1746066805.347501:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977304192 00000100:00100000:1.0:1746066805.347610:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15447 00000100:00100000:1.0:1746066805.347618:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:32025:x1830882977304192:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066805.347633:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.347647:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fbb9 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.347670:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d8b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb26 expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.349310:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608d8b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb2d expref: 17 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.349316:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066805.349319:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066805.349323:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3670016->4194303] (req 3670016->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 31 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.349356:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608d8b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb2d expref: 17 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.349368:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608d8b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb2d expref: 17 pid: 8112 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066805.349381:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976990080:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066805.350382:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d8b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb26 expref: 31 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.350393:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d8b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb26 expref: 31 pid: 21203 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066805.350402:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976990208:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066805.351087:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066805.352796:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976990080:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066805.353005:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976990208:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066805.353027:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3670016->4194303] (req 3670016->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 31 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.353041:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1ea00, rc 0) 00000100:00100000:1.0:1746066805.353072:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:32025:x1830882977304192:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 5455us (5700us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.353080:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15447 00000100:00100000:0.0:1746066805.353476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.353579:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977304320 00000100:00100000:3.0:1746066805.353585:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977304320 00010000:00010000:3.0:1746066805.353606:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608d8b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb2d expref: 18 pid: 8112 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066805.353631:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7988 00000100:00100000:3.0:1746066805.353637:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977304320:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066805.353646:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066805.353661:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608d8b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb2d expref: 18 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.353670:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608d8b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb2d expref: 18 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.353706:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e880a00/0xfb36a14ee608d8b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb2d expref: 18 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.353718:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066805.353745:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977304320:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 108us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.353750:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7988 00000100:00100000:0.0:1746066805.357624:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.357716:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977304448 00000100:00100000:2.0:1746066805.357724:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977304448 00010000:00010000:2.0:1746066805.357750:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d8b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb26 expref: 31 pid: 21203 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066805.357782:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7989 00000100:00100000:2.0:1746066805.357789:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882977304448:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066805.357803:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066805.357819:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d8b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb26 expref: 31 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.357829:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d8b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb26 expref: 31 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.357848:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d8b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb26 expref: 31 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.358510:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.358513:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.358520:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3670016->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 30 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.358527:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3670016->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 30 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.358557:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3670016->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 30 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.358566:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976990336:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066805.358638:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dab840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066805.360365:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976990336:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066805.360380:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066805.360421:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977304448:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2631us (2802us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.360431:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7989 00000100:00100000:0.0:1746066805.366074:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.366140:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977304576 00000100:00100000:1.0:1746066805.366147:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977304576 00000100:00100000:1.0:1746066805.366199:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15448 00000100:00100000:1.0:1746066805.366207:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:32025:x1830882977304576:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066805.366222:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.366238:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fbc0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.366263:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0a4000/0xfb36a14ee608d8ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb42 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.366272:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5600/0xfb36a14ee608d8f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb49 expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.366277:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746066805.366279:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746066805.366281:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->4702207] (req 4194304->4702207) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 25 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.366311:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009faf5600/0xfb36a14ee608d8f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb49 expref: 19 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.366322:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009faf5600/0xfb36a14ee608d8f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb49 expref: 19 pid: 8112 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066805.366332:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976990464:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066805.366417:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0a4000/0xfb36a14ee608d8ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb42 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.366424:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0a4000/0xfb36a14ee608d8ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb42 expref: 25 pid: 21203 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066805.366431:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976990592:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066805.366445:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066805.367873:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976990464:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066805.367883:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976990592:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066805.367903:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->4702207] (req 4194304->4702207) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 25 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.367914:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1e000, rc 0) 00000100:00100000:1.0:1746066805.367938:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:32025:x1830882977304576:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 1733us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.367948:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15448 00000100:00100000:0.0:1746066805.378515:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.378556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.378635:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977304704 00000100:00100000:3.0:1746066805.378643:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977304704 00010000:00010000:3.0:1746066805.378672:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0a4000/0xfb36a14ee608d8ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb42 expref: 25 pid: 21203 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066805.378721:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977304832 00000100:00100000:3.0:1746066805.378724:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977304832 00010000:00010000:3.0:1746066805.378734:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faf5600/0xfb36a14ee608d8f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb49 expref: 20 pid: 8112 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066805.378760:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7990 00000100:00100000:3.0:1746066805.378767:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977304704:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066805.378778:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066805.378795:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0a4000/0xfb36a14ee608d8ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb42 expref: 25 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.378808:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0a4000/0xfb36a14ee608d8ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb42 expref: 25 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.378827:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0a4000/0xfb36a14ee608d8ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb42 expref: 25 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.378845:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066805.378879:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977304704:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 113us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.378883:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7990 00000100:00100000:3.0:1746066805.378923:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7991 00000100:00100000:3.0:1746066805.378928:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977304832:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066805.378933:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066805.378940:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faf5600/0xfb36a14ee608d8f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb49 expref: 20 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.378948:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faf5600/0xfb36a14ee608d8f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb49 expref: 20 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.378958:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faf5600/0xfb36a14ee608d8f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb49 expref: 20 pid: 8112 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.378966:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.378967:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.378972:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 23 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.378980:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 23 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.379000:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 23 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066805.379010:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976990720:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066805.379048:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066805.380992:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.381247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.381954:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977304960 00000100:00100000:1.0:1746066805.381962:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977304960 00000100:00100000:3.0:1746066805.382031:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976990720:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066805.382048:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066805.382115:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977305088 00000100:00100000:1.0:1746066805.382118:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977305088 00000100:00100000:3.0:1746066805.382294:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977304832:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3364us (3735us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.382303:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7991 00000100:00100000:1.0:1746066805.382510:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15449 00000100:00100000:1.0:1746066805.382517:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882977304960:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.382531:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.382544:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1fe00/0xfb36a14ee608d98b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fbc7 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066805.382579:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976990848:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066805.383388:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15450 00000100:00100000:3.0:1746066805.383396:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977305088:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.383405:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.383414:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d992 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fbce expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066805.383437:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976990976:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066805.383702:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.384557:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800925a93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066805.384645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.384779:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977305344 00000100:00100000:2.0:1746066805.384785:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977305344 00002000:00100000:2.0:1746066805.384813:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4698112->4702207) req@ffff8800929cd180 x1830882977305344/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.384821:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cd180 with x1830882977305344 ext(4698112->4702207) 00002000:00010000:2.0:1746066805.384825:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929cd180 00002000:00010000:0.0:1746066805.384830:0:21973:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime: 1746066804 -> 1746066805 00002000:00010000:0.0:1746066805.384834:0:21973:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime: 1746066804 -> 1746066805 00000100:00100000:2.0:1746066805.384843:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7040 00000100:00100000:2.0:1746066805.384848:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977305344:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:0.0:1746066805.384851:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976990848:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066805.384870:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1fe00/0xfb36a14ee608d98b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc7 expref: 20 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.384879:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1fe00/0xfb36a14ee608d98b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc7 expref: 20 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.384898:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a1fe00, rc 0) 00000100:00100000:0.0:1746066805.384925:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+19:1965:x1830882977304960:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2409us (3939us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066805.384931:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15449 00002000:00010000:3.0:1746066805.385070:0:8112:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime: 1746066804 -> 1746066805 00002000:00010000:3.0:1746066805.385073:0:8112:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime: 1746066804 -> 1746066805 00000100:00100000:3.0:1746066805.385084:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976990976:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066805.385098:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d992 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbce expref: 18 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.385374:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d992 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbce expref: 18 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.385381:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e880000, rc 0) 00000100:00100000:3.0:1746066805.385550:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977305088:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2154us (4302us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066805.385555:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15450 00000100:00100000:2.0:1746066805.386246:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977305344:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 1395us (1600us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066805.386253:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7040 00002000:00100000:2.0:1746066805.386259:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (4698112->4702207) req@ffff8800929cd180 x1830882977305344/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/4536 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.386266:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cd180 with x1830882977305344 ext(4698112->4702207) 00002000:00010000:2.0:1746066805.386269:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929cd180 00000100:00100000:0.0:1746066805.391302:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.391457:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977305600 00000100:00100000:3.0:1746066805.391465:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977305600 00000100:00100000:3.0:1746066805.391845:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4279 00000100:00100000:3.0:1746066805.391853:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:32025:x1830882977305600:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066805.392658:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:32025:x1830882977305600:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 804us (1361us total) trans 8589944263 rc 0/0 00000100:00100000:3.0:1746066805.392665:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4279 00000100:00100000:0.0:1746066805.406072:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.407055:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977305984 00000100:00100000:2.0:1746066805.407064:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977305984 00000100:00100000:0.0:1746066805.407068:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.407091:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:2.0:1746066805.407103:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e8c4e00 x1830882977305984/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 504/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066805.407105:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977306112 00000100:00100000:0.0:1746066805.407108:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977306112 00002000:00100000:2.0:1746066805.407112:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c4e00 with x1830882977305984 ext(0->1048575) 00002000:00010000:2.0:1746066805.407117:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c4e00 00002000:00100000:0.0:1746066805.407126:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2015231) req@ffff88009e8c5500 x1830882977306112/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066805.407132:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c5500 with x1830882977306112 ext(1048576->2015231) 00002000:00010000:0.0:1746066805.407136:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c5500 00000100:00100000:2.0:1746066805.407143:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977306496 00000100:00100000:2.0:1746066805.407145:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977306496 00000100:00100000:0.0:1746066805.407146:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7041 00000100:00100000:0.0:1746066805.407152:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977305984:12345-192.168.202.57@tcp:3:cat.0 00002000:00100000:2.0:1746066805.407156:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009e8c7480 x1830882977306496/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.407161:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c7480 with x1830882977306496 ext(1048576->2097151) 00002000:00010000:2.0:1746066805.407164:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c7480 00000100:00100000:2.0:1746066805.407178:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7042 00000100:00100000:2.0:1746066805.407182:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977306112:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066805.407913:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7043 00000100:00100000:3.0:1746066805.408871:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977306496:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066805.408963:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.409034:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977306368 00000100:00100000:3.0:1746066805.409039:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977306368 00002000:00100000:3.0:1746066805.409060:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e8c4380 x1830882977306368/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.409067:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c4380 with x1830882977306368 ext(1048576->2097151) 00002000:00010000:3.0:1746066805.409071:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c4380 00000100:00100000:3.0:1746066805.409083:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7044 00000100:00100000:3.0:1746066805.409088:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977306368:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066805.417227:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977305984:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10065us (11153us total) trans 0 rc 802816/802816 00000100:00100000:0.0:1746066805.417239:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7041 00002000:00100000:0.0:1746066805.417250:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e8c4e00 x1830882977305984/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 504/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 802816/802816 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066805.417259:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c4e00 with x1830882977305984 ext(0->1048575) 00002000:00010000:0.0:1746066805.417264:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c4e00 00000100:00100000:2.0:1746066805.423793:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977306112:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16602us (16718us total) trans 0 rc 966656/966656 00000100:00100000:2.0:1746066805.423964:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7042 00002000:00100000:2.0:1746066805.423978:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2015231) req@ffff88009e8c5500 x1830882977306112/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 966656/966656 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.423987:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c5500 with x1830882977306112 ext(1048576->2015231) 00002000:00010000:2.0:1746066805.423992:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e8c5500 00000100:00100000:3.0:1746066805.430449:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977306368:12345-192.168.202.57@tcp:3:cat.0 Request processed in 21351us (21478us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066805.430459:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7044 00002000:00100000:3.0:1746066805.430469:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e8c4380 x1830882977306368/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.430478:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c4380 with x1830882977306368 ext(1048576->2097151) 00002000:00010000:3.0:1746066805.430483:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c4380 00000100:00100000:0.0:1746066805.432579:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977306496:12345-192.168.202.57@tcp:3:cat.0 Request processed in 24653us (25480us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066805.432588:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7043 00002000:00100000:0.0:1746066805.432595:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009e8c7480 x1830882977306496/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066805.432603:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c7480 with x1830882977306496 ext(1048576->2097151) 00002000:00010000:0.0:1746066805.432606:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c7480 00000100:00100000:0.0:1746066805.441100:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.441184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.441265:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977306880 00000100:00100000:3.0:1746066805.441272:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977306880 00000100:00100000:3.0:1746066805.441303:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977306752 00000100:00100000:3.0:1746066805.441305:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977306752 00000100:00100000:3.0:1746066805.441329:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15451 00000100:00100000:3.0:1746066805.441335:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977306880:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.441349:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.441361:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d999 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fbdc expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066805.441483:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15452 00000100:00100000:1.0:1746066805.441490:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977306752:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.441507:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.441517:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb97800/0xfb36a14ee608d9a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fbd5 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066805.441554:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976991104:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066805.441746:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976991232:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066805.442080:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.442391:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.444984:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976991232:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066805.445016:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d999 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbdc expref: 18 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.445027:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e880000/0xfb36a14ee608d999 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbdc expref: 18 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.445042:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e880000, rc 0) 00000100:00100000:3.0:1746066805.445077:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977306880:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3741us (3983us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066805.445084:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15451 00000100:00100000:1.0:1746066805.445212:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976991104:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066805.445235:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb97800/0xfb36a14ee608d9a0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbd5 expref: 20 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.445248:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb97800/0xfb36a14ee608d9a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbd5 expref: 20 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.445373:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb97800, rc 0) 00000100:00100000:1.0:1746066805.445399:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977306752:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3910us (4214us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066805.445404:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15452 00000100:00100000:0.0:1746066805.452142:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.452833:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977307136 00000100:00100000:2.0:1746066805.452841:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977307136 00002000:00100000:2.0:1746066805.452877:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2117632->3145727) req@ffff880135e5fb80 x1830882977307136/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.452886:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5fb80 with x1830882977307136 ext(2117632->3145727) 00002000:00010000:2.0:1746066805.452891:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5fb80 00000100:00100000:2.0:1746066805.452920:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7045 00000100:00100000:2.0:1746066805.452927:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977307136:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066805.461514:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977307136:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8580us (9370us total) trans 0 rc 1028096/1028096 00000100:00100000:2.0:1746066805.461528:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7045 00002000:00100000:2.0:1746066805.461538:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (2117632->3145727) req@ffff880135e5fb80 x1830882977307136/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1028096/1028096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.461546:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5fb80 with x1830882977307136 ext(2117632->3145727) 00002000:00010000:2.0:1746066805.461551:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e5fb80 00000100:00100000:0.0:1746066805.470658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.470721:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977307264 00000100:00100000:1.0:1746066805.470729:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977307264 00000100:00100000:1.0:1746066805.470775:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15453 00000100:00100000:1.0:1746066805.470783:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+17:32035:x1830882977307264:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.470798:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.470813:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608d9a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fbe3 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.470837:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3670016->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 29 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.470844:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066805.470845:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066805.470848:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608d9a7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbe3 expref: 18 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.470872:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3670016->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 29 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.470886:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3670016->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 29 pid: 21973 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066805.470895:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976991360:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066805.470977:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066805.477488:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976991360:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066805.477523:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608d9a7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbe3 expref: 18 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.477537:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb97e00, rc 0) 00000100:00100000:1.0:1746066805.478239:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+18:32035:x1830882977307264:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7454us (7585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.478248:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15453 00000100:00100000:0.0:1746066805.480066:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.480568:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977307392 00000100:00100000:2.0:1746066805.480576:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977307392 00002000:00100000:2.0:1746066805.480611:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3670016->4194303) req@ffff880135e5f100 x1830882977307392/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.480619:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5f100 with x1830882977307392 ext(3670016->4194303) 00010000:00010000:2.0:1746066805.480627:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3670016->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 30 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.480639:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3670016->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 30 pid: 21973 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746066805.480644:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135e5f100 00000100:00100000:2.0:1746066805.481176:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2277 00000100:00100000:2.0:1746066805.481474:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977307392:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066805.494939:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.495158:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977307648 00000100:00100000:3.0:1746066805.495166:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977307648 00000100:00100000:3.0:1746066805.495203:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10178 00000100:00100000:3.0:1746066805.495209:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+255:32039:x1830882977307648:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.495227:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.495241:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fbea expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.495313:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1f400/0xfb36a14ee608d9b5 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066805.495323:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1f400/0xfb36a14ee608d9b5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066805.495332:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1f400/0xfb36a14ee608d9b5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:3.0:1746066805.495341:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066805.495420:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbea expref: 258 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.495450:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1f400/0xfb36a14ee608d9b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbea expref: 257 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.495460:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066805.495462:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746066805.495464:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1f400, rc 0) 00000100:00100000:3.0:1746066805.495508:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:32039:x1830882977307648:12345-192.168.202.57@tcp:101:cat.0 Request processed in 299us (575us total) trans 8589944264 rc 0/0 00000100:00100000:3.0:1746066805.495514:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10178 00000100:00100000:0.0:1746066805.498276:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.498353:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977307776 00000100:00100000:1.0:1746066805.498360:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977307776 00000100:00100000:1.0:1746066805.498397:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15454 00000100:00100000:1.0:1746066805.498403:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977307776:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.498417:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.498453:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eb97a00/0xfb36a14ee608d9c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fbf1 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066805.498505:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976991488:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066805.498771:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066805.499119:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977307392:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 17935us (19058us total) trans 21474841073 rc 0/0 00000100:00100000:2.0:1746066805.499128:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2277 00002000:00100000:2.0:1746066805.500445:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (3670016->4194303) req@ffff880135e5f100 x1830882977307392/t21474841073(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/448 e 0 to 0 dl 1746066816 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.500462:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e5f100 with x1830882977307392 ext(3670016->4194303) 00010000:00010000:2.0:1746066805.500471:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3670016->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 32 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.500484:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3670016->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 32 pid: 21973 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746066805.500490:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135e5f100 00000100:00100000:0.0:1746066805.501228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.501257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.501270:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977308160 00000100:00100000:3.0:1746066805.501273:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977307904 00000100:00100000:0.0:1746066805.501274:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977308160 00000100:00100000:3.0:1746066805.501277:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977307904 00000100:00100000:3.0:1746066805.501312:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15455 00000100:00100000:3.0:1746066805.501317:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977307904:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.501328:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.501340:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e400/0xfb36a14ee608d9ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fbf8 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066805.501379:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976991616:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066805.502120:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15456 00000100:00100000:2.0:1746066805.502128:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977308160:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066805.502135:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.502144:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e64fc00/0xfb36a14ee608d9d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc06 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.502167:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976991744:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066805.502266:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.502289:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977308032 00000100:00100000:2.0:1746066805.502292:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977308032 00000100:00100000:2.0:1746066805.502310:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15457 00000100:00100000:2.0:1746066805.502315:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977308032:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066805.502321:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.502327:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608d9d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fbff expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.502348:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976991872:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066805.502393:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dabf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.502403:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066805.502791:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1daba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066805.504590:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00010000:2.0:1746066805.504788:0:8112:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime: 1746066804 -> 1746066805 00002000:00010000:2.0:1746066805.504792:0:8112:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime: 1746066804 -> 1746066805 00002000:00010000:2.0:1746066805.504795:0:8112:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime: 1746066804 -> 1746066805 00010000:00010000:3.0:1746066805.504810:0:8452:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.57@tcp) returned -22 from glimpse AST (req@ffff88009e843100 x1830882976991744) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3670016->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 33 pid: 21973 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066805.504812:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976991616:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066805.504833:0:8452:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3670016->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 33 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.504834:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e400/0xfb36a14ee608d9ca lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbf8 expref: 29 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.504845:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e400/0xfb36a14ee608d9ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbf8 expref: 29 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.504848:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a1ea00/0xfb36a14ee608d97d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3670016->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb9 expref: 33 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.504858:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1e400, rc 0) 00000100:00100000:3.0:1746066805.504866:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976991744:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066805.504878:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.504880:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.504886:0:8452:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608d9a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbe3 expref: 17 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.504893:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608d9a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbe3 expref: 17 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.504901:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977307904:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3582us (3673us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066805.504908:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15455 00010000:00010000:3.0:1746066805.504916:0:8452:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608d9a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbe3 expref: 17 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066805.504926:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976992000:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066805.504939:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977308288 00000100:00100000:2.0:1746066805.504943:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977308288 00000100:00100000:3.0:1746066805.504954:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066805.504977:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 724 00000100:00100000:2.0:1746066805.504983:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977308288:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066805.504991:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066805.504993:0:9852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie fb36a14ee608d97d) 00010000:00010000:2.0:1746066805.504994:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066805.505008:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977308288:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 27us (423us total) trans 0 rc 116/116 00000100:00100000:2.0:1746066805.505013:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 724 00002000:00010000:1.0:1746066805.505260:0:21973:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime: 1746066802 -> 1746066805 00002000:00010000:1.0:1746066805.505263:0:21973:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime: 1746066802 -> 1746066805 00002000:00010000:1.0:1746066805.505265:0:21973:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime: 1746066802 -> 1746066805 00000100:00100000:1.0:1746066805.505274:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882976991488:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066805.505290:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eb97a00/0xfb36a14ee608d9c3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbf1 expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.505299:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eb97a00/0xfb36a14ee608d9c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbf1 expref: 27 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.505321:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb97a00, rc 0) 00000100:00100000:1.0:1746066805.505339:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977307776:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6936us (7069us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066805.505344:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15454 00000100:00100000:2.0:1746066805.505721:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976991872:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066805.505735:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608d9d8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbff expref: 25 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.505744:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b19b600/0xfb36a14ee608d9d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbff expref: 25 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.505751:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19b600, rc 0) 00000100:00100000:2.0:1746066805.505766:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977308032:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3451us (3500us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066805.505771:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15457 00000100:00100000:3.0:1746066805.508758:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976992000:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066805.508784:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e64fc00/0xfb36a14ee608d9d1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc06 expref: 32 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.508798:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e64fc00/0xfb36a14ee608d9d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc06 expref: 32 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.508810:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e64fc00, rc 0) 00000100:00100000:3.0:1746066805.508844:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977308160:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6716us (7584us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066805.508854:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15456 00000100:00100000:0.0:1746066805.512036:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.512781:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977308416 00000100:00100000:3.0:1746066805.512788:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977308416 00000100:00100000:0.0:1746066805.512971:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.512992:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15458 00000100:00100000:3.0:1746066805.512999:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:32039:x1830882977308416:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.513013:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.513026:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc0d expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.513753:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977308672 00000100:00100000:2.0:1746066805.513758:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977308672 00002000:00100000:2.0:1746066805.513781:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ef5ed80 x1830882977308672/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.513790:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5ed80 with x1830882977308672 ext(2097152->3145727) 00002000:00010000:2.0:1746066805.513793:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef5ed80 00000100:00100000:2.0:1746066805.513807:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7046 00000100:00100000:2.0:1746066805.513812:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977308672:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:3.0:1746066805.514791:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->761855) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 18 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.514799:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066805.514800:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066805.514804:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9df lrc: 4/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc0d expref: 25 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.514830:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->761855) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 18 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.514840:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->761855) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 18 pid: 21973 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066805.514851:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976992128:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066805.515098:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.520819:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976992128:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066805.520850:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9df lrc: 3/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc0d expref: 25 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.520868:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1f200, rc 0) 00000100:00100000:3.0:1746066805.520919:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:32039:x1830882977308416:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7920us (8889us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.520926:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15458 00000100:00100000:0.0:1746066805.521888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.522206:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+18:1965:x1830882977308672:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8392us (9529us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066805.522214:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7046 00002000:00100000:2.0:1746066805.522222:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009ef5ed80 x1830882977308672/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.522230:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5ed80 with x1830882977308672 ext(2097152->3145727) 00002000:00010000:2.0:1746066805.522235:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef5ed80 00000100:00100000:2.0:1746066805.522252:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977308800 00000100:00100000:2.0:1746066805.522257:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977308800 00002000:00100000:2.0:1746066805.522279:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (516096->761855) req@ffff88009ef5d880 x1830882977308800/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.522440:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5d880 with x1830882977308800 ext(516096->761855) 00010000:00010000:2.0:1746066805.522446:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->761855) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 19 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.522459:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->761855) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 19 pid: 21973 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746066805.522464:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef5d880 00000100:00100000:2.0:1746066805.522528:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2278 00000100:00100000:2.0:1746066805.522536:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977308800:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066805.526405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.526502:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977308928 00000100:00100000:3.0:1746066805.526509:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977308928 00000100:00100000:3.0:1746066805.526559:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15459 00000100:00100000:3.0:1746066805.526565:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+21:32035:x1830882977308928:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.526579:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.526591:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e400/0xfb36a14ee608d9e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc14 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.526613:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.526614:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.526620:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e400/0xfb36a14ee608d9e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc14 expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.526632:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e400/0xfb36a14ee608d9e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc14 expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.526639:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1e400, rc 0) 00000100:00100000:3.0:1746066805.526707:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+22:32035:x1830882977308928:12345-192.168.202.57@tcp:101:cat.0 Request processed in 141us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.526711:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15459 00000100:00100000:2.0:1746066805.532357:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977308800:12345-192.168.202.57@tcp:4:cat.0 Request processed in 9814us (10463us total) trans 17179873770 rc 0/0 00000100:00100000:2.0:1746066805.532367:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2278 00002000:00100000:2.0:1746066805.532376:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x38e:0x0] (516096->761855) req@ffff88009ef5d880 x1830882977308800/t17179873770(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/448 e 0 to 0 dl 1746066816 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.532384:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5d880 with x1830882977308800 ext(516096->761855) 00010000:00010000:2.0:1746066805.532392:0:25585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->761855) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 22 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.532404:0:25585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->761855) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 22 pid: 21973 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746066805.532410:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ef5d880 00000100:00100000:0.0:1746066805.538298:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.538377:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.538442:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977309312 00000100:00100000:0.0:1746066805.538450:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977309312 00010000:00010000:0.0:1746066805.538484:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 516096->761855) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 22 pid: 21973 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066805.538614:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.539295:0:25585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977309184 00000100:00100000:2.0:1746066805.539299:0:25585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977309184 00002000:00100000:2.0:1746066805.539347:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009ef5c700 x1830882977309184/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.539355:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5c700 with x1830882977309184 ext(3145728->4194303) 00002000:00010000:2.0:1746066805.539359:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef5c700 00000100:00100000:2.0:1746066805.539375:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977309568 00000100:00100000:2.0:1746066805.539377:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977309568 00002000:00100000:2.0:1746066805.539387:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800929cce00 x1830882977309568/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.539393:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cce00 with x1830882977309568 ext(3145728->4194303) 00002000:00010000:2.0:1746066805.539396:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929cce00 00000100:00100000:2.0:1746066805.539414:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7047 00000100:00100000:2.0:1746066805.539420:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882977309184:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066805.539638:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7048 00000100:00100000:1.0:1746066805.539644:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977309568:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066805.539804:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7992 00000100:00100000:0.0:1746066805.539813:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882977309312:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066805.539820:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066805.539834:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->761855) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 23 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066805.539844:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->761855) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 23 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066805.539862:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1f400/0xfb36a14ee608d976 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 516096->761855) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbb2 expref: 23 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066805.539876:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.539878:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.539883:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc0d expref: 24 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.539890:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc0d expref: 24 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.539913:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc0d expref: 24 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066805.539923:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976992256:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066805.539973:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066805.541486:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976992256:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066805.541517:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066805.541543:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977309312:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1732us (3167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.541550:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7992 00000100:00100000:2.0:1746066805.557126:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977309184:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17697us (19558us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066805.557137:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7047 00002000:00100000:2.0:1746066805.557148:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009ef5c700 x1830882977309184/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.557157:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5c700 with x1830882977309184 ext(3145728->4194303) 00002000:00010000:2.0:1746066805.557163:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef5c700 00000100:00100000:1.0:1746066805.557376:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977309568:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17730us (18760us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066805.557383:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7048 00002000:00100000:1.0:1746066805.557389:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800929cce00 x1830882977309568/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.557397:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cce00 with x1830882977309568 ext(3145728->4194303) 00002000:00010000:1.0:1746066805.557400:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929cce00 00000100:00100000:0.0:1746066805.562997:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.563034:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.563075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.563088:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977309824 00000100:00100000:3.0:1746066805.563096:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977309824 00000100:00100000:3.0:1746066805.563834:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977309696 00000100:00100000:3.0:1746066805.563838:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977309696 00000100:00100000:3.0:1746066805.563861:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15460 00000100:00100000:3.0:1746066805.563868:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977309824:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.563882:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.563897:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ec00/0xfb36a14ee608d9ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc22 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.564063:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15461 00000100:00100000:2.0:1746066805.564071:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882977309696:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066805.564078:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.564086:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b19bc00/0xfb36a14ee608d9f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc1b expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.564099:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.564100:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.564108:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b19bc00/0xfb36a14ee608d9f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc1b expref: 24 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.564119:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b19bc00/0xfb36a14ee608d9f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc1b expref: 24 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.564128:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19bc00, rc 0) 00000100:00100000:2.0:1746066805.564168:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977309696:12345-192.168.202.57@tcp:101:cat.0 Request processed in 98us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.564173:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15461 00000100:00100000:1.0:1746066805.564218:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977310336 00000100:00100000:1.0:1746066805.564221:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977310336 00002000:00100000:1.0:1746066805.564245:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009ef5ce00 x1830882977310336/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.564253:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5ce00 with x1830882977310336 ext(1048576->2097151) 00002000:00010000:1.0:1746066805.564256:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef5ce00 00000100:00100000:1.0:1746066805.564278:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7049 00000100:00100000:1.0:1746066805.564283:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882977310336:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066805.564773:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.564789:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.564811:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977310208 00000100:00100000:0.0:1746066805.564813:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977310208 00002000:00100000:0.0:1746066805.564828:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009ef5e300 x1830882977310208/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066805.564834:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5e300 with x1830882977310208 ext(1048576->2097151) 00002000:00010000:0.0:1746066805.564837:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef5e300 00000100:00100000:0.0:1746066805.564847:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977310592 00000100:00100000:0.0:1746066805.564848:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977310592 00002000:00100000:0.0:1746066805.564855:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009ef5df80 x1830882977310592/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066805.564860:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5df80 with x1830882977310592 ext(0->1048575) 00002000:00010000:0.0:1746066805.564861:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef5df80 00000100:00100000:0.0:1746066805.564867:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7050 00000100:00100000:0.0:1746066805.564870:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977310208:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066805.565453:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7051 00000100:00100000:2.0:1746066805.565460:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977310592:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066805.567177:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976992384:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066805.567237:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.570002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.570023:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977310848 00000100:00100000:0.0:1746066805.570031:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977310848 00000100:00100000:3.0:1746066805.571313:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10179 00000100:00100000:3.0:1746066805.571322:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+13:32041:x1830882977310848:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066805.571343:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.571357:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092491400/0xfb36a14ee608d9fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc29 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.571432:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.571444:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d8dc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb3b expref: 256 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.571451:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d968 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbab expref: 14 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.571456:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.571484:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d968 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbab expref: 14 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.571504:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d968 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbab expref: 14 pid: 809 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066805.571514:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976992512:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066805.571605:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d8dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb3b expref: 256 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.571612:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d8dc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb3b expref: 256 pid: 14549 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066805.571619:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976992640:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066805.571636:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.576635:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976992512:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066805.576767:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976992640:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066805.576789:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00002000:00010000:3.0:1746066805.576816:0:8451:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime: 1746066804 -> 1746066805 00000100:00100000:3.0:1746066805.576832:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092045180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976992384:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066805.576849:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ec00/0xfb36a14ee608d9ed lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc22 expref: 23 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.576864:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ec00/0xfb36a14ee608d9ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc22 expref: 23 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.576890:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1ec00, rc 0) 00000100:00100000:3.0:1746066805.576927:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977309824:12345-192.168.202.57@tcp:101:cat.0 Request processed in 13059us (13937us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066805.576935:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15460 00000100:00100000:2.0:1746066805.577304:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977310208:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12432us (12530us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066805.577312:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7050 00002000:00100000:2.0:1746066805.577320:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009ef5e300 x1830882977310208/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.577329:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5e300 with x1830882977310208 ext(1048576->2097151) 00002000:00010000:2.0:1746066805.577333:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef5e300 00000100:00100000:0.0:1746066805.577620:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.577659:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.577829:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977311104 00000100:00100000:3.0:1746066805.577835:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977311104 00010000:00010000:3.0:1746066805.577856:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d8dc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb3b expref: 257 pid: 14549 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066805.577879:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977310976 00000100:00100000:3.0:1746066805.577882:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977310976 00010000:00010000:3.0:1746066805.577893:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d968 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbab expref: 15 pid: 809 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066805.577905:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7993 00000100:00100000:3.0:1746066805.577910:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:1964:x1830882977311104:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066805.577921:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066805.577927:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d8dc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb3b expref: 257 pid: 14549 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.577935:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d8dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb3b expref: 257 pid: 14549 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.577954:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608d8dc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb3b expref: 257 pid: 14549 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.577965:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066805.577969:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.577976:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.577980:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066805.577999:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:1964:x1830882977311104:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 88us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.578004:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7993 00000100:00100000:3.0:1746066805.578015:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7994 00000100:00100000:3.0:1746066805.578019:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+15:1964:x1830882977310976:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066805.578026:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066805.578029:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d968 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbab expref: 15 pid: 809 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.578035:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d968 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbab expref: 15 pid: 809 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.578046:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608d968 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbab expref: 15 pid: 809 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.578053:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066805.578056:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.578062:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.578068:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.578082:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066805.578095:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977310976:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 76us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.578100:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7994 00010000:00010000:3.0:1746066805.578114:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.578120:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066805.578132:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066805.578873:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092491400/0xfb36a14ee608d9fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc29 expref: 15 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.578886:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc29 expref: 14 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.578892:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066805.578894:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066805.578896:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092490c00, rc 0) 00000100:00100000:3.0:1746066805.578933:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+14:32041:x1830882977310848:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 7613us (8939us total) trans 8589944265 rc 0/0 00000100:00100000:3.0:1746066805.578942:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10179 00000100:00100000:1.0:1746066805.581256:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882977310336:12345-192.168.202.57@tcp:3:cat.0 Request processed in 16965us (18173us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066805.581266:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7049 00002000:00100000:1.0:1746066805.581275:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009ef5ce00 x1830882977310336/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.581284:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5ce00 with x1830882977310336 ext(1048576->2097151) 00002000:00010000:1.0:1746066805.581288:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ef5ce00 00000100:00100000:0.0:1746066805.584541:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.585041:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1964:x1830882977310592:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19576us (20245us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066805.585051:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7051 00002000:00100000:2.0:1746066805.585063:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009ef5df80 x1830882977310592/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.585071:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ef5df80 with x1830882977310592 ext(0->1048575) 00002000:00010000:2.0:1746066805.585076:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ef5df80 00000100:00100000:3.0:1746066805.585211:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977311232 00000100:00100000:3.0:1746066805.585219:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977311232 00000100:00100000:3.0:1746066805.585261:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15462 00000100:00100000:3.0:1746066805.585268:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:32035:x1830882977311232:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.585282:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.585297:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f60f800/0xfb36a14ee608da10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc30 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.585320:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 24 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.585327:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066805.585328:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066805.585332:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f60f800/0xfb36a14ee608da10 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->5091327] (req 4194304->5091327) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc30 expref: 23 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.585363:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 24 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.585375:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 24 pid: 21973 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066805.585386:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976992768:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066805.585464:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066805.590987:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.591082:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976992768:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066805.591109:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f60f800/0xfb36a14ee608da10 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->5091327] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc30 expref: 23 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.591123:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f60f800, rc 0) 00000100:00100000:3.0:1746066805.591174:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:32035:x1830882977311232:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5907us (6639us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.591181:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15462 00000100:00100000:2.0:1746066805.591850:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977311360 00000100:00100000:2.0:1746066805.591856:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977311360 00002000:00100000:2.0:1746066805.591887:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4702207) req@ffff88009ed73800 x1830882977311360/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.591895:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73800 with x1830882977311360 ext(4194304->4702207) 00010000:00010000:2.0:1746066805.591902:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 25 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.591912:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 25 pid: 21973 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746066805.591917:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed73800 00000100:00100000:2.0:1746066805.591939:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2279 00000100:00100000:2.0:1746066805.591945:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977311360:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066805.603858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.604443:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977311488 00000100:00100000:3.0:1746066805.604450:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977311488 00000100:00100000:3.0:1746066805.604486:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15463 00000100:00100000:3.0:1746066805.604503:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:32039:x1830882977311488:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.604516:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.604530:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608da17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc37 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.604555:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.604561:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066805.604563:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066805.604567:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608da17 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc37 expref: 28 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.604591:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 22 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.604601:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 22 pid: 21203 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066805.604611:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976992896:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066805.606224:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066805.608992:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977311360:12345-192.168.202.57@tcp:4:cat.0 Request processed in 17039us (18005us total) trans 17179873771 rc 0/0 00000100:00100000:0.0:1746066805.609003:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2279 00002000:00100000:0.0:1746066805.609014:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4702207) req@ffff88009ed73800 x1830882977311360/t17179873771(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/448 e 0 to 0 dl 1746066816 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066805.609023:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed73800 with x1830882977311360 ext(4194304->4702207) 00010000:00010000:0.0:1746066805.609031:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 29 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746066805.609044:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 29 pid: 21973 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746066805.609051:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed73800 00000100:00100000:3.0:1746066805.615841:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976992896:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066805.615845:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066805.615867:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608da17 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc37 expref: 28 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.615888:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1f000, rc 0) 00000100:00100000:3.0:1746066805.615924:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:32039:x1830882977311488:12345-192.168.202.57@tcp:101:cat.0 Request processed in 11431us (12073us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.615931:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15463 00000100:00100000:3.0:1746066805.615961:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977311744 00000100:00100000:3.0:1746066805.615965:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977311744 00000100:00100000:3.0:1746066805.616002:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10180 00000100:00100000:3.0:1746066805.616008:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:32043:x1830882977311744:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066805.616023:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.616035:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f60f200/0xfb36a14ee608da1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc3e expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.616117:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ec00/0xfb36a14ee608da25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616128:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ec00/0xfb36a14ee608da25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616137:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ec00/0xfb36a14ee608da25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616151:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608da2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616156:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608da2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616161:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608da2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616247:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608da33 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616255:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608da33 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616261:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608da33 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066805.616268:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066805.616511:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ec00/0xfb36a14ee608da25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616518:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ec00/0xfb36a14ee608da25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616524:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ec00/0xfb36a14ee608da25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616529:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1ec00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066805.616532:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ec00/0xfb36a14ee608da25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616537:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ec00/0xfb36a14ee608da25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616547:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066805.616549:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066805.616553:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ec00/0xfb36a14ee608da25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616557:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1ec00/0xfb36a14ee608da25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616746:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608da2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616752:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608da2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616756:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608da2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616759:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1e200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066805.616761:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608da2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616765:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608da2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616770:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012dc13900) 00010000:00010000:3.0:1746066805.616772:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066805.616774:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608da2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616778:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608da2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.616804:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f60f200/0xfb36a14ee608da1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc3e expref: 259 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.616812:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608da33 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc3e expref: 258 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.616817:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066805.616819:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066805.616821:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dee0c00, rc 0) 00000100:00100000:3.0:1746066805.616850:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+258:32043:x1830882977311744:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 842us (1006us total) trans 8589944266 rc 0/0 00000100:00100000:3.0:1746066805.616855:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10180 00000100:00100000:0.0:1746066805.618511:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.622431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.623128:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977311872 00000100:00100000:2.0:1746066805.623136:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977311872 00002000:00100000:2.0:1746066805.623174:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x390:0x0] (2015232->2097151) req@ffff88009ed71880 x1830882977311872/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.623189:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed71880 with x1830882977311872 ext(2015232->2097151) 00010000:00010000:2.0:1746066805.623197:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 23 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.623207:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 23 pid: 21203 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746066805.623213:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed71880 00000100:00100000:2.0:1746066805.623237:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2280 00000100:00100000:2.0:1746066805.623244:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882977311872:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066805.623373:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.624205:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977312128 00000100:00100000:2.0:1746066805.624210:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977312128 00000100:00100000:2.0:1746066805.624248:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15464 00000100:00100000:2.0:1746066805.624254:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:32041:x1830882977312128:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066805.624265:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.624280:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc45 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.624515:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608d9a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbe3 expref: 19 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.624522:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.624523:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.624527:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2527232->2953215] (req 2527232->2953215) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.624554:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608d9a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbe3 expref: 19 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.624563:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608d9a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbe3 expref: 19 pid: 21973 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066805.624574:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976993024:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066805.624612:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977312000 00000100:00100000:3.0:1746066805.624617:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977312000 00000100:00100000:2.0:1746066805.624630:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dab840 going to sleep for 11 seconds 00010000:00010000:3.0:1746066805.624634:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 28 pid: 21973 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066805.624723:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7995 00000100:00100000:3.0:1746066805.624890:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977312000:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066805.624900:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066805.624914:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 28 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.624924:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 28 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.625722:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4a1e000/0xfb36a14ee608d984 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4702207) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbc0 expref: 28 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.625736:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.625738:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.625742:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f60f800/0xfb36a14ee608da10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc30 expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.625748:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f60f800/0xfb36a14ee608da10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc30 expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.625769:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f60f800/0xfb36a14ee608da10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc30 expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066805.625777:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976993152:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066805.627806:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.627872:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976993024:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066805.627892:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2527232->2953215] (req 2527232->2953215) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 19 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.627905:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b19b800, rc 0) 00000100:00100000:3.0:1746066805.627936:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:32041:x1830882977312128:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3682us (4563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.627943:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15464 00000100:00100000:2.0:1746066805.628185:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882977311872:12345-192.168.202.57@tcp:4:cat.0 Request processed in 4941us (9677us total) trans 17179873772 rc 0/0 00000100:00100000:2.0:1746066805.628193:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2280 00002000:00100000:2.0:1746066805.628202:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x390:0x0] (2015232->2097151) req@ffff88009ed71880 x1830882977311872/t17179873772(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/448 e 0 to 0 dl 1746066816 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.628209:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed71880 with x1830882977311872 ext(2015232->2097151) 00010000:00010000:2.0:1746066805.628217:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 25 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.628226:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 25 pid: 21203 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746066805.628232:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ed71880 00000100:00100000:3.0:1746066805.628639:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976993152:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066805.628651:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066805.628667:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977312000:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3938us (6243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.628695:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7995 00000100:00100000:3.0:1746066805.628741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.628753:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977312256 00000100:00100000:3.0:1746066805.628757:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977312256 00010000:00010000:3.0:1746066805.628772:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608d9a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbe3 expref: 19 pid: 21973 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746066805.628787:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7996 00000100:00100000:3.0:1746066805.628793:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977312256:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066805.628801:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066805.628815:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608d9a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbe3 expref: 19 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.628822:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608d9a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbe3 expref: 19 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.628838:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608d9a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbe3 expref: 19 pid: 21973 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.628847:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.628848:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.628854:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2953215) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 18 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.628861:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2953215) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 18 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.628884:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2953215) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 18 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066805.628892:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976993280:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066805.629010:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.629024:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977312512 00000100:00100000:2.0:1746066805.629027:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977312512 00002000:00100000:2.0:1746066805.629046:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e841180 x1830882977312512/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.629052:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e841180 with x1830882977312512 ext(4194304->5091327) 00002000:00010000:2.0:1746066805.629055:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e841180 00000100:00100000:2.0:1746066805.629066:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7052 00000100:00100000:2.0:1746066805.629071:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882977312512:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066805.629266:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066805.633376:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.633477:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.633549:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977312768 00000100:00100000:1.0:1746066805.633556:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977312768 00002000:00100000:1.0:1746066805.633587:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2527232->2531327) req@ffff88009e840a80 x1830882977312768/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.633596:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e840a80 with x1830882977312768 ext(2527232->2531327) 00002000:00010000:1.0:1746066805.633600:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e840a80 00000100:00100000:1.0:1746066805.633627:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7053 00000100:00100000:1.0:1746066805.633633:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977312768:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066805.633793:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977312768:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 160us (424us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066805.633799:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7053 00002000:00100000:1.0:1746066805.633804:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2527232->2531327) req@ffff88009e840a80 x1830882977312768/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/4536 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.633809:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e840a80 with x1830882977312768 ext(2527232->2531327) 00002000:00010000:1.0:1746066805.633812:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e840a80 00000100:00100000:3.0:1746066805.634015:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976993280:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066805.634031:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066805.634614:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977312256:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5818us (5870us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.634621:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7996 00000100:00100000:3.0:1746066805.634664:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977312896 00000100:00100000:3.0:1746066805.634667:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977312896 00000100:00100000:3.0:1746066805.635272:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15465 00000100:00100000:3.0:1746066805.635278:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:32043:x1830882977312896:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066805.635289:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.635302:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc4c expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.635321:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009025da00/0xfb36a14ee608d8ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb57 expref: 32 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.635328:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009025d200/0xfb36a14ee608d922 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb73 expref: 17 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.635337:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.635339:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066805.635342:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1486848->1708031] (req 1486848->1708031) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 32 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.635364:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009025d200/0xfb36a14ee608d922 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb73 expref: 17 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.635459:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009025d200/0xfb36a14ee608d922 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb73 expref: 17 pid: 8451 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746066805.635470:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976993408:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066805.636164:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009025da00/0xfb36a14ee608d8ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb57 expref: 32 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.636172:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009025da00/0xfb36a14ee608d8ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb57 expref: 32 pid: 21203 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746066805.636181:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976993536:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066805.636200:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.637977:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882977312512:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 8901us (8962us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066805.637986:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7052 00002000:00100000:3.0:1746066805.637995:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e841180 x1830882977312512/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 897024/897024 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.638007:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e841180 with x1830882977312512 ext(4194304->5091327) 00002000:00010000:3.0:1746066805.638012:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e841180 00000100:00100000:0.0:1746066805.639505:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.639626:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977313024 00000100:00100000:2.0:1746066805.639632:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977313024 00010000:00010000:2.0:1746066805.639656:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 25 pid: 21203 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066805.639695:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7997 00000100:00100000:2.0:1746066805.639702:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882977313024:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066805.639712:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066805.639728:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 25 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.639737:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 25 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.639756:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800934eae00/0xfb36a14ee608d8ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2015232->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb1f expref: 25 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.639772:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.639774:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.639779:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608da17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc37 expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.639787:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608da17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc37 expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.639811:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608da17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc37 expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.639820:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976993664:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066805.639878:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1daba80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.640240:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976993408:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066805.640249:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976993536:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066805.640269:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1486848->1708031] (req 1486848->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 32 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.640278:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025c400, rc 0) 00000100:00100000:0.0:1746066805.640444:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.640456:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977313280 00000100:00100000:0.0:1746066805.640458:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977313280 00010000:00010000:0.0:1746066805.640474:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009025d200/0xfb36a14ee608d922 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb73 expref: 18 pid: 8451 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746066805.640505:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7998 00000100:00100000:0.0:1746066805.640511:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977313280:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066805.640518:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066805.640530:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009025d200/0xfb36a14ee608d922 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb73 expref: 18 pid: 8451 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746066805.640537:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009025d200/0xfb36a14ee608d922 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb73 expref: 18 pid: 8451 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746066805.640548:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009025d200/0xfb36a14ee608d922 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb73 expref: 18 pid: 8451 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746066805.640706:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:32043:x1830882977312896:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 5035us (6835us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066805.640713:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15465 00010000:00010000:0.0:1746066805.640826:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066805.640857:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977313280:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 345us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.640863:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7998 00000100:00100000:0.0:1746066805.641360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.641666:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977313152 00000100:00100000:2.0:1746066805.641670:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977313152 00010000:00010000:2.0:1746066805.641702:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009025da00/0xfb36a14ee608d8ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb57 expref: 32 pid: 21203 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746066805.641725:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7999 00000100:00100000:2.0:1746066805.641731:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977313152:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066805.641738:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066805.641748:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009025da00/0xfb36a14ee608d8ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb57 expref: 32 pid: 21203 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746066805.641756:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009025da00/0xfb36a14ee608d8ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb57 expref: 32 pid: 21203 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746066805.641882:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009025da00/0xfb36a14ee608d8ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb57 expref: 32 pid: 21203 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746066805.641892:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.641893:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.641898:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.641904:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.641922:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.641931:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976993792:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066805.644430:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dab240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066805.646199:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882976993664:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066805.646214:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066805.646249:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882977313024:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6547us (6746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.646257:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7997 00000100:00100000:0.0:1746066805.646325:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.646368:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977313536 00000100:00100000:3.0:1746066805.646374:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977313536 00000100:00100000:0.0:1746066805.646388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:3.0:1746066805.646402:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2949120->2953215) req@ffff88009ed71180 x1830882977313536/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746066805.646403:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:3.0:1746066805.646412:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed71180 with x1830882977313536 ext(2949120->2953215) 00002000:00010000:3.0:1746066805.646416:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed71180 00000100:00100000:3.0:1746066805.646451:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977313664 00000100:00100000:3.0:1746066805.646453:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977313664 00000100:00100000:1.0:1746066805.646453:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977314176 00000100:00100000:1.0:1746066805.646456:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977314176 00000100:00100000:3.0:1746066805.646469:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15466 00002000:00100000:1.0:1746066805.646471:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009ed70e00 x1830882977314176/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746066805.646474:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977313664:12345-192.168.202.57@tcp:101:cat.0 00002000:00100000:1.0:1746066805.646478:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed70e00 with x1830882977314176 ext(1048576->2097151) 00002000:00010000:1.0:1746066805.646480:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed70e00 00010000:00010000:3.0:1746066805.646484:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.646504:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009025de00/0xfb36a14ee608da4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc53 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066805.646504:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7054 00000100:00100000:1.0:1746066805.646509:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:1966:x1830882977313536:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066805.646543:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976993920:192.168.202.57@tcp:106: 00000100:00100000:3.0:1746066805.646579:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.646590:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7055 00000100:00100000:3.0:1746066805.646594:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ed70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977314176:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066805.646611:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977313536:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 102us (286us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066805.646616:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7054 00002000:00100000:1.0:1746066805.646620:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2949120->2953215) req@ffff88009ed71180 x1830882977313536/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/4536 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.646626:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed71180 with x1830882977313536 ext(2949120->2953215) 00002000:00010000:1.0:1746066805.646628:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ed71180 00000100:00100000:0.0:1746066805.646809:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.647073:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977313920 00000100:00100000:1.0:1746066805.647076:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977313920 00000100:00100000:1.0:1746066805.647101:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15467 00000100:00100000:1.0:1746066805.647105:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:1966:x1830882977313920:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.647112:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.647120:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc61 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.647135:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da56 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc61 expref: 25 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.647143:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc61 expref: 25 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.648070:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935c0e00, rc 0) 00000100:00100000:1.0:1746066805.648092:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:1966:x1830882977313920:12345-192.168.202.57@tcp:101:cat.0 Request processed in 986us (1283us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066805.648097:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15467 00000100:00100000:0.0:1746066805.650439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.650620:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977313792 00000100:00100000:1.0:1746066805.650627:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977313792 00000100:00100000:1.0:1746066805.650658:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15468 00000100:00100000:1.0:1746066805.650665:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882977313792:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.651352:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.651368:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935c1000/0xfb36a14ee608da5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc5a expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.651386:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066805.651387:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066805.651393:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935c1000/0xfb36a14ee608da5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc5a expref: 25 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.651409:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935c1000/0xfb36a14ee608da5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc5a expref: 25 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.651418:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935c1000, rc 0) 00000100:00100000:1.0:1746066805.651453:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882977313792:12345-192.168.202.57@tcp:101:cat.0 Request processed in 788us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.651458:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15468 00000100:00100000:0.0:1746066805.652304:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.652478:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977314432 00000100:00100000:1.0:1746066805.652482:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977314432 00002000:00100000:1.0:1746066805.652518:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1703936->1708031) req@ffff88008c397b80 x1830882977314432/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.652526:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c397b80 with x1830882977314432 ext(1703936->1708031) 00002000:00010000:1.0:1746066805.652529:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c397b80 00000100:00100000:1.0:1746066805.652556:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7056 00000100:00100000:1.0:1746066805.652562:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977314432:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066805.652667:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977314432:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 105us (365us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066805.652671:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7056 00002000:00100000:1.0:1746066805.652693:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1703936->1708031) req@ffff88008c397b80 x1830882977314432/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/4536 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.652699:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c397b80 with x1830882977314432 ext(1703936->1708031) 00002000:00010000:1.0:1746066805.652702:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c397b80 00000100:00100000:2.0:1746066805.652764:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976993792:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066805.652776:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066805.652795:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882977313152:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 11064us (11436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.652801:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7999 00000100:00100000:2.0:1746066805.657356:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977314176:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 10753us (10959us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066805.657368:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7055 00002000:00100000:2.0:1746066805.657378:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009ed70e00 x1830882977314176/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.657386:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ed70e00 with x1830882977314176 ext(1048576->2097151) 00002000:00010000:2.0:1746066805.657391:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ed70e00 00002000:00010000:3.0:1746066805.657477:0:8451:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime: 1746066804 -> 1746066805 00002000:00010000:3.0:1746066805.657481:0:8451:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime: 1746066803 -> 1746066805 00002000:00010000:3.0:1746066805.657482:0:8451:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime: 1746066804 -> 1746066805 00000100:00100000:3.0:1746066805.657504:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976993920:192.168.202.57@tcp:106: 00010000:00010000:3.0:1746066805.657528:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009025de00/0xfb36a14ee608da4f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc53 expref: 18 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.657538:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009025de00/0xfb36a14ee608da4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc53 expref: 18 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066805.658875:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009025de00, rc 0) 00000100:00100000:3.0:1746066805.658961:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ed72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977313664:12345-192.168.202.57@tcp:101:cat.0 Request processed in 12484us (12553us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066805.658968:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15466 00000100:00100000:0.0:1746066805.659256:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.659294:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977314688 00000100:00100000:3.0:1746066805.659300:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977314688 00000100:00100000:3.0:1746066805.659334:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4280 00000100:00100000:3.0:1746066805.659340:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+258:32043:x1830882977314688:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:3.0:1746066805.659484:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:32043:x1830882977314688:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 143us (227us total) trans 8589944267 rc 0/0 00000100:00100000:3.0:1746066805.659498:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4280 00000100:00100000:0.0:1746066805.664597:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.664642:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.664661:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977314816 00000100:00100000:0.0:1746066805.664668:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977314816 00000100:00100000:0.0:1746066805.664724:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977314944 00000100:00100000:0.0:1746066805.664726:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977314944 00000100:00100000:1.0:1746066805.664732:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15469 00000100:00100000:1.0:1746066805.664740:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977314816:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.664756:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.664772:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee1ec00/0xfb36a14ee608da64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc68 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066805.664813:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976994048:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066805.664868:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066805.666556:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15470 00000100:00100000:0.0:1746066805.666568:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882977314944:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066805.666581:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066805.666593:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092490800/0xfb36a14ee608da6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc6f expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.666615:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092490800/0xfb36a14ee608da6b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc6f expref: 26 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.666624:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092490800/0xfb36a14ee608da6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc6f expref: 26 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.666655:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092490800, rc 0) 00000100:00100000:0.0:1746066805.666703:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882977314944:12345-192.168.202.57@tcp:101:cat.0 Request processed in 139us (2060us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066805.666708:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15470 00000100:00100000:1.0:1746066805.666837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.666874:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.666942:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976994048:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066805.666962:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1ec00/0xfb36a14ee608da64 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc68 expref: 18 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.666970:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1ec00/0xfb36a14ee608da64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc68 expref: 18 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.666980:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1ec00, rc 0) 00000100:00100000:1.0:1746066805.666997:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+17:1965:x1830882977314816:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2259us (2408us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066805.667002:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15469 00000100:00100000:1.0:1746066805.667012:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977315072 00000100:00100000:1.0:1746066805.667015:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977315072 00000100:00100000:1.0:1746066805.667031:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977315200 00000100:00100000:1.0:1746066805.667032:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977315200 00000100:00100000:1.0:1746066805.667043:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15471 00000100:00100000:1.0:1746066805.667047:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977315072:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.667056:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.667061:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da72 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc76 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.667074:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da72 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc76 expref: 28 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.667082:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da72 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc76 expref: 28 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.667088:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935c0e00, rc 0) 00000100:00100000:1.0:1746066805.667102:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977315072:12345-192.168.202.57@tcp:101:cat.0 Request processed in 55us (266us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066805.667107:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15471 00000100:00100000:1.0:1746066805.667117:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15472 00000100:00100000:1.0:1746066805.667121:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977315200:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.667127:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.667134:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935c1c00/0xfb36a14ee608da79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc7d expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066805.667159:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976994176:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066805.667190:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fc00 going to sleep for 11 seconds 00002000:00010000:1.0:1746066805.671234:0:8452:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime: 1746066804 -> 1746066805 00000100:00100000:1.0:1746066805.671261:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976994176:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066805.671288:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935c1c00/0xfb36a14ee608da79 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc7d expref: 32 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.671300:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935c1c00/0xfb36a14ee608da79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc7d expref: 32 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.671309:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935c1c00, rc 0) 00000100:00100000:1.0:1746066805.671667:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1963:x1830882977315200:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4542us (4790us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066805.671694:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15472 00000100:00100000:0.0:1746066805.675479:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.675549:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977315328 00000100:00100000:1.0:1746066805.675556:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977315328 00000100:00100000:1.0:1746066805.675588:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15473 00000100:00100000:1.0:1746066805.675594:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:32039:x1830882977315328:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.675608:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.675621:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc84 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.675644:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2117631) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 24 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.675651:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066805.675653:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066805.675655:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da80 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc84 expref: 28 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.675699:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2117631) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 24 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.675713:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2117631) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 24 pid: 21203 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066805.675723:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976994304:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066805.676966:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066805.681634:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976994304:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066805.681662:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da80 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc84 expref: 28 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.681706:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935c0e00, rc 0) 00000100:00100000:1.0:1746066805.681756:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:32039:x1830882977315328:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6161us (6284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.681764:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15473 00000100:00100000:0.0:1746066805.681773:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.681839:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977315456 00000100:00100000:3.0:1746066805.681845:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977315456 00002000:00100000:3.0:1746066805.681876:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (2097152->2117631) req@ffff88008c395880 x1830882977315456/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.681884:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395880 with x1830882977315456 ext(2097152->2117631) 00010000:00010000:3.0:1746066805.681889:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 25 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.681899:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 25 pid: 21203 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746066805.681905:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c395880 00000100:00100000:3.0:1746066805.681926:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2281 00000100:00100000:3.0:1746066805.681931:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882977315456:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066805.685138:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977315456:12345-192.168.202.57@tcp:4:cat.0 Request processed in 3198us (3356us total) trans 17179873773 rc 0/0 00000100:00100000:3.0:1746066805.685151:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2281 00002000:00100000:3.0:1746066805.685161:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (2097152->2117631) req@ffff88008c395880 x1830882977315456/t17179873773(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/448 e 0 to 0 dl 1746066816 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.685169:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395880 with x1830882977315456 ext(2097152->2117631) 00010000:00010000:3.0:1746066805.685182:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 27 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.685198:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 27 pid: 21203 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746066805.685204:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c395880 00000100:00100000:1.0:1746066805.689999:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.690087:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977315584 00000100:00100000:2.0:1746066805.690095:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977315584 00010000:00010000:2.0:1746066805.690124:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 27 pid: 21203 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066805.690149:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8000 00000100:00100000:2.0:1746066805.690157:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977315584:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066805.690167:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066805.690185:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 27 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.690195:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2117631) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 27 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.690214:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed4a000/0xfb36a14ee608d8c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2117631) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb34 expref: 27 pid: 21203 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.691357:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.691360:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.691367:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc84 expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.691381:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc84 expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.691412:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc84 expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.691423:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976994432:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066805.691782:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dab240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066805.693655:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882976994432:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066805.693669:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066805.693730:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882977315584:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3573us (3737us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.693738:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8000 00000100:00100000:0.0:1746066805.696379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.696487:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977315840 00000100:00100000:3.0:1746066805.696502:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977315840 00002000:00100000:3.0:1746066805.696537:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88008c396d80 x1830882977315840/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.696546:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396d80 with x1830882977315840 ext(2097152->3145727) 00002000:00010000:3.0:1746066805.696550:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c396d80 00000100:00100000:3.0:1746066805.697425:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7057 00000100:00100000:3.0:1746066805.697434:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977315840:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066805.716696:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977315840:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19244us (20303us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066805.716708:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7057 00002000:00100000:3.0:1746066805.716717:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88008c396d80 x1830882977315840/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.716726:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396d80 with x1830882977315840 ext(2097152->3145727) 00002000:00010000:3.0:1746066805.716730:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c396d80 00000100:00100000:0.0:1746066805.721276:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.721377:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977315968 00000100:00100000:1.0:1746066805.721384:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977315968 00000100:00100000:1.0:1746066805.721420:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15474 00000100:00100000:1.0:1746066805.721427:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:32039:x1830882977315968:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.721441:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.721456:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608da87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc8b expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.721480:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2953215) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 16 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.721503:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066805.721505:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066805.721508:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608da87 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc8b expref: 32 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.721534:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2953215) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 16 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.721545:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2953215) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 16 pid: 8451 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746066805.721555:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976994560:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066805.723094:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066805.724527:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976994560:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066805.724553:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608da87 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc8b expref: 32 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.724566:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935c1600, rc 0) 00000100:00100000:1.0:1746066805.724601:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:32039:x1830882977315968:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3174us (3332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.724608:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15474 00000100:00100000:0.0:1746066805.725006:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.725066:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977316096 00000100:00100000:3.0:1746066805.725071:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977316096 00002000:00100000:3.0:1746066805.725100:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2527232->2953215) req@ffff88008c397100 x1830882977316096/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.725113:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c397100 with x1830882977316096 ext(2527232->2953215) 00010000:00010000:3.0:1746066805.725119:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 17 pid: 8451 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.725130:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 17 pid: 8451 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746066805.725135:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c397100 00000100:00100000:3.0:1746066805.725157:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2282 00000100:00100000:3.0:1746066805.725162:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977316096:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066805.739256:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977316096:12345-192.168.202.57@tcp:4:cat.0 Request processed in 14084us (14240us total) trans 21474841074 rc 0/0 00000100:00100000:3.0:1746066805.739267:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2282 00002000:00100000:3.0:1746066805.739278:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2527232->2953215) req@ffff88008c397100 x1830882977316096/t21474841074(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/448 e 0 to 0 dl 1746066816 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.739287:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c397100 with x1830882977316096 ext(2527232->2953215) 00010000:00010000:3.0:1746066805.739294:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 19 pid: 8451 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746066805.739308:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 19 pid: 8451 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746066805.739313:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c397100 00000100:00100000:0.0:1746066805.746938:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.747057:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977316224 00000100:00100000:2.0:1746066805.747064:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977316224 00010000:00010000:2.0:1746066805.747095:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2527232->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 19 pid: 8451 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746066805.747120:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8001 00000100:00100000:2.0:1746066805.747126:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977316224:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066805.747138:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066805.747157:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->2953215) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 19 pid: 8451 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.747172:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->2953215) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 19 pid: 8451 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.747190:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b19b800/0xfb36a14ee608da41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2527232->2953215) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc45 expref: 19 pid: 8451 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746066805.747220:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.747221:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.747228:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608da87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc8b expref: 31 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.747235:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608da87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc8b expref: 31 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.747262:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608da87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc8b expref: 31 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.747273:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976994688:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066805.747336:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dab240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066805.750851:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882976994688:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066805.750872:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066805.750919:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+18:1963:x1830882977316224:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3792us (4109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.750929:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8001 00000100:00100000:0.0:1746066805.754622:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.754658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.754727:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.754751:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977316608 00000100:00100000:1.0:1746066805.754757:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977316608 00000100:00100000:2.0:1746066805.754775:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977316736 00000100:00100000:2.0:1746066805.754779:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977316736 00002000:00100000:1.0:1746066805.754790:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88008c394700 x1830882977316608/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.754796:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88008c395180 x1830882977316736/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.754803:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395180 with x1830882977316736 ext(3145728->4194303) 00002000:00100000:1.0:1746066805.754803:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394700 with x1830882977316608 ext(2097152->3145727) 00002000:00010000:2.0:1746066805.754807:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c395180 00002000:00010000:1.0:1746066805.754807:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c394700 00000100:00100000:2.0:1746066805.754821:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977316992 00000100:00100000:2.0:1746066805.754823:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977316992 00002000:00100000:2.0:1746066805.754832:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88008c396680 x1830882977316992/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.754837:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396680 with x1830882977316992 ext(3145728->4194303) 00002000:00010000:2.0:1746066805.754840:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c396680 00000100:00100000:1.0:1746066805.754868:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7058 00000100:00100000:1.0:1746066805.754874:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977316736:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066805.754914:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7059 00000100:00100000:2.0:1746066805.754921:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977316608:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066805.755071:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7060 00000100:00100000:0.0:1746066805.755081:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977316992:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066805.766308:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977316608:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11380us (11686us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066805.766320:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7059 00002000:00100000:2.0:1746066805.766335:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88008c394700 x1830882977316608/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.766344:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394700 with x1830882977316608 ext(2097152->3145727) 00002000:00010000:2.0:1746066805.766349:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c394700 00000100:00100000:2.0:1746066805.773314:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977316992:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18229us (18579us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066805.773325:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7060 00002000:00100000:2.0:1746066805.773334:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88008c396680 x1830882977316992/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.773349:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396680 with x1830882977316992 ext(3145728->4194303) 00002000:00010000:2.0:1746066805.773354:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c396680 00000100:00100000:1.0:1746066805.777284:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977316736:12345-192.168.202.57@tcp:3:cat.0 Request processed in 22403us (22618us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066805.777294:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7058 00002000:00100000:1.0:1746066805.777303:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88008c395180 x1830882977316736/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.777312:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395180 with x1830882977316736 ext(3145728->4194303) 00002000:00010000:1.0:1746066805.777317:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c395180 00000100:00100000:0.0:1746066805.788826:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.788927:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977317248 00000100:00100000:1.0:1746066805.788935:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977317248 00002000:00100000:1.0:1746066805.788972:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88008c397800 x1830882977317248/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.788981:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c397800 with x1830882977317248 ext(4194304->5091327) 00002000:00010000:1.0:1746066805.788985:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c397800 00000100:00100000:1.0:1746066805.789016:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7061 00000100:00100000:1.0:1746066805.789022:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977317248:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066805.791431:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.791503:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977317504 00000100:00100000:3.0:1746066805.791511:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977317504 00000100:00100000:3.0:1746066805.791548:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10181 00000100:00100000:3.0:1746066805.791555:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+14:32052:x1830882977317504:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066805.791574:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066805.791589:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608da8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc92 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.791670:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0a4000/0xfb36a14ee608da95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791702:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0a4000/0xfb36a14ee608da95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791711:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0a4000/0xfb36a14ee608da95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791723:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608da9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791728:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608da9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791733:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608da9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791820:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608daa3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791829:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608daa3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791834:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608daa3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:3.0:1746066805.791844:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066805.791907:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0a4000/0xfb36a14ee608da95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791913:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0a4000/0xfb36a14ee608da95 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791918:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0a4000/0xfb36a14ee608da95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791923:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0a4000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066805.791926:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0a4000/0xfb36a14ee608da95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791931:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0a4000/0xfb36a14ee608da95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791939:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066805.791942:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066805.791946:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0a4000/0xfb36a14ee608da95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791950:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0a4000/0xfb36a14ee608da95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791964:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608da9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791969:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608da9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791973:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608da9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791980:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092489800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066805.791982:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608da9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791985:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608da9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791990:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012dc13900) 00010000:00010000:3.0:1746066805.791991:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066805.791993:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608da9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.791997:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092489800/0xfb36a14ee608da9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:3.0:1746066805.792022:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0a5000/0xfb36a14ee608da8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc92 expref: 17 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.792034:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608daa3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc92 expref: 16 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.792040:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066805.792041:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066805.792043:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092489e00, rc 0) 00000100:00100000:3.0:1746066805.792074:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:32052:x1830882977317504:12345-192.168.202.57@tcp:101:cat.0 Request processed in 519us (648us total) trans 8589944268 rc 0/0 00000100:00100000:3.0:1746066805.792079:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10181 00000100:00100000:1.0:1746066805.807444:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977317248:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18412us (18616us total) trans 0 rc 897024/897024 00000100:00100000:1.0:1746066805.807455:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7061 00002000:00100000:1.0:1746066805.807467:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88008c397800 x1830882977317248/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.807475:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c397800 with x1830882977317248 ext(4194304->5091327) 00002000:00010000:1.0:1746066805.807479:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c397800 00000100:00100000:0.0:1746066805.807486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.807565:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977317760 00000100:00100000:2.0:1746066805.807571:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977317760 00000100:00100000:2.0:1746066805.807598:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4281 00000100:00100000:2.0:1746066805.807603:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:32052:x1830882977317760:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066805.808168:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:32052:x1830882977317760:12345-192.168.202.57@tcp:35:cat.0 Request processed in 564us (682us total) trans 8589944269 rc 0/0 00000100:00100000:2.0:1746066805.808173:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4281 00000100:00100000:0.0:1746066805.813869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.813901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.813928:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977317888 00000100:00100000:1.0:1746066805.813936:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977317888 00000100:00100000:1.0:1746066805.813973:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977318016 00000100:00100000:1.0:1746066805.813975:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977318016 00000100:00100000:0.0:1746066805.813976:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.814724:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977318144 00000100:00100000:1.0:1746066805.814728:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977318144 00000100:00100000:1.0:1746066805.814749:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15475 00000100:00100000:1.0:1746066805.814756:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977317888:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.814771:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.814786:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a50a2200/0xfb36a14ee608dab1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fc99 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066805.814858:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15476 00000100:00100000:0.0:1746066805.814870:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977318016:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066805.814877:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066805.814885:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a489f000/0xfb36a14ee608dab8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fca0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.814901:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.814903:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.814909:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a489f000/0xfb36a14ee608dab8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca0 expref: 27 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.814920:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a489f000/0xfb36a14ee608dab8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca0 expref: 27 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.814928:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a489f000, rc 0) 00000100:00100000:0.0:1746066805.814960:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977318016:12345-192.168.202.57@tcp:101:cat.0 Request processed in 97us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.814965:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15476 00000100:00100000:0.0:1746066805.814977:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15477 00000100:00100000:0.0:1746066805.814982:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977318144:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066805.814986:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066805.814991:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608dabf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fca7 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.814999:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.815000:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066805.815003:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608dabf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca7 expref: 20 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.815011:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608dabf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca7 expref: 20 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066805.815020:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a489ec00, rc 0) 00000100:00100000:0.0:1746066805.815030:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977318144:12345-192.168.202.57@tcp:101:cat.0 Request processed in 49us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.815034:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15477 00000100:00100000:1.0:1746066805.815074:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976994816:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066805.815089:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.815104:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977318400 00000100:00100000:0.0:1746066805.815107:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977318400 00000100:00100000:1.0:1746066805.815114:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066805.815128:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10182 00000100:00100000:0.0:1746066805.815133:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:32048:x1830882977318400:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066805.815143:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066805.815153:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a386e00/0xfb36a14ee608dac6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fcae expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.815230:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96000/0xfb36a14ee608dacd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815239:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96000/0xfb36a14ee608dacd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815246:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96000/0xfb36a14ee608dacd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815255:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608dad4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815260:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608dad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815265:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608dad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815352:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96400/0xfb36a14ee608dadb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815359:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96400/0xfb36a14ee608dadb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815364:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96400/0xfb36a14ee608dadb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:0.0:1746066805.815371:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066805.815434:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96000/0xfb36a14ee608dacd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815440:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96000/0xfb36a14ee608dacd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815445:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96000/0xfb36a14ee608dacd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815450:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eb96000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066805.815453:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96000/0xfb36a14ee608dacd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815459:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96000/0xfb36a14ee608dacd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815467:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066805.815470:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066805.815473:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96000/0xfb36a14ee608dacd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815477:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96000/0xfb36a14ee608dacd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815504:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608dad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815509:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608dad4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815512:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608dad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815515:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009eb97e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066805.815517:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608dad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815521:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608dad4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815525:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a73fa400) 00010000:00010000:0.0:1746066805.815527:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066805.815529:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608dad4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815532:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb97e00/0xfb36a14ee608dad4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066805.815562:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a386e00/0xfb36a14ee608dac6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcae expref: 20 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.815571:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96400/0xfb36a14ee608dadb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcae expref: 19 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.815576:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066805.815579:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066805.815580:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009eb96400, rc 0) 00000100:00100000:0.0:1746066805.815614:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:32048:x1830882977318400:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 480us (523us total) trans 8589944270 rc 0/0 00000100:00100000:0.0:1746066805.815619:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10182 00000100:00100000:0.0:1746066805.817517:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.817791:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977318656 00000100:00100000:2.0:1746066805.817796:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977318656 00000100:00100000:2.0:1746066805.817833:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10183 00000100:00100000:2.0:1746066805.817839:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:32053:x1830882977318656:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066805.817855:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.817866:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46200/0xfb36a14ee608dae9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fcb5 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.817930:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b47600/0xfb36a14ee608daf0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.817938:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b47600/0xfb36a14ee608daf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.817945:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b47600/0xfb36a14ee608daf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.817953:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46000/0xfb36a14ee608daf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.817958:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46000/0xfb36a14ee608daf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.817962:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46000/0xfb36a14ee608daf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818025:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608dafe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818031:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608dafe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818036:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608dafe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:2.0:1746066805.818041:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066805.818091:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b47600/0xfb36a14ee608daf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818095:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b47600/0xfb36a14ee608daf0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818100:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b47600/0xfb36a14ee608daf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818104:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b47600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066805.818106:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b47600/0xfb36a14ee608daf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818110:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b47600/0xfb36a14ee608daf0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818117:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066805.818119:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066805.818122:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b47600/0xfb36a14ee608daf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818127:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b47600/0xfb36a14ee608daf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818148:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46000/0xfb36a14ee608daf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818152:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46000/0xfb36a14ee608daf7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818156:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46000/0xfb36a14ee608daf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818159:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b46000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066805.818161:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46000/0xfb36a14ee608daf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818165:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46000/0xfb36a14ee608daf7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818169:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ec74e00) 00010000:00010000:2.0:1746066805.818171:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066805.818172:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46000/0xfb36a14ee608daf7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818176:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46000/0xfb36a14ee608daf7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066805.818198:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46200/0xfb36a14ee608dae9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcb5 expref: 262 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.818206:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608dafe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcb5 expref: 261 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.818211:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066805.818213:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066805.818214:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b46e00, rc 0) 00000100:00100000:2.0:1746066805.818242:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:32053:x1830882977318656:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 403us (729us total) trans 8589944271 rc 0/0 00000100:00100000:2.0:1746066805.818247:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10183 00000100:00100000:1.0:1746066805.825024:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976994816:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066805.825051:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a50a2200/0xfb36a14ee608dab1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc99 expref: 20 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.825064:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50a2200/0xfb36a14ee608dab1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc99 expref: 20 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066805.825129:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a50a2200, rc 0) 00000100:00100000:1.0:1746066805.827453:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977317888:12345-192.168.202.57@tcp:101:cat.0 Request processed in 12687us (13580us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066805.827466:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15475 00000100:00100000:0.0:1746066805.828953:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.829069:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.829102:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.829134:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977319168 00000100:00100000:0.0:1746066805.829141:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977319168 00000100:00100000:0.0:1746066805.829178:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4282 00000100:00100000:0.0:1746066805.829185:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:32048:x1830882977319168:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:0.0:1746066805.829347:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:32048:x1830882977319168:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 162us (243us total) trans 8589944272 rc 0/0 00000100:00100000:0.0:1746066805.829353:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4282 00000100:00100000:0.0:1746066805.829417:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977318784 00000100:00100000:0.0:1746066805.829420:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977318784 00000100:00100000:0.0:1746066805.829442:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 725 00000100:00100000:0.0:1746066805.829448:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b473480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:1963:x1830882977318784:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066805.829457:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066805.829475:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46e00/0xfb36a14ee608dafe lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcb5 expref: 261 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.829487:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066805.829501:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066805.829520:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b473480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:1963:x1830882977318784:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 72us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.829525:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 725 00000100:00100000:0.0:1746066805.829535:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977318912 00000100:00100000:0.0:1746066805.829537:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977318912 00000100:00100000:0.0:1746066805.829553:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 726 00000100:00100000:0.0:1746066805.829557:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977318912:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066805.829563:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066805.829571:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eb96400/0xfb36a14ee608dadb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcae expref: 20 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066805.829579:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066805.829582:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066805.829594:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977318912:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 37us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066805.829599:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 726 00000100:00100000:0.0:1746066805.837525:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.837583:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977319424 00000100:00100000:1.0:1746066805.837596:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977319424 00002000:00100000:1.0:1746066805.837631:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009b473480 x1830882977319424/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.837640:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b473480 with x1830882977319424 ext(0->1048575) 00002000:00010000:1.0:1746066805.837653:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b473480 00000100:00100000:1.0:1746066805.837709:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7062 00000100:00100000:1.0:1746066805.837716:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977319424:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066805.888845:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.889040:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977319424:12345-192.168.202.57@tcp:3:cat.0 Request processed in 51322us (51519us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066805.889050:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7062 00002000:00100000:1.0:1746066805.889059:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009b473480 x1830882977319424/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.889068:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b473480 with x1830882977319424 ext(0->1048575) 00002000:00010000:1.0:1746066805.889073:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b473480 00000100:00100000:2.0:1746066805.889138:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977319552 00000100:00100000:2.0:1746066805.889145:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977319552 00000100:00100000:2.0:1746066805.889173:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15478 00000100:00100000:2.0:1746066805.889179:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+27:32048:x1830882977319552:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066805.889191:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.889205:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fcbc expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.889229:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608da17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc37 expref: 27 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.889238:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935c1000/0xfb36a14ee608da5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc5a expref: 28 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.889243:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.889245:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.889248:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1052672->1617919] (req 1052672->1617919) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 28 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.889271:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800935c1000/0xfb36a14ee608da5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc5a expref: 28 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.889280:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800935c1000/0xfb36a14ee608da5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc5a expref: 28 pid: 8452 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746066805.889290:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976994944:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066805.889368:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608da17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc37 expref: 27 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.889375:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608da17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc37 expref: 27 pid: 8451 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066805.889383:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976995072:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066805.889408:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dab240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066805.892154:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976994944:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066805.892166:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882976995072:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066805.892186:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1052672->1617919] (req 1052672->1617919) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 28 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.892199:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b46400, rc 0) 00000100:00100000:2.0:1746066805.892246:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+28:32048:x1830882977319552:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3065us (3406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.892253:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15478 00000100:00100000:0.0:1746066805.892722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.892803:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977319808 00000100:00100000:1.0:1746066805.892809:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977319808 00010000:00010000:1.0:1746066805.892832:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608da17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc37 expref: 28 pid: 8451 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066805.892850:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8002 00000100:00100000:1.0:1746066805.892857:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b470a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977319808:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066805.892866:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066805.892883:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608da17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc37 expref: 28 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066805.892892:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608da17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc37 expref: 28 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066805.892911:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608da17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc37 expref: 28 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066805.892936:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066805.892956:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b470a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977319808:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 100us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066805.892961:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8002 00000100:00100000:0.0:1746066805.894755:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.894833:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977319680 00000100:00100000:2.0:1746066805.894838:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977319680 00010000:00010000:2.0:1746066805.894857:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800935c1000/0xfb36a14ee608da5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc5a expref: 28 pid: 8452 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746066805.894882:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8003 00000100:00100000:2.0:1746066805.894887:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b472a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882977319680:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066805.894894:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066805.894905:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800935c1000/0xfb36a14ee608da5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc5a expref: 28 pid: 8452 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746066805.894913:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800935c1000/0xfb36a14ee608da5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc5a expref: 28 pid: 8452 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746066805.894928:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935c1000/0xfb36a14ee608da5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc5a expref: 28 pid: 8452 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746066805.897952:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.897957:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.897967:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1052672->1617919) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.897976:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1052672->1617919) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.898016:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1052672->1617919) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.898027:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976995200:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066805.898107:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dab240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066805.898803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.898873:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977319936 00000100:00100000:2.0:1746066805.898879:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977319936 00000100:00100000:2.0:1746066805.898909:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15479 00000100:00100000:2.0:1746066805.898914:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:32052:x1830882977319936:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066805.898926:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.898938:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b46800/0xfb36a14ee608db13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fcc3 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.898956:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.898961:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066805.898963:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066805.898965:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b46800/0xfb36a14ee608db13 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcc3 expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.898981:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1708031) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.898991:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1708031) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 31 pid: 8451 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066805.899000:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976995328:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066805.899767:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1daba80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.904074:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882976995328:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066805.904077:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066805.904097:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b46800/0xfb36a14ee608db13 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcc3 expref: 20 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066805.904113:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b46800, rc 0) 00000100:00100000:3.0:1746066805.904152:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:32052:x1830882977319936:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5238us (5350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.904156:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976995200:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066805.904160:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15479 00010000:00010000:2.0:1746066805.904164:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066805.904181:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b472a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882977319680:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 9294us (9430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.904188:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8003 00000100:00100000:1.0:1746066805.904447:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977320192 00000100:00100000:1.0:1746066805.904453:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977320192 00002000:00100000:1.0:1746066805.904480:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x390:0x0] (1052672->1056767) req@ffff88009b471500 x1830882977320192/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.904498:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b471500 with x1830882977320192 ext(1052672->1056767) 00002000:00010000:1.0:1746066805.904501:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b471500 00000100:00100000:1.0:1746066805.904523:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7063 00000100:00100000:1.0:1746066805.904528:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977320192:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066805.904641:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977320192:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 113us (565us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066805.904646:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7063 00002000:00100000:1.0:1746066805.904650:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x390:0x0] (1052672->1056767) req@ffff88009b471500 x1830882977320192/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/4536 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.904661:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b471500 with x1830882977320192 ext(1052672->1056767) 00002000:00010000:1.0:1746066805.904663:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b471500 00000100:00100000:0.0:1746066805.908801:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.910967:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977320320 00000100:00100000:2.0:1746066805.910978:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977320320 00002000:00100000:2.0:1746066805.911020:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1486848->1708031) req@ffff88008c394a80 x1830882977320320/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.911028:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394a80 with x1830882977320320 ext(1486848->1708031) 00010000:00010000:2.0:1746066805.911037:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 32 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066805.911048:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 32 pid: 8451 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746066805.911054:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c394a80 00000100:00100000:2.0:1746066805.911083:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2283 00000100:00100000:2.0:1746066805.911091:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977320320:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066805.915203:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.915280:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977320576 00000100:00100000:1.0:1746066805.915288:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977320576 00002000:00100000:1.0:1746066805.915321:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x390:0x0] (1613824->1617919) req@ffff88012c7b2050 x1830882977320576/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.915332:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c7b2050 with x1830882977320576 ext(1613824->1617919) 00002000:00010000:1.0:1746066805.915336:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c7b2050 00000100:00100000:1.0:1746066805.915364:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7064 00000100:00100000:1.0:1746066805.915369:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c7b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977320576:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066805.915509:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c7b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977320576:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 139us (313us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066805.915515:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7064 00002000:00100000:1.0:1746066805.915519:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x390:0x0] (1613824->1617919) req@ffff88012c7b2050 x1830882977320576/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/4536 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.915525:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c7b2050 with x1830882977320576 ext(1613824->1617919) 00002000:00010000:1.0:1746066805.915528:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c7b2050 00000100:00100000:2.0:1746066805.919967:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977320320:12345-192.168.202.57@tcp:4:cat.0 Request processed in 8869us (11164us total) trans 21474841075 rc 0/0 00000100:00100000:2.0:1746066805.919978:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2283 00002000:00100000:2.0:1746066805.919988:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1486848->1708031) req@ffff88008c394a80 x1830882977320320/t21474841075(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/448 e 0 to 0 dl 1746066816 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.919996:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394a80 with x1830882977320320 ext(1486848->1708031) 00010000:00010000:2.0:1746066805.920005:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 34 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066805.920022:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 34 pid: 8451 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746066805.920028:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c394a80 00000100:00100000:0.0:1746066805.924600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.925388:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977320704 00000100:00100000:2.0:1746066805.925396:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977320704 00010000:00010000:2.0:1746066805.925521:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 34 pid: 8451 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066805.925559:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8004 00000100:00100000:2.0:1746066805.925566:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977320704:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066805.925577:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066805.925593:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 34 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066805.925604:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->1708031) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 34 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066805.925624:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009025c400/0xfb36a14ee608da48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->1708031) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc4c expref: 34 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066805.925651:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.925652:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.925658:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b46800/0xfb36a14ee608db13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcc3 expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.925670:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b46800/0xfb36a14ee608db13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcc3 expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.925718:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b46800/0xfb36a14ee608db13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcc3 expref: 19 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066805.925728:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976995456:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066805.925804:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dab240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066805.927196:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976995456:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066805.927208:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066805.927240:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977320704:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1675us (2647us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.927247:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8004 00000100:00100000:0.0:1746066805.933540:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.933587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.933767:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977321088 00000100:00100000:3.0:1746066805.933775:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977321088 00002000:00100000:3.0:1746066805.933813:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88008c396a00 x1830882977321088/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.933822:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396a00 with x1830882977321088 ext(1048576->2097151) 00002000:00010000:3.0:1746066805.933826:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c396a00 00000100:00100000:3.0:1746066805.933853:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977321216 00000100:00100000:3.0:1746066805.933855:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977321216 00002000:00100000:3.0:1746066805.933868:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88008c397b80 x1830882977321216/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 504/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.933874:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c397b80 with x1830882977321216 ext(1048576->2097151) 00002000:00010000:3.0:1746066805.933877:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c397b80 00000100:00100000:3.0:1746066805.933889:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7065 00000100:00100000:3.0:1746066805.933894:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+20:1965:x1830882977321088:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066805.934505:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7066 00000100:00100000:2.0:1746066805.934513:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882977321216:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066805.953843:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+20:1965:x1830882977321088:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 19940us (20303us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066805.953853:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7065 00002000:00100000:3.0:1746066805.953862:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88008c396a00 x1830882977321088/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.953877:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396a00 with x1830882977321088 ext(1048576->2097151) 00002000:00010000:3.0:1746066805.953882:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c396a00 00000100:00100000:0.0:1746066805.954598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.954796:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977321472 00000100:00100000:1.0:1746066805.954804:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977321472 00000100:00100000:1.0:1746066805.954844:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10184 00000100:00100000:1.0:1746066805.954851:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:32058:x1830882977321472:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.954866:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.954879:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ec00/0xfb36a14ee608db1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fcca expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.954960:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608db21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.954970:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608db21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.954979:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608db21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.954989:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e800/0xfb36a14ee608db28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.954994:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e800/0xfb36a14ee608db28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.954999:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e800/0xfb36a14ee608db28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:3.0:1746066805.955009:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882977321216:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 20496us (21421us total) trans 0 rc 483328/483328 00000100:00100000:3.0:1746066805.955016:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7066 00002000:00100000:3.0:1746066805.955022:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88008c397b80 x1830882977321216/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 504/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 483328/483328 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.955030:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c397b80 with x1830882977321216 ext(1048576->2097151) 00002000:00010000:3.0:1746066805.955034:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c397b80 00010000:00010000:1.0:1746066805.955081:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608db2f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955088:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608db2f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955094:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608db2f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746066805.955101:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066805.955168:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608db21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955174:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608db21 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955182:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608db21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955187:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b5e600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066805.955190:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608db21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955195:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608db21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955203:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066805.955205:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066805.955208:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608db21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955213:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e600/0xfb36a14ee608db21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955224:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e800/0xfb36a14ee608db28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955229:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e800/0xfb36a14ee608db28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955233:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e800/0xfb36a14ee608db28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955237:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b5e800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066805.955239:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e800/0xfb36a14ee608db28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955243:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e800/0xfb36a14ee608db28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955251:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d3b8f00) 00010000:00010000:1.0:1746066805.955253:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066805.955254:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e800/0xfb36a14ee608db28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955258:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5e800/0xfb36a14ee608db28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066805.955285:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5ec00/0xfb36a14ee608db1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcca expref: 263 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.955293:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608db2f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcca expref: 262 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066805.955298:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066805.955299:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066805.955301:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5fe00, rc 0) 00000100:00100000:1.0:1746066805.955330:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:32058:x1830882977321472:12345-192.168.202.57@tcp:101:cat.0 Request processed in 480us (734us total) trans 8589944273 rc 0/0 00000100:00100000:1.0:1746066805.955335:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10184 00000100:00100000:0.0:1746066805.965814:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.965886:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977321728 00000100:00100000:2.0:1746066805.965895:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977321728 00000100:00100000:2.0:1746066805.965951:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4283 00000100:00100000:2.0:1746066805.965960:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:32058:x1830882977321728:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066805.966199:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:32058:x1830882977321728:12345-192.168.202.57@tcp:35:cat.0 Request processed in 239us (389us total) trans 8589944274 rc 0/0 00000100:00100000:2.0:1746066805.966205:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4283 00000100:00100000:0.0:1746066805.969297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.969374:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977321856 00000100:00100000:2.0:1746066805.969380:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977321856 00000100:00100000:2.0:1746066805.969476:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 727 00000100:00100000:2.0:1746066805.969483:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:1964:x1830882977321856:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066805.969504:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066805.969524:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608db2f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcca expref: 263 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.970295:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066805.970300:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066805.970375:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:1964:x1830882977321856:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 891us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.970381:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 727 00000100:00100000:0.0:1746066805.974593:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.974632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.974663:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.974709:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066805.974744:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.974809:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977322112 00000100:00100000:1.0:1746066805.974817:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977322112 00000100:00100000:1.0:1746066805.974849:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977321984 00000100:00100000:1.0:1746066805.974851:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977321984 00000100:00100000:1.0:1746066805.974866:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15480 00000100:00100000:1.0:1746066805.974872:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1966:x1830882977322112:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066805.974885:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066805.974898:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b5fe00/0xfb36a14ee608db3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fcd8 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066805.974938:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976995584:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066805.974999:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066805.975012:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977322368 00000100:00100000:1.0:1746066805.975015:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977322368 00002000:00100000:1.0:1746066805.975036:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88008c395180 x1830882977322368/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.975044:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395180 with x1830882977322368 ext(2097152->3145727) 00002000:00010000:1.0:1746066805.975048:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c395180 00000100:00100000:1.0:1746066805.975063:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977322624 00000100:00100000:1.0:1746066805.975065:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977322624 00002000:00100000:1.0:1746066805.975078:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88008c397800 x1830882977322624/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.975084:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c397800 with x1830882977322624 ext(2097152->3145727) 00002000:00010000:1.0:1746066805.975087:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c397800 00000100:00100000:1.0:1746066805.975095:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977322880 00000100:00100000:1.0:1746066805.975097:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977322880 00002000:00100000:1.0:1746066805.975108:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88008c394a80 x1830882977322880/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066805.975114:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394a80 with x1830882977322880 ext(3145728->4194303) 00002000:00010000:1.0:1746066805.975116:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c394a80 00000100:00100000:1.0:1746066805.975126:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7067 00000100:00100000:1.0:1746066805.975131:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977322368:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066805.975784:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15481 00000100:00100000:2.0:1746066805.975791:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1966:x1830882977321984:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066805.975798:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7068 00000100:00100000:3.0:1746066805.975804:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977322624:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:2.0:1746066805.975804:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.975813:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b47e00/0xfb36a14ee608db44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fcd1 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.975823:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.975825:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.975831:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b47e00/0xfb36a14ee608db44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd1 expref: 34 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.975842:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b47e00/0xfb36a14ee608db44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd1 expref: 34 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.975850:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b47e00, rc 0) 00000100:00100000:2.0:1746066805.975873:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1966:x1830882977321984:12345-192.168.202.57@tcp:101:cat.0 Request processed in 83us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.975877:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15481 00000100:00100000:2.0:1746066805.975896:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7069 00000100:00100000:2.0:1746066805.975901:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:1963:x1830882977322880:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066805.980536:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976995584:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066805.980568:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b5fe00/0xfb36a14ee608db3d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd8 expref: 28 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.980581:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b5fe00/0xfb36a14ee608db3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd8 expref: 28 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.980595:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5fe00, rc 0) 00000100:00100000:2.0:1746066805.980652:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1966:x1830882977322112:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5778us (6064us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066805.980660:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15480 00000100:00100000:0.0:1746066805.983717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066805.983885:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977323008 00000100:00100000:2.0:1746066805.983892:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977323008 00000100:00100000:2.0:1746066805.984129:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15482 00000100:00100000:2.0:1746066805.984137:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:32053:x1830882977323008:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066805.984152:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066805.984166:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fcdf expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.984189:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b46800/0xfb36a14ee608db13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcc3 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.984201:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b47e00/0xfb36a14ee608db44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd1 expref: 35 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.984208:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.984210:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066805.984213:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1851392->2097151] (req 1851392->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 35 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.984415:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b47e00/0xfb36a14ee608db44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd1 expref: 35 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066805.984427:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b47e00/0xfb36a14ee608db44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd1 expref: 35 pid: 21973 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746066805.984437:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976995712:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066805.984962:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b46800/0xfb36a14ee608db13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcc3 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.984971:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b46800/0xfb36a14ee608db13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcc3 expref: 23 pid: 8452 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066805.984978:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976995840:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066805.985935:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dabf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066805.986268:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977322624:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10461us (11555us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066805.986277:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7068 00002000:00100000:3.0:1746066805.986286:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88008c397800 x1830882977322624/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.986294:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c397800 with x1830882977322624 ext(2097152->3145727) 00002000:00010000:3.0:1746066805.986298:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c397800 00000100:00100000:0.0:1746066805.988630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066805.988703:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977323264 00000100:00100000:3.0:1746066805.988711:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977323264 00002000:00100000:3.0:1746066805.988751:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8800a5bb1180 x1830882977323264/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/0 e 0 to 0 dl 1746066816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066805.988765:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb1180 with x1830882977323264 ext(1048576->2097151) 00010000:00010000:3.0:1746066805.988773:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092b47e00/0xfb36a14ee608db44 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd1 expref: 36 pid: 21973 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066805.988784:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092b47e00/0xfb36a14ee608db44 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd1 expref: 36 pid: 21973 timeout: 867 lvb_type: 1 00002000:00010000:3.0:1746066805.988791:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5bb1180 00000100:00100000:3.0:1746066805.988813:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2284 00000100:00100000:3.0:1746066805.988821:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882977323264:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066805.989098:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976995712:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066805.989325:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977322880:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13423us (14579us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066805.989331:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7069 00002000:00100000:2.0:1746066805.989337:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88008c394a80 x1830882977322880/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066805.989344:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c394a80 with x1830882977322880 ext(3145728->4194303) 00002000:00010000:2.0:1746066805.989347:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c394a80 00000100:00100000:2.0:1746066805.989973:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882976995840:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066805.989994:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1851392->2097151] (req 1851392->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 37 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066805.990007:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5f600, rc 0) 00000100:00100000:2.0:1746066805.990028:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:32053:x1830882977323008:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 5892us (6357us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.990034:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15482 00000100:00100000:0.0:1746066805.991610:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066805.992340:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977322368:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17207us (17674us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066805.992350:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7067 00002000:00100000:1.0:1746066805.992357:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88008c395180 x1830882977322368/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746066805.992358:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977323392 00000100:00100000:2.0:1746066805.992363:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977323392 00002000:00100000:1.0:1746066805.992365:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395180 with x1830882977322368 ext(2097152->3145727) 00002000:00010000:1.0:1746066805.992368:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c395180 00010000:00010000:2.0:1746066805.992384:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b46800/0xfb36a14ee608db13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcc3 expref: 20 pid: 8452 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066805.992403:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8005 00000100:00100000:2.0:1746066805.992408:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977323392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066805.992418:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066805.992431:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b46800/0xfb36a14ee608db13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcc3 expref: 20 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066805.992445:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b46800/0xfb36a14ee608db13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcc3 expref: 20 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066805.992465:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b46800/0xfb36a14ee608db13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcc3 expref: 20 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066805.992479:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066805.992507:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977323392:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 99us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066805.992513:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8005 00000100:00100000:3.0:1746066806.000300:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882977323264:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11472us (11667us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066806.000312:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2284 00002000:00100000:3.0:1746066806.000323:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8800a5bb1180 x1830882977323264/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:211/0 lens 488/440 e 0 to 0 dl 1746066816 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.000332:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb1180 with x1830882977323264 ext(1048576->2097151) 00010000:00010000:3.0:1746066806.000343:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092b47e00/0xfb36a14ee608db44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd1 expref: 35 pid: 21973 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.000356:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092b47e00/0xfb36a14ee608db44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd1 expref: 35 pid: 21973 timeout: 867 lvb_type: 1 00002000:00010000:3.0:1746066806.000363:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5bb1180 00000100:00100000:0.0:1746066806.001555:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.001633:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977323520 00000100:00100000:2.0:1746066806.001640:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977323520 00000100:00100000:3.0:1746066806.001770:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15483 00000100:00100000:3.0:1746066806.001778:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977323520:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066806.001790:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066806.001802:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092489800/0xfb36a14ee608db52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fce6 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.001818:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066806.001826:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092489800/0xfb36a14ee608db52 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fce6 expref: 20 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066806.001835:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092489800/0xfb36a14ee608db52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fce6 expref: 20 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066806.001847:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092489800, rc 0) 00000100:00100000:3.0:1746066806.001878:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977323520:12345-192.168.202.57@tcp:101:cat.0 Request processed in 101us (325us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066806.001883:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15483 00000100:00100000:2.0:1746066806.006979:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.007000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.007083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.007118:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977323648 00000100:00100000:1.0:1746066806.007125:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977323648 00010000:00010000:1.0:1746066806.007155:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b47e00/0xfb36a14ee608db44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd1 expref: 35 pid: 21973 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746066806.007188:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8006 00000100:00100000:1.0:1746066806.007196:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1963:x1830882977323648:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.007208:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.007223:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b47e00/0xfb36a14ee608db44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd1 expref: 35 pid: 21973 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.007234:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b47e00/0xfb36a14ee608db44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd1 expref: 35 pid: 21973 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.007254:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b47e00/0xfb36a14ee608db44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcd1 expref: 35 pid: 21973 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746066806.007387:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977323904 00000100:00100000:3.0:1746066806.007391:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977323904 00000100:00100000:3.0:1746066806.007420:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977323776 00000100:00100000:3.0:1746066806.007422:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977323776 00000100:00100000:3.0:1746066806.007440:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15484 00000100:00100000:3.0:1746066806.007445:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:32058:x1830882977323904:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066806.007455:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066806.007465:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b5e600/0xfb36a14ee608db59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fcf4 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.007482:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1052672->1617919) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 26 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.007498:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066806.007500:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066806.007503:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b5e600/0xfb36a14ee608db59 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcf4 expref: 28 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.007525:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1052672->1617919) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 26 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.007534:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1052672->1617919) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 26 pid: 8452 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.007544:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976995968:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066806.007607:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066806.007621:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15485 00000100:00100000:3.0:1746066806.007627:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977323776:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066806.007633:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066806.007639:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b5ec00/0xfb36a14ee608db60 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fced expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.007650:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066806.007655:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b5ec00/0xfb36a14ee608db60 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fced expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066806.007663:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b5ec00/0xfb36a14ee608db60 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fced expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066806.007695:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5ec00, rc 0) 00000100:00100000:3.0:1746066806.007713:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977323776:12345-192.168.202.57@tcp:101:cat.0 Request processed in 86us (630us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066806.007718:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15485 00010000:00010000:1.0:1746066806.007926:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.007928:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.007934:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 34 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.007947:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 34 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.007965:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 34 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.007973:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976996096:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066806.008009:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066806.009114:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976995968:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066806.009131:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b5e600/0xfb36a14ee608db59 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcf4 expref: 28 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.009140:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5e600, rc 0) 00000100:00100000:3.0:1746066806.009160:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:32058:x1830882977323904:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1716us (2160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.009165:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15484 00000100:00100000:0.0:1746066806.009739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.009810:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882976996096:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066806.009819:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.009838:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977323648:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2643us (2867us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.009845:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8006 00000100:00100000:3.0:1746066806.009897:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977324288 00000100:00100000:3.0:1746066806.009901:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977324288 00002000:00100000:3.0:1746066806.009926:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1851392->1855487) req@ffff8800a5bb0e00 x1830882977324288/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.009933:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb0e00 with x1830882977324288 ext(1851392->1855487) 00002000:00010000:3.0:1746066806.009936:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb0e00 00000100:00100000:3.0:1746066806.009949:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7070 00000100:00100000:3.0:1746066806.009954:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977324288:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066806.010060:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977324288:12345-192.168.202.57@tcp:3:cat.0 Request processed in 105us (322us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066806.010065:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7070 00002000:00100000:3.0:1746066806.010070:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1851392->1855487) req@ffff8800a5bb0e00 x1830882977324288/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/4536 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.010077:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb0e00 with x1830882977324288 ext(1851392->1855487) 00002000:00010000:3.0:1746066806.010302:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5bb0e00 00000100:00100000:0.0:1746066806.010706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.010815:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977324032 00000100:00100000:3.0:1746066806.010818:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977324032 00002000:00100000:3.0:1746066806.010835:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x390:0x0] (1052672->1617919) req@ffff8800a5bb1500 x1830882977324032/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.010842:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb1500 with x1830882977324032 ext(1052672->1617919) 00010000:00010000:3.0:1746066806.010847:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1052672->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 27 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.010857:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1052672->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 27 pid: 8452 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746066806.010863:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5bb1500 00000100:00100000:3.0:1746066806.010873:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2285 00000100:00100000:3.0:1746066806.010878:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977324032:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066806.011524:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.011557:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.011593:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977324416 00000100:00100000:3.0:1746066806.011597:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977324416 00000100:00100000:3.0:1746066806.011612:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977324544 00000100:00100000:3.0:1746066806.011613:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977324544 00000100:00100000:2.0:1746066806.011624:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15486 00000100:00100000:2.0:1746066806.011632:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977324416:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066806.011634:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15487 00000100:00100000:3.0:1746066806.011638:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977324544:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066806.011641:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066806.011644:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066806.011653:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608db6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd02 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.011653:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608db67 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fcfb expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066806.011702:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976996224:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066806.011702:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976996352:192.168.202.57@tcp:106: 00000100:00100000:2.0:1746066806.012843:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dabf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066806.012910:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.020000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.020203:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976996352:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066806.020229:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608db67 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcfb expref: 20 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.020242:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4af1a00/0xfb36a14ee608db67 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcfb expref: 20 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.020256:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4af1a00, rc 0) 00000100:00100000:2.0:1746066806.020290:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977324416:12345-192.168.202.57@tcp:101:cat.0 Request processed in 8658us (8766us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066806.020297:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15486 00000100:00100000:2.0:1746066806.020317:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977324672 00000100:00100000:2.0:1746066806.020322:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977324672 00000100:00100000:2.0:1746066806.020343:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15488 00000100:00100000:2.0:1746066806.020348:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:32053:x1830882977324672:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066806.020360:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.020370:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd09 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.020389:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a50a3200/0xfb36a14ee608d826 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fac4 expref: 35 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.020397:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350bcc00/0xfb36a14ee608d82d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97facb expref: 18 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.020402:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.020404:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.020406:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->1683455] (req 1048576->1683455) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 35 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.020432:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350bcc00/0xfb36a14ee608d82d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97facb expref: 18 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.020443:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350bcc00/0xfb36a14ee608d82d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97facb expref: 18 pid: 8112 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.020453:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976996480:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.020515:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a50a3200/0xfb36a14ee608d826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fac4 expref: 35 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.020521:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a50a3200/0xfb36a14ee608d826 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fac4 expref: 35 pid: 8450 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.020528:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976996608:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.020546:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dabf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066806.020827:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882976996224:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066806.020845:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608db6e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd02 expref: 30 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.020854:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608db6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd02 expref: 30 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.020861:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5ec00, rc 0) 00000100:00100000:2.0:1746066806.020879:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977324544:12345-192.168.202.57@tcp:101:cat.0 Request processed in 9240us (9321us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066806.020885:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15487 00000100:00100000:3.0:1746066806.026178:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977324032:12345-192.168.202.57@tcp:4:cat.0 Request processed in 15290us (15495us total) trans 17179873774 rc 0/0 00000100:00100000:3.0:1746066806.026190:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2285 00002000:00100000:3.0:1746066806.026200:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x390:0x0] (1052672->1617919) req@ffff8800a5bb1500 x1830882977324032/t17179873774(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/448 e 0 to 0 dl 1746066817 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.026207:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb1500 with x1830882977324032 ext(1052672->1617919) 00010000:00010000:3.0:1746066806.026216:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1052672->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 29 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.026226:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1052672->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 29 pid: 8452 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746066806.026232:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5bb1500 00000100:00100000:0.0:1746066806.026965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.027009:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977324800 00000100:00100000:1.0:1746066806.027015:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977324800 00010000:00010000:1.0:1746066806.027038:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a50a3200/0xfb36a14ee608d826 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fac4 expref: 36 pid: 8450 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.027059:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8007 00000100:00100000:1.0:1746066806.027065:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1965:x1830882977324800:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.027076:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.027091:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a50a3200/0xfb36a14ee608d826 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fac4 expref: 36 pid: 8450 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.027105:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a50a3200/0xfb36a14ee608d826 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fac4 expref: 36 pid: 8450 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.027127:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.027149:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1965:x1830882977324800:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 84us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.027154:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8007 00000100:00100000:2.0:1746066806.027254:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976996480:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.027264:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a50a3200/0xfb36a14ee608d826 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fac4 expref: 35 pid: 8450 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.027275:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882976996608:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.027296:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->1683455] (req 1048576->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 34 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.027303:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801367cde00, rc 0) 00000100:00100000:2.0:1746066806.027319:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:32053:x1830882977324672:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6971us (7328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.027324:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15488 00000100:00100000:0.0:1746066806.028614:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.028694:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977324928 00000100:00100000:2.0:1746066806.028699:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977324928 00010000:00010000:2.0:1746066806.028718:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350bcc00/0xfb36a14ee608d82d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97facb expref: 19 pid: 8112 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.028746:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8008 00000100:00100000:2.0:1746066806.028752:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977324928:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066806.028759:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066806.028772:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350bcc00/0xfb36a14ee608d82d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97facb expref: 19 pid: 8112 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.028784:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350bcc00/0xfb36a14ee608d82d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97facb expref: 19 pid: 8112 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.028797:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350bcc00/0xfb36a14ee608d82d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97facb expref: 19 pid: 8112 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.028806:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.028808:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.028813:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.028820:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.028843:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066806.028853:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976996736:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066806.028900:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dabf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066806.030971:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882976996736:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066806.030987:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066806.033026:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977324928:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4266us (4407us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.033038:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8008 00000100:00100000:0.0:1746066806.033215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.033558:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977325056 00000100:00100000:2.0:1746066806.033565:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977325056 00010000:00010000:2.0:1746066806.033588:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1052672->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 29 pid: 8452 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.033610:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8009 00000100:00100000:2.0:1746066806.033616:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977325056:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066806.033626:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066806.033644:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1052672->1617919) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 29 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.033653:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1052672->1617919) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 29 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.033672:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b46400/0xfb36a14ee608db0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1052672->1617919) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcbc expref: 29 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.033700:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.033702:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.033708:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b5e600/0xfb36a14ee608db59 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcf4 expref: 27 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.033715:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b5e600/0xfb36a14ee608db59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcf4 expref: 27 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.033740:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136b5e600/0xfb36a14ee608db59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcf4 expref: 27 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066806.033751:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976996864:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066806.033800:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dabf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.037413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.037597:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977325312 00000100:00100000:3.0:1746066806.037605:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977325312 00002000:00100000:3.0:1746066806.037640:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1679360->1683455) req@ffff88009ec2ea00 x1830882977325312/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.037650:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2ea00 with x1830882977325312 ext(1679360->1683455) 00002000:00010000:3.0:1746066806.037655:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2ea00 00000100:00100000:3.0:1746066806.037672:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7071 00000100:00100000:3.0:1746066806.037699:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977325312:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066806.037838:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977325312:12345-192.168.202.57@tcp:3:cat.0 Request processed in 139us (432us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066806.037843:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7071 00002000:00100000:3.0:1746066806.037849:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1679360->1683455) req@ffff88009ec2ea00 x1830882977325312/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/4536 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.037856:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2ea00 with x1830882977325312 ext(1679360->1683455) 00002000:00010000:3.0:1746066806.037859:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2ea00 00000100:00100000:0.0:1746066806.038358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.038411:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977325568 00000100:00100000:1.0:1746066806.038414:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977325568 00002000:00100000:1.0:1746066806.038432:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009ec2ca80 x1830882977325568/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.038439:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2ca80 with x1830882977325568 ext(1048576->2097151) 00002000:00010000:1.0:1746066806.038442:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2ca80 00000100:00100000:1.0:1746066806.038454:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7072 00000100:00100000:1.0:1746066806.038459:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977325568:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066806.040238:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882976996864:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066806.040256:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066806.040286:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882977325056:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6669us (7070us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.040294:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8009 00000100:00100000:0.0:1746066806.046004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.046066:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977325824 00000100:00100000:2.0:1746066806.046073:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977325824 00000100:00100000:2.0:1746066806.046130:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4284 00000100:00100000:2.0:1746066806.046138:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800997f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:32053:x1830882977325824:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066806.046302:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800997f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:32053:x1830882977325824:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 164us (305us total) trans 8589944275 rc 0/0 00000100:00100000:2.0:1746066806.046308:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4284 00000100:00100000:1.0:1746066806.046784:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1965:x1830882977325568:12345-192.168.202.57@tcp:3:cat.0 Request processed in 8323us (8425us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066806.046791:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7072 00002000:00100000:1.0:1746066806.046799:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009ec2ca80 x1830882977325568/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.046807:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2ca80 with x1830882977325568 ext(1048576->2097151) 00002000:00010000:1.0:1746066806.046811:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2ca80 00000100:00100000:0.0:1746066806.079963:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.080143:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977325952 00000100:00100000:3.0:1746066806.080155:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977325952 00000100:00100000:3.0:1746066806.080204:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10185 00000100:00100000:3.0:1746066806.080211:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:32063:x1830882977325952:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066806.080231:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066806.080245:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf000/0xfb36a14ee608db7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd10 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.080292:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf200/0xfb36a14ee608db83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.080303:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf200/0xfb36a14ee608db83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.080311:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf200/0xfb36a14ee608db83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.080323:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf400/0xfb36a14ee608db8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.080328:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf400/0xfb36a14ee608db8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.080332:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf400/0xfb36a14ee608db8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.080422:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.080430:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc29 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.080437:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.080460:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc29 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.080470:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc29 expref: 18 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.080632:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976996992:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066806.080725:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066806.082962:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976996992:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066806.082981:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:0.0:1746066806.083133:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.083602:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977326208 00000100:00100000:2.0:1746066806.083607:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977326208 00000100:00100000:2.0:1746066806.083649:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4285 00000100:00100000:2.0:1746066806.083656:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+19:7643:x1830882977326208:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066806.083875:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+20:7643:x1830882977326208:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 218us (741us total) trans 8589944276 rc 0/0 00000100:00100000:2.0:1746066806.083881:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4285 00000100:00100000:0.0:1746066806.087472:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.087657:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977326336 00000100:00100000:3.0:1746066806.087665:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977326336 00010000:00010000:3.0:1746066806.087720:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc29 expref: 20 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.087744:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8010 00000100:00100000:3.0:1746066806.087752:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977326336:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066806.087762:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066806.087768:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc29 expref: 20 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.087778:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc29 expref: 20 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.087795:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092490c00/0xfb36a14ee608da02 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc29 expref: 20 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.087824:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066806.087829:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.087837:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.087842:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.087870:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066806.087914:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:1964:x1830882977326336:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 163us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.087922:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8010 00010000:00010000:2.0:1746066806.088241:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088249:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:2.0:1746066806.088285:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:2.0:1746066806.088289:0:809:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746066806.088301:0:809:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088310:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088319:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf200/0xfb36a14ee608db83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088324:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf200/0xfb36a14ee608db83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088329:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf200/0xfb36a14ee608db83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088333:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecdf200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066806.088336:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf200/0xfb36a14ee608db83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088341:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf200/0xfb36a14ee608db83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088348:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066806.088351:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066806.088353:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf200/0xfb36a14ee608db83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088356:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf200/0xfb36a14ee608db83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088364:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf400/0xfb36a14ee608db8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088367:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf400/0xfb36a14ee608db8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088371:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf400/0xfb36a14ee608db8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088375:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecdf400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066806.088377:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf400/0xfb36a14ee608db8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088381:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf400/0xfb36a14ee608db8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088386:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012dc13900) 00010000:00010000:2.0:1746066806.088388:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066806.088390:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf400/0xfb36a14ee608db8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088393:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf400/0xfb36a14ee608db8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.088558:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf000/0xfb36a14ee608db7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd10 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.088570:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd10 expref: 7 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.088576:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.088578:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066806.088580:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ecdf600, rc 0) 00000100:00100000:2.0:1746066806.088602:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:32063:x1830882977325952:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 8392us (8646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.088608:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10185 00000100:00100000:0.0:1746066806.091301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.091330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.091358:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.091381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.091393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.091418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.091436:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977326592 00000100:00100000:0.0:1746066806.091442:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977326592 00000100:00100000:0.0:1746066806.091474:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977326848 00000100:00100000:0.0:1746066806.091476:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977326848 00000100:00100000:0.0:1746066806.091498:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977327104 00000100:00100000:0.0:1746066806.091500:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977327104 00000100:00100000:0.0:1746066806.091514:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977326464 00000100:00100000:0.0:1746066806.091515:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977326464 00000100:00100000:0.0:1746066806.091522:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977326720 00000100:00100000:0.0:1746066806.091524:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977326720 00000100:00100000:0.0:1746066806.091528:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977326976 00000100:00100000:0.0:1746066806.091530:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977326976 00000100:00100000:0.0:1746066806.091544:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15489 00000100:00100000:0.0:1746066806.091551:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977326592:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066806.091565:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.091580:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135f30800/0xfb36a14ee608db98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd1e expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.091620:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976997120:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066806.091702:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390840 going to sleep for 11 seconds 00000100:00080000:0.0:1746066806.091713:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746066806.091715:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066806.091804:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15490 00000100:00100000:0.0:1746066806.091811:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977326848:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066806.091818:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.091827:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608db9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd2c expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.091837:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.091839:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.091845:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608db9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd2c expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.091855:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608db9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd2c expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.091864:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5ec00, rc 0) 00000100:00100000:0.0:1746066806.091885:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977326848:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 75us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.091890:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15490 00000100:00100000:0.0:1746066806.091904:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15491 00000100:00100000:0.0:1746066806.091910:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977327104:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066806.091915:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.091921:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608dba6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd3a expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.091930:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.091931:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.091935:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608dba6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd3a expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.091943:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608dba6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd3a expref: 9 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.091953:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5fe00, rc 0) 00000100:00100000:0.0:1746066806.091966:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977327104:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 59us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.091970:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15491 00000100:00100000:0.0:1746066806.091978:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15492 00000100:00100000:0.0:1746066806.091983:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977326464:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066806.091988:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.091993:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b5fa00/0xfb36a14ee608dbad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd17 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.092001:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.092002:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.092006:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b5fa00/0xfb36a14ee608dbad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd17 expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.092014:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b5fa00/0xfb36a14ee608dbad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd17 expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.092020:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5fa00, rc 0) 00000100:00100000:0.0:1746066806.092034:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977326464:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 52us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.092038:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15492 00000100:00100000:0.0:1746066806.092046:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15493 00000100:00100000:0.0:1746066806.092052:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977326720:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066806.092059:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.092064:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b5f200/0xfb36a14ee608dbb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd25 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.092082:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976997248:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066806.092114:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.092177:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15494 00000100:00100000:0.0:1746066806.092183:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977326976:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066806.092189:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.092195:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135f31e00/0xfb36a14ee608dbbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd33 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.092203:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.092204:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.092208:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f31e00/0xfb36a14ee608dbbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd33 expref: 8 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.092215:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135f31e00/0xfb36a14ee608dbbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd33 expref: 8 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.092221:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f31e00, rc 0) 00000100:00100000:0.0:1746066806.092238:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977326976:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 57us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.092243:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15494 00000100:00100000:2.0:1746066806.095996:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882976997120:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066806.096031:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135f30800/0xfb36a14ee608db98 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd1e expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.096048:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135f30800/0xfb36a14ee608db98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd1e expref: 9 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.096069:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f30800, rc 0) 00000100:00100000:2.0:1746066806.096116:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977326592:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 4564us (4821us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066806.096123:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15489 00002000:00010000:1.0:1746066806.096203:0:21203:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime: 1746066803 -> 1746066805 00002000:00010000:1.0:1746066806.096206:0:21203:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime: 1746066803 -> 1746066805 00002000:00010000:1.0:1746066806.096208:0:21203:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime: 1746066803 -> 1746066805 00000100:00100000:1.0:1746066806.096216:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882976997248:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066806.096232:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b5f200/0xfb36a14ee608dbb4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd25 expref: 7 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.096240:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b5f200/0xfb36a14ee608dbb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd25 expref: 7 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.096251:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b5f200, rc 0) 00000100:00100000:1.0:1746066806.096273:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1964:x1830882977326720:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 4222us (4879us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066806.096278:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15493 00000100:00100000:0.0:1746066806.099215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.099348:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977327360 00000100:00100000:2.0:1746066806.099355:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977327360 00000100:00100000:1.0:1746066806.099997:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10186 00000100:00100000:1.0:1746066806.100007:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:32063:x1830882977327360:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066806.100025:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.100039:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c000/0xfb36a14ee608dbc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd41 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.100109:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dbc9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.100120:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd10 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.100126:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dbc9 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.100153:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd10 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.100162:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd10 expref: 8 pid: 809 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.100171:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976997376:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066806.100227:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a81fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.102025:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882976997376:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066806.102043:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dbc9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000100:00100000:0.0:1746066806.102450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.102517:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977327488 00000100:00100000:2.0:1746066806.102522:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977327488 00010000:00010000:2.0:1746066806.102545:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd10 expref: 9 pid: 809 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.102576:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8011 00000100:00100000:2.0:1746066806.102583:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977327488:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066806.102593:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066806.102597:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd10 expref: 9 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.102605:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd10 expref: 9 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.102620:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ecdf600/0xfb36a14ee608db91 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd10 expref: 9 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.102636:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.102639:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dbc9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066806.102646:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dbc9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066806.102651:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dbc9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066806.102700:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066806.102733:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977327488:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 151us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.102738:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8011 00010000:00010000:1.0:1746066806.103049:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dbc9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.103055:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dbc9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746066806.103069:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066806.103171:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c000/0xfb36a14ee608dbc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd41 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.103182:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dbc9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd41 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.103188:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066806.103190:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066806.103192:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c3ca00, rc 0) 00000100:00100000:1.0:1746066806.103226:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32063:x1830882977327360:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 3221us (4017us total) trans 8589944277 rc 0/0 00000100:00100000:1.0:1746066806.103232:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10186 00000100:00100000:0.0:1746066806.105181:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.106444:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977327744 00000100:00100000:1.0:1746066806.106452:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977327744 00000100:00100000:1.0:1746066806.106512:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10187 00000100:00100000:1.0:1746066806.106519:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32063:x1830882977327744:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066806.106539:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.106542:0:14549:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066806.106561:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dbc9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd41 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.106574:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066806.106578:0:14549:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066806.106586:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c200/0xfb36a14ee608dbd7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd48 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.106656:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dbde lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.106666:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dbde lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.106714:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dbde lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00000004:00200000:1.0:1746066806.106725:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066806.106811:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3c200/0xfb36a14ee608dbd7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd48 expref: 10 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.106825:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dbde lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd48 expref: 9 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.106830:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066806.106832:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066806.106834:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c3cc00, rc 0) 00000100:00100000:1.0:1746066806.106874:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:32063:x1830882977327744:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 357us (1698us total) trans 8589944278 rc 0/0 00000100:00100000:1.0:1746066806.106879:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10187 00000100:00100000:0.0:1746066806.113861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.114602:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977327872 00000100:00100000:2.0:1746066806.114610:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977327872 00000100:00100000:2.0:1746066806.114811:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10188 00000100:00100000:2.0:1746066806.114820:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:32063:x1830882977327872:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066806.114839:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.114854:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25400/0xfb36a14ee608dbec lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd4f expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.115098:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25400/0xfb36a14ee608dbec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd4f expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.115111:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25400/0xfb36a14ee608dbec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd4f expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.115132:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.115135:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066806.115138:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f25400, rc 0) 00000100:00100000:2.0:1746066806.115190:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:32063:x1830882977327872:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 371us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.115196:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10188 00000100:00100000:0.0:1746066806.122523:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.122602:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977328000 00000100:00100000:1.0:1746066806.122609:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977328000 00000100:00100000:1.0:1746066806.122721:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15495 00000100:00100000:1.0:1746066806.122730:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977328000:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066806.122765:0:21203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093c3c600/0xfb36a14ee608dbf3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.122780:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc0d expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.122787:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b5fa00/0xfb36a14ee608dbad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd17 expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.122794:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b19bc00/0xfb36a14ee608d9f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc1b expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.122799:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.122801:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.122804:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c3c600/0xfb36a14ee608dbf3 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.122829:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b19bc00/0xfb36a14ee608d9f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc1b expref: 27 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.122838:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b19bc00/0xfb36a14ee608d9f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc1b expref: 27 pid: 21203 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746066806.122848:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976997504:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066806.122924:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b5fa00/0xfb36a14ee608dbad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd17 expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.122932:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b5fa00/0xfb36a14ee608dbad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd17 expref: 8 pid: 21203 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746066806.122939:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976997632:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066806.122963:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc0d expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.122969:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc0d expref: 27 pid: 8452 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.122976:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976997760:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066806.122988:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.124884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.124966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.124998:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.125025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.125138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.125764:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977328128 00000100:00100000:3.0:1746066806.125771:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977328128 00000100:00100000:3.0:1746066806.125801:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977328256 00000100:00100000:3.0:1746066806.125803:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977328256 00000100:00100000:3.0:1746066806.125813:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977328384 00000100:00100000:3.0:1746066806.125815:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977328384 00000100:00100000:3.0:1746066806.125825:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977328512 00000100:00100000:3.0:1746066806.125827:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977328512 00000100:00100000:3.0:1746066806.125835:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977328640 00000100:00100000:3.0:1746066806.125837:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977328640 00000100:00100000:3.0:1746066806.125846:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15496 00000100:00100000:3.0:1746066806.125852:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977328128:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:3.0:1746066806.125883:0:8112:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ecdfc00/0xfb36a14ee608dbfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.125896:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 33 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.125902:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066806.125903:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066806.125906:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecdfc00/0xfb36a14ee608dbfa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.125929:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 33 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.125938:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 33 pid: 8451 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.125959:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976997888:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066806.126011:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066806.126029:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15497 00000100:00100000:3.0:1746066806.126034:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977328256:12345-192.168.202.57@tcp:1:mirror_io.0 00000100:00100000:0.0:1746066806.126035:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15498 00000100:00100000:0.0:1746066806.126045:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977328384:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:3.0:1746066806.126050:0:20532:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ecdec00/0xfb36a14ee608dc01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.126058:0:8451:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.126059:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.126065:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066806.126066:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066806.126067:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b5e600/0xfb36a14ee608db59 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcf4 expref: 27 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.126068:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecdec00/0xfb36a14ee608dc01 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.126073:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608db9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd2c expref: 10 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.126078:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.126079:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066806.126080:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.126081:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc08 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.126087:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 33 pid: 21973 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.126092:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608db9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd2c expref: 10 pid: 21203 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066806.126094:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976998016:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066806.126099:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608db9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd2c expref: 10 pid: 21203 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746066806.126106:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976998144:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066806.126111:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066806.126124:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15499 00010000:00010000:0.0:1746066806.126126:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b5e600/0xfb36a14ee608db59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcf4 expref: 27 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066806.126129:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977328512:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066806.126133:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b5e600/0xfb36a14ee608db59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcf4 expref: 27 pid: 8112 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066806.126139:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e635180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976998272:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066806.126141:0:4614:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801350bcc00/0xfb36a14ee608dc0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.126149:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc84 expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.126152:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746066806.126156:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f31e00/0xfb36a14ee608dbbb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd33 expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066806.126162:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a489f000/0xfb36a14ee608dab8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca0 expref: 27 pid: 8450 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066806.126163:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15500 00000100:00100000:0.0:1746066806.126168:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977328640:12345-192.168.202.57@tcp:1:mirror_io.0 00010000:00010000:3.0:1746066806.126169:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e400/0xfb36a14ee608d9e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc14 expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.126175:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f60f800/0xfb36a14ee608da10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc30 expref: 27 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.126179:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746066806.126180:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066806.126180:0:9776:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135f30400/0xfb36a14ee608dc16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.126183:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350bcc00/0xfb36a14ee608dc0f lrc: 8/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.126187:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608da87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc8b expref: 33 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.126194:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608dba6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd3a expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066806.126195:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f60f800/0xfb36a14ee608da10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc30 expref: 27 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.126200:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608dabf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca7 expref: 17 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066806.126202:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f60f800/0xfb36a14ee608da10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc30 expref: 27 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.126205:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.126206:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.126208:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135f30400/0xfb36a14ee608dc16 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066806.126210:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976998400:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066806.126219:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608dabf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca7 expref: 17 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.126226:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608dabf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca7 expref: 17 pid: 8450 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.126230:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e400/0xfb36a14ee608d9e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc14 expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.126232:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976998528:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066806.126236:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e400/0xfb36a14ee608d9e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc14 expref: 27 pid: 8452 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.126242:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976998656:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066806.126251:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608dba6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd3a expref: 8 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066806.126257:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a489f000/0xfb36a14ee608dab8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca0 expref: 27 pid: 8450 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.126257:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608dba6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd3a expref: 8 pid: 21203 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.126264:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a489f000/0xfb36a14ee608dab8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca0 expref: 27 pid: 8450 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746066806.126264:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976998784:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066806.126270:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976998912:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066806.126279:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608da87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc8b expref: 33 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.126283:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135f31e00/0xfb36a14ee608dbbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd33 expref: 10 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.126286:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608da87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc8b expref: 33 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.126289:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135f31e00/0xfb36a14ee608dbbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd33 expref: 10 pid: 10402 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746066806.126292:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976999040:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066806.126295:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976999168:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066806.126301:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390000 going to sleep for 11 seconds 00010000:00010000:3.0:1746066806.126321:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc84 expref: 27 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.126328:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc84 expref: 27 pid: 8452 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.126334:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976999296:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066806.126345:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.127590:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976997504:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066806.127599:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976997632:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066806.127606:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882976997760:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066806.127623:0:21203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093c3c600/0xfb36a14ee608dbf3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.132419:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.132455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.132507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.132521:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977328768 00000100:00100000:2.0:1746066806.132528:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977328768 00010000:00010000:2.0:1746066806.132557:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b5fa00/0xfb36a14ee608dbad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd17 expref: 11 pid: 21203 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746066806.132580:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977328896 00000100:00100000:2.0:1746066806.132582:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977328896 00010000:00010000:2.0:1746066806.132590:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc0d expref: 28 pid: 8452 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066806.132595:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976998144:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.132605:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8012 00000100:00100000:2.0:1746066806.132611:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977328768:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066806.132620:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8013 00010000:00010000:2.0:1746066806.132621:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066806.132633:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1964:x1830882977328896:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066806.132639:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b5fa00/0xfb36a14ee608dbad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd17 expref: 11 pid: 21203 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746066806.132640:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066806.132654:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b5fa00/0xfb36a14ee608dbad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd17 expref: 11 pid: 21203 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746066806.132707:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977329024 00000100:00100000:3.0:1746066806.132711:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882976998016:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066806.132711:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977329024 00010000:00010000:3.0:1746066806.132730:0:20532:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ecdec00/0xfb36a14ee608dc01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746066806.132747:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (1851392->2097151) req@ffff88009e634a80 x1830882977329024/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066806.132752:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:8112:1830882976997888:192.168.202.57@tcp:104: 00002000:00100000:1.0:1746066806.132756:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e634a80 with x1830882977329024 ext(1851392->2097151) 00010000:00010000:3.0:1746066806.132761:0:8112:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ecdfc00/0xfb36a14ee608dbfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.132762:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 34 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.132777:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 34 pid: 8451 timeout: 867 lvb_type: 0 00002000:00010000:1.0:1746066806.132783:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e634a80 00000100:00100000:1.0:1746066806.132800:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2286 00000100:00100000:1.0:1746066806.132811:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1965:x1830882977329024:12345-192.168.202.57@tcp:4:cat.0 00010000:00010000:0.0:1746066806.133059:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc0d expref: 28 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.133067:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc0d expref: 28 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.133098:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608d9df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc0d expref: 28 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.133109:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b5fa00/0xfb36a14ee608dbad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd17 expref: 11 pid: 21203 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746066806.133124:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066806.133124:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066806.133169:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977328768:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 557us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.133175:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8012 00000100:00100000:0.0:1746066806.133412:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977328896:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 785us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.133418:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8013 00000100:00100000:0.0:1746066806.133468:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e635180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882976998272:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066806.133496:0:8451:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066806.133798:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976998400:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066806.133939:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976998528:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.134185:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976998656:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.134193:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976998912:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.134199:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976999168:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066806.134199:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976998784:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.134207:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882976999296:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066806.134209:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882976999040:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.134225:0:4614:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801350bcc00/0xfb36a14ee608dc0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.134228:0:9776:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135f30400/0xfb36a14ee608dc16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.139827:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1965:x1830882977329024:12345-192.168.202.57@tcp:4:cat.0 Request processed in 7012us (7310us total) trans 21474841076 rc 0/0 00000100:00100000:1.0:1746066806.139838:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2286 00002000:00100000:1.0:1746066806.139849:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38d:0x0] (1851392->2097151) req@ffff88009e634a80 x1830882977329024/t21474841076(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/448 e 0 to 0 dl 1746066817 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.139861:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e634a80 with x1830882977329024 ext(1851392->2097151) 00010000:00010000:1.0:1746066806.139869:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 36 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.139880:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 36 pid: 8451 timeout: 867 lvb_type: 0 00002000:00010000:1.0:1746066806.139886:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e634a80 00000100:00100000:0.0:1746066806.140994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.141026:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.141057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.141074:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977329152 00000100:00100000:0.0:1746066806.141076:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.141081:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977329152 00000100:00100000:0.0:1746066806.141087:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.141097:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:1.0:1746066806.141109:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1683455) req@ffff88009e636a00 x1830882977329152/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066806.141116:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00100000:1.0:1746066806.141117:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e636a00 with x1830882977329152 ext(1048576->1683455) 00010000:00010000:1.0:1746066806.141123:0:21551:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 36 pid: 21973 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066806.141127:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977329408 00000100:00100000:0.0:1746066806.141130:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977329408 00010000:00010000:1.0:1746066806.141132:0:21551:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 36 pid: 21973 timeout: 867 lvb_type: 0 00002000:00010000:1.0:1746066806.141138:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e636a00 00010000:00010000:0.0:1746066806.141150:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b5e600/0xfb36a14ee608db59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcf4 expref: 27 pid: 8112 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.141153:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977329664 00000100:00100000:1.0:1746066806.141155:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977329664 00000100:00100000:0.0:1746066806.141161:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977329920 00010000:00010000:1.0:1746066806.141163:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e400/0xfb36a14ee608d9e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc14 expref: 28 pid: 8452 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066806.141163:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977329920 00010000:00010000:0.0:1746066806.141170:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608dabf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca7 expref: 18 pid: 8450 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746066806.141172:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977330176 00000100:00100000:1.0:1746066806.141173:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977330176 00000100:00100000:0.0:1746066806.141178:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977329280 00000100:00100000:0.0:1746066806.141179:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977329280 00010000:00010000:1.0:1746066806.141180:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a489f000/0xfb36a14ee608dab8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca0 expref: 29 pid: 8450 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746066806.141187:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977329536 00000100:00100000:1.0:1746066806.141189:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977329536 00010000:00010000:1.0:1746066806.141195:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f60f800/0xfb36a14ee608da10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc30 expref: 30 pid: 8451 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.141204:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8014 00000100:00100000:1.0:1746066806.141209:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1964:x1830882977329408:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.141217:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.141233:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b5e600/0xfb36a14ee608db59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcf4 expref: 27 pid: 8112 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.141241:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b5e600/0xfb36a14ee608db59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcf4 expref: 27 pid: 8112 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.141257:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b5e600/0xfb36a14ee608db59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcf4 expref: 27 pid: 8112 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.141273:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.141307:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977329408:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 98us (279us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066806.141322:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608db9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd2c expref: 10 pid: 21203 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746066806.141334:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8015 00000100:00100000:0.0:1746066806.141340:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+30:1964:x1830882977329664:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066806.141346:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066806.141354:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e400/0xfb36a14ee608d9e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc14 expref: 30 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.141361:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e400/0xfb36a14ee608d9e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc14 expref: 30 pid: 8452 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.141370:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8016 00010000:00010000:0.0:1746066806.141372:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e400/0xfb36a14ee608d9e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 8 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc14 expref: 30 pid: 8452 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.141379:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+18:1964:x1830882977329920:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066806.141380:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066806.141387:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066806.141394:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977329664:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 55us (336us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066806.141398:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608dabf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca7 expref: 18 pid: 8450 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746066806.141399:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8015 00010000:00010000:3.0:1746066806.141407:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608dabf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca7 expref: 18 pid: 8450 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746066806.141409:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8017 00000100:00100000:0.0:1746066806.141414:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882977330176:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066806.141419:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a489ec00/0xfb36a14ee608dabf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca7 expref: 18 pid: 8450 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746066806.141419:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066806.141425:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a489f000/0xfb36a14ee608dab8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca0 expref: 28 pid: 8450 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.141431:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066806.141433:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a489f000/0xfb36a14ee608dab8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca0 expref: 28 pid: 8450 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746066806.141442:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a489f000/0xfb36a14ee608dab8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fca0 expref: 28 pid: 8450 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746066806.141449:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977329920:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 72us (372us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066806.141453:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066806.141455:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8016 00000100:00100000:3.0:1746066806.141468:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8018 00000100:00100000:0.0:1746066806.141468:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977330176:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 54us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.141473:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977329536:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066806.141473:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8017 00010000:00010000:3.0:1746066806.141478:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066806.141484:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8019 00010000:00010000:3.0:1746066806.141499:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f60f800/0xfb36a14ee608da10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc30 expref: 26 pid: 8451 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066806.141501:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977329280:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066806.141507:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066806.141508:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f60f800/0xfb36a14ee608da10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc30 expref: 26 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.141514:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608db9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd2c expref: 10 pid: 21203 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.141519:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f60f800/0xfb36a14ee608da10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc30 expref: 26 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.141521:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608db9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd2c expref: 10 pid: 21203 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.141528:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066806.141530:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b5ec00/0xfb36a14ee608db9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd2c expref: 10 pid: 21203 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746066806.141537:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.141538:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.141542:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066806.141545:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882977329536:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 72us (428us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066806.141548:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc08 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066806.141550:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8018 00010000:00010000:0.0:1746066806.141569:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066806.141584:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977329280:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 84us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.141589:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2287 00000100:00100000:0.0:1746066806.141590:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8019 00000100:00100000:3.0:1746066806.141594:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882977329152:12345-192.168.202.57@tcp:4:cat.0 00010000:00010000:0.0:1746066806.141607:0:8451:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.141614:0:8451:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.141629:0:8451:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.141635:0:8451:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.141641:0:8451:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.141646:0:8451:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f30800 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066806.141649:0:8451:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.141656:0:8451:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.141665:0:8451:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc08 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.141715:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8014 00010000:00010000:0.0:1746066806.141887:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.141923:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977328384:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 15882us (16925us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.141930:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15498 00000100:00100000:0.0:1746066806.141960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.141978:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977329792 00000100:00100000:1.0:1746066806.141982:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977329792 00010000:00010000:1.0:1746066806.141994:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608dba6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd3a expref: 9 pid: 21203 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746066806.142001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.142148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.142212:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977330048 00000100:00100000:1.0:1746066806.142215:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977330048 00010000:00010000:1.0:1746066806.142227:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135f31e00/0xfb36a14ee608dbbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd33 expref: 8 pid: 10402 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746066806.142243:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8020 00000100:00100000:1.0:1746066806.142247:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977329792:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.142253:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.142261:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608dba6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd3a expref: 9 pid: 21203 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.142268:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608dba6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd3a expref: 9 pid: 21203 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.142464:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b5fe00/0xfb36a14ee608dba6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd3a expref: 9 pid: 21203 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.142473:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.142497:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977329792:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 249us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.142502:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8020 00000100:00100000:1.0:1746066806.142512:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8021 00000100:00100000:1.0:1746066806.142516:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977330048:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.142521:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.142529:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135f31e00/0xfb36a14ee608dbbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd33 expref: 8 pid: 10402 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.142535:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135f31e00/0xfb36a14ee608dbbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd33 expref: 8 pid: 10402 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.142543:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135f31e00/0xfb36a14ee608dbbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd33 expref: 8 pid: 10402 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.142549:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.142559:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977330048:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 43us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.142563:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8021 00000100:00100000:2.0:1746066806.142775:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977330304 00000100:00100000:2.0:1746066806.142779:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977330304 00010000:00010000:2.0:1746066806.142793:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc84 expref: 26 pid: 8452 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.142809:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8022 00000100:00100000:2.0:1746066806.142813:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977330304:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066806.142819:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066806.142826:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc84 expref: 26 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.142837:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc84 expref: 26 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.142847:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800935c0e00/0xfb36a14ee608da80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc84 expref: 26 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.142863:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.142864:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.142867:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350bcc00/0xfb36a14ee608dc0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.142874:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801350bcc00/0xfb36a14ee608dc0f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.142889:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066806.142899:0:4614:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801350bcc00/0xfb36a14ee608dc0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066806.142904:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977330304:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 90us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.142909:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8022 00010000:00010000:3.0:1746066806.142910:0:4614:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801350bcc00/0xfb36a14ee608dc0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.142923:0:4614:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801350bcc00/0xfb36a14ee608dc0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.142929:0:4614:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801350bcc00/0xfb36a14ee608dc0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.143024:0:4614:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801350bcc00/0xfb36a14ee608dc0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.143030:0:4614:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801350bcc00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066806.143032:0:4614:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801350bcc00/0xfb36a14ee608dc0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.143039:0:4614:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801350bcc00/0xfb36a14ee608dc0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.143048:0:4614:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801350bcc00/0xfb36a14ee608dc0f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.143054:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350bcc00/0xfb36a14ee608dc0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066806.143085:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882977328512:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 16955us (18059us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.143092:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15499 00000100:00100000:2.0:1746066806.146823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.146845:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.146871:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977330432 00000100:00100000:2.0:1746066806.146874:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.146878:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977330432 00010000:00010000:3.0:1746066806.146901:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b19bc00/0xfb36a14ee608d9f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc1b expref: 25 pid: 21203 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746066806.146921:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977330560 00000100:00100000:3.0:1746066806.146923:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977330560 00010000:00010000:3.0:1746066806.146931:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 38 pid: 8451 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.146943:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977330688 00000100:00100000:3.0:1746066806.146945:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977330688 00010000:00010000:3.0:1746066806.146952:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608da87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc8b expref: 39 pid: 8452 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.146977:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8023 00000100:00100000:3.0:1746066806.146983:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977330432:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066806.146994:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066806.146996:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8024 00000100:00100000:2.0:1746066806.147001:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1964:x1830882977330560:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066806.147008:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066806.147010:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b19bc00/0xfb36a14ee608d9f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc1b expref: 25 pid: 21203 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746066806.147016:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8025 00010000:00010000:2.0:1746066806.147018:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 39 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.147019:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b19bc00/0xfb36a14ee608d9f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc1b expref: 25 pid: 21203 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746066806.147023:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1965:x1830882977330688:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066806.147029:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 39 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.147031:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066806.147035:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b19bc00/0xfb36a14ee608d9f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc1b expref: 25 pid: 21203 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746066806.147039:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b5f600/0xfb36a14ee608db4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fcdf expref: 39 pid: 8451 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.147042:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608da87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc8b expref: 39 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.147049:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.147049:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066806.147051:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.147051:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.147051:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608da87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc8b expref: 38 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.147055:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093c3c600/0xfb36a14ee608dbf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.147055:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecdfc00/0xfb36a14ee608dbfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.147062:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c3c600/0xfb36a14ee608dbf3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.147062:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecdfc00/0xfb36a14ee608dbfa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.147063:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608da87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc8b expref: 38 pid: 8452 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.147072:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.147074:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.147077:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135f30400/0xfb36a14ee608dc16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.147078:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066806.147078:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066806.147083:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135f30400/0xfb36a14ee608dc16 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.147097:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066806.147106:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882977330432:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 123us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.147106:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1964:x1830882977330560:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 105us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.147111:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8023 00000100:00100000:1.0:1746066806.147116:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1965:x1830882977330688:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 94us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.147117:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8024 00000100:00100000:1.0:1746066806.147122:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8025 00010000:00010000:2.0:1746066806.147129:0:8112:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ecdfc00/0xfb36a14ee608dbfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.147136:0:8112:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecdfc00/0xfb36a14ee608dbfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.147143:0:21203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093c3c600/0xfb36a14ee608dbf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.147149:0:21203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093c3c600/0xfb36a14ee608dbf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.147152:0:8112:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ecdfc00/0xfb36a14ee608dbfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.147161:0:8112:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecdfc00/0xfb36a14ee608dbfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.147163:0:21203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093c3c600/0xfb36a14ee608dbf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.147167:0:8112:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ecdfc00/0xfb36a14ee608dbfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.147168:0:21203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093c3c600/0xfb36a14ee608dbf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.147172:0:8112:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecdfc00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066806.147173:0:21203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093c3c600/0xfb36a14ee608dbf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.147175:0:8112:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ecdfc00/0xfb36a14ee608dbfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.147178:0:21203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c3c600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066806.147181:0:8112:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ecdfc00/0xfb36a14ee608dbfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.147181:0:21203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093c3c600/0xfb36a14ee608dbf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.147189:0:8112:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ecdfc00/0xfb36a14ee608dbfa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.147190:0:21203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093c3c600/0xfb36a14ee608dbf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.147193:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecdfc00/0xfb36a14ee608dbfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.147199:0:21203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093c3c600/0xfb36a14ee608dbf3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.147205:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c3c600/0xfb36a14ee608dbf3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066806.147228:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977328128:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 21377us (22350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.147235:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15496 00000100:00100000:1.0:1746066806.147238:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1964:x1830882977328000:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 24510us (24721us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.147245:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15495 00010000:00010000:0.0:1746066806.148025:0:9776:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135f30400/0xfb36a14ee608dc16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.148033:0:9776:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135f30400/0xfb36a14ee608dc16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.148047:0:9776:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135f30400/0xfb36a14ee608dc16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.148053:0:9776:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135f30400/0xfb36a14ee608dc16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.148059:0:9776:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135f30400/0xfb36a14ee608dc16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.148064:0:9776:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f30400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066806.148066:0:9776:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135f30400/0xfb36a14ee608dc16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.148072:0:9776:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135f30400/0xfb36a14ee608dc16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.148082:0:9776:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135f30400/0xfb36a14ee608dc16 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.148087:0:9776:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135f30400/0xfb36a14ee608dc16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.148138:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882977328640:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 21968us (22998us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.148144:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15500 00000100:00100000:2.0:1746066806.161063:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882977329152:12345-192.168.202.57@tcp:4:cat.0 Request processed in 19460us (20063us total) trans 21474841077 rc 0/0 00000100:00100000:2.0:1746066806.161074:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2287 00002000:00100000:2.0:1746066806.161085:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1683455) req@ffff88009e636a00 x1830882977329152/t21474841077(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/448 e 0 to 0 dl 1746066817 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.161093:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e636a00 with x1830882977329152 ext(1048576->1683455) 00010000:00010000:2.0:1746066806.161102:0:31368:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 36 pid: 21973 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.161115:0:31368:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 36 pid: 21973 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746066806.161122:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e636a00 00000100:00100000:0.0:1746066806.164403:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.164450:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977330816 00000100:00100000:1.0:1746066806.164458:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977330816 00010000:00010000:1.0:1746066806.164497:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 36 pid: 21973 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.164524:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8026 00000100:00100000:1.0:1746066806.164531:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882977330816:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.164573:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.164593:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 36 pid: 21973 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.164603:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 36 pid: 21973 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.164626:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801367cde00/0xfb36a14ee608db75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd09 expref: 36 pid: 21973 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.164650:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.164652:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.164655:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ecdec00/0xfb36a14ee608dc01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.164663:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecdec00/0xfb36a14ee608dc01 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.164708:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066806.164726:0:20532:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ecdec00/0xfb36a14ee608dc01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.164736:0:20532:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ecdec00/0xfb36a14ee608dc01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.164751:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1963:x1830882977330816:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 220us (353us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066806.164755:0:20532:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ecdec00/0xfb36a14ee608dc01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.164762:0:20532:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ecdec00/0xfb36a14ee608dc01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.164762:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8026 00010000:00010000:3.0:1746066806.164767:0:20532:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ecdec00/0xfb36a14ee608dc01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.164777:0:20532:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ecdec00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066806.164780:0:20532:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ecdec00/0xfb36a14ee608dc01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.164786:0:20532:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ecdec00/0xfb36a14ee608dc01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.164795:0:20532:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ecdec00/0xfb36a14ee608dc01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.164800:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ecdec00/0xfb36a14ee608dc01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066806.164858:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1963:x1830882977328256:12345-192.168.202.57@tcp:1:mirror_io.0 Request processed in 38823us (39891us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.164865:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15497 00000100:00100000:0.0:1746066806.166898:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.167030:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977331072 00000100:00100000:2.0:1746066806.167037:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977331072 00000100:00100000:2.0:1746066806.167131:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10189 00000100:00100000:2.0:1746066806.167138:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:32063:x1830882977331072:12345-192.168.202.57@tcp:36:mirror_io.0 00010000:00010000:2.0:1746066806.167175:0:809:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066806.167195:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4f25400/0xfb36a14ee608dbec lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd4f expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.167226:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.167229:0:809:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066806.167253:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.167263:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fafc expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.167270:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 262 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.167279:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d896 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb0a expref: 18 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.167284:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1f400/0xfb36a14ee608d9b5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbea expref: 262 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.167290:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608da33 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc3e expref: 262 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.167296:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608daa3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc92 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.167302:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 9/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.167327:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608daa3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc92 expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.167337:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608daa3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc92 expref: 18 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.167348:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976999424:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.167976:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608da33 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc3e expref: 262 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.167984:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608da33 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc3e expref: 262 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.167996:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976999552:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.168026:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1f400/0xfb36a14ee608d9b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbea expref: 262 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.168034:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1f400/0xfb36a14ee608d9b5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbea expref: 262 pid: 809 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.168040:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976999680:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.168059:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d896 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb0a expref: 18 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.168065:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d896 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb0a expref: 18 pid: 809 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.168072:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976999808:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.168103:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 262 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.168109:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 262 pid: 14550 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.168116:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976999936:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.168131:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fafc expref: 18 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.168141:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fafc expref: 18 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.168147:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882977000064:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.168160:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066806.173328:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976999424:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066806.173861:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.173864:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976999552:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.173871:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976999680:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.173877:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976999808:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066806.173925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.173941:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.173963:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977331200 00000100:00100000:0.0:1746066806.173969:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977331200 00010000:00010000:0.0:1746066806.174002:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608daa3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc92 expref: 19 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.174048:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977331584 00000100:00100000:1.0:1746066806.174051:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977331584 00000100:00100000:1.0:1746066806.174088:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4286 00000100:00100000:1.0:1746066806.174094:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:27101:x1830882977331584:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066806.174252:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:27101:x1830882977331584:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 158us (391us total) trans 8589944279 rc 0/0 00000100:00100000:1.0:1746066806.174259:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4286 00000100:00100000:1.0:1746066806.174355:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.174762:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977331328 00000100:00100000:0.0:1746066806.174762:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977331712 00000100:00100000:2.0:1746066806.174765:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977331328 00000100:00100000:0.0:1746066806.174765:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977331712 00010000:00010000:2.0:1746066806.174778:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d896 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb0a expref: 20 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.174778:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608da33 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc3e expref: 264 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.174793:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8027 00000100:00100000:2.0:1746066806.174798:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977331200:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066806.174801:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8028 00010000:00010000:2.0:1746066806.174806:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066806.174806:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977331328:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066806.174810:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608daa3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc92 expref: 20 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.174810:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066806.174813:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d896 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb0a expref: 20 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.174818:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608daa3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc92 expref: 20 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.174839:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d896 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb0a expref: 20 pid: 809 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.174845:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8029 00000100:00100000:3.0:1746066806.174851:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:1963:x1830882977331712:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066806.174854:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608d896 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb0a expref: 20 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.174856:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066806.174859:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608da33 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc3e expref: 264 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.174866:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608da33 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc3e expref: 264 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.174876:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066806.174879:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.174886:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066806.174905:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977331328:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 99us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.174910:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8028 00010000:00010000:3.0:1746066806.175121:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dee0c00/0xfb36a14ee608da33 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc3e expref: 264 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.175136:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066806.175139:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.175143:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066806.175158:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:1963:x1830882977331712:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 309us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.175163:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8029 00010000:00010000:2.0:1746066806.175423:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092489e00/0xfb36a14ee608daa3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fc92 expref: 18 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.175444:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.175447:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.175452:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066806.175465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.175468:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977331200:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 670us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.175473:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8027 00000100:00100000:2.0:1746066806.175512:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977331840 00000100:00100000:2.0:1746066806.175515:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977331840 00010000:00010000:2.0:1746066806.175524:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fafc expref: 17 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066806.175524:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.175534:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977331968 00000100:00100000:2.0:1746066806.175536:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977331968 00010000:00010000:2.0:1746066806.175543:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 263 pid: 14550 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.175558:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8030 00000100:00100000:0.0:1746066806.175561:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8031 00000100:00100000:2.0:1746066806.175562:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977331840:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066806.175567:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:1965:x1830882977331968:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066806.175568:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066806.175571:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fafc expref: 17 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.175572:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066806.175575:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 263 pid: 14550 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.175578:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fafc expref: 17 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.175584:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 263 pid: 14550 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.176010:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.176015:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.176020:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066806.176038:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+17:1966:x1830882977331840:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 475us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.176043:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8030 00000100:00100000:2.0:1746066806.176074:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882976999936:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.176082:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a1e600/0xfb36a14ee608d888 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fafc expref: 16 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.176089:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882977000064:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.176112:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.176188:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608d88f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fb03 expref: 263 pid: 14550 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.176197:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066806.176200:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.176204:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066806.176223:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:1965:x1830882977331968:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 656us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.176228:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8031 00000100:00100000:1.0:1746066806.176296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.176446:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977332096 00000100:00100000:0.0:1746066806.176449:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977332096 00010000:00010000:0.0:1746066806.176461:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1f400/0xfb36a14ee608d9b5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbea expref: 262 pid: 809 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066806.176521:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8032 00000100:00100000:0.0:1746066806.176528:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:1963:x1830882977332096:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066806.176534:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066806.176538:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1f400/0xfb36a14ee608d9b5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbea expref: 262 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.176545:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1f400/0xfb36a14ee608d9b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbea expref: 262 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.176556:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1f400/0xfb36a14ee608d9b5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fbea expref: 262 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.176564:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066806.176566:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.176571:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.176577:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.176888:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.176894:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.177275:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066806.177306:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:1963:x1830882977332096:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 779us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.177312:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8032 00000040:00080000:3.0:1746066806.177924:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3216, 88 off272272 00000004:00080000:3.0:1746066806.177932:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767355255464ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066806.177981:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3219, 88 off272448 00000004:00080000:3.0:1746066806.177985:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767355309474ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066806.178041:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3220, 88 off272536 00000004:00080000:3.0:1746066806.178045:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767355369234ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066806.178054:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3217, 88 off272360 00000004:00080000:3.0:1746066806.178056:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767355380254ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066806.178168:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3218, 88 off272448 00000004:00080000:3.0:1746066806.178172:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767355495619ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066806.178179:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3221, 88 off272624 00000004:00080000:3.0:1746066806.178182:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767355505876ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066806.178190:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3222, 88 off272712 00000004:00080000:3.0:1746066806.178192:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767355516076ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066806.178198:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3223, 88 off272800 00000004:00080000:3.0:1746066806.178200:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767355524621ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066806.178207:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3219, 88 off272536 00000004:00080000:3.0:1746066806.178209:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767355533651ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066806.178216:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3224, 88 off272888 00000004:00080000:3.0:1746066806.178218:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767355541767ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066806.178224:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3220, 88 off272624 00000004:00080000:3.0:1746066806.178226:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767355550126ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066806.178232:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3225, 88 off272976 00000004:00080000:3.0:1746066806.178234:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767355557976ns, next at 749511475809ns, rc = 0 00000040:00080000:3.0:1746066806.178240:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3221, 88 off272712 00000004:00080000:3.0:1746066806.178243:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767355566649ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066806.178249:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3222, 88 off272800 00000004:00080000:3.0:1746066806.178251:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767355575284ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066806.178257:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3223, 88 off272888 00000004:00080000:3.0:1746066806.178260:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767355584107ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066806.178266:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3224, 88 off272976 00000004:00080000:3.0:1746066806.178268:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767355592591ns, next at 749511128030ns, rc = 0 00000040:00080000:3.0:1746066806.178274:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3226, 88 off273064 00000004:00080000:3.0:1746066806.178277:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767355600707ns, next at 749511475809ns, rc = 0 00000004:00010000:2.0:1746066806.212088:0:809:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009e637800 reply state ffff8800996aac00 transno 8589944280 ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:2.0:1746066806.212100:0:809:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1746066806.212264:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944272 is committed 00000001:00080000:1.0:1746066806.212275:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944279 is committed 00000001:00080000:1.0:1746066806.212280:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944278 is committed 00000001:00080000:1.0:1746066806.212289:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944276 is committed 00000001:00080000:1.0:1746066806.212307:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944280 is committed 00000004:00080000:1.0:1746066806.212310:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2499 committed 00000004:00080000:1.0:1746066806.212316:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2496 committed 00000004:00080000:1.0:1746066806.212320:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2495 committed 00000004:00080000:1.0:1746066806.212321:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2494 committed 00000004:00080000:1.0:1746066806.212323:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2493 committed 00000004:00080000:1.0:1746066806.212324:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2498 committed 00000004:00080000:1.0:1746066806.212325:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2492 committed 00000004:00080000:1.0:1746066806.212327:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2497 committed 00000004:00080000:1.0:1746066806.212328:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2491 committed 00000004:00080000:1.0:1746066806.212329:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2496 committed 00000004:00080000:1.0:1746066806.212331:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2495 committed 00000004:00080000:1.0:1746066806.212332:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2494 committed 00000004:00080000:1.0:1746066806.212333:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2490 committed 00000004:00080000:1.0:1746066806.212334:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2489 committed 00000004:00080000:1.0:1746066806.212335:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2493 committed 00000004:00080000:1.0:1746066806.212336:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2492 committed 00000004:00080000:1.0:1746066806.212337:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2488 committed 00000100:00100000:3.0:1746066806.212611:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977000192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.212651:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.212707:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977000704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.212726:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.212741:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977001216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.212754:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.212763:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977001728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.212773:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.212787:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1746066806.212791:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977000576:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.212802:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.212811:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977001088:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.212821:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.212829:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977001600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.212841:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.212851:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977002112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.212862:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.212878:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977000320:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.212891:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.212901:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977000832:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.212914:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.212923:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977001344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.212934:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.212940:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977001856:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.212952:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.212960:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746066806.212964:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977000448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.212977:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.212984:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977000960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.212995:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.213000:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977001472:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.213015:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.213021:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977001984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.213034:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.213054:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977000192 00000100:00100000:3.0:1746066806.213059:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977000192 00000100:00100000:3.0:1746066806.213088:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977000704 00000100:00100000:3.0:1746066806.213090:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977000704 00000100:00100000:3.0:1746066806.213096:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977001216 00000100:00100000:3.0:1746066806.213097:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977001216 00000100:00100000:3.0:1746066806.213104:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977001728 00000100:00100000:3.0:1746066806.213105:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977001728 00000100:00100000:3.0:1746066806.213110:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977000576 00000100:00100000:3.0:1746066806.213112:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977000576 00000100:00100000:3.0:1746066806.213117:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977001088 00000100:00100000:3.0:1746066806.213118:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977001088 00000100:00100000:3.0:1746066806.213123:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977001600 00000100:00100000:3.0:1746066806.213125:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977001600 00000100:00100000:3.0:1746066806.213130:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977002112 00000100:00100000:3.0:1746066806.213132:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977002112 00000100:00100000:3.0:1746066806.213136:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977000320 00000100:00100000:3.0:1746066806.213137:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977000320 00000100:00100000:3.0:1746066806.213142:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977000832 00000100:00100000:3.0:1746066806.213143:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977000832 00000100:00100000:3.0:1746066806.213148:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977001344 00000100:00100000:3.0:1746066806.213149:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977001344 00000100:00100000:3.0:1746066806.213154:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977001856 00000100:00100000:3.0:1746066806.213156:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977001856 00000100:00100000:3.0:1746066806.213162:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977000448 00000100:00100000:3.0:1746066806.213163:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977000448 00000100:00100000:3.0:1746066806.213168:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977000960 00000100:00100000:3.0:1746066806.213170:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977000960 00000100:00100000:3.0:1746066806.213175:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977001472 00000100:00100000:3.0:1746066806.213176:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977001472 00000100:00100000:3.0:1746066806.213181:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977001984 00000100:00100000:3.0:1746066806.213182:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977001984 00000100:00100000:3.0:1746066806.213190:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15501 00000100:00100000:3.0:1746066806.213196:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3294:x1830882977000192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.213351:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3294:x1830882977000192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 155us (699us total) trans 21474841078 rc 0/0 00000100:00100000:3.0:1746066806.213357:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15501 00000100:00100000:3.0:1746066806.213366:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15502 00000100:00100000:3.0:1746066806.213370:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3294:x1830882977000704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.213430:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3294:x1830882977000704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (703us total) trans 21474841079 rc 0/0 00000100:00100000:3.0:1746066806.213435:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15502 00000100:00100000:3.0:1746066806.213444:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15503 00000100:00100000:3.0:1746066806.213448:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3294:x1830882977001216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.213554:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3294:x1830882977001216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (799us total) trans 17179873775 rc 0/0 00000100:00100000:3.0:1746066806.213559:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15503 00000100:00100000:3.0:1746066806.213566:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15504 00000100:00100000:3.0:1746066806.213570:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3294:x1830882977001728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.213638:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3294:x1830882977001728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (863us total) trans 17179873776 rc 0/0 00000100:00100000:3.0:1746066806.213646:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15504 00000100:00100000:3.0:1746066806.213654:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15505 00000100:00100000:3.0:1746066806.213659:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3294:x1830882977000576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.213756:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3294:x1830882977000576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (951us total) trans 21474841080 rc 0/0 00000100:00100000:3.0:1746066806.213761:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15505 00000100:00100000:3.0:1746066806.213769:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15506 00000100:00100000:3.0:1746066806.213773:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3294:x1830882977001088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.213844:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3294:x1830882977001088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1020us total) trans 21474841081 rc 0/0 00000100:00100000:3.0:1746066806.213849:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15506 00000100:00100000:3.0:1746066806.213857:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15507 00000100:00100000:3.0:1746066806.213861:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3294:x1830882977001600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.213928:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3294:x1830882977001600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (1085us total) trans 17179873777 rc 0/0 00000100:00100000:3.0:1746066806.213933:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15507 00000100:00100000:3.0:1746066806.213941:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15508 00000100:00100000:3.0:1746066806.213945:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3294:x1830882977002112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.214008:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3294:x1830882977002112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (1144us total) trans 17179873778 rc 0/0 00000100:00100000:3.0:1746066806.214012:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15508 00000100:00100000:3.0:1746066806.214020:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15509 00000100:00100000:3.0:1746066806.214025:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3295:x1830882977000320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.214110:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3295:x1830882977000320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (1218us total) trans 21474841082 rc 0/0 00000100:00100000:3.0:1746066806.214115:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15509 00000100:00100000:3.0:1746066806.214123:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15510 00000100:00100000:3.0:1746066806.214127:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3295:x1830882977000832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.214194:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3295:x1830882977000832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1279us total) trans 21474841083 rc 0/0 00000100:00100000:3.0:1746066806.214199:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15510 00000100:00100000:3.0:1746066806.214206:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15511 00000100:00100000:3.0:1746066806.214210:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3295:x1830882977001344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.214280:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3295:x1830882977001344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (1344us total) trans 17179873779 rc 0/0 00000100:00100000:3.0:1746066806.214285:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15511 00000100:00100000:3.0:1746066806.214293:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15512 00000100:00100000:3.0:1746066806.214297:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3295:x1830882977001856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.214362:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3295:x1830882977001856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1408us total) trans 17179873780 rc 0/0 00000100:00100000:3.0:1746066806.214367:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15512 00000100:00100000:3.0:1746066806.214375:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15513 00000100:00100000:3.0:1746066806.214379:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3295:x1830882977000448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.214452:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3295:x1830882977000448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1474us total) trans 21474841084 rc 0/0 00000100:00100000:3.0:1746066806.214457:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15513 00000100:00100000:3.0:1746066806.214467:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15514 00000100:00100000:3.0:1746066806.214471:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3295:x1830882977000960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.214550:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3295:x1830882977000960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (1554us total) trans 21474841085 rc 0/0 00000100:00100000:3.0:1746066806.214555:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15514 00000100:00100000:3.0:1746066806.214563:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15515 00000100:00100000:3.0:1746066806.214568:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3295:x1830882977001472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.214646:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3295:x1830882977001472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (1630us total) trans 17179873781 rc 0/0 00000100:00100000:3.0:1746066806.214651:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15515 00000100:00100000:3.0:1746066806.214753:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15516 00000100:00100000:3.0:1746066806.214758:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3295:x1830882977001984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066806.214817:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746066806.214819:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746066806.214821:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066806.214822:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746066806.214824:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746066806.214842:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3295:x1830882977001984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (1807us total) trans 17179873782 rc 0/0 00000100:00100000:3.0:1746066806.214846:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15516 00000004:00080000:3.0:1746066806.214884:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e636300/2, rc 0, transno 21474841084 00000100:00100000:3.0:1746066806.214889:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977000448:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066806.214896:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093210000/2, rc 0, transno 21474841085 00000100:00100000:3.0:1746066806.214898:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977000960:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066806.214905:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093212a00/2, rc 0, transno 17179873781 00000100:00100000:3.0:1746066806.214912:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977001472:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066806.214919:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093210700/2, rc 0, transno 17179873782 00000100:00100000:3.0:1746066806.214921:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977001984:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066806.214927:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e635500/2, rc 0, transno 21474841082 00000100:00100000:3.0:1746066806.214929:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977000320:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066806.214934:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093213b80/2, rc 0, transno 21474841083 00000100:00100000:3.0:1746066806.214937:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977000832:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066806.214943:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093212300/2, rc 0, transno 17179873779 00000100:00100000:3.0:1746066806.214945:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977001344:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066806.214950:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093211500/2, rc 0, transno 17179873780 00000100:00100000:3.0:1746066806.214952:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977001856:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.214989:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977002240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.215008:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746066806.215034:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e635180/2, rc 0, transno 21474841080 00000100:00100000:3.0:1746066806.215036:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977000576:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066806.215043:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093210380/2, rc 0, transno 21474841081 00000100:00100000:3.0:1746066806.215045:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977001088:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066806.215051:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093210e00/2, rc 0, transno 17179873777 00000100:00100000:3.0:1746066806.215054:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977001600:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066806.215059:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093211880/2, rc 0, transno 17179873778 00000100:00100000:3.0:1746066806.215061:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977002112:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066806.215068:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e637b80/2, rc 0, transno 21474841078 00000100:00100000:3.0:1746066806.215070:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977000192:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066806.215076:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093213800/2, rc 0, transno 21474841079 00000100:00100000:3.0:1746066806.215078:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977000704:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066806.215083:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093211f80/2, rc 0, transno 17179873775 00000100:00100000:3.0:1746066806.215085:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977001216:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066806.215090:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093213480/2, rc 0, transno 17179873776 00000100:00100000:3.0:1746066806.215092:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977001728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.215104:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977002240 00000100:00100000:3.0:1746066806.215107:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977002240 00000100:00100000:3.0:1746066806.215122:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15517 00000100:00100000:3.0:1746066806.215127:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3294:x1830882977002240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.215202:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3294:x1830882977002240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (192us total) trans 17179873783 rc 0/0 00000100:00100000:3.0:1746066806.215207:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15517 00000004:00080000:3.0:1746066806.215224:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efb7480/2, rc 0, transno 17179873783 00000100:00100000:3.0:1746066806.215227:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977002240:0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1746066806.215295:0:809:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746066806.215307:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32063:x1830882977331072:12345-192.168.202.57@tcp:36:mirror_io.0 Request processed in 48168us (48411us total) trans 8589944280 rc 0/0 00000100:00100000:2.0:1746066806.215314:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10189 00000100:00080000:0.0:1746066806.215979:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746066806.215983:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746066806.216238:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.216248:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.216254:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.216258:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801363f3600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066806.216262:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.216271:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.216283:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066806.216285:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066806.216288:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.216293:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3600/0xfb36a14ee608dc1d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00000100:00100000:0.0:1746066806.219732:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.219913:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977332224 00000100:00100000:2.0:1746066806.219921:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977332224 00000100:00100000:2.0:1746066806.219954:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10190 00000100:00100000:2.0:1746066806.219960:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:32063:x1830882977332224:12345-192.168.202.57@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066806.219979:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.219993:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9600/0xfb36a14ee608dc24 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd56 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.220034:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9600/0xfb36a14ee608dc24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd56 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.220044:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9600/0xfb36a14ee608dc24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd56 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.220057:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.220060:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066806.220062:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9600, rc 0) 00000100:00100000:2.0:1746066806.220106:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32063:x1830882977332224:12345-192.168.202.57@tcp:101:mirror_io.0 Request processed in 146us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.220111:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10190 00000100:00100000:0.0:1746066806.226597:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.226996:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977332352 00000100:00100000:2.0:1746066806.227005:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977332352 00000100:00100000:2.0:1746066806.227049:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 728 00000100:00100000:2.0:1746066806.227055:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32063:x1830882977332352:12345-192.168.202.57@tcp:103:mirror_io.0 00010000:00010000:2.0:1746066806.227067:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066806.227086:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dbde lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd48 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.227099:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.227102:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066806.227548:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:32063:x1830882977332352:12345-192.168.202.57@tcp:103:mirror_io.0 Request processed in 491us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.227554:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 728 00000100:00100000:0.0:1746066806.230030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.230120:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977332608 00000100:00100000:3.0:1746066806.230127:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977332608 00000100:00100000:3.0:1746066806.230177:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4287 00000100:00100000:3.0:1746066806.230184:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:32063:x1830882977332608:12345-192.168.202.57@tcp:35:mirror_io.0 00000100:00100000:3.0:1746066806.230388:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32063:x1830882977332608:12345-192.168.202.57@tcp:35:mirror_io.0 Request processed in 204us (363us total) trans 8589944281 rc 0/0 00000100:00100000:3.0:1746066806.230394:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4287 00000100:00100000:0.0:1746066806.231995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.232105:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977332864 00000100:00100000:1.0:1746066806.232111:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977332864 00000100:00100000:1.0:1746066806.232143:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4288 00000100:00100000:1.0:1746066806.232148:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32063:x1830882977332864:12345-192.168.202.57@tcp:35:mirror_io.0 00000100:00100000:1.0:1746066806.232278:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:32063:x1830882977332864:12345-192.168.202.57@tcp:35:mirror_io.0 Request processed in 129us (285us total) trans 8589944282 rc 0/0 00000100:00100000:1.0:1746066806.232284:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4288 00010000:00010000:1.0:1746066806.260082:0:9850:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746066806.260193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.260244:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.260304:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977333120 00000100:00100000:0.0:1746066806.260312:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977333120 00000100:00100000:2.0:1746066806.260328:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977333376 00000100:00100000:2.0:1746066806.260331:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977333376 00000100:00100000:0.0:1746066806.260350:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10191 00000100:00100000:0.0:1746066806.260357:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+250:32074:x1830882977333120:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:2.0:1746066806.260362:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10192 00000100:00100000:2.0:1746066806.260366:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+7:32075:x1830882977333376:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066806.260373:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.260373:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.260386:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xfb36a14ee608dc32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd64 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.260386:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3a00/0xfb36a14ee608dc2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd5d expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.260470:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7000/0xfb36a14ee608dc39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.260472:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3200/0xfb36a14ee608dc40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066806.260480:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7000/0xfb36a14ee608dc39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.261614:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7000/0xfb36a14ee608dc39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.261630:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608dc47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.261635:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608dc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.261640:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608dc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.261754:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7200/0xfb36a14ee608dc4e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.261762:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7200/0xfb36a14ee608dc4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.261767:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7200/0xfb36a14ee608dc4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:2.0:1746066806.261778:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066806.261898:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3200/0xfb36a14ee608dc40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066806.261906:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7000/0xfb36a14ee608dc39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.261906:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3200/0xfb36a14ee608dc40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066806.261912:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7000/0xfb36a14ee608dc39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.261916:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7000/0xfb36a14ee608dc39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.261920:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129ff7000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066806.261924:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7000/0xfb36a14ee608dc39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066806.261953:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dc5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.261959:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dc5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.261964:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dc5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066806.262401:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7000/0xfb36a14ee608dc39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.262411:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:2.0:1746066806.262414:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066806.262417:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7000/0xfb36a14ee608dc39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.262421:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7000/0xfb36a14ee608dc39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066806.262594:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dc63 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.262600:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dc63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.262606:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dc63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066806.262609:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608dc47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00000004:00200000:1.0:1746066806.262612:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066806.262615:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608dc47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.262619:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608dc47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.262626:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129ff6c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:2.0:1746066806.262628:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608dc47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.262632:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608dc47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.262639:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebebe00) 00010000:00010000:2.0:1746066806.262641:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066806.262643:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608dc47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.262647:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608dc47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066806.262648:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3200/0xfb36a14ee608dc40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.262652:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3200/0xfb36a14ee608dc40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.262656:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3200/0xfb36a14ee608dc40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.262659:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801363f3200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066806.262661:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3200/0xfb36a14ee608dc40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.262664:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3200/0xfb36a14ee608dc40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.262670:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066806.262672:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066806.262690:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3200/0xfb36a14ee608dc40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066806.262694:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9c00/0xfb36a14ee608dc32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd64 expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.262695:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3200/0xfb36a14ee608dc40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066806.262704:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7200/0xfb36a14ee608dc4e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd64 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.262709:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.262711:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066806.262713:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff7200, rc 0) 00010000:00010000:1.0:1746066806.263111:0:14549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dc5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.263117:0:14549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dc5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.263122:0:14549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dc5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.263126:0:14549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c3cc00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066806.263128:0:14549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dc5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.263133:0:14549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dc5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.263140:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ebebe00) 00010000:00010000:1.0:1746066806.263141:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066806.263143:0:14549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dc5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.263147:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3cc00/0xfb36a14ee608dc5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.263171:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801363f3a00/0xfb36a14ee608dc2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd5d expref: 253 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066806.263183:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+9:32075:x1830882977333376:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2816us (2938us total) trans 8589944283 rc 0/0 00010000:00010000:1.0:1746066806.263183:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dc63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd5d expref: 252 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.263188:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00000100:00100000:2.0:1746066806.263190:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10192 00010000:00010000:1.0:1746066806.263190:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066806.263191:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c3ca00, rc 0) 00000100:00100000:1.0:1746066806.263206:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:32074:x1830882977333120:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2851us (3020us total) trans 8589944284 rc 0/0 00000100:00100000:1.0:1746066806.263211:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10191 00000100:00100000:0.0:1746066806.265634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.265805:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977333632 00000100:00100000:3.0:1746066806.265813:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977333632 00000100:00100000:3.0:1746066806.265858:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4289 00000100:00100000:3.0:1746066806.265865:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+9:32075:x1830882977333632:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:3.0:1746066806.266665:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:32075:x1830882977333632:12345-192.168.202.57@tcp:35:cat.0 Request processed in 358us (595us total) trans 8589944285 rc 0/0 00000100:00100000:3.0:1746066806.266694:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4289 00000100:00100000:0.0:1746066806.267479:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.267581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.267780:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977333760 00000100:00100000:1.0:1746066806.267784:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977333760 00000100:00100000:1.0:1746066806.267814:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15518 00000100:00100000:1.0:1746066806.267819:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977333760:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066806.267831:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.267845:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093c3c200/0xfb36a14ee608dc71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd6b expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066806.267865:0:10402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd75, atime: 0x6812dd75, ctime: 0x6812dd75, blocks: 0x7ff 00000100:00100000:0.0:1746066806.267915:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.267932:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977334144 00000100:00100000:0.0:1746066806.267935:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977334144 00000100:00100000:0.0:1746066806.267956:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15519 00000100:00100000:0.0:1746066806.267961:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1963:x1830882977334144:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066806.267969:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.267978:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801363f3400/0xfb36a14ee608dc78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd79 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066806.267990:0:8451:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38d:0x0] initial LVB size: 2097152, mtime: 0x6812dd75, atime: 0x6812dd75, ctime: 0x6812dd75, blocks: 0x821 00010000:00010000:0.0:1746066806.268004:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.268006:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.268012:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363f3400/0xfb36a14ee608dc78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd79 expref: 36 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.268025:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801363f3400/0xfb36a14ee608dc78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd79 expref: 36 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.268035:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801363f3400, rc 0) 00000100:00100000:0.0:1746066806.268074:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882977334144:12345-192.168.202.57@tcp:101:cat.0 Request processed in 112us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.268079:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15519 00010000:00010000:1.0:1746066806.268744:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.268746:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.268751:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c3c200/0xfb36a14ee608dc71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd6b expref: 26 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.268760:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093c3c200/0xfb36a14ee608dc71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd6b expref: 26 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.268771:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c3c200, rc 0) 00000100:00100000:1.0:1746066806.268789:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977333760:12345-192.168.202.57@tcp:101:cat.0 Request processed in 970us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.268794:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15518 00000100:00100000:1.0:1746066806.268813:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977334016 00000100:00100000:1.0:1746066806.268816:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977334016 00000100:00100000:1.0:1746066806.268844:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10193 00000100:00100000:1.0:1746066806.268848:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:32072:x1830882977334016:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066806.268858:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.268867:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608dc7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd72 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.268935:0:14549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.268947:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7200/0xfb36a14ee608dc4e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd64 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.268954:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dc63 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd5d expref: 253 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.268959:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:1.0:1746066806.268985:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dc63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd5d expref: 253 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.268999:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dc63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd5d expref: 253 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.269009:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882977002368:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066806.269067:0:14549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7200/0xfb36a14ee608dc4e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd64 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.269074:0:14549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7200/0xfb36a14ee608dc4e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd64 expref: 9 pid: 809 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.269081:0:14549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882977002496:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066806.269099:0:14549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.270252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.270284:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.270305:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.270460:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977334272 00000100:00100000:1.0:1746066806.270465:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977334272 00000100:00100000:1.0:1746066806.270494:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977334528 00000100:00100000:1.0:1746066806.270495:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977334528 00000100:00100000:1.0:1746066806.270505:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977334400 00000100:00100000:1.0:1746066806.270507:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977334400 00000100:00100000:1.0:1746066806.271284:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15520 00000100:00100000:1.0:1746066806.271293:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882977334272:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066806.271305:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.271319:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e400/0xfb36a14ee608dc8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd80 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066806.271337:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd75, atime: 0x6812dd73, ctime: 0x6812dd75, blocks: 0x821 00010000:00010000:1.0:1746066806.271350:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.271352:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.271358:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e400/0xfb36a14ee608dc8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd80 expref: 37 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.271369:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e400/0xfb36a14ee608dc8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd80 expref: 37 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.271377:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1e400, rc 0) 00000100:00100000:1.0:1746066806.271405:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1963:x1830882977334272:12345-192.168.202.57@tcp:101:cat.0 Request processed in 114us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.271410:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15520 00000100:00100000:1.0:1746066806.271422:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15521 00000100:00100000:1.0:1746066806.271427:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977334528:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066806.271434:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.271443:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608dc94 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd8e expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066806.271455:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 5090560, mtime: 0x6812dd75, atime: 0x6812dd75, ctime: 0x6812dd75, blocks: 0x1723 00010000:00010000:1.0:1746066806.271463:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.271464:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.271469:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608dc94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd8e expref: 28 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.271479:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608dc94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd8e expref: 28 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.271498:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1f200, rc 0) 00000100:00100000:1.0:1746066806.271514:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977334528:12345-192.168.202.57@tcp:101:cat.0 Request processed in 87us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.271519:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15521 00000100:00100000:1.0:1746066806.271529:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15522 00000100:00100000:1.0:1746066806.271534:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977334400:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066806.271539:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.271546:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc9b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd87 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066806.271556:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 2097152, mtime: 0x6812dd75, atime: 0x6812dd75, ctime: 0x6812dd75, blocks: 0x81d 00010000:00010000:1.0:1746066806.271563:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.271565:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.271569:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd87 expref: 28 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.271577:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd87 expref: 28 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.271583:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f30800, rc 0) 00000100:00100000:1.0:1746066806.271598:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977334400:12345-192.168.202.57@tcp:101:cat.0 Request processed in 64us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.271603:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15522 00000100:00100000:3.0:1746066806.272093:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.272148:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977334656 00000100:00100000:0.0:1746066806.272153:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977334656 00000100:00100000:0.0:1746066806.272187:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15523 00000100:00100000:0.0:1746066806.272193:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1963:x1830882977334656:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066806.272199:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.272207:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25800/0xfb36a14ee608dca2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd95 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066806.272218:0:9776:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38f:0x0] initial LVB size: 4194304, mtime: 0x6812dd75, atime: 0x6812dd74, ctime: 0x6812dd75, blocks: 0x1029 00010000:00010000:0.0:1746066806.272225:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.272227:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.272230:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25800/0xfb36a14ee608dca2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd95 expref: 38 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.272239:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25800/0xfb36a14ee608dca2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd95 expref: 38 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.272245:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4f25800, rc 0) 00000100:00100000:0.0:1746066806.272264:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1963:x1830882977334656:12345-192.168.202.57@tcp:101:cat.0 Request processed in 72us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.272269:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15523 00000100:00100000:0.0:1746066806.273538:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.273864:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.273950:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977335040 00000100:00100000:2.0:1746066806.273956:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977335040 00000100:00100000:2.0:1746066806.273985:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10194 00000100:00100000:2.0:1746066806.273991:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:32069:x1830882977335040:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066806.274006:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.274018:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7e00/0xfb36a14ee608dca9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fda3 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.274088:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.274099:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.274105:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:2.0:1746066806.274973:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977334784 00000100:00100000:2.0:1746066806.274978:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977334784 00000100:00100000:0.0:1746066806.274996:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.275120:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977335168 00000100:00100000:2.0:1746066806.275123:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977335168 00000100:00100000:0.0:1746066806.275135:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.275140:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977335296 00000100:00100000:2.0:1746066806.275141:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977335296 00000100:00100000:0.0:1746066806.275149:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.275153:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15524 00000100:00100000:2.0:1746066806.275157:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+24:1966:x1830882977334784:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:0.0:1746066806.275161:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066806.275166:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066806.275172:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066806.275175:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608dcb7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fd9c expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.275189:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.275191:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.275197:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608dcb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd9c expref: 25 pid: 8451 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066806.275203:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066806.275223:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608dcb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd9c expref: 25 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.275231:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff6800, rc 0) 00000100:00100000:0.0:1746066806.275260:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.275263:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+25:1966:x1830882977334784:12345-192.168.202.57@tcp:101:cat.0 Request processed in 105us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.275268:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15524 00000100:00100000:0.0:1746066806.275274:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977335936 00000100:00100000:0.0:1746066806.275276:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977335936 00000100:00100000:2.0:1746066806.275278:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977335424 00000100:00100000:2.0:1746066806.275279:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977335424 00010000:00010000:0.0:1746066806.275295:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7200/0xfb36a14ee608dc4e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd64 expref: 12 pid: 809 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.275301:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977335552 00000100:00100000:2.0:1746066806.275303:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977335552 00000100:00100000:2.0:1746066806.275309:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977335680 00000100:00100000:0.0:1746066806.275310:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977335808 00000100:00100000:2.0:1746066806.275311:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977335680 00000100:00100000:0.0:1746066806.275311:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977335808 00000100:00100000:2.0:1746066806.275318:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15525 00010000:00010000:0.0:1746066806.275319:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dc63 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd5d expref: 254 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.275323:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977335168:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066806.275329:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066806.275330:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8033 00000100:00100000:0.0:1746066806.275335:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882977335936:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066806.275337:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ff7a00/0xfb36a14ee608dcbe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fdaa expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.275341:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066806.275345:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7200/0xfb36a14ee608dc4e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd64 expref: 12 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.275346:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.275347:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.275351:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff7a00/0xfb36a14ee608dcbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdaa expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.275357:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7200/0xfb36a14ee608dc4e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd64 expref: 12 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.275359:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129ff7a00/0xfb36a14ee608dcbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdaa expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.275369:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff7a00, rc 0) 00010000:00010000:0.0:1746066806.275370:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066806.275374:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066806.275379:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746066806.275382:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977335168:12345-192.168.202.57@tcp:101:cat.0 Request processed in 60us (387us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066806.275384:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066806.275387:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15525 00000100:00100000:2.0:1746066806.275395:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15526 00000100:00100000:0.0:1746066806.275395:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:1965:x1830882977335936:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 60us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.275399:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977335296:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:0.0:1746066806.275399:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8033 00010000:00010000:2.0:1746066806.275404:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066806.275407:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8034 00010000:00010000:2.0:1746066806.275409:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608dcc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fdb1 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.275412:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:1964:x1830882977335808:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066806.275417:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066806.275418:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.275419:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.275420:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dc63 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd5d expref: 254 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.275423:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608dcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb1 expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.275427:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dc63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd5d expref: 254 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.275430:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608dcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb1 expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.275435:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.275436:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff6200, rc 0) 00010000:00010000:0.0:1746066806.275438:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14549 initiator: MDT0 00010000:00010000:0.0:1746066806.275443:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746066806.275447:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977335296:12345-192.168.202.57@tcp:101:cat.0 Request processed in 47us (312us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066806.275449:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14549 initiator: MDT0 00000100:00100000:2.0:1746066806.275451:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15526 00010000:00010000:0.0:1746066806.275454:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:2.0:1746066806.275458:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15527 00010000:00010000:0.0:1746066806.275458:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00000100:00100000:2.0:1746066806.275462:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977335424:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066806.275463:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.275469:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.275474:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129ff7c00/0xfb36a14ee608dccc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fdb8 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.275480:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066806.275482:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.275483:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.275500:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff7c00/0xfb36a14ee608dccc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb8 expref: 27 pid: 8451 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066806.275505:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:1964:x1830882977335808:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 93us (245us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066806.275509:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129ff7c00/0xfb36a14ee608dccc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb8 expref: 27 pid: 8451 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066806.275509:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8034 00010000:00010000:2.0:1746066806.275515:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff7c00, rc 0) 00000100:00100000:2.0:1746066806.275526:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977335424:12345-192.168.202.57@tcp:101:cat.0 Request processed in 64us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.275530:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15527 00000100:00100000:2.0:1746066806.275537:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15528 00000100:00100000:2.0:1746066806.275541:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977335552:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066806.275546:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.275550:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129ff6600/0xfb36a14ee608dcd3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fdbf expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.275557:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.275559:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.275561:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff6600/0xfb36a14ee608dcd3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdbf expref: 27 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.275563:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c3ca00/0xfb36a14ee608dc63 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd5d expref: 253 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.275568:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129ff6600/0xfb36a14ee608dcd3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdbf expref: 27 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.275574:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff6600, rc 0) 00000100:00100000:0.0:1746066806.275576:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882977002368:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.275585:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977335552:12345-192.168.202.57@tcp:101:cat.0 Request processed in 44us (423us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066806.275585:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7200/0xfb36a14ee608dc4e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd64 expref: 11 pid: 809 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.275590:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15528 00000100:00100000:0.0:1746066806.275592:0:14549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14549:1830882977002496:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.275596:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15529 00000100:00100000:2.0:1746066806.275600:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+19:1966:x1830882977335680:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066806.275605:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.275606:0:14549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066806.275610:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dcda lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fdc6 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.275611:0:14549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066806.275617:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.275618:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.275618:0:14549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14549 initiator: MDT0 00010000:00010000:2.0:1746066806.275621:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dcda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdc6 expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.275628:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dcda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdc6 expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00000004:00200000:0.0:1746066806.275630:0:14549:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066806.275633:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff6e00, rc 0) 00000100:00100000:2.0:1746066806.275645:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977335680:12345-192.168.202.57@tcp:101:cat.0 Request processed in 45us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.275649:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15529 00010000:00010000:2.0:1746066806.275670:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.275690:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:2.0:1746066806.275698:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066806.275742:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7e00/0xfb36a14ee608dca9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fda3 expref: 12 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.275742:0:14549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b46c00/0xfb36a14ee608dc7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd72 expref: 254 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.275751:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd72 expref: 253 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.275755:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fda3 expref: 11 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.275756:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066806.275759:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066806.275761:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066806.275761:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f209200, rc 0) 00010000:00010000:2.0:1746066806.275762:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066806.275763:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff7400, rc 0) 00000100:00100000:2.0:1746066806.275773:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+11:32069:x1830882977335040:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 1784us (2239us total) trans 8589944287 rc 0/0 00000100:00100000:0.0:1746066806.275773:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32072:x1830882977334016:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6924us (8192us total) trans 8589944286 rc 0/0 00000100:00100000:0.0:1746066806.275777:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10193 00000100:00100000:2.0:1746066806.275780:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10194 00000100:00100000:0.0:1746066806.283627:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.283968:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977336064 00000100:00100000:2.0:1746066806.283975:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977336064 00000100:00100000:2.0:1746066806.284011:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10195 00000100:00100000:2.0:1746066806.284018:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32074:x1830882977336064:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066806.284034:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.284048:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dcef lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fdcd expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.284095:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dcef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdcd expref: 254 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.284105:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dcef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdcd expref: 254 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.284123:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.284125:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066806.284128:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff6000, rc 0) 00000100:00100000:2.0:1746066806.284172:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:32074:x1830882977336064:12345-192.168.202.57@tcp:101:cat.0 Request processed in 154us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.284177:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10195 00000100:00100000:0.0:1746066806.285955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.286031:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977336192 00000100:00100000:2.0:1746066806.286037:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977336192 00000100:00100000:2.0:1746066806.286063:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10196 00000100:00100000:2.0:1746066806.286069:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:32075:x1830882977336192:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066806.286085:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.286096:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608dcf6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fdd4 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.286130:0:14549:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608dcf6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdd4 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.286140:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608dcf6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdd4 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.286151:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.286153:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066806.286155:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff6a00, rc 0) 00000100:00100000:2.0:1746066806.286197:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:32075:x1830882977336192:12345-192.168.202.57@tcp:101:cat.0 Request processed in 128us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.286202:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10196 00000100:00100000:0.0:1746066806.325443:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.326379:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977336448 00000100:00100000:2.0:1746066806.326387:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977336448 00002000:00100000:2.0:1746066806.326426:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e851180 x1830882977336448/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.326435:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e851180 with x1830882977336448 ext(0->1048575) 00002000:00010000:2.0:1746066806.326439:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e851180 00000100:00100000:2.0:1746066806.326473:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7073 00000100:00100000:2.0:1746066806.326479:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882977336448:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066806.329239:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.329269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.329280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.329299:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.329309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.329320:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.329376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.329398:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977336704 00000100:00100000:0.0:1746066806.329406:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977336704 00002000:00100000:0.0:1746066806.329449:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e851c00 x1830882977336704/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.329459:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e851c00 with x1830882977336704 ext(1048576->2097151) 00002000:00010000:0.0:1746066806.329464:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e851c00 00000100:00100000:0.0:1746066806.329479:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977336960 00000100:00100000:0.0:1746066806.329481:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977336960 00002000:00100000:0.0:1746066806.329503:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009e852a00 x1830882977336960/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.329509:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e852a00 with x1830882977336960 ext(1048576->2097151) 00002000:00010000:0.0:1746066806.329512:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e852a00 00000100:00100000:0.0:1746066806.329520:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977337216 00000100:00100000:0.0:1746066806.329523:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977337216 00002000:00100000:0.0:1746066806.329533:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009e850700 x1830882977337216/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.329544:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e850700 with x1830882977337216 ext(1048576->2097151) 00002000:00010000:0.0:1746066806.329547:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e850700 00000100:00100000:0.0:1746066806.329556:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977337472 00000100:00100000:0.0:1746066806.329558:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977337472 00002000:00100000:0.0:1746066806.329570:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e853100 x1830882977337472/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.329576:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e853100 with x1830882977337472 ext(0->1048575) 00002000:00010000:0.0:1746066806.329578:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e853100 00000100:00100000:0.0:1746066806.330410:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977337728 00000100:00100000:0.0:1746066806.330415:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977337728 00002000:00100000:0.0:1746066806.330432:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e850000 x1830882977337728/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.330443:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e850000 with x1830882977337728 ext(1048576->2097151) 00002000:00010000:0.0:1746066806.330446:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e850000 00000100:00100000:3.0:1746066806.330495:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977337984 00000100:00100000:3.0:1746066806.330499:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977337984 00002000:00100000:3.0:1746066806.330515:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009e853800 x1830882977337984/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.330520:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e853800 with x1830882977337984 ext(1048576->2097151) 00002000:00010000:3.0:1746066806.330523:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e853800 00000100:00100000:3.0:1746066806.330533:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977338240 00000100:00100000:3.0:1746066806.330535:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977338240 00002000:00100000:3.0:1746066806.330543:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88012c22d180 x1830882977338240/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.330548:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22d180 with x1830882977338240 ext(1048576->2097151) 00002000:00010000:3.0:1746066806.330551:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c22d180 00000100:00100000:3.0:1746066806.330560:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7074 00000100:00100000:3.0:1746066806.330567:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+21:1965:x1830882977336704:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066806.331817:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7075 00000100:00100000:3.0:1746066806.331827:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882977336960:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066806.332592:0:25585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7076 00000100:00100000:1.0:1746066806.332602:0:25585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+29:1965:x1830882977337216:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066806.333826:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7077 00000100:00100000:2.0:1746066806.333834:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977337472:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066806.334737:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7078 00000100:00100000:2.0:1746066806.334744:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1963:x1830882977337728:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066806.336914:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7079 00000100:00100000:1.0:1746066806.336929:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977337984:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066806.344211:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7080 00000100:00100000:0.0:1746066806.344235:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977338240:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066806.398196:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1965:x1830882977336704:12345-192.168.202.57@tcp:3:cat.0 Request processed in 67620us (68955us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066806.398207:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7074 00002000:00100000:3.0:1746066806.398221:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e851c00 x1830882977336704/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.398230:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e851c00 with x1830882977336704 ext(1048576->2097151) 00002000:00010000:3.0:1746066806.398235:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e851c00 00000100:00100000:2.0:1746066806.409551:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+29:1965:x1830882977336448:12345-192.168.202.57@tcp:3:cat.0 Request processed in 83061us (84105us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066806.409562:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7073 00002000:00100000:2.0:1746066806.409573:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e851180 x1830882977336448/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.409582:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e851180 with x1830882977336448 ext(0->1048575) 00002000:00010000:2.0:1746066806.409587:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e851180 00000100:00100000:0.0:1746066806.414084:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.414137:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977338496 00000100:00100000:1.0:1746066806.414145:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977338496 00000100:00100000:1.0:1746066806.414190:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10197 00000100:00100000:1.0:1746066806.414197:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:32072:x1830882977338496:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066806.414215:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.414218:0:809:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066806.414239:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dcef lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdcd expref: 254 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.414263:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066806.414267:0:809:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066806.414275:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135430600/0xfb36a14ee608dcfd lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fddb expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.414316:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066806.414327:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9600/0xfb36a14ee608dc24 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd56 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.414333:0:809:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608dcf6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdd4 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.414339:0:809:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066806.414363:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608dcf6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdd4 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.414376:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608dcf6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdd4 expref: 11 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.414386:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882977002624:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066806.414469:0:809:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9600/0xfb36a14ee608dc24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd56 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.414477:0:809:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9600/0xfb36a14ee608dc24 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd56 expref: 8 pid: 809 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.414498:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882977002752:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066806.414518:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066806.419642:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977337472:12345-192.168.202.57@tcp:3:cat.0 Request processed in 85802us (90334us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066806.419653:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7077 00002000:00100000:2.0:1746066806.419663:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009e853100 x1830882977337472/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.419693:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e853100 with x1830882977337472 ext(0->1048575) 00002000:00010000:2.0:1746066806.419698:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e853100 00000100:00100000:0.0:1746066806.426611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.426660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.427576:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882977002624:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.427586:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882977002752:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.427606:0:809:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000100:00100000:0.0:1746066806.427868:0:25585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882977337216:12345-192.168.202.57@tcp:3:cat.0 Request processed in 95268us (98585us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066806.427878:0:25585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7076 00002000:00100000:0.0:1746066806.427886:0:25585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009e850700 x1830882977337216/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.427894:0:25585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e850700 with x1830882977337216 ext(1048576->2097151) 00002000:00010000:0.0:1746066806.427899:0:25585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e850700 00000100:00100000:1.0:1746066806.428507:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977338624 00000100:00100000:1.0:1746066806.428513:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977338624 00010000:00010000:1.0:1746066806.428538:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608dcf6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdd4 expref: 12 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.428557:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977338752 00000100:00100000:1.0:1746066806.428559:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977338752 00010000:00010000:1.0:1746066806.428567:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9600/0xfb36a14ee608dc24 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd56 expref: 9 pid: 809 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.428579:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8035 00000100:00100000:1.0:1746066806.428583:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882977338624:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.428594:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.428599:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608dcf6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdd4 expref: 12 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.428608:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608dcf6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdd4 expref: 12 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.428625:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608dcf6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdd4 expref: 12 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.428639:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066806.428644:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066806.428650:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066806.428654:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.428686:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+11:1964:x1830882977338624:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 89us (2070us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.428692:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8035 00000100:00100000:1.0:1746066806.428703:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8036 00000100:00100000:1.0:1746066806.428707:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977338752:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.428713:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.428717:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9600/0xfb36a14ee608dc24 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd56 expref: 9 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.428724:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9600/0xfb36a14ee608dc24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd56 expref: 9 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.428734:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fe9600/0xfb36a14ee608dc24 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd56 expref: 9 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.428742:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066806.428745:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066806.428750:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066806.428756:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066806.428769:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.428783:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977338752:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 75us (2122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.428788:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8036 00010000:00010000:2.0:1746066806.429087:0:809:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:2.0:1746066806.429093:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000040:00080000:2.0:1746066806.429594:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3225, 88 off273064 00000004:00080000:2.0:1746066806.429599:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767606922588ns, next at 749511128030ns, rc = 0 00000100:00100000:0.0:1746066806.430348:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000040:00080000:2.0:1746066806.430916:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3227, 88 off273152 00000004:00080000:2.0:1746066806.430922:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767608245614ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066806.430936:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3228, 88 off273240 00000004:00080000:2.0:1746066806.430939:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767608263114ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066806.430951:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3226, 88 off273152 00000004:00080000:2.0:1746066806.430954:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767608277691ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066806.430961:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3227, 88 off273240 00000004:00080000:2.0:1746066806.430963:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767608286946ns, next at 749511128030ns, rc = 0 00000100:00100000:0.0:1746066806.430964:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977337984:12345-192.168.202.57@tcp:3:cat.0 Request processed in 94039us (101640us total) trans 0 rc 1048576/1048576 00000040:00080000:2.0:1746066806.430969:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3229, 88 off273328 00000004:00080000:2.0:1746066806.430971:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767608295361ns, next at 749511475809ns, rc = 0 00000100:00100000:0.0:1746066806.430972:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7079 00000040:00080000:2.0:1746066806.430977:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3230, 88 off273416 00000004:00080000:2.0:1746066806.430979:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767608303599ns, next at 749511475809ns, rc = 0 00002000:00100000:0.0:1746066806.430982:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009e853800 x1830882977337984/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000040:00080000:2.0:1746066806.430987:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3231, 88 off273504 00000004:00080000:2.0:1746066806.430989:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767608312662ns, next at 749511475809ns, rc = 0 00002000:00100000:0.0:1746066806.430990:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e853800 with x1830882977337984 ext(1048576->2097151) 00000040:00080000:2.0:1746066806.430994:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3228, 88 off273328 00002000:00010000:0.0:1746066806.430994:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e853800 00000004:00080000:2.0:1746066806.430996:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767608320210ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066806.431003:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3232, 88 off273592 00000004:00080000:2.0:1746066806.431005:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767608329374ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066806.431011:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3229, 88 off273416 00000004:00080000:2.0:1746066806.431013:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767608337496ns, next at 749511128030ns, rc = 0 00000100:00100000:0.0:1746066806.431088:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977338880 00000100:00100000:0.0:1746066806.431094:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977338880 00000100:00100000:0.0:1746066806.431556:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10198 00000100:00100000:0.0:1746066806.431564:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+11:32069:x1830882977338880:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066806.431578:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.431590:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bce00/0xfb36a14ee608dd0b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fde2 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1746066806.432136:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3233, 88 off273680 00000004:00080000:2.0:1746066806.432143:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767609467187ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066806.432160:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3230, 88 off273504 00000004:00080000:2.0:1746066806.432163:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767609486750ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066806.432171:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3231, 88 off273592 00000004:00080000:2.0:1746066806.432173:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767609497274ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066806.432182:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3232, 88 off273680 00000004:00080000:2.0:1746066806.432184:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767609508203ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066806.432192:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3233, 88 off273768 00000004:00080000:2.0:1746066806.432194:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767609517672ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066806.433014:0:809:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3234, 88 off273768 00000004:00080000:2.0:1746066806.433020:0:809:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767610344270ns, next at 749511475809ns, rc = 0 00010000:00010000:3.0:1746066806.433885:0:14549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.433898:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bce00/0xfb36a14ee608dd0b lrc: 4/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde2 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.433914:0:14549:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.433926:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bce00/0xfb36a14ee608dd0b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde2 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.433937:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066806.433940:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066806.433942:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bce00/0xfb36a14ee608dd0b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde2 expref: 12 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.433947:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9bce00, rc 0) 00000100:00100000:3.0:1746066806.433989:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc98f875-2edf-4505-a13a-65f96879556b+12:32069:x1830882977338880:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 2425us (3643us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.433995:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10198 00000100:00100000:0.0:1746066806.444015:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977338240:12345-192.168.202.57@tcp:3:cat.0 Request processed in 99786us (114630us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066806.444025:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7080 00002000:00100000:0.0:1746066806.444036:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88012c22d180 x1830882977338240/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.444044:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22d180 with x1830882977338240 ext(1048576->2097151) 00002000:00010000:0.0:1746066806.444050:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c22d180 00000100:00100000:0.0:1746066806.444528:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.444937:0:14549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977339008 00000100:00100000:3.0:1746066806.444944:0:14549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977339008 00000100:00100000:3.0:1746066806.444974:0:14549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10199 00000100:00100000:3.0:1746066806.444979:0:14549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:32074:x1830882977339008:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066806.444993:0:14549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066806.445008:0:14549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130f35800/0xfb36a14ee608dd12 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fde9 expref: -99 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.445057:0:14549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130f35800/0xfb36a14ee608dd12 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde9 expref: 257 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.445067:0:14549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130f35800/0xfb36a14ee608dd12 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde9 expref: 257 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.445077:0:14549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066806.445079:0:14549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066806.445082:0:14549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bce00/0xfb36a14ee608dd0b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde2 expref: 11 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.445086:0:14549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f35800, rc 0) 00000100:00100000:3.0:1746066806.445109:0:14549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:32074:x1830882977339008:12345-192.168.202.57@tcp:101:cat.0 Request processed in 130us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.445114:0:14549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10199 00000100:00100000:2.0:1746066806.454102:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1963:x1830882977337728:12345-192.168.202.57@tcp:3:cat.0 Request processed in 119349us (124782us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066806.454112:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7078 00002000:00100000:2.0:1746066806.454122:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e850000 x1830882977337728/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.454131:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e850000 with x1830882977337728 ext(1048576->2097151) 00002000:00010000:2.0:1746066806.454137:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e850000 00000100:00100000:3.0:1746066806.456496:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+20:1965:x1830882977336960:12345-192.168.202.57@tcp:3:cat.0 Request processed in 124656us (127210us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066806.456509:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7075 00002000:00100000:3.0:1746066806.456517:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009e852a00 x1830882977336960/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.456526:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e852a00 with x1830882977336960 ext(1048576->2097151) 00002000:00010000:3.0:1746066806.456530:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e852a00 00000001:00080000:1.0:1746066806.480512:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944286 is committed 00000001:00080000:1.0:1746066806.480526:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944282 is committed 00000001:00080000:1.0:1746066806.480530:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944288 is committed 00000004:00080000:1.0:1746066806.480535:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2507 committed 00000004:00080000:1.0:1746066806.480542:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2505 committed 00000004:00080000:1.0:1746066806.480547:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2504 committed 00000004:00080000:1.0:1746066806.480549:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2503 committed 00000004:00080000:1.0:1746066806.480550:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2502 committed 00000004:00080000:1.0:1746066806.480552:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2506 committed 00000004:00080000:1.0:1746066806.480553:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2501 committed 00000004:00080000:1.0:1746066806.480554:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2505 committed 00000004:00080000:1.0:1746066806.480555:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2500 committed 00000004:00080000:1.0:1746066806.480556:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2504 committed 00000004:00080000:1.0:1746066806.480557:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2503 committed 00000004:00080000:1.0:1746066806.480559:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2502 committed 00000004:00080000:1.0:1746066806.480561:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2499 committed 00000004:00080000:1.0:1746066806.480562:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2498 committed 00000004:00080000:1.0:1746066806.480563:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2501 committed 00000004:00080000:1.0:1746066806.480565:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2500 committed 00000004:00080000:1.0:1746066806.480566:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2497 committed 00000001:00080000:1.0:1746066806.480569:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944287 is committed 00000100:00100000:1.0:1746066806.480728:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977003008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066806.480775:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066806.480814:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977003520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066806.480829:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066806.480845:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746066806.480849:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977002880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066806.480862:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066806.480871:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977003392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066806.480882:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066806.480902:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977003008 00000100:00100000:1.0:1746066806.480907:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977003008 00000100:00100000:1.0:1746066806.480932:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977003520 00000100:00100000:1.0:1746066806.480934:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977003520 00000100:00100000:1.0:1746066806.480944:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977002880 00000100:00100000:1.0:1746066806.480946:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977002880 00000100:00100000:1.0:1746066806.480953:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977003392 00000100:00100000:1.0:1746066806.480955:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977003392 00000100:00100000:1.0:1746066806.480964:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15530 00000100:00100000:1.0:1746066806.480970:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3296:x1830882977003008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066806.481108:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066806.481111:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066805 -> 1746066805 00002000:00010000:1.0:1746066806.481113:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066803 -> 1746066803 00002000:00010000:1.0:1746066806.481115:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066805 -> 1746066805 00002000:00010000:1.0:1746066806.481116:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746066806.481142:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3296:x1830882977003008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 172us (366us total) trans 21474841086 rc 0/0 00000100:00100000:1.0:1746066806.481148:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15530 00000100:00100000:1.0:1746066806.481160:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15531 00000100:00100000:1.0:1746066806.481165:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3296:x1830882977003520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066806.481235:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3296:x1830882977003520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (405us total) trans 21474841087 rc 0/0 00000100:00100000:1.0:1746066806.481240:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15531 00000100:00100000:1.0:1746066806.481248:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15532 00000100:00100000:1.0:1746066806.481252:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3296:x1830882977002880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066806.481309:0:10402:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066806.481312:0:10402:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066805 -> 1746066805 00002000:00010000:1.0:1746066806.481313:0:10402:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066805 -> 1746066805 00002000:00010000:1.0:1746066806.481315:0:10402:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066805 -> 1746066805 00002000:00010000:1.0:1746066806.481316:0:10402:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746066806.481331:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3296:x1830882977002880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (468us total) trans 21474841088 rc 0/0 00000100:00100000:1.0:1746066806.481336:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15532 00000100:00100000:1.0:1746066806.481344:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15533 00000100:00100000:1.0:1746066806.481348:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3296:x1830882977003392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066806.481410:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3296:x1830882977003392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (526us total) trans 21474841089 rc 0/0 00000100:00100000:1.0:1746066806.481414:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15533 00000004:00080000:1.0:1746066806.481449:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929cca80/2, rc 0, transno 21474841088 00000100:00100000:1.0:1746066806.481454:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977002880:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066806.481461:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929cfb80/2, rc 0, transno 21474841089 00000100:00100000:1.0:1746066806.481463:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977003392:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066806.481469:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929cc700/2, rc 0, transno 21474841086 00000100:00100000:1.0:1746066806.481471:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977003008:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066806.481476:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929cf800/2, rc 0, transno 21474841087 00000100:00100000:1.0:1746066806.481478:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977003520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066806.481556:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977003136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066806.481578:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066806.481591:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977003648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066806.481603:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066806.481612:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746066806.481616:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977003264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066806.481627:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066806.481634:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977003776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066806.481646:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066806.481659:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977003136 00000100:00100000:2.0:1746066806.481662:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977003136 00000100:00100000:2.0:1746066806.481694:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977003648 00000100:00100000:2.0:1746066806.481696:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977003648 00000100:00100000:2.0:1746066806.481705:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977003264 00000100:00100000:2.0:1746066806.481707:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977003264 00000100:00100000:2.0:1746066806.481712:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977003776 00000100:00100000:2.0:1746066806.481714:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977003776 00000100:00100000:2.0:1746066806.481721:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15534 00000100:00100000:2.0:1746066806.481725:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3293:x1830882977003136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066806.481798:0:8452:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746066806.481800:0:8452:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066805 -> 1746066805 00002000:00010000:2.0:1746066806.481802:0:8452:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066804 -> 1746066804 00002000:00010000:2.0:1746066806.481804:0:8452:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066805 -> 1746066805 00002000:00010000:2.0:1746066806.481806:0:8452:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746066806.481826:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3293:x1830882977003136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (247us total) trans 21474841090 rc 0/0 00000100:00100000:2.0:1746066806.481833:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15534 00000100:00100000:2.0:1746066806.481842:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15535 00000100:00100000:2.0:1746066806.481846:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3293:x1830882977003648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066806.481912:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3293:x1830882977003648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (308us total) trans 21474841091 rc 0/0 00000100:00100000:2.0:1746066806.481917:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15535 00000100:00100000:2.0:1746066806.481925:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15536 00000100:00100000:2.0:1746066806.481929:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3293:x1830882977003264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066806.481998:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3293:x1830882977003264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (369us total) trans 21474841092 rc 0/0 00000100:00100000:2.0:1746066806.482003:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15536 00000100:00100000:2.0:1746066806.482011:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15537 00000100:00100000:2.0:1746066806.482015:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3293:x1830882977003776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066806.482083:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3293:x1830882977003776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (436us total) trans 21474841093 rc 0/0 00000100:00100000:2.0:1746066806.482087:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15537 00010000:00010000:2.0:1746066806.482174:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fddb expref: 254 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.482185:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.482187:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746066806.482191:0:809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bce00/0xfb36a14ee608dd0b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde2 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.482202:0:809:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bce00/0xfb36a14ee608dd0b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde2 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.482208:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bce00/0xfb36a14ee608dd0b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde2 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.482214:0:809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130f35800/0xfb36a14ee608dd12 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde9 expref: 254 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.482220:0:809:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f35800/0xfb36a14ee608dd12 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde9 expref: 254 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.482226:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130f35800/0xfb36a14ee608dd12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde9 expref: 254 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.482246:0:809:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130f35800/0xfb36a14ee608dd12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde9 expref: 254 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066806.482254:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882977003904:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066806.482303:0:809:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bce00/0xfb36a14ee608dd0b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde2 expref: 8 pid: 14549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066806.482309:0:809:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882977004032:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066806.482323:0:809:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049e40 going to sleep for 11 seconds 00000004:00080000:2.0:1746066806.482420:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929ce300/2, rc 0, transno 21474841092 00000100:00100000:2.0:1746066806.482424:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977003264:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066806.482430:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929ce680/2, rc 0, transno 21474841093 00000100:00100000:2.0:1746066806.482433:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977003776:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066806.482441:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929cd500/2, rc 0, transno 21474841090 00000100:00100000:2.0:1746066806.482443:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977003136:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066806.482447:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800929ced80/2, rc 0, transno 21474841091 00000100:00100000:2.0:1746066806.482449:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977003648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066806.482758:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977004160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.482781:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.482794:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977004672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.482806:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.482816:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746066806.482819:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977004288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.482832:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.482840:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977004800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.482851:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.482864:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977004544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.482875:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.482882:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977005056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.482892:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.482898:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746066806.482901:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977004416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.482912:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.482918:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977004928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.482928:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.482941:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977004160 00000100:00100000:3.0:1746066806.482944:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977004160 00000100:00100000:3.0:1746066806.482956:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977004672 00000100:00100000:3.0:1746066806.482958:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977004672 00000100:00100000:3.0:1746066806.482964:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977004288 00000100:00100000:3.0:1746066806.482966:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977004288 00000100:00100000:3.0:1746066806.482971:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977004800 00000100:00100000:3.0:1746066806.482972:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977004800 00000100:00100000:3.0:1746066806.482977:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977004544 00000100:00100000:3.0:1746066806.482979:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977004544 00000100:00100000:3.0:1746066806.482984:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977005056 00000100:00100000:3.0:1746066806.482985:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977005056 00000100:00100000:3.0:1746066806.482990:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977004416 00000100:00100000:3.0:1746066806.482992:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977004416 00000100:00100000:3.0:1746066806.482997:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977004928 00000100:00100000:3.0:1746066806.482999:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977004928 00000100:00100000:3.0:1746066806.483007:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15538 00000100:00100000:3.0:1746066806.483011:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3295:x1830882977004160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066806.483103:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746066806.483105:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066805 -> 1746066805 00002000:00010000:3.0:1746066806.483107:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066805 -> 1746066805 00002000:00010000:3.0:1746066806.483109:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066805 -> 1746066805 00002000:00010000:3.0:1746066806.483111:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2047 -> 2047 00000100:00100000:3.0:1746066806.483131:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3295:x1830882977004160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (349us total) trans 17179873784 rc 0/0 00000100:00100000:3.0:1746066806.483136:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15538 00000100:00100000:3.0:1746066806.483148:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15539 00000100:00100000:3.0:1746066806.483152:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3295:x1830882977004672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.483216:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3295:x1830882977004672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (409us total) trans 17179873785 rc 0/0 00000100:00100000:3.0:1746066806.483221:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15539 00000100:00100000:3.0:1746066806.483229:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15540 00000100:00100000:3.0:1746066806.483233:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3295:x1830882977004288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066806.483285:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066806.483288:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066805 -> 1746066805 00002000:00010000:3.0:1746066806.483289:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066805 -> 1746066805 00002000:00010000:3.0:1746066806.483291:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066805 -> 1746066805 00002000:00010000:3.0:1746066806.483293:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746066806.483308:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3295:x1830882977004288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (475us total) trans 17179873786 rc 0/0 00000100:00100000:3.0:1746066806.483313:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15540 00000100:00100000:3.0:1746066806.483321:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15541 00000100:00100000:3.0:1746066806.483325:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3295:x1830882977004800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.483383:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3295:x1830882977004800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (531us total) trans 17179873787 rc 0/0 00000100:00100000:3.0:1746066806.483388:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15541 00000100:00100000:3.0:1746066806.483396:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15542 00000100:00100000:3.0:1746066806.483399:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3294:x1830882977004544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.483462:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3294:x1830882977004544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (585us total) trans 17179873788 rc 0/0 00000100:00100000:3.0:1746066806.483466:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15542 00000100:00100000:3.0:1746066806.483474:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15543 00000100:00100000:3.0:1746066806.483478:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3294:x1830882977005056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.483567:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3294:x1830882977005056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (673us total) trans 17179873789 rc 0/0 00000100:00100000:3.0:1746066806.483571:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15543 00000100:00100000:3.0:1746066806.483581:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15544 00000100:00100000:3.0:1746066806.483585:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3294:x1830882977004416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066806.483644:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:3.0:1746066806.483646:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066805 -> 1746066805 00002000:00010000:3.0:1746066806.483648:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066805 -> 1746066805 00002000:00010000:3.0:1746066806.483649:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066805 -> 1746066805 00002000:00010000:3.0:1746066806.483651:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5923 -> 5923 00000100:00100000:3.0:1746066806.483668:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3294:x1830882977004416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (754us total) trans 17179873790 rc 0/0 00000100:00100000:3.0:1746066806.483672:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15544 00000100:00100000:3.0:1746066806.483703:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15545 00000100:00100000:3.0:1746066806.483707:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3294:x1830882977004928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066806.483764:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746066806.483766:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746066806.483768:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066806.483769:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746066806.483771:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746066806.483789:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3294:x1830882977004928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (859us total) trans 17179873791 rc 0/0 00000100:00100000:3.0:1746066806.483793:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15545 00000004:00080000:3.0:1746066806.483817:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efb5500/2, rc 0, transno 17179873790 00000100:00100000:3.0:1746066806.483824:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977004416:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066806.483830:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efb5180/2, rc 0, transno 17179873791 00000100:00100000:3.0:1746066806.483833:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977004928:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066806.483838:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efb5f80/2, rc 0, transno 17179873788 00000100:00100000:3.0:1746066806.483840:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977004544:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066806.483845:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efb4000/2, rc 0, transno 17179873789 00000100:00100000:3.0:1746066806.483847:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977005056:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066806.483858:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efb6300/2, rc 0, transno 17179873786 00000100:00100000:3.0:1746066806.483861:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977004288:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066806.483866:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efb4e00/2, rc 0, transno 17179873787 00000100:00100000:3.0:1746066806.483868:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977004800:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066806.483875:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efb4700/2, rc 0, transno 17179873784 00000100:00100000:3.0:1746066806.483877:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977004160:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066806.483882:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efb4a80/2, rc 0, transno 17179873785 00000100:00100000:3.0:1746066806.483884:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977004672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.483908:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977005184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.483924:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066806.483941:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977005184 00000100:00100000:3.0:1746066806.483944:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977005184 00000100:00100000:3.0:1746066806.483958:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15546 00000100:00100000:3.0:1746066806.483961:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3295:x1830882977005184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066806.484033:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3295:x1830882977005184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (107us total) trans 17179873792 rc 0/0 00000100:00100000:3.0:1746066806.484038:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15546 00000004:00080000:3.0:1746066806.484054:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e634e00/2, rc 0, transno 17179873792 00000100:00100000:3.0:1746066806.484057:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977005184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066806.485628:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882977003904:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066806.486353:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.486473:0:809:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:809:1830882977004032:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066806.486513:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135430600/0xfb36a14ee608dcfd lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fddb expref: 254 pid: 809 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746066806.486528:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fddb expref: 253 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.486551:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135430800, rc 0) 00000100:00100000:2.0:1746066806.486586:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32072:x1830882977338496:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 72389us (72510us total) trans 8589944288 rc 0/0 00000100:00100000:2.0:1746066806.486593:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10197 00000100:00100000:0.0:1746066806.486865:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.486886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.486951:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977339136 00000100:00100000:1.0:1746066806.486956:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977339136 00000100:00100000:1.0:1746066806.486976:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977339264 00000100:00100000:1.0:1746066806.486978:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977339264 00000100:00100000:1.0:1746066806.486990:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4290 00000100:00100000:1.0:1746066806.486995:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c253850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32074:x1830882977339136:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:1.0:1746066806.487055:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c253850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32074:x1830882977339136:12345-192.168.202.57@tcp:49:cat.0 Request processed in 60us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.487061:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4290 00000100:00100000:1.0:1746066806.487096:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4291 00000100:00100000:1.0:1746066806.487101:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+9:32069:x1830882977339264:12345-192.168.202.57@tcp:49:multiop.0 00000100:00100000:1.0:1746066806.487132:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+9:32069:x1830882977339264:12345-192.168.202.57@tcp:49:multiop.0 Request processed in 30us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.487136:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4291 00000100:00100000:2.0:1746066806.487695:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977339392 00000100:00100000:2.0:1746066806.487699:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977339392 00000100:00100000:2.0:1746066806.487727:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10200 00000100:00100000:2.0:1746066806.487731:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+9:32075:x1830882977339392:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066806.487739:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.487749:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093dbb400/0xfb36a14ee608dd19 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fdf0 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.487776:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093dbb400/0xfb36a14ee608dd19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf0 expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.487786:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093dbb400/0xfb36a14ee608dd19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf0 expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.487795:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.487798:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066806.487800:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093dbb400, rc 0) 00000100:00100000:2.0:1746066806.487814:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:32075:x1830882977339392:12345-192.168.202.57@tcp:101:cat.0 Request processed in 82us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.487818:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10200 00000100:00100000:3.0:1746066806.491739:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.491759:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.492013:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977339520 00000100:00100000:2.0:1746066806.492020:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977339520 00000100:00100000:2.0:1746066806.492048:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977339648 00000100:00100000:2.0:1746066806.492050:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977339648 00000100:00100000:2.0:1746066806.492064:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4292 00000100:00100000:2.0:1746066806.492070:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32072:x1830882977339520:12345-192.168.202.57@tcp:49:multiop.0 00000100:00100000:2.0:1746066806.492166:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32072:x1830882977339520:12345-192.168.202.57@tcp:49:multiop.0 Request processed in 96us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.492172:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4292 00000100:00100000:2.0:1746066806.492183:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4293 00000100:00100000:2.0:1746066806.492187:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:32075:x1830882977339648:12345-192.168.202.57@tcp:49:cat.0 00000100:00100000:2.0:1746066806.492216:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+10:32075:x1830882977339648:12345-192.168.202.57@tcp:49:cat.0 Request processed in 28us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.492220:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4293 00000100:00100000:3.0:1746066806.492292:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.493108:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977339776 00000100:00100000:2.0:1746066806.493112:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977339776 00000100:00100000:2.0:1746066806.493149:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 729 00000100:00100000:2.0:1746066806.493154:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+10:1966:x1830882977339776:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066806.493162:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066806.493179:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093dbb400/0xfb36a14ee608dd19 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf0 expref: 10 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.493192:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.493196:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066806.493784:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+9:1966:x1830882977339776:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 628us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.493791:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 729 00000100:00100000:0.0:1746066806.501147:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.501237:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977340032 00000100:00100000:3.0:1746066806.501244:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977340032 00002000:00100000:3.0:1746066806.501279:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e93dc00 x1830882977340032/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.501288:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93dc00 with x1830882977340032 ext(1048576->2097151) 00002000:00010000:3.0:1746066806.501292:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93dc00 00000100:00100000:3.0:1746066806.502163:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7081 00000100:00100000:3.0:1746066806.502173:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977340032:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066806.506380:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.506589:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977340160 00000100:00100000:1.0:1746066806.506597:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977340160 00000100:00100000:1.0:1746066806.506643:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15547 00000100:00100000:1.0:1746066806.506652:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+22:32069:x1830882977340160:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066806.506666:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.506701:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fdf7 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.506726:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25800/0xfb36a14ee608dca2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd95 expref: 37 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.506733:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dcda lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdc6 expref: 23 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.506740:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.506741:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.506745:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2134016->2781183] (req 2134016->2781183) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.506770:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dcda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdc6 expref: 23 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.506781:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dcda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdc6 expref: 23 pid: 8451 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746066806.506791:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977005312:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066806.506862:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25800/0xfb36a14ee608dca2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd95 expref: 37 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.506869:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25800/0xfb36a14ee608dca2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd95 expref: 37 pid: 9776 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746066806.506878:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977005440:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066806.506897:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066806.511512:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977340032:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9331us (10363us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066806.511523:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7081 00002000:00100000:3.0:1746066806.511533:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009e93dc00 x1830882977340032/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.511541:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93dc00 with x1830882977340032 ext(1048576->2097151) 00002000:00010000:3.0:1746066806.511546:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93dc00 00000100:00100000:1.0:1746066806.512033:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977005312:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.512291:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.512379:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977340416 00000100:00100000:0.0:1746066806.512385:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977340416 00000100:00100000:1.0:1746066806.512808:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977005440:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066806.512831:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2134016->2781183] (req 2134016->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 21 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.512843:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ae6400, rc 0) 00000100:00100000:1.0:1746066806.512970:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+21:32069:x1830882977340160:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6318us (6597us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.512977:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15547 00000100:00100000:0.0:1746066806.513073:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15548 00000100:00100000:0.0:1746066806.513081:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:32072:x1830882977340416:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066806.513092:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.513104:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fdfe expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.513121:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e400/0xfb36a14ee608dc8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd80 expref: 39 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.513128:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608dcc5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb1 expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.513133:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.513134:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.513137:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1912832->2097151] (req 1912832->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 39 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.513156:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608dcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb1 expref: 20 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.513164:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608dcc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb1 expref: 20 pid: 8451 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746066806.513173:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882977005568:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066806.513220:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e400/0xfb36a14ee608dc8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd80 expref: 39 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.513226:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e400/0xfb36a14ee608dc8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd80 expref: 39 pid: 8452 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746066806.513233:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882977005696:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066806.513245:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.513327:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.513341:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.513393:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.513454:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977340288 00000100:00100000:3.0:1746066806.513457:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977340288 00010000:00010000:3.0:1746066806.513473:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dcda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdc6 expref: 21 pid: 8451 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746066806.513496:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977340544 00000100:00100000:3.0:1746066806.513498:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977340544 00010000:00010000:3.0:1746066806.513505:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25800/0xfb36a14ee608dca2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd95 expref: 40 pid: 9776 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746066806.513517:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8037 00000100:00100000:3.0:1746066806.513521:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+21:1964:x1830882977340288:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066806.513528:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066806.513544:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dcda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdc6 expref: 21 pid: 8451 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.513552:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dcda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdc6 expref: 21 pid: 8451 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746066806.513555:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8038 00000100:00100000:1.0:1746066806.513560:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977340544:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.513566:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066806.513571:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dcda lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdc6 expref: 21 pid: 8451 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.513573:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25800/0xfb36a14ee608dca2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd95 expref: 40 pid: 9776 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.513580:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25800/0xfb36a14ee608dca2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd95 expref: 40 pid: 9776 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746066806.513865:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977340800 00000100:00100000:0.0:1746066806.513869:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977340800 00002000:00100000:0.0:1746066806.513888:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8800929cea00 x1830882977340800/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.513895:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cea00 with x1830882977340800 ext(1048576->2097151) 00002000:00010000:0.0:1746066806.513898:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929cea00 00010000:00010000:3.0:1746066806.514018:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066806.514027:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f25800/0xfb36a14ee608dca2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd95 expref: 41 pid: 9776 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.514035:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.514036:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.514040:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2134016->2781183) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 20 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.514047:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2134016->2781183) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 20 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066806.514052:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977340288:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 530us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.514058:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8037 00010000:00010000:1.0:1746066806.514064:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2134016->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 20 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.514073:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882977005824:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066806.514105:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.514199:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7082 00000100:00100000:0.0:1746066806.514206:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1964:x1830882977340800:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066806.517744:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882977005568:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.517755:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882977005696:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066806.517786:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882977005824:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066806.517789:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1912832->2097151] (req 1912832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 41 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.517800:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066806.517804:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9bcc00, rc 0) 00000100:00100000:1.0:1746066806.517838:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1963:x1830882977340544:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4276us (4494us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.517847:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8038 00000100:00100000:2.0:1746066806.517989:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:32072:x1830882977340416:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4908us (5698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.517995:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15548 00000100:00100000:0.0:1746066806.520114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.520147:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.520167:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977341056 00000100:00100000:1.0:1746066806.520174:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977341056 00000100:00100000:3.0:1746066806.520185:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977340928 00000100:00100000:3.0:1746066806.520189:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977340928 00010000:00010000:1.0:1746066806.520198:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e400/0xfb36a14ee608dc8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd80 expref: 40 pid: 8452 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746066806.520200:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:3.0:1746066806.520202:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608dcc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb1 expref: 20 pid: 8451 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746066806.520246:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8039 00000100:00100000:3.0:1746066806.520253:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977340928:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066806.520262:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066806.520278:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608dcc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb1 expref: 20 pid: 8451 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.520287:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608dcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb1 expref: 20 pid: 8451 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.520304:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608dcc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb1 expref: 20 pid: 8451 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.520315:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066806.520350:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:1963:x1830882977340928:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 97us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.520355:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8039 00000100:00100000:3.0:1746066806.520365:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8040 00000100:00100000:3.0:1746066806.520370:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977341056:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066806.520374:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066806.520380:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e400/0xfb36a14ee608dc8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd80 expref: 40 pid: 8452 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.520388:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e400/0xfb36a14ee608dc8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd80 expref: 40 pid: 8452 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.520397:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ee1e400/0xfb36a14ee608dc8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd80 expref: 40 pid: 8452 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.520403:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066806.520405:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066806.520410:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 39 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.520417:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 39 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.520441:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 39 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066806.520450:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882977005952:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066806.520505:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977341184 00000100:00100000:2.0:1746066806.520509:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977341184 00000100:00100000:2.0:1746066806.520536:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15549 00000100:00100000:2.0:1746066806.520541:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+19:32075:x1830882977341184:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066806.520552:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.520561:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f209000/0xfb36a14ee608dd2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe05 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.520577:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 39 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.520582:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066806.520583:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066806.520586:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f209000/0xfb36a14ee608dd2e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe05 expref: 20 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.520598:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 39 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.520606:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 39 pid: 21203 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.520613:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882977006080:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.520640:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066806.520768:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d7d600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066806.521549:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+38:1964:x1830882977340800:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 7342us (8153us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066806.521556:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7082 00002000:00100000:2.0:1746066806.521564:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8800929cea00 x1830882977340800/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.521571:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cea00 with x1830882977340800 ext(1048576->2097151) 00002000:00010000:2.0:1746066806.521576:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929cea00 00000100:00100000:3.0:1746066806.522199:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882977005952:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066806.522212:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066806.522231:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1963:x1830882977341056:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1860us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.522238:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8040 00000100:00100000:2.0:1746066806.522404:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882977006080:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.522420:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f209000/0xfb36a14ee608dd2e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe05 expref: 20 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.522429:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f209000, rc 0) 00000100:00100000:2.0:1746066806.522445:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+20:32075:x1830882977341184:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1904us (2245us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.522451:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15549 00000100:00100000:0.0:1746066806.525904:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.526580:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.526829:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977341696 00000100:00100000:2.0:1746066806.526837:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977341696 00000100:00100000:0.0:1746066806.526926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.527004:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977341568 00000100:00100000:3.0:1746066806.527008:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977341568 00002000:00100000:3.0:1746066806.527034:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38e:0x0] (1912832->2097151) req@ffff88009e93c700 x1830882977341568/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.527042:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93c700 with x1830882977341568 ext(1912832->2097151) 00010000:00010000:3.0:1746066806.527048:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 37 pid: 21203 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.527059:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 37 pid: 21203 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746066806.527065:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e93c700 00000100:00100000:3.0:1746066806.527082:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977341824 00000100:00100000:3.0:1746066806.527084:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977341824 00002000:00100000:3.0:1746066806.527094:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38f:0x0] (2777088->2781183) req@ffff88009e93df80 x1830882977341824/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.527101:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93df80 with x1830882977341824 ext(2777088->2781183) 00002000:00010000:3.0:1746066806.527103:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93df80 00000100:00100000:3.0:1746066806.527112:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2288 00000100:00100000:3.0:1746066806.527117:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+37:1966:x1830882977341568:12345-192.168.202.57@tcp:4:multiop.0 00000100:00100000:0.0:1746066806.527366:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7083 00000100:00100000:0.0:1746066806.527375:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977341824:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066806.527406:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15550 00000100:00100000:2.0:1746066806.527412:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:32072:x1830882977341696:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066806.527419:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.527432:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe0c expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.527449:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc9b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd87 expref: 29 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.527455:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ff7c00/0xfb36a14ee608dccc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb8 expref: 26 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.527460:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.527461:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.527464:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [1048576->1564671] (req 1048576->1564671) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 29 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.527479:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+20:1963:x1830882977341824:12345-192.168.202.57@tcp:3:cat.0 Request processed in 109us (554us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066806.527497:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7083 00010000:00010000:2.0:1746066806.527502:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129ff7c00/0xfb36a14ee608dccc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb8 expref: 26 pid: 8451 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746066806.527502:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2777088->2781183) req@ffff88009e93df80 x1830882977341824/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/4536 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.527508:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93df80 with x1830882977341824 ext(2777088->2781183) 00002000:00010000:0.0:1746066806.527510:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e93df80 00010000:00010000:2.0:1746066806.527511:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129ff7c00/0xfb36a14ee608dccc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb8 expref: 26 pid: 8451 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746066806.527521:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882977006208:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.527569:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd87 expref: 29 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.527576:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd87 expref: 29 pid: 8452 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746066806.527583:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882977006336:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.527609:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.530303:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.530327:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882977006208:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066806.530347:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977341952 00000100:00100000:3.0:1746066806.530352:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977341952 00010000:00010000:3.0:1746066806.530575:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff7c00/0xfb36a14ee608dccc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb8 expref: 27 pid: 8451 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746066806.530599:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8041 00000100:00100000:3.0:1746066806.530606:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977341952:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066806.530616:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066806.530633:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129ff7c00/0xfb36a14ee608dccc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb8 expref: 27 pid: 8451 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.530916:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129ff7c00/0xfb36a14ee608dccc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb8 expref: 27 pid: 8451 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.530934:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129ff7c00/0xfb36a14ee608dccc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdb8 expref: 27 pid: 8451 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746066806.530945:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066806.530974:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977341952:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 369us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.530980:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8041 00000100:00100000:3.0:1746066806.531001:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882977006336:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066806.531020:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->1564671] (req 1048576->1564671) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 29 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.531033:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff6a00, rc 0) 00000100:00100000:3.0:1746066806.531047:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:32072:x1830882977341696:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3635us (5149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.531053:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15550 00000100:00100000:3.0:1746066806.532857:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1966:x1830882977341568:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 5733us (6272us total) trans 21474841094 rc 0/0 00000100:00100000:3.0:1746066806.532866:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2288 00002000:00100000:3.0:1746066806.532874:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38e:0x0] (1912832->2097151) req@ffff88009e93c700 x1830882977341568/t21474841094(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/448 e 0 to 0 dl 1746066817 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.532882:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93c700 with x1830882977341568 ext(1912832->2097151) 00010000:00010000:3.0:1746066806.532888:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 39 pid: 21203 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.532898:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 39 pid: 21203 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746066806.532908:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e93c700 00000100:00100000:0.0:1746066806.533079:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.533191:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977342080 00000100:00100000:1.0:1746066806.533196:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977342080 00010000:00010000:1.0:1746066806.533214:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd87 expref: 29 pid: 8452 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746066806.533244:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8042 00000100:00100000:1.0:1746066806.533249:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1963:x1830882977342080:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.533269:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.533284:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd87 expref: 29 pid: 8452 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.533292:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd87 expref: 29 pid: 8452 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.533308:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135f30800/0xfb36a14ee608dc9b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd87 expref: 29 pid: 8452 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.533318:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.533320:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.533326:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 28 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.533333:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 28 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.533359:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 28 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.533370:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882977006464:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066806.533425:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.536875:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.537007:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977342336 00000100:00100000:3.0:1746066806.537014:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977342336 00002000:00100000:3.0:1746066806.537049:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1912831) req@ffff88009e93e300 x1830882977342336/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.537058:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93e300 with x1830882977342336 ext(1048576->1912831) 00010000:00010000:3.0:1746066806.537065:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 39 pid: 21203 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.537082:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 39 pid: 21203 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746066806.537089:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e93e300 00000100:00100000:3.0:1746066806.537119:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2289 00000100:00100000:3.0:1746066806.537126:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1964:x1830882977342336:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066806.538152:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882977006464:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066806.538168:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.538192:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977342080:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4943us (5113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.538200:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8042 00000100:00100000:0.0:1746066806.539790:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.539820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.541236:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977342720 00000100:00100000:3.0:1746066806.541244:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977342720 00000100:00100000:2.0:1746066806.542822:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977342592 00000100:00100000:2.0:1746066806.542830:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977342592 00002000:00100000:2.0:1746066806.542862:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1052672->2097151) req@ffff88009e93d180 x1830882977342592/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.542871:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93d180 with x1830882977342592 ext(1052672->2097151) 00002000:00010000:2.0:1746066806.542876:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93d180 00000100:00100000:2.0:1746066806.542895:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7084 00000100:00100000:2.0:1746066806.542902:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977342592:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066806.544047:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15551 00000100:00100000:3.0:1746066806.544057:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:32074:x1830882977342720:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066806.544068:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066806.544083:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608dd3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe13 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.544103:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066806.544108:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608dd3c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe13 expref: 42 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.544119:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608dd3c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe13 expref: 42 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.544128:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935c1600, rc 0) 00000100:00100000:3.0:1746066806.544165:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:32074:x1830882977342720:12345-192.168.202.57@tcp:101:cat.0 Request processed in 110us (4344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.544170:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15551 00000100:00100000:3.0:1746066806.549416:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1964:x1830882977342336:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 12281us (12538us total) trans 0 rc 864256/864256 00000100:00100000:3.0:1746066806.549428:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2289 00002000:00100000:3.0:1746066806.549438:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1912831) req@ffff88009e93e300 x1830882977342336/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:H/200/0 rc 864256/864256 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.549447:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93e300 with x1830882977342336 ext(1048576->1912831) 00010000:00010000:3.0:1746066806.549457:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 40 pid: 21203 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.549470:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 40 pid: 21203 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746066806.549476:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e93e300 00000100:00100000:0.0:1746066806.553889:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.554069:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977342592:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 11165us (14281us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746066806.554078:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7084 00002000:00100000:2.0:1746066806.554088:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1052672->2097151) req@ffff88009e93d180 x1830882977342592/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.554096:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93d180 with x1830882977342592 ext(1052672->2097151) 00002000:00010000:2.0:1746066806.554101:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93d180 00000100:00100000:1.0:1746066806.554234:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977342848 00000100:00100000:1.0:1746066806.554240:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977342848 00010000:00010000:1.0:1746066806.554267:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 40 pid: 21203 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.554295:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8043 00000100:00100000:1.0:1746066806.554301:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977342848:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.554312:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066806.554325:0:21351:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066805 -> 1746066806 00002000:00010000:1.0:1746066806.554328:0:21351:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066805 -> 1746066806 00010000:00010000:1.0:1746066806.554332:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 40 pid: 21203 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.554343:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 40 pid: 21203 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.554363:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e9bcc00/0xfb36a14ee608dd27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdfe expref: 40 pid: 21203 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.554376:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.554378:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.554384:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f209000/0xfb36a14ee608dd2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe05 expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.554391:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f209000/0xfb36a14ee608dd2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe05 expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.554398:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.554399:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.554774:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608dd3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe13 expref: 39 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.554785:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608dd3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe13 expref: 39 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.554809:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608dd3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe13 expref: 39 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.554818:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882977006592:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066806.554887:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f209000/0xfb36a14ee608dd2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe05 expref: 19 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.554895:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882977006720:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066806.555300:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.566556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.566612:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977343104 00000100:00100000:2.0:1746066806.566619:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977343104 00002000:00100000:2.0:1746066806.566656:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8801361f8e00 x1830882977343104/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.566665:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8e00 with x1830882977343104 ext(1048576->2097151) 00002000:00010000:2.0:1746066806.566670:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361f8e00 00000100:00100000:1.0:1746066806.566770:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882977006592:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066806.566778:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882977006720:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066806.566792:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.566824:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1963:x1830882977342848:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 12523us (12942us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.566832:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8043 00000100:00100000:2.0:1746066806.567262:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7085 00000100:00100000:2.0:1746066806.567277:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977343104:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066806.573446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.573634:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977343360 00000100:00100000:3.0:1746066806.573642:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977343360 00002000:00100000:3.0:1746066806.573694:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8801361f9880 x1830882977343360/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.573703:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f9880 with x1830882977343360 ext(1048576->2097151) 00002000:00010000:3.0:1746066806.573709:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361f9880 00000100:00100000:3.0:1746066806.573742:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7086 00000100:00100000:3.0:1746066806.573749:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1963:x1830882977343360:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066806.588504:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1966:x1830882977343104:12345-192.168.202.57@tcp:3:cat.0 Request processed in 21227us (21947us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066806.588513:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7085 00002000:00100000:2.0:1746066806.588522:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8801361f8e00 x1830882977343104/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.588531:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8e00 with x1830882977343104 ext(1048576->2097151) 00002000:00010000:2.0:1746066806.588535:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361f8e00 00000100:00100000:3.0:1746066806.594591:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1963:x1830882977343360:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 20835us (21145us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066806.594601:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7086 00002000:00100000:3.0:1746066806.594611:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff8801361f9880 x1830882977343360/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.594962:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f9880 with x1830882977343360 ext(1048576->2097151) 00002000:00010000:3.0:1746066806.594968:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361f9880 00000100:00100000:0.0:1746066806.596003:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.596086:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977343488 00000100:00100000:1.0:1746066806.596093:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977343488 00000100:00100000:1.0:1746066806.596176:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15552 00000100:00100000:1.0:1746066806.596184:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+26:32075:x1830882977343488:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066806.596197:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.596211:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eecbe00/0xfb36a14ee608dd43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe1a expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.596236:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 27 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.596242:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066806.596244:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066806.596247:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eecbe00/0xfb36a14ee608dd43 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe1a expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.596273:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 27 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.596283:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 27 pid: 21203 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.596298:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882977006848:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066806.597506:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.601355:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882977006848:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066806.601380:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eecbe00/0xfb36a14ee608dd43 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe1a expref: 27 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.601393:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eecbe00, rc 0) 00000100:00100000:1.0:1746066806.601429:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+27:32075:x1830882977343488:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5246us (5427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.601436:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15552 00000100:00100000:0.0:1746066806.602217:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.602319:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977343616 00000100:00100000:1.0:1746066806.602324:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977343616 00000100:00100000:1.0:1746066806.603147:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15553 00000100:00100000:1.0:1746066806.603156:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1963:x1830882977343616:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066806.603169:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.603181:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eecbc00/0xfb36a14ee608dd4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe21 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.603219:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977006976:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066806.603279:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.603395:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.603493:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977343744 00000100:00100000:2.0:1746066806.603497:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977343744 00002000:00100000:2.0:1746066806.603520:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x390:0x0] (1048576->1564671) req@ffff8801361fa300 x1830882977343744/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.603528:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fa300 with x1830882977343744 ext(1048576->1564671) 00010000:00010000:2.0:1746066806.603534:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 28 pid: 21203 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.603543:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 28 pid: 21203 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746066806.603549:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801361fa300 00000100:00100000:2.0:1746066806.603559:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2290 00000100:00100000:2.0:1746066806.603563:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977343744:12345-192.168.202.57@tcp:4:multiop.0 00002000:00010000:1.0:1746066806.608378:0:10402:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime: 1746066805 -> 1746066806 00002000:00010000:1.0:1746066806.608390:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime: 1746066804 -> 1746066806 00002000:00010000:1.0:1746066806.608394:0:10402:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime: 1746066805 -> 1746066806 00000100:00100000:1.0:1746066806.608414:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977006976:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066806.608442:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eecbc00/0xfb36a14ee608dd4a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe21 expref: 40 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.608453:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eecbc00/0xfb36a14ee608dd4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe21 expref: 40 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.609080:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eecbc00, rc 0) 00000100:00100000:1.0:1746066806.609132:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1963:x1830882977343616:12345-192.168.202.57@tcp:101:cat.0 Request processed in 5976us (6914us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066806.609139:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15553 00000100:00100000:2.0:1746066806.610394:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977343744:12345-192.168.202.57@tcp:4:multiop.0 Request processed in 6826us (6996us total) trans 17179873793 rc 0/0 00000100:00100000:2.0:1746066806.610402:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2290 00002000:00100000:2.0:1746066806.610410:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x390:0x0] (1048576->1564671) req@ffff8801361fa300 x1830882977343744/t17179873793(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/448 e 0 to 0 dl 1746066817 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.610419:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fa300 with x1830882977343744 ext(1048576->1564671) 00010000:00010000:2.0:1746066806.610427:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 30 pid: 21203 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.610439:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 30 pid: 21203 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746066806.610449:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801361fa300 00000100:00100000:0.0:1746066806.618248:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.618301:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.618391:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977344128 00000100:00100000:1.0:1746066806.618398:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977344128 00010000:00010000:1.0:1746066806.618429:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 30 pid: 21203 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.618467:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8044 00000100:00100000:1.0:1746066806.618474:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1966:x1830882977344128:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.618499:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066806.618500:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977344000 00000100:00100000:2.0:1746066806.618504:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977344000 00002000:00010000:1.0:1746066806.618515:0:21351:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066805 -> 1746066806 00002000:00010000:1.0:1746066806.618518:0:21351:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066805 -> 1746066806 00002000:00010000:1.0:1746066806.618519:0:21351:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066805 -> 1746066806 00010000:00010000:1.0:1746066806.618524:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 31 pid: 21203 timeout: 867 lvb_type: 0 00002000:00100000:2.0:1746066806.618528:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8801361fbb80 x1830882977344000/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.618535:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fbb80 with x1830882977344000 ext(2097152->3145727) 00010000:00010000:1.0:1746066806.618535:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 31 pid: 21203 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746066806.618539:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361fbb80 00000100:00100000:2.0:1746066806.618562:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7087 00000100:00100000:2.0:1746066806.618568:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882977344000:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:1.0:1746066806.618652:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129ff6a00/0xfb36a14ee608dd35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe0c expref: 31 pid: 21203 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.618738:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.618740:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.618746:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eecbe00/0xfb36a14ee608dd43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe1a expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.618757:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eecbe00/0xfb36a14ee608dd43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe1a expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.618782:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008eecbe00/0xfb36a14ee608dd43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe1a expref: 26 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.618792:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882977007104:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066806.618841:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.622789:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882977007104:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066806.622807:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.622856:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1966:x1830882977344128:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4381us (4553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.622865:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8044 00000100:00100000:0.0:1746066806.628559:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.633284:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977344384 00000100:00100000:2.0:1746066806.633295:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977344384 00002000:00100000:2.0:1746066806.633330:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff8801361f9c00 x1830882977344384/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.633339:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f9c00 with x1830882977344384 ext(1048576->2097151) 00002000:00010000:2.0:1746066806.633345:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361f9c00 00000100:00100000:2.0:1746066806.633527:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7088 00000100:00100000:2.0:1746066806.633535:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977344384:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066806.637632:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977344000:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19055us (19381us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066806.637643:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7087 00002000:00100000:3.0:1746066806.637653:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8801361fbb80 x1830882977344000/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.637662:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fbb80 with x1830882977344000 ext(2097152->3145727) 00002000:00010000:3.0:1746066806.637668:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361fbb80 00000100:00100000:2.0:1746066806.644945:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977344384:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11392us (16375us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066806.644960:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7088 00002000:00100000:2.0:1746066806.644974:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff8801361f9c00 x1830882977344384/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.644998:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f9c00 with x1830882977344384 ext(1048576->2097151) 00002000:00010000:2.0:1746066806.645005:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361f9c00 00000100:00100000:0.0:1746066806.646169:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.646213:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977344512 00000100:00100000:1.0:1746066806.646219:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977344512 00000100:00100000:1.0:1746066806.646257:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15554 00000100:00100000:1.0:1746066806.646263:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:32074:x1830882977344512:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066806.646277:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.646289:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eecb400/0xfb36a14ee608dd51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe28 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.646311:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2134016->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 19 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.646318:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066806.646320:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066806.646323:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eecb400/0xfb36a14ee608dd51 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe28 expref: 40 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.646347:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2134016->2781183) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 19 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.646356:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2134016->2781183) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 19 pid: 10402 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.646366:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977007232:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066806.647402:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.649292:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977007232:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066806.649317:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eecb400/0xfb36a14ee608dd51 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe28 expref: 40 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.649332:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eecb400, rc 0) 00000100:00100000:1.0:1746066806.649384:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:32074:x1830882977344512:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3120us (3216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.649393:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15554 00000100:00100000:2.0:1746066806.650356:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.650463:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977344640 00000100:00100000:3.0:1746066806.650469:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977344640 00002000:00100000:3.0:1746066806.650509:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2134016->2781183) req@ffff88009e843480 x1830882977344640/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.650517:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e843480 with x1830882977344640 ext(2134016->2781183) 00010000:00010000:3.0:1746066806.650524:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2134016->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 20 pid: 10402 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.650534:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2134016->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 20 pid: 10402 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746066806.650539:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e843480 00000100:00100000:3.0:1746066806.650555:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2291 00000100:00100000:3.0:1746066806.650560:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+20:1964:x1830882977344640:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066806.653590:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.653780:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977344896 00000100:00100000:3.0:1746066806.653788:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977344896 00002000:00100000:3.0:1746066806.653820:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8801361f8380 x1830882977344896/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.653829:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8380 with x1830882977344896 ext(2097152->3145727) 00002000:00010000:3.0:1746066806.653833:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361f8380 00000100:00100000:3.0:1746066806.653851:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7089 00000100:00100000:3.0:1746066806.653858:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977344896:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066806.662587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.665196:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977345024 00000100:00100000:3.0:1746066806.665208:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977345024 00000100:00100000:3.0:1746066806.665718:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10201 00000100:00100000:3.0:1746066806.665727:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:32080:x1830882977345024:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066806.665748:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066806.665765:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02e200/0xfb36a14ee608dd58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe2f expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.665813:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02e000/0xfb36a14ee608dd5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.665825:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02e000/0xfb36a14ee608dd5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.665833:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02e000/0xfb36a14ee608dd5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.665845:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ea00/0xfb36a14ee608dd66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.665850:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ea00/0xfb36a14ee608dd66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.665858:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ea00/0xfb36a14ee608dd66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.665946:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.665955:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd72 expref: 252 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.665962:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fda3 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.665967:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 5/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.665992:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fda3 expref: 8 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.666000:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fda3 expref: 8 pid: 809 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.666009:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882977007360:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066806.666099:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd72 expref: 252 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.666106:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd72 expref: 252 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.666113:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882977007488:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066806.666131:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d7d780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066806.667725:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977344896:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13862us (14137us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066806.667733:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7089 00002000:00100000:2.0:1746066806.667742:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8801361f8380 x1830882977344896/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.667751:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8380 with x1830882977344896 ext(2097152->3145727) 00002000:00010000:2.0:1746066806.667755:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361f8380 00000100:00100000:3.0:1746066806.670144:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977344640:12345-192.168.202.57@tcp:4:cat.0 Request processed in 19577us (19783us total) trans 21474841095 rc 0/0 00000100:00100000:3.0:1746066806.670154:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2291 00002000:00100000:3.0:1746066806.670164:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2134016->2781183) req@ffff88009e843480 x1830882977344640/t21474841095(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/448 e 0 to 0 dl 1746066817 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.670172:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e843480 with x1830882977344640 ext(2134016->2781183) 00010000:00010000:3.0:1746066806.670180:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2134016->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 22 pid: 10402 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746066806.670191:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2134016->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 22 pid: 10402 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746066806.670197:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e843480 00000100:00100000:1.0:1746066806.670949:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.671182:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977345280 00000100:00100000:3.0:1746066806.671189:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977345280 00000100:00100000:3.0:1746066806.671778:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10202 00000100:00100000:3.0:1746066806.671786:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+9:32079:x1830882977345280:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066806.671799:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066806.671812:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1400/0xfb36a14ee608dd74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe36 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.671891:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1600/0xfb36a14ee608dd7b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.671902:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1600/0xfb36a14ee608dd7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.671913:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1600/0xfb36a14ee608dd7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.671920:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1800/0xfb36a14ee608dd82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.671924:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1800/0xfb36a14ee608dd82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.671928:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1800/0xfb36a14ee608dd82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.672004:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1a00/0xfb36a14ee608dd89 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.672011:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1a00/0xfb36a14ee608dd89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.672016:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1a00/0xfb36a14ee608dd89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:3.0:1746066806.672023:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066806.672126:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1600/0xfb36a14ee608dd7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.672132:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1600/0xfb36a14ee608dd7b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.672136:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1600/0xfb36a14ee608dd7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.672141:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fff1600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066806.672144:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1600/0xfb36a14ee608dd7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.672153:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1600/0xfb36a14ee608dd7b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.672162:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066806.672164:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066806.672168:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1600/0xfb36a14ee608dd7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.672172:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1600/0xfb36a14ee608dd7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.673963:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1800/0xfb36a14ee608dd82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.673973:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1800/0xfb36a14ee608dd82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.673978:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1800/0xfb36a14ee608dd82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.673983:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fff1800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066806.673985:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1800/0xfb36a14ee608dd82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.673990:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1800/0xfb36a14ee608dd82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.674001:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135105900) 00010000:00010000:3.0:1746066806.674003:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066806.674005:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1800/0xfb36a14ee608dd82 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.674009:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1800/0xfb36a14ee608dd82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:3.0:1746066806.674052:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1400/0xfb36a14ee608dd74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe36 expref: 12 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.674063:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1a00/0xfb36a14ee608dd89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe36 expref: 11 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.674068:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066806.674069:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066806.674072:0:809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.674078:0:809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.674083:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fff1a00, rc 0) 00000100:00100000:3.0:1746066806.675537:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+11:32079:x1830882977345280:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3746us (4582us total) trans 8589944289 rc 0/0 00000100:00100000:3.0:1746066806.675547:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10202 00000100:00100000:1.0:1746066806.676980:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.677010:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.677040:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.677060:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977345664 00000100:00100000:1.0:1746066806.677066:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977345664 00010000:00010000:1.0:1746066806.677091:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2134016->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 22 pid: 10402 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.677124:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8045 00000100:00100000:1.0:1746066806.677131:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977345664:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.677140:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.677158:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2134016->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 22 pid: 10402 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.677167:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2134016->2781183) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 22 pid: 10402 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.677184:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ae6400/0xfb36a14ee608dd20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2134016->2781183) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdf7 expref: 22 pid: 10402 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.677199:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.677201:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.677207:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eecb400/0xfb36a14ee608dd51 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe28 expref: 39 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.677218:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eecb400/0xfb36a14ee608dd51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe28 expref: 39 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.677247:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008eecb400/0xfb36a14ee608dd51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe28 expref: 39 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.677258:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882977007616:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066806.677315:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.677403:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977345536 00000100:00100000:0.0:1746066806.677408:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977345536 00000100:00100000:0.0:1746066806.677431:0:14551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977345920 00000100:00100000:0.0:1746066806.677433:0:14551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977345920 00000100:00100000:0.0:1746066806.677444:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4294 00000100:00100000:0.0:1746066806.677449:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+11:23712:x1830882977345536:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746066806.677645:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:23712:x1830882977345536:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 195us (668us total) trans 8589944290 rc 0/0 00000100:00100000:0.0:1746066806.677650:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4294 00000100:00100000:0.0:1746066806.677665:0:14551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4295 00000100:00100000:0.0:1746066806.677670:0:14551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c251850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:27101:x1830882977345920:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746066806.677740:0:14551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c251850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:27101:x1830882977345920:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 70us (728us total) trans 8589944291 rc 0/0 00000100:00100000:0.0:1746066806.677744:0:14551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4295 00000100:00100000:3.0:1746066806.677993:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882977007360:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066806.678003:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882977007488:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066806.678021:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066806.678235:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.678292:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977346048 00000100:00100000:2.0:1746066806.678296:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977346048 00000100:00100000:2.0:1746066806.678329:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15555 00000100:00100000:2.0:1746066806.678335:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+22:32075:x1830882977346048:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066806.678344:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.678354:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dd97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe3d expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.678367:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.678369:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.678373:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dd97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe3d expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.678382:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dd97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe3d expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.678393:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135431200, rc 0) 00000100:00100000:2.0:1746066806.678413:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+23:32075:x1830882977346048:12345-192.168.202.57@tcp:101:cat.0 Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.678418:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15555 00000100:00100000:0.0:1746066806.681437:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.681472:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.681524:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977346176 00000100:00100000:1.0:1746066806.681530:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977346176 00010000:00010000:1.0:1746066806.681556:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fda3 expref: 12 pid: 809 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.681576:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977346304 00000100:00100000:1.0:1746066806.681579:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977346304 00010000:00010000:1.0:1746066806.681588:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd72 expref: 254 pid: 14549 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.681613:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8046 00000100:00100000:2.0:1746066806.681618:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8047 00000100:00100000:1.0:1746066806.681619:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+12:1963:x1830882977346176:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066806.681623:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:1964:x1830882977346304:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066806.681630:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.681630:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066806.681634:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd72 expref: 254 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.681634:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fda3 expref: 12 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.681643:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fda3 expref: 12 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.682399:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd72 expref: 254 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.682417:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209200/0xfb36a14ee608dc86 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd72 expref: 254 pid: 14549 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746066806.682439:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066806.682443:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066806.682453:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066806.682457:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066806.682462:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066806.682509:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:1964:x1830882977346304:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 885us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.682516:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8047 00010000:00010000:1.0:1746066806.682786:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7400/0xfb36a14ee608dcb0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fda3 expref: 12 pid: 809 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.682796:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066806.682798:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066806.682804:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066806.682809:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00000100:00100000:0.0:1746066806.682814:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e637100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882977007616:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066806.682826:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066806.682832:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.682844:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+11:1963:x1830882977346176:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1226us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.682844:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977345664:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5714us (5804us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.682850:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8046 00000100:00100000:0.0:1746066806.682852:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8045 00010000:00010000:3.0:1746066806.683007:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683014:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:3.0:1746066806.683050:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066806.683053:0:14550:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066806.683066:0:14550:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683073:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683081:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02e000/0xfb36a14ee608dd5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683086:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02e000/0xfb36a14ee608dd5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683090:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02e000/0xfb36a14ee608dd5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683094:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f02e000 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066806.683098:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02e000/0xfb36a14ee608dd5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683103:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02e000/0xfb36a14ee608dd5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683111:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066806.683113:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066806.683115:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02e000/0xfb36a14ee608dd5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683119:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02e000/0xfb36a14ee608dd5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683128:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ea00/0xfb36a14ee608dd66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683133:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ea00/0xfb36a14ee608dd66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683137:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ea00/0xfb36a14ee608dd66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683140:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f02ea00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066806.683141:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ea00/0xfb36a14ee608dd66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683145:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ea00/0xfb36a14ee608dd66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683150:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135105900) 00010000:00010000:3.0:1746066806.683151:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066806.683153:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ea00/0xfb36a14ee608dd66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683156:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ea00/0xfb36a14ee608dd66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.683181:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02e200/0xfb36a14ee608dd58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe2f expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.683190:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe2f expref: 7 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.683196:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066806.683197:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066806.683199:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f02ec00, rc 0) 00000100:00100000:3.0:1746066806.683224:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:32080:x1830882977345024:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 17500us (20646us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.683230:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10201 00000100:00100000:0.0:1746066806.691220:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.692595:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977346560 00000100:00100000:3.0:1746066806.692605:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977346560 00002000:00100000:3.0:1746066806.692907:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8801361fa680 x1830882977346560/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.692918:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fa680 with x1830882977346560 ext(2097152->3145727) 00002000:00010000:3.0:1746066806.692923:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361fa680 00000100:00100000:1.0:1746066806.692979:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.693741:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.693933:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977346816 00000100:00100000:3.0:1746066806.693940:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977346816 00002000:00100000:3.0:1746066806.693964:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e637100 x1830882977346816/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.693971:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e637100 with x1830882977346816 ext(3145728->4194303) 00002000:00010000:3.0:1746066806.693975:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e637100 00000100:00100000:3.0:1746066806.693997:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7090 00000100:00100000:3.0:1746066806.694005:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1966:x1830882977346560:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066806.696763:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.696797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.696845:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.697040:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977347328 00000100:00100000:0.0:1746066806.697047:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977347328 00002000:00100000:0.0:1746066806.697083:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88012c22ea00 x1830882977347328/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.697090:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22ea00 with x1830882977347328 ext(2097152->3145727) 00002000:00010000:0.0:1746066806.697094:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c22ea00 00000100:00100000:0.0:1746066806.697111:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977347200 00000100:00100000:0.0:1746066806.697113:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977347200 00002000:00100000:0.0:1746066806.697123:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88012c22fb80 x1830882977347200/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.697128:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22fb80 with x1830882977347200 ext(3145728->4194303) 00002000:00010000:0.0:1746066806.697131:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c22fb80 00000100:00100000:0.0:1746066806.697138:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977347584 00000100:00100000:0.0:1746066806.697141:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977347584 00002000:00100000:0.0:1746066806.697149:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88012c22d500 x1830882977347584/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.697154:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22d500 with x1830882977347584 ext(3145728->4194303) 00002000:00010000:0.0:1746066806.697156:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c22d500 00000100:00100000:0.0:1746066806.697164:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977347840 00000100:00100000:0.0:1746066806.697166:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977347840 00002000:00100000:0.0:1746066806.697175:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a5bb2a00 x1830882977347840/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.697181:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb2a00 with x1830882977347840 ext(3145728->4194303) 00002000:00010000:0.0:1746066806.697184:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb2a00 00000100:00100000:0.0:1746066806.697193:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7091 00000100:00100000:0.0:1746066806.697200:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1966:x1830882977346816:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066806.698238:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7092 00000100:00100000:0.0:1746066806.698246:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882977347328:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066806.698635:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7093 00000100:00100000:2.0:1746066806.698642:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1966:x1830882977347200:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066806.700655:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7094 00000100:00100000:3.0:1746066806.700664:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882977347584:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066806.701505:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7095 00000100:00100000:3.0:1746066806.701512:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977347840:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066806.703235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.703257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.703283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.703297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.703309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.703324:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977347968 00000100:00100000:0.0:1746066806.703330:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977347968 00000100:00100000:0.0:1746066806.703357:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977348096 00000100:00100000:0.0:1746066806.703358:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977348096 00000100:00100000:0.0:1746066806.703367:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977348224 00000100:00100000:0.0:1746066806.703369:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977348224 00000100:00100000:0.0:1746066806.703376:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977348352 00000100:00100000:0.0:1746066806.703377:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977348352 00000100:00100000:0.0:1746066806.703384:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977348480 00000100:00100000:0.0:1746066806.703385:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977348480 00000100:00100000:0.0:1746066806.703394:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15556 00000100:00100000:0.0:1746066806.703399:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800993b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977347968:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066806.703409:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.703423:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130f34a00/0xfb36a14ee608dd9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe44 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.703440:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.703442:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.703448:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130f34a00/0xfb36a14ee608dd9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe44 expref: 8 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.703540:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130f34a00/0xfb36a14ee608dd9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe44 expref: 8 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.703549:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130f34a00, rc 0) 00000100:00100000:1.0:1746066806.703565:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15557 00000100:00100000:0.0:1746066806.703569:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800993b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977347968:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 170us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.703572:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882977348096:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:0.0:1746066806.703578:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15556 00010000:00010000:1.0:1746066806.703580:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.703589:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ae6600/0xfb36a14ee608dda5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe4b expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066806.703601:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15558 00010000:00010000:1.0:1746066806.703605:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.703606:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066806.703608:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977348224:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066806.703611:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ae6600/0xfb36a14ee608dda5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe4b expref: 7 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066806.703614:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.703620:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ae6600/0xfb36a14ee608dda5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe4b expref: 7 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066806.703621:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d4e4c00/0xfb36a14ee608ddac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe52 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.703627:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ae6600, rc 0) 00010000:00010000:3.0:1746066806.703632:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066806.703633:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066806.703638:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4e4c00/0xfb36a14ee608ddac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe52 expref: 8 pid: 20532 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066806.703644:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977348096:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 74us (387us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066806.703648:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d4e4c00/0xfb36a14ee608ddac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe52 expref: 8 pid: 20532 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066806.703650:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15557 00010000:00010000:3.0:1746066806.703655:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4e4c00, rc 0) 00000100:00100000:1.0:1746066806.703661:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15559 00000100:00100000:1.0:1746066806.703666:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977348352:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:3.0:1746066806.703671:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977348224:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 64us (387us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066806.703671:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066806.703692:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15558 00010000:00010000:1.0:1746066806.703693:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ae6200/0xfb36a14ee608ddb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe59 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066806.703697:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15560 00010000:00010000:1.0:1746066806.703702:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746066806.703702:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977348480:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066806.703703:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.703707:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ae6200/0xfb36a14ee608ddb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe59 expref: 8 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.703707:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.703713:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e9bd200/0xfb36a14ee608ddba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe60 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.703715:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ae6200/0xfb36a14ee608ddb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe59 expref: 8 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.703725:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.703726:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066806.703729:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e9bd200/0xfb36a14ee608ddba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe60 expref: 9 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066806.703732:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ae6200, rc 0) 00010000:00010000:0.0:1746066806.703736:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e9bd200/0xfb36a14ee608ddba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe60 expref: 9 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066806.703742:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9bd200, rc 0) 00000100:00100000:1.0:1746066806.703745:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977348352:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 80us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.703750:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15559 00000100:00100000:0.0:1746066806.703757:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977348480:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 55us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.703761:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15560 00000100:00100000:1.0:1746066806.703798:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.703859:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977348608 00000100:00100000:2.0:1746066806.703863:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977348608 00000100:00100000:2.0:1746066806.703880:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15561 00000100:00100000:2.0:1746066806.703884:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977348608:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066806.703890:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.703896:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6800/0xfb36a14ee608ddc1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe67 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.703905:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.703907:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.703911:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6800/0xfb36a14ee608ddc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe67 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.703919:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6800/0xfb36a14ee608ddc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe67 expref: 8 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.703926:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85b6800, rc 0) 00000100:00100000:2.0:1746066806.704067:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977348608:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 182us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.704073:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15561 00000100:00100000:0.0:1746066806.711759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.711786:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977348864 00000100:00100000:3.0:1746066806.711794:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977348864 00000100:00100000:3.0:1746066806.711834:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10203 00000100:00100000:3.0:1746066806.711840:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:32080:x1830882977348864:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066806.711856:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066806.712154:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5400/0xfb36a14ee608ddc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe6e expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.712224:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.712235:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe2f expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.712244:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.712267:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe2f expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.712275:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe2f expref: 8 pid: 14550 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.712285:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882977007744:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066806.712353:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d7d780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066806.712588:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1966:x1830882977346560:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18583us (21428us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066806.712599:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7090 00002000:00100000:2.0:1746066806.712606:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8801361fa680 x1830882977346560/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.712614:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fa680 with x1830882977346560 ext(2097152->3145727) 00002000:00010000:2.0:1746066806.712618:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361fa680 00000100:00100000:0.0:1746066806.719326:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.719350:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977348992 00000100:00100000:0.0:1746066806.719356:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977348992 00010000:00010000:0.0:1746066806.719388:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe2f expref: 9 pid: 14550 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066806.719422:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8048 00000100:00100000:0.0:1746066806.719430:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977348992:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066806.719441:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066806.719448:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe2f expref: 9 pid: 14550 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.719458:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe2f expref: 9 pid: 14550 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746066806.719477:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066806.719492:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066806.719500:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066806.719505:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066806.719522:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066806.719558:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977348992:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 129us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.719564:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8048 00010000:00010000:3.0:1746066806.720028:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f02ec00/0xfb36a14ee608dd6d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe2f expref: 8 pid: 14550 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746066806.720048:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882977007744:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066806.720062:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.720069:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.720073:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:3.0:1746066806.720089:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066806.721830:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5400/0xfb36a14ee608ddc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe6e expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.721847:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe6e expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.721855:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066806.721857:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066806.721859:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4e5600, rc 0) 00000100:00100000:3.0:1746066806.721899:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32080:x1830882977348864:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 10058us (10147us total) trans 8589944292 rc 0/0 00000100:00100000:3.0:1746066806.721906:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10203 00000100:00100000:2.0:1746066806.722229:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1966:x1830882977346816:12345-192.168.202.57@tcp:3:cat.0 Request processed in 25029us (29470us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066806.722237:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7091 00002000:00100000:2.0:1746066806.722245:0:21551:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009e637100 x1830882977346816/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.722253:0:21551:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e637100 with x1830882977346816 ext(3145728->4194303) 00002000:00010000:2.0:1746066806.722257:0:21551:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e637100 00000100:00100000:3.0:1746066806.729098:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1966:x1830882977347200:12345-192.168.202.57@tcp:3:cat.0 Request processed in 30449us (32335us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066806.729107:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7093 00002000:00100000:3.0:1746066806.729117:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88012c22fb80 x1830882977347200/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.729125:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22fb80 with x1830882977347200 ext(3145728->4194303) 00002000:00010000:3.0:1746066806.729129:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c22fb80 00000100:00100000:0.0:1746066806.739035:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.739619:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882977347584:12345-192.168.202.57@tcp:3:cat.0 Request processed in 38955us (42820us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066806.739630:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7094 00002000:00100000:3.0:1746066806.739640:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88012c22d500 x1830882977347584/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.739649:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22d500 with x1830882977347584 ext(3145728->4194303) 00002000:00010000:3.0:1746066806.739654:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c22d500 00000100:00100000:2.0:1746066806.739772:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977349120 00000100:00100000:2.0:1746066806.739779:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977349120 00000100:00100000:2.0:1746066806.739812:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15562 00000100:00100000:2.0:1746066806.739818:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1965:x1830882977349120:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066806.739831:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.739845:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a85b6a00/0xfb36a14ee608dddd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe75 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.739863:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.739864:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.739871:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85b6a00/0xfb36a14ee608dddd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe75 expref: 30 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.739888:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a85b6a00/0xfb36a14ee608dddd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe75 expref: 30 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.739897:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85b6a00, rc 0) 00000100:00100000:2.0:1746066806.739913:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1965:x1830882977349120:12345-192.168.202.57@tcp:101:cat.0 Request processed in 96us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.739917:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15562 00000100:00100000:3.0:1746066806.745128:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977347840:12345-192.168.202.57@tcp:3:cat.0 Request processed in 43605us (48272us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066806.745141:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7095 00002000:00100000:3.0:1746066806.745154:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a5bb2a00 x1830882977347840/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.745163:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb2a00 with x1830882977347840 ext(3145728->4194303) 00002000:00010000:3.0:1746066806.745168:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb2a00 00000100:00100000:0.0:1746066806.752769:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.753175:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:1963:x1830882977347328:12345-192.168.202.57@tcp:3:cat.0 Request processed in 54928us (59434us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066806.753185:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7092 00002000:00100000:1.0:1746066806.753206:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88012c22ea00 x1830882977347328/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.753214:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22ea00 with x1830882977347328 ext(2097152->3145727) 00002000:00010000:1.0:1746066806.753219:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c22ea00 00000100:00100000:1.0:1746066806.753242:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977349376 00000100:00100000:1.0:1746066806.753247:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977349376 00002000:00100000:1.0:1746066806.753279:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e93f480 x1830882977349376/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.753285:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93f480 with x1830882977349376 ext(4194304->5091327) 00002000:00010000:1.0:1746066806.753288:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93f480 00000100:00100000:0.0:1746066806.753578:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.753673:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977349504 00000100:00100000:0.0:1746066806.753695:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977349504 00000100:00100000:0.0:1746066806.753724:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10204 00000100:00100000:0.0:1746066806.753730:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32080:x1830882977349504:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066806.753746:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.753760:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bda00/0xfb36a14ee608dde4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe7c expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.753823:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066806.753834:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe6e expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.753841:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066806.753863:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe6e expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.753872:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe6e expref: 9 pid: 14550 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746066806.753882:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882977007872:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066806.753925:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.754032:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7096 00000100:00100000:1.0:1746066806.754039:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1966:x1830882977349376:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066806.759342:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882977007872:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.759367:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:1.0:1746066806.759839:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1966:x1830882977349376:12345-192.168.202.57@tcp:3:cat.0 Request processed in 5796us (7075us total) trans 0 rc 897024/897024 00000100:00100000:1.0:1746066806.759849:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7096 00002000:00100000:1.0:1746066806.759863:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e93f480 x1830882977349376/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066806.759871:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e93f480 with x1830882977349376 ext(4194304->5091327) 00002000:00010000:1.0:1746066806.759876:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e93f480 00000100:00100000:0.0:1746066806.761973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.762055:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977349632 00000100:00100000:1.0:1746066806.762063:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977349632 00010000:00010000:1.0:1746066806.762090:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe6e expref: 10 pid: 14550 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.762126:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8049 00000100:00100000:1.0:1746066806.762132:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977349632:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.762143:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.762148:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe6e expref: 10 pid: 14550 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.762157:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe6e expref: 10 pid: 14550 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.762173:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608ddcf lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe6e expref: 10 pid: 14550 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.762665:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066806.762671:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066806.762720:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066806.762725:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066806.762963:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066806.762991:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.762997:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:1.0:1746066806.763061:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977349632:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 928us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.763067:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8049 00000004:00200000:3.0:1746066806.763124:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066806.763127:0:14550:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066806.763170:0:14550:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066806.763197:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bda00/0xfb36a14ee608dde4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe7c expref: 9 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.763611:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe7c expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.763618:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066806.763620:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066806.763623:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e9bc400, rc 0) 00000100:00100000:3.0:1746066806.763657:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32080:x1830882977349504:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 9927us (10081us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.763663:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10204 00000100:00100000:1.0:1746066806.784840:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.784888:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.784948:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977350144 00000100:00100000:0.0:1746066806.784955:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977350144 00002000:00100000:0.0:1746066806.784992:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a5bb3b80 x1830882977350144/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066806.785000:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb3b80 with x1830882977350144 ext(4194304->5091327) 00002000:00010000:0.0:1746066806.785004:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb3b80 00000100:00100000:0.0:1746066806.785018:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7097 00000100:00100000:0.0:1746066806.785023:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882977350144:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066806.786195:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.786389:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.788631:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977350656 00000100:00100000:1.0:1746066806.788640:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977350656 00000100:00100000:1.0:1746066806.788687:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4296 00000100:00100000:1.0:1746066806.788693:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32074:x1830882977350656:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:1.0:1746066806.788848:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:32074:x1830882977350656:12345-192.168.202.57@tcp:35:cat.0 Request processed in 155us (2458us total) trans 8589944293 rc 0/0 00000100:00100000:1.0:1746066806.788853:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4296 00000100:00100000:1.0:1746066806.789858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.790897:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977350784 00000100:00100000:2.0:1746066806.790904:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977350784 00000100:00100000:2.0:1746066806.790931:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15563 00000100:00100000:2.0:1746066806.790936:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+22:32079:x1830882977350784:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066806.790949:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.790963:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe91 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.790987:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eecb400/0xfb36a14ee608dd51 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe28 expref: 39 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.790995:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6800/0xfb36a14ee608ddc1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe67 expref: 7 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.791006:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dd97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe3d expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.791011:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.791012:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.791015:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3989504->4194303] (req 3989504->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 23 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.791036:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dd97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe3d expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.791044:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dd97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe3d expref: 23 pid: 10402 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.791054:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977008000:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066806.791640:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977350016 00000100:00100000:0.0:1746066806.791645:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977350016 00000100:00100000:0.0:1746066806.791699:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977350400 00000100:00100000:0.0:1746066806.791701:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977350400 00010000:00010000:2.0:1746066806.793355:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6800/0xfb36a14ee608ddc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe67 expref: 7 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.793370:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6800/0xfb36a14ee608ddc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe67 expref: 7 pid: 8451 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746066806.793381:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977008128:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.793427:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eecb400/0xfb36a14ee608dd51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe28 expref: 39 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.793439:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eecb400/0xfb36a14ee608dd51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe28 expref: 39 pid: 10402 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746066806.793445:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977008256:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.793456:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.794593:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10205 00000100:00100000:0.0:1746066806.794641:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32080:x1830882977350016:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066806.794659:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.794673:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3000/0xfb36a14ee608ddf9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe83 expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.794755:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3200/0xfb36a14ee608de00 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.794765:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3200/0xfb36a14ee608de00 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.794774:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3200/0xfb36a14ee608de00 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.794783:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3200/0xfb36a14ee608de00 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.794788:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3200/0xfb36a14ee608de00 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.794793:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3200/0xfb36a14ee608de00 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.794798:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a7e3200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066806.794801:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3200/0xfb36a14ee608de00 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.794806:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3200/0xfb36a14ee608de00 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.794814:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066806.794816:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066806.794819:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3200/0xfb36a14ee608de00 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.794828:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3200/0xfb36a14ee608de00 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.794853:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3000/0xfb36a14ee608ddf9 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe83 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.794859:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3000/0xfb36a14ee608ddf9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe83 expref: 9 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.794866:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a7e3000, rc 0) 00000100:00100000:0.0:1746066806.794894:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32080:x1830882977350016:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 261us (10060us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066806.794900:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10205 00000100:00100000:0.0:1746066806.794916:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10206 00000100:00100000:0.0:1746066806.794922:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:32082:x1830882977350400:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066806.794929:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066806.794934:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e2c00/0xfb36a14ee608de07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe8a expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.794984:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3400/0xfb36a14ee608de0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.794991:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3400/0xfb36a14ee608de0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.794996:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3400/0xfb36a14ee608de0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795005:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3600/0xfb36a14ee608de15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795011:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3600/0xfb36a14ee608de15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795016:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3600/0xfb36a14ee608de15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795091:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3800/0xfb36a14ee608de1c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795097:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3800/0xfb36a14ee608de1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795102:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3800/0xfb36a14ee608de1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:0.0:1746066806.795108:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066806.795168:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3400/0xfb36a14ee608de0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795173:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3400/0xfb36a14ee608de0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795177:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3400/0xfb36a14ee608de0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795181:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a7e3400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066806.795183:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3400/0xfb36a14ee608de0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795187:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3400/0xfb36a14ee608de0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795193:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066806.795195:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066806.795197:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3400/0xfb36a14ee608de0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795202:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3400/0xfb36a14ee608de0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795208:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3600/0xfb36a14ee608de15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795212:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3600/0xfb36a14ee608de15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795216:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3600/0xfb36a14ee608de15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795220:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a7e3600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066806.795222:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3600/0xfb36a14ee608de15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795226:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3600/0xfb36a14ee608de15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795230:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093705700) 00010000:00010000:0.0:1746066806.795232:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066806.795234:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3600/0xfb36a14ee608de15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795238:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3600/0xfb36a14ee608de15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:0.0:1746066806.795260:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e2c00/0xfb36a14ee608de07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe8a expref: 257 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.795268:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3800/0xfb36a14ee608de1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe8a expref: 256 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066806.795274:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066806.795275:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066806.795277:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a7e3800, rc 0) 00000100:00100000:0.0:1746066806.795303:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:32082:x1830882977350400:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 382us (9111us total) trans 8589944294 rc 0/0 00000100:00100000:0.0:1746066806.795308:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10206 00000100:00100000:2.0:1746066806.798430:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882977350144:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13399us (13533us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066806.798439:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7097 00002000:00100000:2.0:1746066806.798448:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800a5bb3b80 x1830882977350144/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/440 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.798456:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5bb3b80 with x1830882977350144 ext(4194304->5091327) 00002000:00010000:2.0:1746066806.798461:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5bb3b80 00000100:00100000:3.0:1746066806.799441:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977008000:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066806.799450:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977008128:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066806.799456:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977008256:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066806.799478:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [3989504->4194303] (req 3989504->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 23 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066806.799501:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85b6e00, rc 0) 00000100:00100000:3.0:1746066806.799523:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:32079:x1830882977350784:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 8587us (9667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066806.799529:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15563 00000100:00100000:0.0:1746066806.806769:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.807935:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.807976:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.808036:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977351296 00000100:00100000:2.0:1746066806.808044:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977351296 00000100:00100000:2.0:1746066806.808083:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4297 00000100:00100000:2.0:1746066806.808089:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32080:x1830882977351296:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:2.0:1746066806.808281:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:32080:x1830882977351296:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 191us (349us total) trans 8589944295 rc 0/0 00000100:00100000:2.0:1746066806.808288:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4297 00000100:00100000:1.0:1746066806.808477:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977350912 00000100:00100000:1.0:1746066806.808492:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977350912 00010000:00010000:1.0:1746066806.808516:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6800/0xfb36a14ee608ddc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe67 expref: 8 pid: 8451 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746066806.808541:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977351040 00000100:00100000:1.0:1746066806.808545:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977351040 00010000:00010000:1.0:1746066806.808559:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eecb400/0xfb36a14ee608dd51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe28 expref: 40 pid: 10402 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.808578:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8050 00000100:00100000:1.0:1746066806.808585:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1966:x1830882977350912:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.808597:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.808617:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6800/0xfb36a14ee608ddc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe67 expref: 8 pid: 8451 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.808628:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6800/0xfb36a14ee608ddc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe67 expref: 8 pid: 8451 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.808647:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6800/0xfb36a14ee608ddc1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe67 expref: 8 pid: 8451 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746066806.808665:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.808725:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1966:x1830882977350912:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 138us (1963us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.808731:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8050 00000100:00100000:1.0:1746066806.808747:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8051 00000100:00100000:1.0:1746066806.808754:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1965:x1830882977351040:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.808763:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.808773:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eecb400/0xfb36a14ee608dd51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe28 expref: 40 pid: 10402 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.808781:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eecb400/0xfb36a14ee608dd51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe28 expref: 40 pid: 10402 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.808795:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eecb400/0xfb36a14ee608dd51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe28 expref: 40 pid: 10402 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.808808:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.808829:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1965:x1830882977351040:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 75us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.808835:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8051 00000100:00100000:1.0:1746066806.808934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.808954:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977351424 00000100:00100000:1.0:1746066806.808959:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977351424 00010000:00010000:1.0:1746066806.808973:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dd97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe3d expref: 23 pid: 10402 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746066806.808995:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8052 00000100:00100000:1.0:1746066806.809001:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882977351424:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.809009:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.809019:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dd97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe3d expref: 23 pid: 10402 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.809028:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dd97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe3d expref: 23 pid: 10402 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.809040:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dd97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe3d expref: 23 pid: 10402 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746066806.809049:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.809051:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.809058:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 22 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.809070:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 22 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.809103:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 22 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.809115:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882977008384:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066806.809176:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.809304:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.809399:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977351552 00000100:00100000:1.0:1746066806.809404:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977351552 00000100:00100000:1.0:1746066806.809432:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15564 00000100:00100000:1.0:1746066806.809440:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882977351552:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066806.809451:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.809462:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008edf9e00/0xfb36a14ee608de2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe98 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.809507:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977008512:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066806.809542:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066806.815823:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977008512:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066806.815853:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008edf9e00/0xfb36a14ee608de2a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe98 expref: 24 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.815872:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008edf9e00/0xfb36a14ee608de2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe98 expref: 24 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.815893:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008edf9e00, rc 0) 00000100:00100000:2.0:1746066806.815931:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882977351552:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6492us (6626us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066806.815938:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15564 00000100:00100000:0.0:1746066806.815976:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.816018:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977351808 00000100:00100000:2.0:1746066806.816023:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977351808 00002000:00100000:2.0:1746066806.816053:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3989504->3993599) req@ffff88012c22c700 x1830882977351808/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.816061:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22c700 with x1830882977351808 ext(3989504->3993599) 00002000:00010000:2.0:1746066806.816064:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c22c700 00000100:00100000:2.0:1746066806.816093:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7098 00000100:00100000:2.0:1746066806.816114:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1966:x1830882977351808:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066806.816244:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830882977008384:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066806.816257:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.816277:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882977351424:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7277us (7344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.816284:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8052 00000100:00100000:2.0:1746066806.816293:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:1966:x1830882977351808:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 180us (317us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066806.816298:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7098 00002000:00100000:2.0:1746066806.816303:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3989504->3993599) req@ffff88012c22c700 x1830882977351808/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/4536 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.816310:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22c700 with x1830882977351808 ext(3989504->3993599) 00002000:00010000:2.0:1746066806.816313:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c22c700 00000100:00100000:0.0:1746066806.826997:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.827094:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977351936 00000100:00100000:2.0:1746066806.827102:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977351936 00000100:00100000:2.0:1746066806.827151:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15565 00000100:00100000:2.0:1746066806.827158:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+27:32079:x1830882977351936:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066806.827174:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066806.827187:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fe9f expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.827213:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608dc94 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd8e expref: 29 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.827220:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e9bd200/0xfb36a14ee608ddba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe60 expref: 7 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.827226:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ff6600/0xfb36a14ee608dcd3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdbf expref: 28 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.827232:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.827234:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066806.827236:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->4706303] (req 4194304->4706303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 28 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.827259:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129ff6600/0xfb36a14ee608dcd3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdbf expref: 28 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.827269:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129ff6600/0xfb36a14ee608dcd3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdbf expref: 28 pid: 8451 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066806.827278:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882977008640:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.828062:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e9bd200/0xfb36a14ee608ddba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe60 expref: 7 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.828071:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e9bd200/0xfb36a14ee608ddba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe60 expref: 7 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066806.828079:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882977008768:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.829220:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608dc94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd8e expref: 29 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066806.829231:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608dc94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd8e expref: 29 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066806.829242:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882977008896:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.829271:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066806.832729:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882977008640:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.832748:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882977008768:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066806.832759:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882977008896:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066806.832789:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [4194304->4706303] (req 4194304->4706303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 28 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066806.832806:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85b7800, rc 0) 00000100:00100000:2.0:1746066806.832862:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+28:32079:x1830882977351936:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 5701us (5869us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.832874:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15565 00000100:00100000:0.0:1746066806.838751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066806.838792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.838882:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977352192 00000100:00100000:1.0:1746066806.838882:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977352064 00000100:00100000:2.0:1746066806.838890:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977352192 00000100:00100000:1.0:1746066806.838890:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977352064 00010000:00010000:2.0:1746066806.838918:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff6600/0xfb36a14ee608dcd3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdbf expref: 28 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066806.838918:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e9bd200/0xfb36a14ee608ddba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe60 expref: 8 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066806.839144:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8053 00000100:00100000:2.0:1746066806.839152:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882977352192:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066806.839271:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066806.839402:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129ff6600/0xfb36a14ee608dcd3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdbf expref: 28 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746066806.839412:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129ff6600/0xfb36a14ee608dcd3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdbf expref: 28 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746066806.839430:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129ff6600/0xfb36a14ee608dcd3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdbf expref: 28 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746066806.839743:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066806.839780:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977352192:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 629us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.839786:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8053 00000100:00100000:2.0:1746066806.839799:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8054 00000100:00100000:2.0:1746066806.839803:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977352064:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066806.839809:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066806.839816:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e9bd200/0xfb36a14ee608ddba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe60 expref: 8 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746066806.839823:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e9bd200/0xfb36a14ee608ddba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe60 expref: 8 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746066806.839832:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e9bd200/0xfb36a14ee608ddba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe60 expref: 8 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746066806.839889:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066806.839901:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1963:x1830882977352064:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 98us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066806.839905:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8054 00000100:00100000:0.0:1746066806.843027:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.843271:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977352320 00000100:00100000:1.0:1746066806.843281:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977352320 00010000:00010000:1.0:1746066806.843313:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608dc94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd8e expref: 30 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746066806.843510:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8055 00000100:00100000:1.0:1746066806.843521:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977352320:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.843535:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066806.843557:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608dc94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd8e expref: 30 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066806.843569:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608dc94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd8e expref: 30 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066806.843590:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f200/0xfb36a14ee608dc94 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd8e expref: 30 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066806.843628:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.843631:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.843638:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4706303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.843647:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4706303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.843703:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4706303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.843717:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882977009024:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066806.843816:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.846819:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882977009024:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066806.846841:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066806.846876:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:1964:x1830882977352320:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3356us (3857us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.846886:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8055 00000100:00100000:0.0:1746066806.854422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.854462:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977352576 00000100:00100000:2.0:1746066806.854470:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977352576 00002000:00100000:2.0:1746066806.854520:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4702208->4706303) req@ffff88012c22f100 x1830882977352576/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.854530:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22f100 with x1830882977352576 ext(4702208->4706303) 00002000:00010000:2.0:1746066806.854534:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c22f100 00000100:00100000:2.0:1746066806.855201:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7099 00000100:00100000:2.0:1746066806.855211:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977352576:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066806.858650:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977352576:12345-192.168.202.57@tcp:3:cat.0 Request processed in 3432us (4229us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066806.858660:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7099 00002000:00100000:2.0:1746066806.859185:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4702208->4706303) req@ffff88012c22f100 x1830882977352576/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/4536 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.859200:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22f100 with x1830882977352576 ext(4702208->4706303) 00002000:00010000:2.0:1746066806.859205:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c22f100 00000100:00100000:0.0:1746066806.860294:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.861232:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977352832 00000100:00100000:1.0:1746066806.861240:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977352832 00000100:00100000:1.0:1746066806.861300:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4298 00000100:00100000:1.0:1746066806.861308:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+11:32079:x1830882977352832:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:1.0:1746066806.861557:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+12:32079:x1830882977352832:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 248us (1263us total) trans 8589944296 rc 0/0 00000100:00100000:1.0:1746066806.861563:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4298 00000100:00100000:0.0:1746066806.884125:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.884369:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977352960 00000100:00100000:2.0:1746066806.884378:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977352960 00000100:00100000:1.0:1746066806.885572:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15566 00000100:00100000:1.0:1746066806.885583:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+29:32082:x1830882977352960:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066806.885597:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066806.885611:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fea6 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.885640:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4706303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.885647:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066806.885648:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066806.885651:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3170304->3866623] (req 3170304->3866623) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 30 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.885692:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4706303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 26 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.885702:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4706303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 26 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066806.885712:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882977009152:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066806.886388:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066806.890221:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882977009152:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066806.890249:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3170304->3866623] (req 3170304->3866623) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 30 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.890262:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008edf8200, rc 0) 00000100:00100000:1.0:1746066806.890294:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:32082:x1830882977352960:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4715us (6176us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066806.890301:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15566 00000100:00100000:0.0:1746066806.891165:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.892056:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977353088 00000100:00100000:2.0:1746066806.892062:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977353088 00002000:00100000:2.0:1746066806.892094:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4706303) req@ffff88012c22dc00 x1830882977353088/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.892101:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22dc00 with x1830882977353088 ext(4194304->4706303) 00010000:00010000:2.0:1746066806.892108:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4706303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 27 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066806.892118:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4706303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 27 pid: 8451 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746066806.892124:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c22dc00 00000100:00100000:2.0:1746066806.892148:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2292 00000100:00100000:2.0:1746066806.892153:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977353088:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066806.908800:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977353088:12345-192.168.202.57@tcp:4:cat.0 Request processed in 16639us (17630us total) trans 17179873794 rc 0/0 00000100:00100000:2.0:1746066806.908812:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2292 00002000:00100000:2.0:1746066806.908820:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4706303) req@ffff88012c22dc00 x1830882977353088/t17179873794(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:212/0 lens 488/448 e 0 to 0 dl 1746066817 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.908829:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22dc00 with x1830882977353088 ext(4194304->4706303) 00010000:00010000:2.0:1746066806.908839:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4706303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 29 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066806.908850:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4706303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 29 pid: 8451 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746066806.908856:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c22dc00 00000100:00100000:0.0:1746066806.914846:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066806.916636:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977353216 00000100:00100000:1.0:1746066806.916645:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977353216 00010000:00010000:1.0:1746066806.916688:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4706303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 29 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066806.916723:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8056 00000100:00100000:1.0:1746066806.916729:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+29:1966:x1830882977353216:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066806.916740:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066806.916754:0:7108:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066805 -> 1746066806 00002000:00010000:1.0:1746066806.916757:0:7108:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066805 -> 1746066806 00010000:00010000:1.0:1746066806.916761:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4706303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 29 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066806.916771:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4706303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 29 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066806.916787:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a85b7800/0xfb36a14ee608de31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4706303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe9f expref: 29 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066806.916802:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.916803:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066806.916808:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3866623) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 29 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.916815:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3866623) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 29 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066806.916863:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3866623) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 29 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066806.916873:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882977009280:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066806.916939:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066806.920576:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830882977009280:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066806.920596:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066806.920628:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+28:1966:x1830882977353216:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3899us (5789us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066806.920638:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8056 00000100:00100000:1.0:1746066806.920805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066806.921527:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977353472 00000100:00100000:3.0:1746066806.921534:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977353472 00002000:00100000:3.0:1746066806.921566:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3170304->3174399) req@ffff88009ec2df80 x1830882977353472/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.921575:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2df80 with x1830882977353472 ext(3170304->3174399) 00002000:00010000:3.0:1746066806.921578:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2df80 00000100:00100000:3.0:1746066806.921601:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7100 00000100:00100000:3.0:1746066806.921608:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977353472:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066806.921761:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977353472:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 153us (955us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066806.921766:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7100 00002000:00100000:3.0:1746066806.921771:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3170304->3174399) req@ffff88009ec2df80 x1830882977353472/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/4536 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066806.921777:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2df80 with x1830882977353472 ext(3170304->3174399) 00002000:00010000:3.0:1746066806.921779:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2df80 00000100:00100000:0.0:1746066806.928399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.928541:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977353728 00000100:00100000:2.0:1746066806.928549:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977353728 00002000:00100000:2.0:1746066806.928583:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3862528->3866623) req@ffff88009e852d80 x1830882977353728/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/0 e 0 to 0 dl 1746066817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.928592:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e852d80 with x1830882977353728 ext(3862528->3866623) 00002000:00010000:2.0:1746066806.928597:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e852d80 00000100:00100000:2.0:1746066806.928625:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7101 00000100:00100000:2.0:1746066806.928631:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977353728:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066806.928812:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977353728:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 180us (420us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066806.928817:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7101 00002000:00100000:2.0:1746066806.928822:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3862528->3866623) req@ffff88009e852d80 x1830882977353728/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:212/0 lens 488/4536 e 0 to 0 dl 1746066817 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066806.928828:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e852d80 with x1830882977353728 ext(3862528->3866623) 00002000:00010000:2.0:1746066806.928831:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e852d80 00000100:00100000:0.0:1746066806.934425:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066806.935355:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977353984 00000100:00100000:2.0:1746066806.935363:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977353984 00000100:00100000:2.0:1746066806.935408:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4299 00000100:00100000:2.0:1746066806.935414:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+256:32082:x1830882977353984:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066806.935609:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:32082:x1830882977353984:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 194us (1190us total) trans 8589944297 rc 0/0 00000100:00100000:2.0:1746066806.935615:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4299 00000100:00100000:0.0:1746066807.031715:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.031934:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977354240 00000100:00100000:3.0:1746066807.031960:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977354240 00000100:00100000:3.0:1746066807.032518:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10207 00000100:00100000:3.0:1746066807.032526:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+257:32090:x1830882977354240:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066807.032573:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066807.032600:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5c00/0xfb36a14ee608de3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fead expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.032776:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5e00/0xfb36a14ee608de46 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.032788:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5e00/0xfb36a14ee608de46 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.032816:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5e00/0xfb36a14ee608de46 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:3.0:1746066807.032826:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066807.033028:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5c00/0xfb36a14ee608de3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fead expref: 260 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.033079:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5e00/0xfb36a14ee608de46 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fead expref: 259 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.033085:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066807.033088:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746066807.033090:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4e5e00, rc 0) 00000100:00080000:0.0:1746066807.033499:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066807.035466:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:32090:x1830882977354240:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2933us (3787us total) trans 8589944298 rc 0/0 00000100:00100000:3.0:1746066807.035475:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10207 00000100:00100000:0.0:1746066807.040431:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.042017:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977354368 00000100:00100000:1.0:1746066807.042026:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977354368 00000100:00080000:0.0:1746066807.043839:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066807.043953:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15567 00000100:00100000:1.0:1746066807.043966:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1965:x1830882977354368:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066807.043982:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.043998:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008edf8e00/0xfb36a14ee608de54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97feb4 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.044042:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977009408:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066807.045050:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.048756:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977009408:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066807.048784:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008edf8e00/0xfb36a14ee608de54 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97feb4 expref: 40 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.048797:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008edf8e00/0xfb36a14ee608de54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97feb4 expref: 40 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.048815:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008edf8e00, rc 0) 00000100:00100000:1.0:1746066807.048865:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1965:x1830882977354368:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4902us (8440us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.048873:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15567 00000100:00100000:0.0:1746066807.056507:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.056576:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977354624 00000100:00100000:3.0:1746066807.056584:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977354624 00002000:00100000:3.0:1746066807.056624:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88008efb7800 x1830882977354624/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.056633:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb7800 with x1830882977354624 ext(0->1048575) 00002000:00010000:3.0:1746066807.056637:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb7800 00000100:00100000:3.0:1746066807.056665:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7102 00000100:00100000:3.0:1746066807.056672:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1965:x1830882977354624:12345-192.168.202.57@tcp:3:cat.0 00000100:00080000:0.0:1746066807.059028:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066807.065198:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.065253:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.065374:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977354880 00000100:00100000:3.0:1746066807.065383:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977354880 00002000:00100000:3.0:1746066807.065423:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88008efb4380 x1830882977354880/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.065431:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb4380 with x1830882977354880 ext(1048576->2097151) 00002000:00010000:3.0:1746066807.065435:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb4380 00000100:00100000:3.0:1746066807.065453:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7103 00000100:00100000:3.0:1746066807.065460:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1965:x1830882977354880:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066807.066250:0:809:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977355136 00000100:00100000:1.0:1746066807.066254:0:809:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977355136 00000100:00100000:1.0:1746066807.066285:0:809:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10208 00000100:00100000:1.0:1746066807.066290:0:809:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:32093:x1830882977355136:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066807.066305:0:809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.066318:0:809:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00600/0xfb36a14ee608de5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97febb expref: -99 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.066390:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00800/0xfb36a14ee608de62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066400:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00800/0xfb36a14ee608de62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066409:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00800/0xfb36a14ee608de62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066419:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608de69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066424:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608de69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066428:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608de69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066521:0:809:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608de70 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066530:0:809:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608de70 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066535:0:809:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608de70 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 809 initiator: MDT0 00000004:00200000:1.0:1746066807.066547:0:809:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:1.0:1746066807.066613:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00800/0xfb36a14ee608de62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066619:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00800/0xfb36a14ee608de62 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066624:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00800/0xfb36a14ee608de62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066628:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e00800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066807.066631:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00800/0xfb36a14ee608de62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066636:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00800/0xfb36a14ee608de62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066643:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066807.066645:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066807.066648:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00800/0xfb36a14ee608de62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066652:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00800/0xfb36a14ee608de62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066665:0:809:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608de69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066669:0:809:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608de69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066689:0:809:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608de69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066697:0:809:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e00a00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066807.066699:0:809:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608de69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066703:0:809:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608de69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066709:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a73fa400) 00010000:00010000:1.0:1746066807.066711:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066807.066713:0:809:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608de69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066717:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608de69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 809 initiator: MDT0 00010000:00010000:1.0:1746066807.066748:0:809:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00600/0xfb36a14ee608de5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97febb expref: 15 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.066757:0:809:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608de70 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97febb expref: 14 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.066762:0:809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066807.066764:0:809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066807.066766:0:809:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e00c00, rc 0) 00000100:00100000:1.0:1746066807.066802:0:809:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fc98f875-2edf-4505-a13a-65f96879556b+14:32093:x1830882977355136:12345-192.168.202.57@tcp:101:cat.0 Request processed in 511us (1547us total) trans 8589944299 rc 0/0 00000100:00100000:1.0:1746066807.066807:0:809:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10208 00000100:00080000:0.0:1746066807.067119:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066807.089139:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1965:x1830882977354624:12345-192.168.202.57@tcp:3:cat.0 Request processed in 32460us (32631us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066807.089149:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7102 00002000:00100000:3.0:1746066807.089160:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88008efb7800 x1830882977354624/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.089168:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb7800 with x1830882977354624 ext(0->1048575) 00002000:00010000:3.0:1746066807.089174:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb7800 00000100:00100000:1.0:1746066807.091006:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.091594:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977355392 00000100:00100000:2.0:1746066807.091601:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977355392 00000100:00100000:2.0:1746066807.091797:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4300 00000100:00100000:2.0:1746066807.091804:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+14:32093:x1830882977355392:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066807.092226:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:32093:x1830882977355392:12345-192.168.202.57@tcp:35:cat.0 Request processed in 422us (1223us total) trans 8589944300 rc 0/0 00000100:00100000:2.0:1746066807.092232:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4300 00000100:00100000:2.0:1746066807.093597:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1965:x1830882977354880:12345-192.168.202.57@tcp:3:cat.0 Request processed in 28134us (28402us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066807.093605:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7103 00002000:00100000:2.0:1746066807.093612:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88008efb4380 x1830882977354880/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.093621:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efb4380 with x1830882977354880 ext(1048576->2097151) 00002000:00010000:2.0:1746066807.093626:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efb4380 00000100:00100000:0.0:1746066807.105032:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.105117:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.105150:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977355776 00000100:00100000:0.0:1746066807.105157:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977355776 00000100:00100000:0.0:1746066807.105196:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10209 00000100:00100000:0.0:1746066807.105203:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+15:32095:x1830882977355776:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066807.105222:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.105238:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf8e00/0xfb36a14ee608de7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fec9 expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.105314:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066807.105325:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe7c expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.105332:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3800/0xfb36a14ee608de1c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe8a expref: 258 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.105337:0:14550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608de70 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97febb expref: 16 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.105343:0:14550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066807.105368:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608de70 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97febb expref: 16 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.105378:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608de70 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97febb expref: 16 pid: 809 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066807.105388:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e635f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882977009536:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066807.105469:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3800/0xfb36a14ee608de1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe8a expref: 258 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.105487:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3800/0xfb36a14ee608de1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe8a expref: 258 pid: 809 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066807.105495:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e636680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882977009664:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066807.105520:0:14550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe7c expref: 8 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.105528:0:14550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe7c expref: 8 pid: 14550 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066807.105535:0:14550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e637480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882977009792:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066807.105544:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977355520 00000100:00100000:1.0:1746066807.105548:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977355520 00000100:00100000:0.0:1746066807.105560:0:14550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390480 going to sleep for 11 seconds 00000100:00080000:0.0:1746066807.105574:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066807.105577:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15568 00000100:00100000:1.0:1746066807.105583:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882977355520:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066807.105591:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.105601:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e01400/0xfb36a14ee608de8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fec2 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.105628:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882977009920:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066807.105653:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.113520:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.113800:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e635f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882977009536:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.113810:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e636680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882977009664:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066807.114768:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977356032 00000100:00100000:3.0:1746066807.114775:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977356032 00002000:00100000:3.0:1746066807.114808:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009e634000 x1830882977356032/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.114817:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e634000 with x1830882977356032 ext(2097152->3145727) 00002000:00010000:3.0:1746066807.114821:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e634000 00000100:00100000:2.0:1746066807.114827:0:14550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e637480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14550:1830882977009792:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066807.114835:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7104 00000100:00100000:3.0:1746066807.114840:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977356032:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:2.0:1746066807.114856:0:14550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000100:00100000:1.0:1746066807.116635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00010000:0.0:1746066807.116635:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime: 1746066805 -> 1746066806 00000100:00100000:0.0:1746066807.116651:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882977009920:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066807.116663:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.116702:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:0.0:1746066807.116716:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e01400/0xfb36a14ee608de8c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fec2 expref: 29 pid: 10402 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066807.116732:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977356160 00000100:00100000:1.0:1746066807.116737:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977356160 00010000:00010000:0.0:1746066807.116742:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e01400/0xfb36a14ee608de8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fec2 expref: 29 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.116761:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608de70 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97febb expref: 17 pid: 809 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066807.116773:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e01400, rc 0) 00000100:00100000:1.0:1746066807.116780:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977356288 00000100:00100000:1.0:1746066807.116782:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977356288 00010000:00010000:1.0:1746066807.116790:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3800/0xfb36a14ee608de1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe8a expref: 259 pid: 809 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.116800:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977356416 00000100:00100000:1.0:1746066807.116802:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977356416 00000100:00100000:0.0:1746066807.116813:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882977355520:12345-192.168.202.57@tcp:101:cat.0 Request processed in 11229us (11787us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066807.116821:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15568 00010000:00010000:1.0:1746066807.116824:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe7c expref: 9 pid: 14550 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.116836:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8057 00000100:00080000:0.0:1746066807.116838:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746066807.116842:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+17:1963:x1830882977356160:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.116852:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.116857:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608de70 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97febb expref: 17 pid: 809 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.116865:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608de70 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97febb expref: 17 pid: 809 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.116879:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608de70 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97febb expref: 17 pid: 809 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.116892:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066807.116896:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066807.116903:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066807.116908:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066807.116913:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8058 00000100:00100000:0.0:1746066807.116924:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+259:1964:x1830882977356288:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066807.116927:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc98f875-2edf-4505-a13a-65f96879556b+16:1963:x1830882977356160:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 85us (297us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066807.116930:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066807.116932:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8057 00000100:00100000:1.0:1746066807.116942:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8059 00010000:00010000:0.0:1746066807.116943:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3800/0xfb36a14ee608de1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe8a expref: 259 pid: 809 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.116946:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1963:x1830882977356416:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066807.116951:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3800/0xfb36a14ee608de1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe8a expref: 259 pid: 809 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.116954:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.116957:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe7c expref: 9 pid: 14550 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066807.116962:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a7e3800/0xfb36a14ee608de1c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe8a expref: 259 pid: 809 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.116965:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe7c expref: 9 pid: 14550 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.116974:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bc400/0xfb36a14ee608ddeb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe7c expref: 9 pid: 14550 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066807.116980:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066807.116983:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066807.116990:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:0.0:1746066807.117010:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14550 initiator: MDT0 00010000:00010000:1.0:1746066807.117956:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066807.117961:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.117987:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1963:x1830882977356416:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1040us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.117994:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8059 00010000:00010000:0.0:1746066807.120502:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066807.120734:0:14550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:2.0:1746066807.120745:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:2.0:1746066807.120768:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066807.120898:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf8e00/0xfb36a14ee608de7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fec9 expref: 17 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.120916:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fec9 expref: 16 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.120923:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066807.120925:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066807.120928:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008edf9800, rc 0) 00000100:00100000:2.0:1746066807.120956:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc98f875-2edf-4505-a13a-65f96879556b+16:32095:x1830882977355776:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 15753us (15838us total) trans 8589944301 rc 0/0 00000100:00100000:2.0:1746066807.120963:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10209 00000100:00100000:1.0:1746066807.120968:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+258:1964:x1830882977356288:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4046us (4302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.120987:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8058 00000100:00100000:3.0:1746066807.135534:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1964:x1830882977356032:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20684us (22011us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066807.135545:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7104 00002000:00100000:3.0:1746066807.135555:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009e634000 x1830882977356032/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.135564:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e634000 with x1830882977356032 ext(2097152->3145727) 00002000:00010000:3.0:1746066807.135569:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e634000 00000100:00100000:1.0:1746066807.135788:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.137236:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977356672 00000100:00100000:3.0:1746066807.137244:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977356672 00002000:00100000:3.0:1746066807.137275:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009ec2e680 x1830882977356672/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.137284:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2e680 with x1830882977356672 ext(0->1048575) 00002000:00010000:3.0:1746066807.137287:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2e680 00000100:00100000:3.0:1746066807.137314:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7105 00000100:00100000:3.0:1746066807.137319:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882977356672:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066807.142213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.142621:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977356800 00000100:00100000:0.0:1746066807.142629:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977356800 00000100:00100000:0.0:1746066807.142760:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15569 00000100:00100000:0.0:1746066807.142769:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:32090:x1830882977356800:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066807.142785:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.142799:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7e00/0xfb36a14ee608de9a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fed0 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.142822:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 21 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.142830:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066807.142831:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066807.142834:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7e00/0xfb36a14ee608de9a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed0 expref: 40 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.142858:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 21 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.142867:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 21 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066807.142878:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e637480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977010048:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066807.143308:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066807.146537:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e637480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977010048:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.146568:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7e00/0xfb36a14ee608de9a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed0 expref: 40 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.146582:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85b7e00, rc 0) 00000100:00100000:2.0:1746066807.147220:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:32090:x1830882977356800:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4449us (5012us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.147228:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15569 00000100:00100000:0.0:1746066807.149067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.149125:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977356928 00000100:00100000:2.0:1746066807.149132:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977356928 00000100:00100000:3.0:1746066807.149544:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882977356672:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12223us (13756us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066807.149554:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7105 00002000:00100000:3.0:1746066807.149564:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff88009ec2e680 x1830882977356672/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.149572:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2e680 with x1830882977356672 ext(0->1048575) 00002000:00010000:3.0:1746066807.149576:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ec2e680 00002000:00100000:2.0:1746066807.149660:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3989504->4194303) req@ffff88009e636680 x1830882977356928/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.149667:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e636680 with x1830882977356928 ext(3989504->4194303) 00010000:00010000:2.0:1746066807.149694:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 22 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.149707:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 22 pid: 8451 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746066807.149713:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e636680 00000100:00100000:2.0:1746066807.149726:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2293 00000100:00100000:2.0:1746066807.149732:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+22:1964:x1830882977356928:12345-192.168.202.57@tcp:4:cat.0 00000100:00080000:1.0:1746066807.150227:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066807.161056:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977356928:12345-192.168.202.57@tcp:4:cat.0 Request processed in 11316us (11985us total) trans 21474841096 rc 0/0 00000100:00100000:2.0:1746066807.161068:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2293 00002000:00100000:2.0:1746066807.161079:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3989504->4194303) req@ffff88009e636680 x1830882977356928/t21474841096(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/448 e 0 to 0 dl 1746066818 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.161088:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e636680 with x1830882977356928 ext(3989504->4194303) 00010000:00010000:2.0:1746066807.161097:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 24 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.161111:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 24 pid: 8451 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746066807.161118:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e636680 00000100:00100000:0.0:1746066807.167876:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.169753:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977357056 00000100:00100000:2.0:1746066807.169765:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977357056 00000100:00100000:2.0:1746066807.169829:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15570 00000100:00100000:2.0:1746066807.169839:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:32093:x1830882977357056:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066807.169856:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.169873:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093304e00/0xfb36a14ee608dea1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fed7 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.169901:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3866623) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 29 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.169908:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066807.169910:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066807.169913:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093304e00/0xfb36a14ee608dea1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed7 expref: 29 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.169944:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3866623) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 29 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.169954:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3866623) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 29 pid: 10402 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.169965:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882977010176:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.170090:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.173792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.175104:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977357184 00000100:00100000:2.0:1746066807.175114:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977357184 00010000:00010000:2.0:1746066807.175146:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 24 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.175178:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8060 00000100:00100000:2.0:1746066807.175185:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882977357184:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066807.175195:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066807.175220:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 24 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.175230:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 24 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.175251:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a85b6e00/0xfb36a14ee608ddf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe91 expref: 24 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.175282:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.175284:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.175290:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7e00/0xfb36a14ee608de9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed0 expref: 39 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.175297:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7e00/0xfb36a14ee608de9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed0 expref: 39 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.175324:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7e00/0xfb36a14ee608de9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed0 expref: 39 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066807.175335:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882977010304:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066807.175631:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882977010176:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066807.175659:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093304e00/0xfb36a14ee608dea1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed7 expref: 29 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.175671:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093304e00, rc 0) 00000100:00100000:2.0:1746066807.175934:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066807.176280:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+29:32093:x1830882977357056:12345-192.168.202.57@tcp:101:cat.0 Request processed in 6442us (8409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.176288:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15570 00000100:00100000:1.0:1746066807.178316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.178426:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977357312 00000100:00100000:2.0:1746066807.178435:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977357312 00002000:00100000:2.0:1746066807.178475:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3170304->3866623) req@ffff88009ec2d500 x1830882977357312/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.178494:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2d500 with x1830882977357312 ext(3170304->3866623) 00010000:00010000:2.0:1746066807.178501:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 30 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.178514:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 30 pid: 10402 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746066807.178520:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ec2d500 00000100:00100000:2.0:1746066807.178560:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2294 00000100:00100000:2.0:1746066807.178569:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+30:1963:x1830882977357312:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066807.180220:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.180325:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882977010304:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066807.180340:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.180520:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977357568 00000100:00100000:3.0:1746066807.180526:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977357568 00000100:00100000:3.0:1746066807.180557:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10210 00000100:00100000:3.0:1746066807.180563:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+258:32097:x1830882977357568:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066807.180580:0:14550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066807.180593:0:14550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5a00/0xfb36a14ee608dea8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fede expref: -99 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.180694:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608deaf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180705:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608deaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180714:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608deaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180727:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5400/0xfb36a14ee608deb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180732:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5400/0xfb36a14ee608deb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180736:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5400/0xfb36a14ee608deb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180820:0:14550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e4e00/0xfb36a14ee608debd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180828:0:14550:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e4e00/0xfb36a14ee608debd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180833:0:14550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e4e00/0xfb36a14ee608debd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14550 initiator: MDT0 00000004:00200000:3.0:1746066807.180841:0:14550:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066807.180905:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608deaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180911:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608deaf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180916:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608deaf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180920:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d4e5600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066807.180923:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608deaf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180928:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608deaf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180936:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066807.180939:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066807.180943:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608deaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180947:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5600/0xfb36a14ee608deaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180959:0:14550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5400/0xfb36a14ee608deb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180963:0:14550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5400/0xfb36a14ee608deb6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180967:0:14550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5400/0xfb36a14ee608deb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180971:0:14550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d4e5400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066807.180973:0:14550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5400/0xfb36a14ee608deb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180978:0:14550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5400/0xfb36a14ee608deb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180983:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135105300) 00010000:00010000:3.0:1746066807.180985:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066807.180987:0:14550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5400/0xfb36a14ee608deb6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.180991:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5400/0xfb36a14ee608deb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14550 initiator: MDT0 00010000:00010000:3.0:1746066807.182018:0:14550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5a00/0xfb36a14ee608dea8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fede expref: 261 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.182035:0:14550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e4e00/0xfb36a14ee608debd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fede expref: 260 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.182041:0:14550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066807.182043:0:14550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066807.182045:0:14550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4e4e00, rc 0) 00000100:00100000:1.0:1746066807.182046:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1963:x1830882977357184:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5178us (6578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.182059:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8060 00000100:00100000:3.0:1746066807.184088:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:32097:x1830882977357568:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3517us (3865us total) trans 8589944302 rc 0/0 00000100:00100000:3.0:1746066807.184097:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10210 00000100:00100000:3.0:1746066807.184790:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.184879:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977357824 00000100:00100000:3.0:1746066807.184885:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977357824 00002000:00100000:3.0:1746066807.184919:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009e8c5180 x1830882977357824/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.184927:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c5180 with x1830882977357824 ext(2097152->3145727) 00002000:00010000:3.0:1746066807.184935:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c5180 00000100:00100000:3.0:1746066807.184951:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7106 00000100:00100000:3.0:1746066807.184957:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1965:x1830882977357824:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066807.198321:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977357312:12345-192.168.202.57@tcp:4:cat.0 Request processed in 19746us (20002us total) trans 17179873795 rc 0/0 00000100:00100000:2.0:1746066807.198331:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2294 00002000:00100000:2.0:1746066807.198341:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3170304->3866623) req@ffff88009ec2d500 x1830882977357312/t17179873795(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/448 e 0 to 0 dl 1746066818 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.198349:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2d500 with x1830882977357312 ext(3170304->3866623) 00010000:00010000:2.0:1746066807.198358:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 32 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.198371:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 32 pid: 10402 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746066807.198382:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ec2d500 00000100:00100000:2.0:1746066807.204055:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1965:x1830882977357824:12345-192.168.202.57@tcp:3:cat.0 Request processed in 19089us (19257us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066807.204065:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7106 00002000:00100000:2.0:1746066807.204075:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009e8c5180 x1830882977357824/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.204084:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e8c5180 with x1830882977357824 ext(2097152->3145727) 00002000:00010000:2.0:1746066807.204088:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e8c5180 00000100:00100000:0.0:1746066807.208847:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.208891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.209001:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977357952 00000100:00100000:1.0:1746066807.209008:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977357952 00010000:00010000:1.0:1746066807.209035:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3170304->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 32 pid: 10402 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.209075:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8061 00000100:00100000:1.0:1746066807.209080:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977357952:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.209092:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.209108:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3170304->3866623) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 32 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.209117:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3170304->3866623) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 32 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.209133:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008edf8200/0xfb36a14ee608de38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3170304->3866623) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fea6 expref: 32 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.209146:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.209148:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.209153:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093304e00/0xfb36a14ee608dea1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed7 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.209159:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093304e00/0xfb36a14ee608dea1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed7 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.209185:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093304e00/0xfb36a14ee608dea1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed7 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.209193:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c395f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882977010432:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066807.209252:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066807.209342:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977358080 00000100:00100000:3.0:1746066807.209346:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977358080 00000100:00100000:3.0:1746066807.209368:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15571 00000100:00100000:3.0:1746066807.209373:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:32090:x1830882977358080:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:3.0:1746066807.209383:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066807.209392:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d4e5000/0xfb36a14ee608decb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fee5 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.209405:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.209406:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.209411:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4e5000/0xfb36a14ee608decb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fee5 expref: 33 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.209420:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d4e5000/0xfb36a14ee608decb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fee5 expref: 33 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.209426:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4e5000, rc 0) 00000100:00100000:3.0:1746066807.209447:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:32090:x1830882977358080:12345-192.168.202.57@tcp:101:cat.0 Request processed in 74us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.209452:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15571 00000100:00100000:0.0:1746066807.217794:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.217975:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977358336 00000100:00100000:2.0:1746066807.217983:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977358336 00002000:00100000:2.0:1746066807.218019:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8801361f8700 x1830882977358336/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.218028:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8700 with x1830882977358336 ext(3145728->4194303) 00002000:00010000:2.0:1746066807.218033:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361f8700 00000100:00100000:2.0:1746066807.218048:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7107 00000100:00100000:2.0:1746066807.218055:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1965:x1830882977358336:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066807.218836:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.219266:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c395f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882977010432:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066807.219285:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066807.219319:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977357952:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 10237us (10478us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.219327:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8061 00000100:00100000:0.0:1746066807.219375:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977358592 00000100:00100000:0.0:1746066807.219378:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977358592 00002000:00100000:0.0:1746066807.219398:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88008c395500 x1830882977358592/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.219405:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395500 with x1830882977358592 ext(2097152->3145727) 00002000:00010000:0.0:1746066807.219408:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c395500 00000100:00100000:0.0:1746066807.219425:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7108 00000100:00100000:0.0:1746066807.219431:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+29:1965:x1830882977358592:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066807.220762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.220796:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977358848 00000100:00100000:1.0:1746066807.220800:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977358848 00002000:00100000:1.0:1746066807.220819:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88008c396680 x1830882977358848/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.220826:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396680 with x1830882977358848 ext(3145728->4194303) 00002000:00010000:1.0:1746066807.220830:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c396680 00000100:00100000:1.0:1746066807.220843:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7109 00000100:00100000:1.0:1746066807.220850:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1966:x1830882977358848:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066807.229027:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1965:x1830882977358336:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10965us (11233us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066807.229038:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7107 00002000:00100000:2.0:1746066807.229048:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8801361f8700 x1830882977358336/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.229057:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8700 with x1830882977358336 ext(3145728->4194303) 00002000:00010000:2.0:1746066807.229063:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801361f8700 00000100:00100000:2.0:1746066807.236493:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+29:1965:x1830882977358592:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17044us (17640us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066807.236504:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7108 00002000:00100000:2.0:1746066807.236515:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88008c395500 x1830882977358592/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.236523:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c395500 with x1830882977358592 ext(2097152->3145727) 00002000:00010000:2.0:1746066807.236529:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c395500 00000100:00100000:1.0:1746066807.243875:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1966:x1830882977358848:12345-192.168.202.57@tcp:3:cat.0 Request processed in 23014us (23104us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066807.243886:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7109 00002000:00100000:1.0:1746066807.243899:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88008c396680 x1830882977358848/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.243907:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c396680 with x1830882977358848 ext(3145728->4194303) 00002000:00010000:1.0:1746066807.243913:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c396680 00000100:00100000:0.0:1746066807.246274:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.246934:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977358976 00000100:00100000:1.0:1746066807.246941:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977358976 00000100:00100000:1.0:1746066807.246989:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15572 00000100:00100000:1.0:1746066807.246996:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:32093:x1830882977358976:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066807.247010:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.247024:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e00400/0xfb36a14ee608ded2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97feec expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.247046:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.247048:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.247055:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e00400/0xfb36a14ee608ded2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97feec expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.247066:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e00400/0xfb36a14ee608ded2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97feec expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.247075:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e00400, rc 0) 00000100:00100000:1.0:1746066807.247119:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+24:32093:x1830882977358976:12345-192.168.202.57@tcp:101:cat.0 Request processed in 124us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.247124:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15572 00000100:00100000:0.0:1746066807.253458:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.253508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.255013:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.255037:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977359232 00000100:00100000:0.0:1746066807.255044:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977359232 00002000:00100000:0.0:1746066807.255080:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8801361fb480 x1830882977359232/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066807.255087:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977359488 00002000:00100000:0.0:1746066807.255089:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fb480 with x1830882977359232 ext(2097152->3145727) 00000100:00100000:3.0:1746066807.255090:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977359488 00002000:00010000:0.0:1746066807.255093:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361fb480 00002000:00100000:3.0:1746066807.255104:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8801361f8a80 x1830882977359488/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066807.255105:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977359744 00000100:00100000:0.0:1746066807.255107:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977359744 00002000:00100000:3.0:1746066807.255111:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8a80 with x1830882977359488 ext(3145728->4194303) 00002000:00010000:3.0:1746066807.255113:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361f8a80 00002000:00100000:0.0:1746066807.255115:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88012c22c000 x1830882977359744/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.255122:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22c000 with x1830882977359744 ext(3145728->4194303) 00000100:00100000:3.0:1746066807.255124:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7110 00002000:00010000:0.0:1746066807.255125:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c22c000 00000100:00100000:3.0:1746066807.255130:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+25:1966:x1830882977359232:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066807.255139:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7111 00000100:00100000:0.0:1746066807.255143:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801361f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+25:1966:x1830882977359488:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066807.255173:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7112 00000100:00100000:1.0:1746066807.256668:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1966:x1830882977359744:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:3.0:1746066807.261759:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746066807.261825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.261850:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977360000 00000100:00100000:2.0:1746066807.261856:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977360000 00002000:00100000:2.0:1746066807.261891:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e840700 x1830882977360000/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.261900:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e840700 with x1830882977360000 ext(4194304->5091327) 00002000:00010000:2.0:1746066807.261905:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e840700 00000100:00100000:2.0:1746066807.261927:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7113 00000100:00100000:2.0:1746066807.261934:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882977360000:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066807.281619:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977359232:12345-192.168.202.57@tcp:3:cat.0 Request processed in 26480us (28160us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066807.281629:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7110 00002000:00100000:3.0:1746066807.281639:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8801361fb480 x1830882977359232/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.281649:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361fb480 with x1830882977359232 ext(2097152->3145727) 00002000:00010000:3.0:1746066807.281654:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361fb480 00000100:00100000:2.0:1746066807.302129:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801361f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+24:1966:x1830882977359488:12345-192.168.202.57@tcp:3:cat.0 Request processed in 46978us (48613us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066807.302139:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7111 00002000:00100000:2.0:1746066807.302148:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8801361f8a80 x1830882977359488/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.302156:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801361f8a80 with x1830882977359488 ext(3145728->4194303) 00002000:00010000:2.0:1746066807.302161:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801361f8a80 00000100:00100000:2.0:1746066807.303276:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1966:x1830882977360000:12345-192.168.202.57@tcp:3:cat.0 Request processed in 41341us (41454us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066807.303283:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7113 00002000:00100000:2.0:1746066807.303288:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009e840700 x1830882977360000/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.303295:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e840700 with x1830882977360000 ext(4194304->5091327) 00002000:00010000:2.0:1746066807.303298:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e840700 00000100:00100000:0.0:1746066807.304979:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.305052:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977360128 00000100:00100000:1.0:1746066807.305060:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977360128 00000100:00100000:1.0:1746066807.305103:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15573 00000100:00100000:1.0:1746066807.305109:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:32097:x1830882977360128:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066807.305122:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.305135:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fef3 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.305155:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7e00/0xfb36a14ee608de9a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed0 expref: 41 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.305162:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e00400/0xfb36a14ee608ded2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97feec expref: 23 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.305167:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.305168:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.305171:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3829760->4194303] (req 3829760->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 41 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.305192:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e00400/0xfb36a14ee608ded2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97feec expref: 23 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.305202:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e00400/0xfb36a14ee608ded2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97feec expref: 23 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.305211:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c394700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977010560:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066807.305279:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7e00/0xfb36a14ee608de9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed0 expref: 41 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.305286:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7e00/0xfb36a14ee608de9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed0 expref: 41 pid: 10402 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.305292:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c394e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977010688:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066807.305304:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.311282:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c394700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977010560:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066807.311294:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c394e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977010688:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066807.311319:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3829760->4194303] (req 3829760->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 41 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.311333:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e00600, rc 0) 00000100:00100000:1.0:1746066807.311386:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:32097:x1830882977360128:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 6275us (6410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.311395:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15573 00000100:00100000:0.0:1746066807.313163:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.314298:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977360256 00000100:00100000:2.0:1746066807.314308:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977360256 00010000:00010000:2.0:1746066807.314345:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e00400/0xfb36a14ee608ded2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97feec expref: 24 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.314402:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8062 00000100:00100000:2.0:1746066807.314411:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977360256:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066807.314426:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066807.316833:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.316859:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977360384 00000100:00100000:1.0:1746066807.316866:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977360384 00000100:00100000:1.0:1746066807.316921:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15574 00000100:00100000:1.0:1746066807.316929:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1963:x1830882977360384:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066807.316944:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.316958:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e00200/0xfb36a14ee608dee0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fefa expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.318056:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e00400/0xfb36a14ee608ded2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97feec expref: 24 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.318071:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e00400/0xfb36a14ee608ded2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97feec expref: 24 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.318091:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e00400/0xfb36a14ee608ded2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97feec expref: 24 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.318158:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.318203:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+23:1964:x1830882977360256:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3792us (5044us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.318210:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8062 00010000:00010000:1.0:1746066807.318324:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.318332:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e00200/0xfb36a14ee608dee0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fefa expref: 42 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.318341:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e00200/0xfb36a14ee608dee0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fefa expref: 42 pid: 8451 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066807.318457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.318622:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977360512 00000100:00100000:2.0:1746066807.318627:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977360512 00010000:00010000:2.0:1746066807.318642:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7e00/0xfb36a14ee608de9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed0 expref: 42 pid: 10402 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.318664:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8063 00000100:00100000:2.0:1746066807.318669:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1965:x1830882977360512:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066807.318693:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066807.318704:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7e00/0xfb36a14ee608de9a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed0 expref: 42 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.318717:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7e00/0xfb36a14ee608de9a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed0 expref: 42 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.318728:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7e00/0xfb36a14ee608de9a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed0 expref: 42 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.318739:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.318741:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.318746:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 41 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.318753:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 41 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.318783:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 41 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066807.318793:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882977010816:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066807.318834:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba33c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066807.319331:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e00200, rc 0) 00000100:00100000:1.0:1746066807.319359:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1963:x1830882977360384:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2431us (2532us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.319365:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15574 00000100:00100000:1.0:1746066807.319836:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c22c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1966:x1830882977359744:12345-192.168.202.57@tcp:3:cat.0 Request processed in 64657us (64826us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066807.319843:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7112 00002000:00100000:1.0:1746066807.319851:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88012c22c000 x1830882977359744/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.319865:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c22c000 with x1830882977359744 ext(3145728->4194303) 00002000:00010000:1.0:1746066807.319869:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c22c000 00000100:00100000:0.0:1746066807.322240:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.322323:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882977010816:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066807.322339:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066807.322379:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1965:x1830882977360512:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3708us (3921us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.322388:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8063 00000100:00100000:1.0:1746066807.322469:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977360768 00000100:00100000:1.0:1746066807.322474:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977360768 00002000:00100000:1.0:1746066807.322509:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3829760->3833855) req@ffff88009ec2f480 x1830882977360768/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.322517:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2f480 with x1830882977360768 ext(3829760->3833855) 00002000:00010000:1.0:1746066807.322521:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2f480 00000100:00100000:1.0:1746066807.322534:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7114 00000100:00100000:1.0:1746066807.322540:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1966:x1830882977360768:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066807.322670:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1966:x1830882977360768:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 129us (434us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066807.322705:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7114 00002000:00100000:1.0:1746066807.322710:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3829760->3833855) req@ffff88009ec2f480 x1830882977360768/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/4536 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.322717:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ec2f480 with x1830882977360768 ext(3829760->3833855) 00002000:00010000:1.0:1746066807.322719:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ec2f480 00000100:00100000:0.0:1746066807.328529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.328934:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977360896 00000100:00100000:1.0:1746066807.328942:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977360896 00000100:00100000:1.0:1746066807.328991:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15575 00000100:00100000:1.0:1746066807.328997:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+23:32093:x1830882977360896:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066807.329013:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.329027:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e00800/0xfb36a14ee608dee7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff01 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.329051:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 39 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.329057:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066807.329059:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066807.329061:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e00800/0xfb36a14ee608dee7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff01 expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.329088:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 39 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.329098:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 39 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.329107:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c394700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977010944:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066807.329180:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.331630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.331874:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977361024 00000100:00100000:3.0:1746066807.331881:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977361024 00000100:00100000:1.0:1746066807.332117:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c394700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977010944:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066807.332137:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e00800/0xfb36a14ee608dee7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff01 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.332151:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e00800, rc 0) 00000100:00100000:1.0:1746066807.332185:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+25:32093:x1830882977360896:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3187us (3663us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.332192:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15575 00000100:00100000:3.0:1746066807.332415:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15576 00000100:00100000:3.0:1746066807.332420:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+24:32095:x1830882977361024:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066807.332431:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066807.332442:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff08 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.332465:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801363f3400/0xfb36a14ee608dc78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd79 expref: 39 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066807.332486:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ae6600/0xfb36a14ee608dda5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe4b expref: 6 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066807.332492:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129ff7a00/0xfb36a14ee608dcbe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdaa expref: 25 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066807.332497:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.332499:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.332502:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1798144->2097151] (req 1798144->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.332528:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129ff7a00/0xfb36a14ee608dcbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdaa expref: 25 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066807.332537:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129ff7a00/0xfb36a14ee608dcbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdaa expref: 25 pid: 8451 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.332547:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977011072:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066807.333045:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ae6600/0xfb36a14ee608dda5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe4b expref: 6 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066807.333054:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ae6600/0xfb36a14ee608dda5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe4b expref: 6 pid: 9776 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.333062:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977011200:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066807.333103:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801363f3400/0xfb36a14ee608dc78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd79 expref: 39 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066807.333111:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801363f3400/0xfb36a14ee608dc78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd79 expref: 39 pid: 8451 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.333119:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977011328:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066807.333136:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d7d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.333710:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.333760:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.333891:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977361408 00000100:00100000:2.0:1746066807.333895:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977361408 00000100:00100000:2.0:1746066807.333918:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15577 00000100:00100000:2.0:1746066807.333923:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:32097:x1830882977361408:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066807.333931:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.333940:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e607200/0xfb36a14ee608def5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff0f expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.333954:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093304e00/0xfb36a14ee608dea1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed7 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.333960:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d4e5000/0xfb36a14ee608decb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fee5 expref: 33 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.333965:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.333966:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.333968:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e607200/0xfb36a14ee608def5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->4542463] (req 4194304->4542463) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff0f expref: 33 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.333981:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d4e5000/0xfb36a14ee608decb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fee5 expref: 33 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.333987:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d4e5000/0xfb36a14ee608decb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fee5 expref: 33 pid: 10402 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.333994:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882977011456:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.334040:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093304e00/0xfb36a14ee608dea1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed7 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.334052:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093304e00/0xfb36a14ee608dea1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed7 expref: 28 pid: 10402 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.334059:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882977011584:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.334076:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.334133:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977361280 00000100:00100000:1.0:1746066807.334137:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977361280 00002000:00100000:1.0:1746066807.334156:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3829760->4194303) req@ffff8800929cd880 x1830882977361280/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.334164:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cd880 with x1830882977361280 ext(3829760->4194303) 00010000:00010000:1.0:1746066807.334169:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 40 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.334176:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 40 pid: 8451 timeout: 868 lvb_type: 0 00002000:00010000:1.0:1746066807.334182:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929cd880 00000100:00100000:1.0:1746066807.334200:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2295 00000100:00100000:1.0:1746066807.334205:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1966:x1830882977361280:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066807.335185:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977011072:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066807.335529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.335573:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977011200:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.335580:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977011328:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.335599:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [1798144->2097151] (req 1798144->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 25 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.335609:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1fb200, rc 0) 00000100:00100000:2.0:1746066807.335631:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+25:32095:x1830882977361024:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 3210us (4008us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.335638:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15576 00000100:00100000:3.0:1746066807.335781:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977361664 00000100:00100000:3.0:1746066807.335784:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977361664 00010000:00010000:3.0:1746066807.335801:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff7a00/0xfb36a14ee608dcbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdaa expref: 25 pid: 8451 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.335816:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8064 00000100:00100000:3.0:1746066807.335820:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977361664:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.335829:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.335842:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129ff7a00/0xfb36a14ee608dcbe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdaa expref: 25 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.335850:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129ff7a00/0xfb36a14ee608dcbe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdaa expref: 25 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.335864:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ff7a00/0xfb36a14ee608dcbe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fdaa expref: 25 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.335879:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.335898:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1963:x1830882977361664:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 77us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.335903:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8064 00000100:00100000:2.0:1746066807.336125:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882977011456:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.339708:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8451:1830882977011584:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.339735:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e607200/0xfb36a14ee608def5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [4194304->4542463] (req 4194304->4542463) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff0f expref: 33 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.339749:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e607200, rc 0) 00000100:00100000:2.0:1746066807.339796:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:32097:x1830882977361408:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 5871us (6085us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.339811:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15577 00000100:00100000:3.0:1746066807.341511:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.341529:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.341541:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.341602:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.341622:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977361792 00000100:00100000:3.0:1746066807.341627:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977361792 00010000:00010000:3.0:1746066807.341650:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801363f3400/0xfb36a14ee608dc78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd79 expref: 42 pid: 8451 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.341670:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977361536 00000100:00100000:3.0:1746066807.341672:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977361536 00010000:00010000:3.0:1746066807.341699:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093ae6600/0xfb36a14ee608dda5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe4b expref: 7 pid: 9776 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.341710:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977361920 00000100:00100000:3.0:1746066807.341711:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977361920 00010000:00010000:3.0:1746066807.341719:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d4e5000/0xfb36a14ee608decb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fee5 expref: 33 pid: 10402 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746066807.341727:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977362048 00000100:00100000:3.0:1746066807.341728:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977362048 00010000:00010000:3.0:1746066807.341735:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093304e00/0xfb36a14ee608dea1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed7 expref: 29 pid: 10402 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746066807.341750:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8065 00000100:00100000:3.0:1746066807.341755:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1965:x1830882977361792:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.341765:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.341783:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801363f3400/0xfb36a14ee608dc78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd79 expref: 42 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.341791:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801363f3400/0xfb36a14ee608dc78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd79 expref: 42 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.341810:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801363f3400/0xfb36a14ee608dc78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd79 expref: 42 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.341819:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.341841:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1965:x1830882977361792:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 86us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.341846:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8065 00000100:00100000:3.0:1746066807.341855:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8066 00000100:00100000:3.0:1746066807.341860:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1965:x1830882977361536:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.341865:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.341870:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093ae6600/0xfb36a14ee608dda5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe4b expref: 7 pid: 9776 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.341878:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093ae6600/0xfb36a14ee608dda5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe4b expref: 7 pid: 9776 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.341892:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ae6600/0xfb36a14ee608dda5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe4b expref: 7 pid: 9776 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.341900:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.341901:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.341907:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.341914:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.341937:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066807.341945:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882977011712:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066807.341980:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d7d900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066807.341993:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8067 00000100:00100000:3.0:1746066807.341998:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1965:x1830882977361920:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.342005:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.342016:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d4e5000/0xfb36a14ee608decb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fee5 expref: 33 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.342023:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d4e5000/0xfb36a14ee608decb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fee5 expref: 33 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.342038:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d4e5000/0xfb36a14ee608decb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fee5 expref: 33 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.342046:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.342059:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1965:x1830882977361920:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 61us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.342064:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8067 00000100:00100000:3.0:1746066807.342072:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8068 00000100:00100000:3.0:1746066807.342076:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882977362048:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.342082:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.342087:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093304e00/0xfb36a14ee608dea1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed7 expref: 29 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.342094:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093304e00/0xfb36a14ee608dea1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed7 expref: 29 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.342102:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093304e00/0xfb36a14ee608dea1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fed7 expref: 29 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.342113:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.342114:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.342117:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e607200/0xfb36a14ee608def5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff0f expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.342123:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e607200/0xfb36a14ee608def5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff0f expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.342138:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e607200/0xfb36a14ee608def5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff0f expref: 31 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066807.342146:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882977011840:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066807.342164:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d7d840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.345486:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882977011712:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066807.345503:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.345534:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1965:x1830882977361536:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3673us (4003us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.345543:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8066 00000100:00100000:1.0:1746066807.345571:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830882977011840:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066807.345577:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.345587:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882977362048:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3511us (3986us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.345592:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8068 00000100:00100000:0.0:1746066807.346505:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.346608:0:31368:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977362304 00000100:00100000:3.0:1746066807.346614:0:31368:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977362304 00002000:00100000:3.0:1746066807.346643:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1798144->1802239) req@ffff8800929cd180 x1830882977362304/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.346651:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cd180 with x1830882977362304 ext(1798144->1802239) 00002000:00010000:3.0:1746066807.346656:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929cd180 00000100:00100000:3.0:1746066807.346669:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7115 00000100:00100000:3.0:1746066807.346689:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882977362304:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066807.346805:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882977362304:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 130us (301us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066807.346811:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7115 00002000:00100000:3.0:1746066807.346815:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38d:0x0] (1798144->1802239) req@ffff8800929cd180 x1830882977362304/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/4536 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.346822:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cd180 with x1830882977362304 ext(1798144->1802239) 00002000:00010000:3.0:1746066807.346825:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800929cd180 00000100:00100000:2.0:1746066807.348382:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1966:x1830882977361280:12345-192.168.202.57@tcp:4:cat.0 Request processed in 14169us (14614us total) trans 21474841097 rc 0/0 00000100:00100000:2.0:1746066807.348391:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2295 00002000:00100000:2.0:1746066807.348399:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3829760->4194303) req@ffff8800929cd880 x1830882977361280/t21474841097(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/448 e 0 to 0 dl 1746066818 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.348406:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cd880 with x1830882977361280 ext(3829760->4194303) 00010000:00010000:2.0:1746066807.348412:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 41 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.348423:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 41 pid: 8451 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746066807.348429:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800929cd880 00000100:00100000:0.0:1746066807.348631:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.349034:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977362560 00000100:00100000:2.0:1746066807.349039:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977362560 00002000:00100000:2.0:1746066807.349061:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4538368->4542463) req@ffff8800929cce00 x1830882977362560/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.349068:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cce00 with x1830882977362560 ext(4538368->4542463) 00002000:00010000:2.0:1746066807.349071:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929cce00 00000100:00100000:2.0:1746066807.349096:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7116 00000100:00100000:2.0:1746066807.349102:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977362560:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066807.349197:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977362560:12345-192.168.202.57@tcp:3:cat.0 Request processed in 95us (566us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066807.349205:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7116 00002000:00100000:2.0:1746066807.349210:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4538368->4542463) req@ffff8800929cce00 x1830882977362560/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/4536 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.349215:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800929cce00 with x1830882977362560 ext(4538368->4542463) 00002000:00010000:2.0:1746066807.349218:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800929cce00 00000100:00100000:1.0:1746066807.354953:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.355027:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.355091:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977362688 00000100:00100000:2.0:1746066807.355099:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977362688 00010000:00010000:2.0:1746066807.355131:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3829760->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 41 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.355156:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8069 00000100:00100000:2.0:1746066807.355162:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1963:x1830882977362688:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066807.355174:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066807.355189:0:7107:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066806 -> 1746066807 00002000:00010000:2.0:1746066807.355192:0:7107:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066806 -> 1746066807 00010000:00010000:2.0:1746066807.355196:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3829760->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 41 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.355206:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3829760->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 41 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.355224:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e00600/0xfb36a14ee608ded9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3829760->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fef3 expref: 41 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.355332:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.355400:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977362816 00000100:00100000:3.0:1746066807.355404:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977362816 00000100:00100000:3.0:1746066807.355432:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15578 00000100:00100000:3.0:1746066807.355437:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+24:32095:x1830882977362816:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:3.0:1746066807.355449:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066807.355457:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff16 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.355473:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f209000/0xfb36a14ee608dd2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe05 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.355490:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d4e4c00/0xfb36a14ee608ddac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe52 expref: 5 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066807.355495:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608dd3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe13 expref: 40 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.355500:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.355501:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.355504:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 6/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->1703935] (req 1048576->1703935) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.355527:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608dd3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe13 expref: 40 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.355535:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608dd3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe13 expref: 40 pid: 21203 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746066807.355544:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977011968:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066807.355622:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d4e4c00/0xfb36a14ee608ddac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe52 expref: 5 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066807.355629:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d4e4c00/0xfb36a14ee608ddac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe52 expref: 5 pid: 20532 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.355636:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977012096:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066807.355659:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f209000/0xfb36a14ee608dd2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe05 expref: 25 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.355666:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f209000/0xfb36a14ee608dd2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe05 expref: 25 pid: 21203 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746066807.355672:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977012224:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066807.355721:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d7d000 going to sleep for 11 seconds 00010000:00010000:2.0:1746066807.355909:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.355911:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.355917:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e00800/0xfb36a14ee608dee7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff01 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.355923:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093e00800/0xfb36a14ee608dee7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff01 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066807.355938:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977363072 00000100:00100000:2.0:1746066807.355941:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977363072 00000100:00100000:2.0:1746066807.355971:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4301 00000100:00100000:2.0:1746066807.355975:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b085050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+260:32097:x1830882977363072:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:2.0:1746066807.356158:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b085050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:32097:x1830882977363072:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 181us (825us total) trans 8589944303 rc 0/0 00000100:00100000:2.0:1746066807.356164:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4301 00010000:00010000:2.0:1746066807.356208:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093e00800/0xfb36a14ee608dee7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff01 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066807.356217:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882977012352:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066807.356234:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066807.360497:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977011968:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066807.360508:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977012096:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066807.360515:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977012224:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066807.360538:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->1703935] (req 1048576->1703935) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.360553:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1fbe00, rc 0) 00000100:00100000:3.0:1746066807.360598:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc98f875-2edf-4505-a13a-65f96879556b+25:32095:x1830882977362816:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 5160us (5570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.360606:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15578 00000100:00100000:0.0:1746066807.363050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.363108:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.363178:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882977012352:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066807.363192:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.363217:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977362688:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 8055us (8272us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.363224:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8069 00000100:00100000:3.0:1746066807.363243:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977363200 00000100:00100000:3.0:1746066807.363247:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977363200 00010000:00010000:3.0:1746066807.363266:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d4e4c00/0xfb36a14ee608ddac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe52 expref: 6 pid: 20532 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.363287:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977363328 00000100:00100000:3.0:1746066807.363289:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977363328 00010000:00010000:3.0:1746066807.363296:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608dd3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe13 expref: 40 pid: 21203 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746066807.363309:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8070 00000100:00100000:3.0:1746066807.363314:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1963:x1830882977363200:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.363323:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.363339:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d4e4c00/0xfb36a14ee608ddac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe52 expref: 6 pid: 20532 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.363348:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d4e4c00/0xfb36a14ee608ddac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe52 expref: 6 pid: 20532 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.363366:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d4e4c00/0xfb36a14ee608ddac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe52 expref: 6 pid: 20532 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.363396:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.363409:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1963:x1830882977363200:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 95us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.363414:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8070 00000100:00100000:3.0:1746066807.363423:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8071 00000100:00100000:3.0:1746066807.363437:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1964:x1830882977363328:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.363442:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.363448:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608dd3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe13 expref: 40 pid: 21203 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.363456:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608dd3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe13 expref: 40 pid: 21203 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.363466:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935c1600/0xfb36a14ee608dd3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe13 expref: 40 pid: 21203 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.363473:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.363492:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1964:x1830882977363328:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 55us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.363497:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8071 00000100:00100000:0.0:1746066807.363960:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.364039:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977363456 00000100:00100000:2.0:1746066807.364043:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977363456 00010000:00010000:2.0:1746066807.364056:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f209000/0xfb36a14ee608dd2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe05 expref: 25 pid: 21203 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.364070:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8072 00000100:00100000:2.0:1746066807.364075:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977363456:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066807.364080:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066807.364088:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f209000/0xfb36a14ee608dd2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe05 expref: 25 pid: 21203 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.364096:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f209000/0xfb36a14ee608dd2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe05 expref: 25 pid: 21203 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.364107:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f209000/0xfb36a14ee608dd2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe05 expref: 25 pid: 21203 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.364129:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.364131:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.364137:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.364145:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.364166:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066807.364176:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882977012480:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066807.364224:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.364843:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.364893:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977363712 00000100:00100000:1.0:1746066807.364897:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977363712 00002000:00100000:1.0:1746066807.364919:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880092848700 x1830882977363712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.364928:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092848700 with x1830882977363712 ext(3145728->4194303) 00002000:00010000:1.0:1746066807.364932:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092848700 00000100:00100000:1.0:1746066807.364952:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7117 00000100:00100000:1.0:1746066807.364957:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+25:1965:x1830882977363712:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066807.365791:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977012992:0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.365819:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066807.365836:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746066807.365840:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:980aefe6-2860-4e29-9b4a-3d9c65563e6f:3295:1830882977012608:0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.365858:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066807.365882:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977013120:0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.365894:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066807.365908:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1830882977012864:0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.365922:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066807.365931:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746066807.365935:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1830882977012736:0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.365945:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066807.365954:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830882977013248:0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.365964:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066807.365977:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977012864 00000100:00100000:3.0:1746066807.365980:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977012864 00000100:00100000:3.0:1746066807.366001:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977012736 00000100:00100000:3.0:1746066807.366002:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977012736 00000100:00100000:3.0:1746066807.366012:0:14550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977013248 00000100:00100000:3.0:1746066807.366013:0:14550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977013248 00000100:00100000:3.0:1746066807.366022:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1746066807.366027:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830882977012864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.366054:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830882977012864:12345-0@lo:400:kworker.0 Request processed in 27us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.366058:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1746066807.366067:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1746066807.366071:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830882977012736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.366084:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830882977012736:12345-0@lo:400:kworker.0 Request processed in 13us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.366088:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1746066807.366094:0:14550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1746066807.366097:0:14550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830882977013248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.366110:0:14550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830882977013248:12345-0@lo:400:kworker.0 Request processed in 12us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.366114:0:14550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:3.0:1746066807.366124:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066807.366140:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1830882977012736:0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.366146:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830882977013248:0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.366152:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1830882977012864:0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.366170:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977012992 00000100:00100000:3.0:1746066807.366172:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977012992 00000100:00100000:3.0:1746066807.366185:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977013120 00000100:00100000:3.0:1746066807.366187:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977013120 00000100:00100000:3.0:1746066807.366195:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1746066807.366199:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830882977012992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.366219:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830882977012992:12345-0@lo:400:kworker.0 Request processed in 20us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.366223:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1746066807.366229:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1746066807.366233:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3295:x1830882977013120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.366246:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3295:x1830882977013120:12345-0@lo:400:kworker.0 Request processed in 13us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.366250:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1746066807.366266:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977013120:0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.366273:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977012992:0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.366784:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977013376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746066807.366805:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066807.366824:0:8454:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977013376 00000100:00100000:3.0:1746066807.366827:0:8454:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977013376 00000100:00100000:3.0:1746066807.366842:0:8454:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1746066807.366846:0:8454:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3294:x1830882977013376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746066807.366857:0:8454:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 686620672 pending 37486592 free 3852468224 avail 3850371072 00000100:00100000:3.0:1746066807.366876:0:8454:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3294:x1830882977013376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30us (71us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.366880:0:8454:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1746066807.366899:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977013376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746066807.367129:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977012608 00000100:00100000:1.0:1746066807.367133:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977012608 00000100:00100000:1.0:1746066807.367152:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1746066807.367156:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a530d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980aefe6-2860-4e29-9b4a-3d9c65563e6f+18:3295:x1830882977012608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066807.368056:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830882977012480:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066807.368067:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066807.368092:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977363456:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4017us (4133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.368099:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8072 00000100:00100000:3.0:1746066807.368240:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977013504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746066807.368260:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066807.368295:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a530d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980aefe6-2860-4e29-9b4a-3d9c65563e6f+18:3295:x1830882977012608:12345-0@lo:400:kworker.0 Request processed in 1139us (2435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.368301:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1746066807.368516:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:980aefe6-2860-4e29-9b4a-3d9c65563e6f:3295:1830882977012608:0@lo:400:kworker.0 00000100:00100000:3.0:1746066807.368532:0:30571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977013504 00000100:00100000:3.0:1746066807.368535:0:30571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977013504 00000100:00100000:3.0:1746066807.368549:0:30571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1746066807.368553:0:30571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3295:x1830882977013504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746066807.368563:0:30571:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 625147904 pending 27262976 free 3852468224 avail 3850371072 00000100:00100000:3.0:1746066807.368907:0:30571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3295:x1830882977013504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 353us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.368912:0:30571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1746066807.368980:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977013504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746066807.380777:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.381970:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977363968 00000100:00100000:2.0:1746066807.381979:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977363968 00002000:00100000:2.0:1746066807.382018:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1699840->1703935) req@ffff88009284aa00 x1830882977363968/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.382032:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284aa00 with x1830882977363968 ext(1699840->1703935) 00002000:00010000:2.0:1746066807.382037:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284aa00 00000100:00100000:3.0:1746066807.383784:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7118 00000100:00100000:3.0:1746066807.383797:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977363968:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:3.0:1746066807.383964:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977363968:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 170us (3193us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066807.383970:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7118 00002000:00100000:3.0:1746066807.383977:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38e:0x0] (1699840->1703935) req@ffff88009284aa00 x1830882977363968/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/4536 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.383984:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284aa00 with x1830882977363968 ext(1699840->1703935) 00002000:00010000:3.0:1746066807.383988:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284aa00 00000100:00100000:0.0:1746066807.385301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.385418:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977364096 00000100:00100000:2.0:1746066807.385424:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977364096 00002000:00100000:2.0:1746066807.385451:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4542463) req@ffff880092849500 x1830882977364096/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.385459:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849500 with x1830882977364096 ext(4194304->4542463) 00002000:00010000:2.0:1746066807.385462:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092849500 00000100:00100000:2.0:1746066807.385491:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7119 00000100:00100000:2.0:1746066807.385497:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977364096:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:1.0:1746066807.386065:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+24:1965:x1830882977363712:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 21107us (21222us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066807.386072:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7117 00002000:00100000:1.0:1746066807.386077:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff880092848700 x1830882977363712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.386084:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092848700 with x1830882977363712 ext(3145728->4194303) 00002000:00010000:1.0:1746066807.386087:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092848700 00000100:00100000:2.0:1746066807.393063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.393842:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977364224 00000100:00100000:1.0:1746066807.393907:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977364224 00000100:00100000:1.0:1746066807.394136:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15579 00000100:00100000:1.0:1746066807.394144:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1966:x1830882977364224:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066807.394157:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.394170:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e01a00/0xfb36a14ee608df03 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff1d expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.394210:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c396d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882977013632:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066807.394843:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066807.394875:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977364096:12345-192.168.202.57@tcp:4:cat.0 Request processed in 9377us (9576us total) trans 17179873796 rc 0/0 00000100:00100000:2.0:1746066807.394883:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7119 00002000:00100000:2.0:1746066807.394890:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->4542463) req@ffff880092849500 x1830882977364096/t17179873796(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/448 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.394898:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849500 with x1830882977364096 ext(4194304->4542463) 00002000:00010000:2.0:1746066807.394901:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092849500 00002000:00010000:1.0:1746066807.396309:0:10402:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime: 1746066806 -> 1746066807 00002000:00010000:1.0:1746066807.396314:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime: 1746066806 -> 1746066807 00002000:00010000:1.0:1746066807.396315:0:10402:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime: 1746066806 -> 1746066807 00000100:00100000:1.0:1746066807.396330:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c396d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882977013632:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066807.396351:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e01a00/0xfb36a14ee608df03 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff1d expref: 29 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.396362:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e01a00/0xfb36a14ee608df03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff1d expref: 29 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.396381:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e01a00, rc 0) 00000100:00100000:1.0:1746066807.396414:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1966:x1830882977364224:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2270us (3357us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.396420:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15579 00000100:00100000:2.0:1746066807.399364:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.399457:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977364352 00000100:00100000:1.0:1746066807.399465:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977364352 00000100:00100000:1.0:1746066807.400614:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15580 00000100:00100000:1.0:1746066807.400623:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:32093:x1830882977364352:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066807.400639:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.400652:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093e01c00/0xfb36a14ee608df0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff24 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.400685:0:10402:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e607200/0xfb36a14ee608def5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff0f expref: 33 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.400692:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066807.400694:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066807.400702:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e01c00/0xfb36a14ee608df0a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [4194304->5091327] (req 4194304->5091327) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff24 expref: 29 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.400724:0:10402:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e607200/0xfb36a14ee608def5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff0f expref: 33 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.400734:0:10402:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e607200/0xfb36a14ee608def5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff0f expref: 33 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.400748:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c396d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882977013760:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066807.400827:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.402910:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c396d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882977013760:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066807.403096:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093e01c00/0xfb36a14ee608df0a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [4194304->5091327] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff24 expref: 29 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.403109:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e01c00, rc 0) 00000100:00100000:1.0:1746066807.403769:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+29:32093:x1830882977364352:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3146us (4411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.403777:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15580 00000100:00100000:0.0:1746066807.403963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.404278:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977364480 00000100:00100000:1.0:1746066807.404284:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977364480 00010000:00010000:1.0:1746066807.404307:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e607200/0xfb36a14ee608def5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff0f expref: 34 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.404333:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8073 00000100:00100000:1.0:1746066807.404338:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977364480:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.404349:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.404366:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e607200/0xfb36a14ee608def5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff0f expref: 34 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.404376:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e607200/0xfb36a14ee608def5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff0f expref: 34 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.404393:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e607200/0xfb36a14ee608def5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4542463) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff0f expref: 34 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.404407:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.404409:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.404414:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e01c00/0xfb36a14ee608df0a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff24 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.404420:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e01c00/0xfb36a14ee608df0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff24 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.404443:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093e01c00/0xfb36a14ee608df0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff24 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.404453:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c396d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882977013888:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066807.405607:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.407161:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c396d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830882977013888:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066807.407369:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.407408:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977364480:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3069us (3445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.407417:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8073 00000100:00100000:0.0:1746066807.408962:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.409185:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977364736 00000100:00100000:2.0:1746066807.409194:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977364736 00002000:00100000:2.0:1746066807.409228:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009284bb80 x1830882977364736/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.409241:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284bb80 with x1830882977364736 ext(4194304->5091327) 00002000:00010000:2.0:1746066807.409246:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284bb80 00000100:00100000:2.0:1746066807.409272:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7120 00000100:00100000:2.0:1746066807.409279:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977364736:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066807.421768:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977364736:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12480us (12799us total) trans 0 rc 897024/897024 00000100:00100000:2.0:1746066807.421778:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7120 00002000:00100000:2.0:1746066807.421788:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff88009284bb80 x1830882977364736/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.421796:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284bb80 with x1830882977364736 ext(4194304->5091327) 00002000:00010000:2.0:1746066807.421801:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284bb80 00000100:00100000:1.0:1746066807.449868:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.451410:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977364992 00000100:00100000:0.0:1746066807.451419:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977364992 00000100:00100000:0.0:1746066807.451461:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10211 00000100:00100000:0.0:1746066807.451467:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+261:32105:x1830882977364992:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066807.451493:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.451507:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc000/0xfb36a14ee608df11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff2b expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.451591:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc200/0xfb36a14ee608df18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.451602:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc200/0xfb36a14ee608df18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.451612:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc200/0xfb36a14ee608df18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.451625:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc400/0xfb36a14ee608df1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.451630:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc400/0xfb36a14ee608df1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.451634:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc400/0xfb36a14ee608df1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.451735:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc600/0xfb36a14ee608df26 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.451743:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc600/0xfb36a14ee608df26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.451749:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc600/0xfb36a14ee608df26 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:0.0:1746066807.451756:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066807.451823:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc200/0xfb36a14ee608df18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.451828:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc200/0xfb36a14ee608df18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.451833:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc200/0xfb36a14ee608df18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.451838:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f6fc200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066807.451841:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc200/0xfb36a14ee608df18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.451847:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc200/0xfb36a14ee608df18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.451857:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066807.451860:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066807.451863:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc200/0xfb36a14ee608df18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.451867:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc200/0xfb36a14ee608df18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.453241:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc400/0xfb36a14ee608df1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.453248:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc400/0xfb36a14ee608df1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.453253:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc400/0xfb36a14ee608df1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.453258:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f6fc400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:0.0:1746066807.453260:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc400/0xfb36a14ee608df1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.453265:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc400/0xfb36a14ee608df1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.453273:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009acddd00) 00010000:00010000:0.0:1746066807.453275:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066807.453278:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc400/0xfb36a14ee608df1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.453282:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc400/0xfb36a14ee608df1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.453321:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc000/0xfb36a14ee608df11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff2b expref: 264 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.453331:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc600/0xfb36a14ee608df26 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff2b expref: 263 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.453337:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066807.453339:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066807.453341:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f6fc600, rc 0) 00000100:00100000:0.0:1746066807.453835:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:32105:x1830882977364992:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2367us (3973us total) trans 8589944304 rc 0/0 00000100:00100000:0.0:1746066807.453843:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10211 00000100:00100000:0.0:1746066807.458305:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.458354:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.458450:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977365376 00000100:00100000:1.0:1746066807.458457:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977365376 00000100:00100000:1.0:1746066807.458521:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 730 00000100:00100000:1.0:1746066807.458528:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:1965:x1830882977365376:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.458540:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.458560:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f6fc600/0xfb36a14ee608df26 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff2b expref: 263 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.458577:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066807.458580:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.458614:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:1965:x1830882977365376:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.458620:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 730 00000100:00100000:2.0:1746066807.458905:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977365248 00000100:00100000:2.0:1746066807.458909:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977365248 00000100:00100000:2.0:1746066807.458931:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4302 00000100:00100000:2.0:1746066807.458935:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+262:32105:x1830882977365248:12345-192.168.202.57@tcp:35:cat.0 00000100:00100000:2.0:1746066807.460487:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:32105:x1830882977365248:12345-192.168.202.57@tcp:35:cat.0 Request processed in 1548us (2185us total) trans 8589944305 rc 0/0 00000100:00100000:2.0:1746066807.460494:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4302 00000100:00100000:0.0:1746066807.463157:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.463200:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977365504 00000100:00100000:1.0:1746066807.463206:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977365504 00000100:00100000:1.0:1746066807.463249:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15581 00000100:00100000:1.0:1746066807.463256:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1963:x1830882977365504:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066807.463270:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.463284:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093e01400/0xfb36a14ee608df34 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff32 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.463326:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c394380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977014016:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066807.463626:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.466148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.466180:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.466207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.466270:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977365760 00000100:00100000:0.0:1746066807.466280:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977365760 00000100:00100000:0.0:1746066807.466311:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977365632 00000100:00100000:0.0:1746066807.466313:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977365632 00000100:00100000:0.0:1746066807.466322:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977365888 00000100:00100000:0.0:1746066807.466324:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977365888 00000100:00100000:0.0:1746066807.466335:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15582 00000100:00100000:0.0:1746066807.466341:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977365760:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066807.466354:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.466367:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f6fd800/0xfb36a14ee608df3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff40 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.466388:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.466389:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.466396:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f6fd800/0xfb36a14ee608df3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff40 expref: 34 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.466408:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f6fd800/0xfb36a14ee608df3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff40 expref: 34 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.466417:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f6fd800, rc 0) 00000100:00100000:0.0:1746066807.466450:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977365760:12345-192.168.202.57@tcp:101:cat.0 Request processed in 109us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.466456:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15582 00000100:00100000:0.0:1746066807.466470:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15583 00000100:00100000:0.0:1746066807.466486:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1964:x1830882977365632:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066807.466493:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.466501:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f6fda00/0xfb36a14ee608df42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff39 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066807.466531:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977014144:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066807.466576:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.466590:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15584 00000100:00100000:0.0:1746066807.466596:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+43:1964:x1830882977365888:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066807.466601:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.466607:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f6fce00/0xfb36a14ee608df49 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff47 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.466616:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.466618:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.466622:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f6fce00/0xfb36a14ee608df49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff47 expref: 44 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.466631:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f6fce00/0xfb36a14ee608df49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff47 expref: 44 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.466637:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f6fce00, rc 0) 00000100:00100000:0.0:1746066807.466653:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+44:1964:x1830882977365888:12345-192.168.202.57@tcp:101:cat.0 Request processed in 58us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.466657:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15584 00002000:00010000:1.0:1746066807.466893:0:10402:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime: 1746066805 -> 1746066807 00002000:00010000:1.0:1746066807.466897:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime: 1746066805 -> 1746066807 00002000:00010000:1.0:1746066807.466898:0:10402:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime: 1746066805 -> 1746066807 00000100:00100000:1.0:1746066807.466914:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c394380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10402:1830882977014016:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066807.466931:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093e01400/0xfb36a14ee608df34 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff32 expref: 43 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.466939:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e01400/0xfb36a14ee608df34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff32 expref: 43 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.466947:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e01400, rc 0) 00000100:00100000:1.0:1746066807.466966:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1963:x1830882977365504:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3711us (3815us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.466971:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15581 00002000:00010000:2.0:1746066807.468582:0:8451:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime: 1746066806 -> 1746066807 00002000:00010000:2.0:1746066807.468587:0:8451:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime: 1746066803 -> 1746066807 00002000:00010000:2.0:1746066807.468589:0:8451:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime: 1746066806 -> 1746066807 00000100:00100000:2.0:1746066807.468601:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977014144:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066807.468633:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f6fda00/0xfb36a14ee608df42 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff39 expref: 41 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.468646:0:8451:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f6fda00/0xfb36a14ee608df42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff39 expref: 41 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.468943:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f6fda00, rc 0) 00000100:00100000:2.0:1746066807.468976:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1964:x1830882977365632:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2501us (2795us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066807.468982:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15583 00000100:00100000:0.0:1746066807.473343:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.474715:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977366016 00000100:00100000:2.0:1746066807.474723:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977366016 00000100:00100000:2.0:1746066807.474775:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15585 00000100:00100000:2.0:1746066807.474783:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:32105:x1830882977366016:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066807.474798:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.474813:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e607200/0xfb36a14ee608df50 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff4e expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.474839:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.474846:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066807.474848:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066807.474851:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e607200/0xfb36a14ee608df50 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff4e expref: 41 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.474877:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 23 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.474891:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 23 pid: 10402 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.474901:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977014272:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.475092:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066807.477722:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977014272:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.477747:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e607200/0xfb36a14ee608df50 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff4e expref: 41 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.477763:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e607200, rc 0) 00000100:00100000:2.0:1746066807.477799:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:32105:x1830882977366016:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3017us (4465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.477808:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15585 00000100:00100000:0.0:1746066807.479954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.480316:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977366144 00000100:00100000:2.0:1746066807.480324:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977366144 00002000:00100000:2.0:1746066807.480358:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1798144->2097151) req@ffff880092849c00 x1830882977366144/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.480367:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849c00 with x1830882977366144 ext(1798144->2097151) 00010000:00010000:2.0:1746066807.480375:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 24 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.480387:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 24 pid: 10402 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746066807.480398:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092849c00 00000100:00100000:2.0:1746066807.480425:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2296 00000100:00100000:2.0:1746066807.480431:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+24:1964:x1830882977366144:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066807.484359:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882977366144:12345-192.168.202.57@tcp:4:cat.0 Request processed in 3921us (4402us total) trans 21474841098 rc 0/0 00000100:00100000:2.0:1746066807.484370:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2296 00002000:00100000:2.0:1746066807.484379:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1798144->2097151) req@ffff880092849c00 x1830882977366144/t21474841098(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/448 e 0 to 0 dl 1746066818 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.484388:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849c00 with x1830882977366144 ext(1798144->2097151) 00010000:00010000:2.0:1746066807.484396:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 26 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.484407:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 26 pid: 10402 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746066807.484412:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092849c00 00000100:00100000:0.0:1746066807.488607:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.488722:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977366272 00000100:00100000:2.0:1746066807.488730:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977366272 00010000:00010000:2.0:1746066807.488760:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 26 pid: 10402 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.488800:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8074 00000100:00100000:2.0:1746066807.488807:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+26:1963:x1830882977366272:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066807.488822:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066807.488840:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 26 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.488851:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 26 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.488869:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608deee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff08 expref: 26 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.488897:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.488899:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.488905:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e607200/0xfb36a14ee608df50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff4e expref: 40 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.488912:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e607200/0xfb36a14ee608df50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff4e expref: 40 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.488940:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e607200/0xfb36a14ee608df50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff4e expref: 40 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066807.488951:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882977014400:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066807.489027:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066807.492072:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882977014400:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066807.492088:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066807.492341:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+25:1963:x1830882977366272:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3532us (3739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.492351:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8074 00000100:00100000:0.0:1746066807.494086:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.494159:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977366528 00000100:00100000:2.0:1746066807.494165:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977366528 00002000:00100000:2.0:1746066807.494197:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009284b800 x1830882977366528/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.494207:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284b800 with x1830882977366528 ext(1048576->2097151) 00002000:00010000:2.0:1746066807.494211:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284b800 00000100:00100000:2.0:1746066807.494235:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7121 00000100:00100000:2.0:1746066807.494241:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1963:x1830882977366528:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066807.503359:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1963:x1830882977366528:12345-192.168.202.57@tcp:3:cat.0 Request processed in 9110us (9268us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066807.503369:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7121 00002000:00100000:2.0:1746066807.503378:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff88009284b800 x1830882977366528/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.503387:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284b800 with x1830882977366528 ext(1048576->2097151) 00002000:00010000:2.0:1746066807.503392:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284b800 00000100:00100000:0.0:1746066807.516224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.517451:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977366656 00000100:00100000:2.0:1746066807.517460:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977366656 00000100:00100000:2.0:1746066807.517717:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15586 00000100:00100000:2.0:1746066807.517725:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:32105:x1830882977366656:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066807.517741:0:8451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.517755:0:8451:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e606200/0xfb36a14ee608df57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff55 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.517783:0:8451:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.517790:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066807.517791:0:8451:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066807.517794:0:8451:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e606200/0xfb36a14ee608df57 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff55 expref: 42 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.517816:0:8451:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 24 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.517825:0:8451:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 24 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.517835:0:8451:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977014528:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.518344:0:8451:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.524822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.525001:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977366784 00000100:00100000:3.0:1746066807.525007:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977366784 00002000:00100000:3.0:1746066807.525040:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1703935) req@ffff880092849180 x1830882977366784/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.525050:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849180 with x1830882977366784 ext(1048576->1703935) 00010000:00010000:3.0:1746066807.525057:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 25 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.525069:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 25 pid: 8451 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746066807.525075:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092849180 00000100:00100000:3.0:1746066807.525090:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2297 00000100:00100000:3.0:1746066807.525096:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+25:1964:x1830882977366784:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:2.0:1746066807.525634:0:8451:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8451:1830882977014528:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.525652:0:8451:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e606200/0xfb36a14ee608df57 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff55 expref: 42 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.525663:0:8451:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e606200, rc 0) 00000100:00100000:2.0:1746066807.525707:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:32105:x1830882977366656:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7983us (9490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.525714:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15586 00000100:00100000:3.0:1746066807.535873:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977366784:12345-192.168.202.57@tcp:4:cat.0 Request processed in 10768us (11055us total) trans 21474841099 rc 0/0 00000100:00100000:3.0:1746066807.535885:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2297 00002000:00100000:3.0:1746066807.535896:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1703935) req@ffff880092849180 x1830882977366784/t21474841099(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/448 e 0 to 0 dl 1746066818 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.535905:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092849180 with x1830882977366784 ext(1048576->1703935) 00010000:00010000:3.0:1746066807.535914:0:8455:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 27 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.535928:0:8455:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 27 pid: 8451 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746066807.535935:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092849180 00000100:00100000:0.0:1746066807.536490:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.536546:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977366912 00000100:00100000:1.0:1746066807.536553:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977366912 00000100:00100000:1.0:1746066807.536596:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10212 00000100:00100000:1.0:1746066807.536602:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:32106:x1830882977366912:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066807.536617:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.536630:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00600/0xfb36a14ee608df5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff5c expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.536701:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608df65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.536716:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608df65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.536725:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608df65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.536735:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e01800/0xfb36a14ee608df6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.536740:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e01800/0xfb36a14ee608df6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.536745:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e01800/0xfb36a14ee608df6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.536819:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.536827:0:16018:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fec9 expref: 15 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.536833:0:16018:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.536856:0:16018:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fec9 expref: 15 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.536865:0:16018:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fec9 expref: 15 pid: 14550 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.536875:0:16018:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c394380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882977014656:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066807.536925:0:16018:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.540261:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.540442:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.540537:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977367296 00000100:00100000:3.0:1746066807.540543:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977367296 00000100:00100000:3.0:1746066807.540575:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4303 00000100:00100000:3.0:1746066807.540582:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+16:27281:x1830882977367296:12345-192.168.202.57@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746066807.540777:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+17:27281:x1830882977367296:12345-192.168.202.57@tcp:35:ldlm_bl.0 Request processed in 195us (334us total) trans 8589944306 rc 0/0 00000100:00100000:3.0:1746066807.540783:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4303 00000100:00100000:2.0:1746066807.540923:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977367040 00000100:00100000:1.0:1746066807.540926:0:16018:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c394380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882977014656:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.540928:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977367040 00010000:00010000:1.0:1746066807.540943:0:16018:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.540945:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 27 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.540962:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8075 00000100:00100000:2.0:1746066807.540966:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977367040:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066807.540974:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066807.540988:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 27 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.540996:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 27 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.541013:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608defc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1703935) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff16 expref: 27 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.541026:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.541027:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.541033:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e606200/0xfb36a14ee608df57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff55 expref: 41 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.541040:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e606200/0xfb36a14ee608df57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff55 expref: 41 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.541064:0:15727:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e606200/0xfb36a14ee608df57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff55 expref: 41 pid: 8451 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066807.541073:0:15727:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882977014784:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066807.541123:0:15727:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.543433:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.543991:0:15727:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15727:1830882977014784:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066807.544007:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066807.544050:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+26:1964:x1830882977367040:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 3082us (3794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.544060:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8075 00000100:00100000:2.0:1746066807.544079:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977367424 00000100:00100000:2.0:1746066807.544083:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977367424 00010000:00010000:2.0:1746066807.544103:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fec9 expref: 17 pid: 14550 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.544121:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8076 00000100:00100000:2.0:1746066807.544126:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+17:1964:x1830882977367424:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066807.544136:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066807.544140:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fec9 expref: 17 pid: 14550 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.544149:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fec9 expref: 17 pid: 14550 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.544165:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008edf9800/0xfb36a14ee608de85 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fec9 expref: 17 pid: 14550 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.544175:0:15727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066807.544179:0:15727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.544187:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.544193:0:15727:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.544332:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066807.544352:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:1964:x1830882977367424:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 225us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.544358:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8076 00010000:00010000:1.0:1746066807.544734:0:16018:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544742:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:1.0:1746066807.544781:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:1.0:1746066807.544784:0:16018:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746066807.544797:0:16018:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544804:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544811:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608df65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544817:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608df65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544822:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608df65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544827:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e00c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066807.544833:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608df65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544840:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608df65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544847:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066807.544849:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066807.544851:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608df65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544855:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00c00/0xfb36a14ee608df65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544882:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e01800/0xfb36a14ee608df6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544886:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e01800/0xfb36a14ee608df6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544890:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093e01800/0xfb36a14ee608df6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544893:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093e01800 already unused, calling callback (ffffffffa137d690) 00010000:00010000:1.0:1746066807.544895:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e01800/0xfb36a14ee608df6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544899:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093e01800/0xfb36a14ee608df6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544905:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b4323200) 00010000:00010000:1.0:1746066807.544906:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066807.544908:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093e01800/0xfb36a14ee608df6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544912:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e01800/0xfb36a14ee608df6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.544940:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00600/0xfb36a14ee608df5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff5c expref: 10 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.544950:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff5c expref: 9 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.544955:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066807.544957:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066807.544959:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093e00a00, rc 0) 00000100:00100000:1.0:1746066807.544995:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:32106:x1830882977366912:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 8394us (8506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.545001:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10212 00000100:00100000:0.0:1746066807.549749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.549775:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977367680 00000100:00100000:3.0:1746066807.549783:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977367680 00002000:00100000:3.0:1746066807.549818:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009bb2d500 x1830882977367680/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.549827:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d500 with x1830882977367680 ext(1048576->2097151) 00002000:00010000:3.0:1746066807.549831:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2d500 00000100:00100000:3.0:1746066807.549854:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7122 00000100:00100000:3.0:1746066807.549861:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1963:x1830882977367680:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066807.550076:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.550291:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.550311:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.550419:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.550699:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977367936 00000100:00100000:2.0:1746066807.550703:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977367936 00000100:00100000:2.0:1746066807.550727:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977368192 00000100:00100000:2.0:1746066807.550729:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977368192 00000100:00100000:2.0:1746066807.550738:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977367808 00000100:00100000:2.0:1746066807.550739:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977367808 00000100:00100000:2.0:1746066807.550746:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977368064 00000100:00100000:2.0:1746066807.550747:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977368064 00000100:00100000:2.0:1746066807.552232:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15587 00000100:00100000:0.0:1746066807.552239:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15588 00000100:00100000:2.0:1746066807.552243:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977367936:12345-192.168.202.57@tcp:101:lfs.0 00000100:00100000:0.0:1746066807.552251:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977368192:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066807.552256:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.552258:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.552270:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7c00/0xfb36a14ee608df7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff78 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.552271:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e607400/0xfb36a14ee608df81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff6a expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.552287:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.552288:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.552289:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.552289:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.552296:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e607400/0xfb36a14ee608df81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff6a expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.552296:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7c00/0xfb36a14ee608df7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff78 expref: 9 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.552308:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e607400/0xfb36a14ee608df81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff6a expref: 9 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.552308:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7c00/0xfb36a14ee608df7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff78 expref: 9 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.552315:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85b7c00, rc 0) 00010000:00010000:2.0:1746066807.552320:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e607400, rc 0) 00000100:00100000:0.0:1746066807.552353:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977368192:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 107us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.552358:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15588 00000100:00100000:0.0:1746066807.552374:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15589 00000100:00100000:0.0:1746066807.552379:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977367808:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066807.552385:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.552392:0:8112:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7a00/0xfb36a14ee608df88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff63 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.552401:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.552402:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.552407:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7a00/0xfb36a14ee608df88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff63 expref: 9 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.552415:0:8112:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7a00/0xfb36a14ee608df88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff63 expref: 9 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.552421:0:8112:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a85b7a00, rc 0) 00000100:00100000:2.0:1746066807.552547:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977367936:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 306us (2470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.552551:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977367808:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 171us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.552552:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15587 00000100:00100000:0.0:1746066807.552556:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15589 00000100:00100000:2.0:1746066807.552563:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15590 00000100:00100000:2.0:1746066807.552568:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1964:x1830882977368064:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066807.552575:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.552582:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e606400/0xfb36a14ee608df8f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff71 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.552594:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.552595:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.552599:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e606400/0xfb36a14ee608df8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff71 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.552607:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e606400/0xfb36a14ee608df8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff71 expref: 8 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.552613:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e606400, rc 0) 00000100:00100000:2.0:1746066807.552625:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977368064:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 58us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.552629:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15590 00000100:00100000:0.0:1746066807.560310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.560369:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977368448 00000100:00100000:1.0:1746066807.560376:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977368448 00000100:00100000:1.0:1746066807.560429:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10213 00000100:00100000:1.0:1746066807.560437:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:32106:x1830882977368448:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066807.560454:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.560468:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608df96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff7f expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.560559:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.560571:0:16018:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff5c expref: 10 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.560577:0:16018:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:1.0:1746066807.560604:0:16018:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff5c expref: 10 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.560614:0:16018:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff5c expref: 10 pid: 16018 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.560624:0:16018:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c394380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882977014912:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066807.560725:0:16018:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fedd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066807.561754:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1963:x1830882977367680:12345-192.168.202.57@tcp:3:cat.0 Request processed in 11890us (12014us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066807.561764:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7122 00002000:00100000:2.0:1746066807.561773:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009bb2d500 x1830882977367680/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.561781:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d500 with x1830882977367680 ext(1048576->2097151) 00002000:00010000:2.0:1746066807.561785:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2d500 00000100:00100000:0.0:1746066807.564646:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.564933:0:16018:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c394380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882977014912:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066807.564956:0:16018:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000100:00100000:2.0:1746066807.564974:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977368576 00000100:00100000:2.0:1746066807.564980:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977368576 00010000:00010000:2.0:1746066807.565006:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff5c expref: 11 pid: 16018 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.565038:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8077 00000100:00100000:2.0:1746066807.565044:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1963:x1830882977368576:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066807.565054:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066807.565059:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff5c expref: 11 pid: 16018 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.565068:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff5c expref: 11 pid: 16018 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.565085:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e00a00/0xfb36a14ee608df73 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff5c expref: 11 pid: 16018 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.565107:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066807.565111:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.565119:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.565125:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.565146:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066807.565163:0:16018:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.565168:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000100:00100000:2.0:1746066807.565179:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1963:x1830882977368576:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 135us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.565184:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8077 00000004:00200000:0.0:1746066807.565185:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:0.0:1746066807.565297:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209e00/0xfb36a14ee608df96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff7f expref: 11 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.565350:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff7f expref: 10 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.565355:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066807.565357:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066807.565358:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f209600, rc 0) 00000100:00100000:0.0:1746066807.565374:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:32106:x1830882977368448:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 4940us (5073us total) trans 8589944307 rc 0/0 00000100:00100000:0.0:1746066807.565379:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10213 00000100:00100000:0.0:1746066807.572199:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.572357:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977368704 00000100:00100000:2.0:1746066807.572366:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977368704 00000100:00100000:2.0:1746066807.572413:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10214 00000100:00100000:2.0:1746066807.572421:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:32106:x1830882977368704:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066807.572442:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.572457:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606a00/0xfb36a14ee608dfab lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff86 expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.572534:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.572546:0:16018:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff7f expref: 11 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.572552:0:16018:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.572578:0:16018:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff7f expref: 11 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.572588:0:16018:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff7f expref: 11 pid: 16018 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.572598:0:16018:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882977015040:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.573743:0:16018:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.580824:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.580916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.580951:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977369216 00000100:00100000:0.0:1746066807.580958:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977369216 00010000:00010000:0.0:1746066807.580993:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff7f expref: 12 pid: 16018 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066807.581029:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8078 00000100:00100000:0.0:1746066807.581037:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882977369216:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066807.581047:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066807.581051:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff7f expref: 12 pid: 16018 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066807.581062:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff7f expref: 12 pid: 16018 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066807.581080:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:0.0:1746066807.581084:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.581093:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.581098:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.581114:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066807.581151:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1963:x1830882977369216:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 115us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.581157:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8078 00000100:00100000:3.0:1746066807.581270:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977368960 00000100:00100000:3.0:1746066807.581274:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977368960 00002000:00100000:3.0:1746066807.581304:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009bb2fb80 x1830882977368960/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.581313:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2fb80 with x1830882977368960 ext(2097152->3145727) 00002000:00010000:3.0:1746066807.581317:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2fb80 00000100:00100000:3.0:1746066807.581331:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7123 00000100:00100000:3.0:1746066807.581335:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1963:x1830882977368960:12345-192.168.202.57@tcp:3:cat.0 00010000:00010000:2.0:1746066807.581740:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f209600/0xfb36a14ee608df9d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff7f expref: 11 pid: 16018 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.581763:0:16018:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882977015040:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.581777:0:16018:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.581789:0:16018:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.581794:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:2.0:1746066807.581829:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:2.0:1746066807.581832:0:16018:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746066807.581849:0:16018:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.581878:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606a00/0xfb36a14ee608dfab lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff86 expref: 11 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.581894:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff86 expref: 10 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.581900:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066807.581902:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066807.581904:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e607000, rc 0) 00000100:00100000:2.0:1746066807.581932:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:32106:x1830882977368704:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 9512us (9740us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.581941:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10214 00000100:00100000:0.0:1746066807.583313:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.583335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.583360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.583702:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977369472 00000100:00100000:3.0:1746066807.583707:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977369472 00002000:00100000:3.0:1746066807.583729:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a45e7b80 x1830882977369472/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.583737:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e7b80 with x1830882977369472 ext(3145728->4194303) 00002000:00010000:3.0:1746066807.583741:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a45e7b80 00000100:00100000:3.0:1746066807.583753:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977369344 00000100:00100000:3.0:1746066807.583755:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977369344 00002000:00100000:3.0:1746066807.583765:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a45e4e00 x1830882977369344/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.583771:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e4e00 with x1830882977369344 ext(2097152->3145727) 00002000:00010000:3.0:1746066807.583773:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a45e4e00 00000100:00100000:3.0:1746066807.583781:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977369728 00000100:00100000:3.0:1746066807.583783:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977369728 00002000:00100000:3.0:1746066807.583792:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a45e7480 x1830882977369728/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.583798:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e7480 with x1830882977369728 ext(3145728->4194303) 00002000:00010000:3.0:1746066807.583801:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a45e7480 00000100:00100000:3.0:1746066807.583812:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7124 00000100:00100000:3.0:1746066807.583818:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+43:1963:x1830882977369472:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066807.584537:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7125 00000100:00100000:1.0:1746066807.584544:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+44:1963:x1830882977369344:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:2.0:1746066807.585287:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7126 00000100:00100000:2.0:1746066807.585295:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882977369728:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066807.585847:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.587774:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977370112 00000100:00100000:2.0:1746066807.587782:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977370112 00000100:00100000:2.0:1746066807.587826:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10215 00000100:00100000:2.0:1746066807.587833:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:32106:x1830882977370112:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066807.589388:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.589408:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606c00/0xfb36a14ee608dfb9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff8d expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.589491:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608dfc0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.589916:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608dfc0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.589927:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608dfc0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:2.0:1746066807.589947:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066807.590058:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e606c00/0xfb36a14ee608dfb9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff8d expref: 13 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.590072:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608dfc0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff8d expref: 12 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.590080:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066807.590084:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066807.590086:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e607600, rc 0) 00000100:00100000:2.0:1746066807.590124:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:32106:x1830882977370112:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2291us (4278us total) trans 8589944308 rc 0/0 00000100:00100000:2.0:1746066807.590131:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10215 00000100:00100000:3.0:1746066807.597918:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+44:1963:x1830882977369472:12345-192.168.202.57@tcp:3:cat.0 Request processed in 14089us (14597us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066807.597928:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7124 00002000:00100000:3.0:1746066807.597938:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800a45e7b80 x1830882977369472/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.597945:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e7b80 with x1830882977369472 ext(3145728->4194303) 00002000:00010000:3.0:1746066807.597951:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a45e7b80 00000100:00100000:3.0:1746066807.607144:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1963:x1830882977368960:12345-192.168.202.57@tcp:3:cat.0 Request processed in 25799us (26317us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066807.607155:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7123 00002000:00100000:3.0:1746066807.607165:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff88009bb2fb80 x1830882977368960/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.607174:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2fb80 with x1830882977368960 ext(2097152->3145727) 00002000:00010000:3.0:1746066807.607179:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2fb80 00000100:00100000:2.0:1746066807.611024:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977369728:12345-192.168.202.57@tcp:3:cat.0 Request processed in 25722us (27654us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066807.611034:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7126 00002000:00100000:2.0:1746066807.611049:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800a45e7480 x1830882977369728/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.611060:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e7480 with x1830882977369728 ext(3145728->4194303) 00002000:00010000:2.0:1746066807.611065:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a45e7480 00000100:00100000:2.0:1746066807.619263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.619277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.619286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.619302:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.619317:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977370368 00000100:00100000:2.0:1746066807.619323:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977370368 00000100:00100000:2.0:1746066807.619349:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977370624 00000100:00100000:2.0:1746066807.619350:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977370624 00000100:00100000:2.0:1746066807.619360:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977370880 00000100:00100000:2.0:1746066807.619361:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977370880 00000100:00100000:2.0:1746066807.619368:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977370240 00000100:00100000:2.0:1746066807.619369:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977370240 00000100:00100000:2.0:1746066807.619379:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15591 00000100:00100000:2.0:1746066807.619385:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882977370368:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066807.619416:0:8452:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608dfce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.619429:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e607200/0xfb36a14ee608df50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff4e expref: 43 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.619436:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7a00/0xfb36a14ee608df88 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff63 expref: 9 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.619441:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.619442:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.619445:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608dfce lrc: 5/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.619467:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7a00/0xfb36a14ee608df88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff63 expref: 9 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.619485:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7a00/0xfb36a14ee608df88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff63 expref: 9 pid: 8112 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.619495:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882977015168:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.619558:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e607200/0xfb36a14ee608df50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff4e expref: 43 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.619566:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e607200/0xfb36a14ee608df50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff4e expref: 43 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.619574:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882977015296:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.619593:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066807.619609:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15592 00000100:00100000:2.0:1746066807.619614:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882977370624:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066807.619630:0:4614:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608dfd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.619640:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eecbe00/0xfb36a14ee608dd43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe1a expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.619646:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a85b6a00/0xfb36a14ee608dddd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe75 expref: 33 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.619652:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ae6200/0xfb36a14ee608ddb3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe59 expref: 9 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.619657:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.619658:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.619660:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608dfd5 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.619688:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ae6200/0xfb36a14ee608ddb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe59 expref: 9 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.619696:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ae6200/0xfb36a14ee608ddb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe59 expref: 9 pid: 9776 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.619704:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e843800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882977015424:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.619733:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a85b6a00/0xfb36a14ee608dddd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe75 expref: 33 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.619740:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a85b6a00/0xfb36a14ee608dddd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe75 expref: 33 pid: 10402 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.619746:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882977015552:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.619760:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eecbe00/0xfb36a14ee608dd43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe1a expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.619765:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eecbe00/0xfb36a14ee608dd43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe1a expref: 28 pid: 10402 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.619771:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e842680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882977015680:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.619781:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066807.619798:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.619839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.619894:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977370496 00000100:00100000:2.0:1746066807.619897:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977370496 00000100:00100000:2.0:1746066807.619908:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977370752 00000100:00100000:2.0:1746066807.619909:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977370752 00000100:00100000:2.0:1746066807.619916:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15593 00000100:00100000:2.0:1746066807.619920:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977370880:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066807.619933:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dfdc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.619945:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093e00800/0xfb36a14ee608dee7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff01 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.619951:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7c00/0xfb36a14ee608df7a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff78 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.619956:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f6fce00/0xfb36a14ee608df49 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff47 expref: 43 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.619961:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.619963:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.619965:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dfdc lrc: 6/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.619978:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f6fce00/0xfb36a14ee608df49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff47 expref: 43 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.619984:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f6fce00/0xfb36a14ee608df49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff47 expref: 43 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.619991:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882977015808:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.620012:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7c00/0xfb36a14ee608df7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff78 expref: 10 pid: 8112 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.620017:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7c00/0xfb36a14ee608df7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff78 expref: 10 pid: 8112 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.620028:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882977015936:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.620042:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093e00800/0xfb36a14ee608dee7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff01 expref: 25 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.620047:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093e00800/0xfb36a14ee608dee7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff01 expref: 25 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.620053:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882977016064:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.620061:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066807.620072:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15594 00000100:00100000:2.0:1746066807.620076:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977370240:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066807.620086:0:20532:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f02f400/0xfb36a14ee608dfe3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.620094:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093c3c200/0xfb36a14ee608dc71 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd6b expref: 33 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.620100:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130f34a00/0xfb36a14ee608dd9e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe44 expref: 10 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.620105:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608dcb7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd9c expref: 28 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.620109:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.620110:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.620112:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f02f400/0xfb36a14ee608dfe3 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.620122:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608dcb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd9c expref: 28 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.620128:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608dcb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd9c expref: 28 pid: 8451 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.620134:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c22ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882977016192:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.620147:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130f34a00/0xfb36a14ee608dd9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe44 expref: 10 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.620153:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130f34a00/0xfb36a14ee608dd9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe44 expref: 10 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.620159:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c22e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882977016320:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.620170:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093c3c200/0xfb36a14ee608dc71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd6b expref: 33 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.620176:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093c3c200/0xfb36a14ee608dc71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd6b expref: 33 pid: 10402 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.620181:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882977016448:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.620190:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066807.620239:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15595 00000100:00100000:2.0:1746066807.620243:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977370496:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066807.620254:0:21973:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dfea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.620262:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e606200/0xfb36a14ee608df57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff55 expref: 43 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.620267:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e607400/0xfb36a14ee608df81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff6a expref: 10 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.620271:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.620272:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.620274:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dfea lrc: 5/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.620285:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e607400/0xfb36a14ee608df81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff6a expref: 10 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.620290:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e607400/0xfb36a14ee608df81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff6a expref: 10 pid: 4614 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.620296:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882977016576:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.620314:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e606200/0xfb36a14ee608df57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff55 expref: 43 pid: 8451 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.620320:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e606200/0xfb36a14ee608df57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff55 expref: 43 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.620331:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882977016704:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.620339:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066807.620421:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15596 00000100:00100000:3.0:1746066807.620427:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977370752:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066807.620439:0:21203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f1fac00/0xfb36a14ee608dff1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.620448:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e01c00/0xfb36a14ee608df0a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff24 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.620457:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e606400/0xfb36a14ee608df8f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff71 expref: 10 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066807.620463:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f6fd800/0xfb36a14ee608df3b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff40 expref: 33 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066807.620467:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.620468:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.620470:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1fac00/0xfb36a14ee608dff1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.620494:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f6fd800/0xfb36a14ee608df3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff40 expref: 33 pid: 8451 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066807.620500:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f6fd800/0xfb36a14ee608df3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff40 expref: 33 pid: 8451 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.620505:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882977016832:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066807.620532:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e606400/0xfb36a14ee608df8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff71 expref: 10 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066807.620539:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e606400/0xfb36a14ee608df8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff71 expref: 10 pid: 4614 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.620545:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882977016960:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066807.620559:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093e01c00/0xfb36a14ee608df0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff24 expref: 28 pid: 10402 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.620565:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093e01c00/0xfb36a14ee608df0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff24 expref: 28 pid: 10402 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746066807.620571:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882977017088:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066807.620579:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d7d240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.620934:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1963:x1830882977369344:12345-192.168.202.57@tcp:3:cat.0 Request processed in 36389us (37595us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066807.620940:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7125 00002000:00100000:1.0:1746066807.620947:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff8800a45e4e00 x1830882977369344/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.620955:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a45e4e00 with x1830882977369344 ext(2097152->3145727) 00010000:00010000:1.0:1746066807.620960:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f6fce00/0xfb36a14ee608df49 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff47 expref: 42 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066807.620968:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f6fce00/0xfb36a14ee608df49 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff47 expref: 42 pid: 8452 timeout: 868 lvb_type: 1 00002000:00010000:1.0:1746066807.620974:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a45e4e00 00000100:00100000:0.0:1746066807.623217:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.623279:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977371136 00000100:00100000:2.0:1746066807.623286:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977371136 00000100:00100000:2.0:1746066807.627197:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882977015168:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066807.627199:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e843800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882977015424:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.627210:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882977015296:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.627236:0:8452:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608dfce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066807.627261:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10216 00000100:00100000:2.0:1746066807.627272:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+263:32108:x1830882977371136:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066807.627294:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.627309:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6400/0xfb36a14ee608dff8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff94 expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.627398:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dfff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.627409:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dfff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.627417:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dfff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.627427:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e006 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.627436:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.627441:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.627537:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.627547:0:16018:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608dfc0 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff8d expref: 11 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.627553:0:16018:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.627580:0:16018:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608dfc0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff8d expref: 11 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.627590:0:16018:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608dfc0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff8d expref: 11 pid: 16018 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.627600:0:16018:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882977017216:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.627693:0:16018:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.628191:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e841180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882977015552:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066807.628387:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.628406:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977372160 00000100:00100000:0.0:1746066807.628411:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977372160 00000100:00100000:0.0:1746066807.628440:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10217 00000100:00100000:0.0:1746066807.628445:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+16:32110:x1830882977372160:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:0.0:1746066807.628456:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.628462:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e806400/0xfb36a14ee608e014 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ff9b expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.628514:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e806600/0xfb36a14ee608e01b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066807.628523:0:20127:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff86 expref: 11 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.628529:0:20127:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e806600/0xfb36a14ee608e01b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066807.628547:0:20127:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff86 expref: 11 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.628554:0:20127:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff86 expref: 11 pid: 16018 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066807.628562:0:20127:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882977017344:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066807.628587:0:20127:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5390540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.628619:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e842680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4614:1830882977015680:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066807.628634:0:4614:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608dfd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066807.631310:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882977016576:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.631323:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882977016704:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.631340:0:21973:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dfea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066807.631373:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882977016448:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.631388:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882977015808:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.631394:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882977015936:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.631401:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800929cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882977016064:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.631428:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dfdc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.632217:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882977016832:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066807.632226:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882977016960:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066807.632232:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882977017088:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066807.632249:0:21203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f1fac00/0xfb36a14ee608dff1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066807.632310:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c22ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882977016192:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.632317:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c22e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20532:1830882977016320:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.632329:0:20532:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f02f400/0xfb36a14ee608dfe3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066807.633288:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.633323:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.633348:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977371392 00000100:00100000:0.0:1746066807.633349:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.633354:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977371392 00000100:00100000:0.0:1746066807.633364:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.633388:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.633400:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.633411:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.634314:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977371648 00000100:00100000:3.0:1746066807.634318:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977371648 00010000:00010000:3.0:1746066807.634338:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093c3c200/0xfb36a14ee608dc71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd6b expref: 34 pid: 10402 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.634354:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977371904 00000100:00100000:3.0:1746066807.634355:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977371904 00010000:00010000:3.0:1746066807.634363:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7c00/0xfb36a14ee608df7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff78 expref: 11 pid: 8112 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.634371:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977371264 00000100:00100000:3.0:1746066807.634372:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977371264 00010000:00010000:3.0:1746066807.634379:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7a00/0xfb36a14ee608df88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff63 expref: 12 pid: 8112 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.634384:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977371520 00000100:00100000:3.0:1746066807.634386:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977371520 00010000:00010000:3.0:1746066807.634392:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a85b6a00/0xfb36a14ee608dddd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe75 expref: 35 pid: 10402 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.634402:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977371776 00000100:00100000:3.0:1746066807.634404:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977371776 00010000:00010000:3.0:1746066807.634410:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e607400/0xfb36a14ee608df81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff6a expref: 13 pid: 4614 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.634415:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977372800 00000100:00100000:3.0:1746066807.634416:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977372800 00010000:00010000:3.0:1746066807.634422:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f6fd800/0xfb36a14ee608df3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff40 expref: 36 pid: 8451 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.634429:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8079 00000100:00100000:3.0:1746066807.634434:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882977371648:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.634443:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.634460:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093c3c200/0xfb36a14ee608dc71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd6b expref: 36 pid: 10402 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634469:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093c3c200/0xfb36a14ee608dc71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd6b expref: 36 pid: 10402 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634500:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c3c200/0xfb36a14ee608dc71 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd6b expref: 36 pid: 10402 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634523:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.634560:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1964:x1830882977371648:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 125us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.634565:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8079 00000100:00100000:3.0:1746066807.634578:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8080 00000100:00100000:3.0:1746066807.634582:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a518c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1964:x1830882977371904:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.634588:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.634599:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7c00/0xfb36a14ee608df7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff78 expref: 13 pid: 8112 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634606:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7c00/0xfb36a14ee608df7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff78 expref: 13 pid: 8112 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634618:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7c00/0xfb36a14ee608df7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff78 expref: 13 pid: 8112 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634625:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.634637:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a518c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1964:x1830882977371904:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 55us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.634641:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8080 00000100:00100000:3.0:1746066807.634651:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8081 00000100:00100000:3.0:1746066807.634655:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977371264:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.634660:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.634668:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7a00/0xfb36a14ee608df88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff63 expref: 11 pid: 8112 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634692:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7a00/0xfb36a14ee608df88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff63 expref: 11 pid: 8112 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634702:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a85b7a00/0xfb36a14ee608df88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff63 expref: 11 pid: 8112 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634709:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.634722:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977371264:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 66us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.634726:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8081 00000100:00100000:3.0:1746066807.634735:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8082 00000100:00100000:3.0:1746066807.634739:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977371520:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.634744:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.634753:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a85b6a00/0xfb36a14ee608dddd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe75 expref: 34 pid: 10402 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634760:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a85b6a00/0xfb36a14ee608dddd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe75 expref: 34 pid: 10402 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634769:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a85b6a00/0xfb36a14ee608dddd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe75 expref: 34 pid: 10402 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634775:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.634787:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977371520:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 48us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.634791:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8082 00000100:00100000:3.0:1746066807.634799:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8083 00000100:00100000:3.0:1746066807.634804:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1964:x1830882977371776:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.634809:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.634817:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e607400/0xfb36a14ee608df81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff6a expref: 9 pid: 4614 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634824:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e607400/0xfb36a14ee608df81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff6a expref: 9 pid: 4614 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634833:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e607400/0xfb36a14ee608df81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff6a expref: 9 pid: 4614 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634839:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.634850:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1964:x1830882977371776:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 46us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.634854:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8083 00000100:00100000:3.0:1746066807.634861:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8084 00000100:00100000:3.0:1746066807.634865:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977372800:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.634870:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.634877:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f6fd800/0xfb36a14ee608df3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff40 expref: 32 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634884:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f6fd800/0xfb36a14ee608df3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff40 expref: 32 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634892:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f6fd800/0xfb36a14ee608df3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff40 expref: 32 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.634899:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.634912:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:1964:x1830882977372800:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 47us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.634919:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8084 00010000:00010000:1.0:1746066807.634994:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ae6200/0xfb36a14ee608ddb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe59 expref: 11 pid: 9776 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066807.634996:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.635009:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977372416 00000100:00100000:1.0:1746066807.635012:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977372416 00010000:00010000:1.0:1746066807.635021:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093e00800/0xfb36a14ee608dee7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff01 expref: 26 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.635029:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8085 00000100:00100000:0.0:1746066807.635029:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.635033:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1964:x1830882977371392:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.635037:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.635043:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ae6200/0xfb36a14ee608ddb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe59 expref: 11 pid: 9776 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066807.635045:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066807.635050:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ae6200/0xfb36a14ee608ddb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe59 expref: 11 pid: 9776 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066807.635057:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066807.635059:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ae6200/0xfb36a14ee608ddb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe59 expref: 11 pid: 9776 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066807.635069:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066807.635070:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.635083:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1964:x1830882977371392:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 50us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.635086:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.635087:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8085 00000100:00100000:0.0:1746066807.635098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.635113:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977372672 00000100:00100000:1.0:1746066807.635115:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977372672 00010000:00010000:1.0:1746066807.635121:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130f34a00/0xfb36a14ee608dd9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe44 expref: 10 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746066807.635128:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977372288 00000100:00100000:1.0:1746066807.635130:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977372288 00010000:00010000:1.0:1746066807.635135:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eecbe00/0xfb36a14ee608dd43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe1a expref: 29 pid: 10402 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.635141:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977372544 00000100:00100000:1.0:1746066807.635143:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977372544 00010000:00010000:1.0:1746066807.635148:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e606400/0xfb36a14ee608df8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff71 expref: 11 pid: 4614 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746066807.635154:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977372928 00000100:00100000:1.0:1746066807.635155:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977372928 00010000:00010000:1.0:1746066807.635160:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093e01c00/0xfb36a14ee608df0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff24 expref: 30 pid: 10402 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.635170:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977373056 00000100:00100000:1.0:1746066807.635171:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977373056 00010000:00010000:1.0:1746066807.635176:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e607200/0xfb36a14ee608df50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff4e expref: 42 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.635182:0:15727:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977373184 00000100:00100000:1.0:1746066807.635183:0:15727:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977373184 00010000:00010000:1.0:1746066807.635188:0:15727:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608dcb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd9c expref: 31 pid: 8451 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746066807.635195:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8086 00000100:00100000:1.0:1746066807.635198:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977372416:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.635201:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.635207:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093e00800/0xfb36a14ee608dee7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff01 expref: 26 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.635213:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093e00800/0xfb36a14ee608dee7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff01 expref: 26 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.635222:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093e00800/0xfb36a14ee608dee7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff01 expref: 26 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.635228:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.635239:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+25:1966:x1830882977372416:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 41us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.635243:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8086 00000100:00100000:1.0:1746066807.635250:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8087 00000100:00100000:1.0:1746066807.635253:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977372672:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.635257:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.635262:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130f34a00/0xfb36a14ee608dd9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe44 expref: 11 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066807.635268:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130f34a00/0xfb36a14ee608dd9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe44 expref: 11 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066807.635275:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130f34a00/0xfb36a14ee608dd9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe44 expref: 11 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066807.635281:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.635289:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1966:x1830882977372672:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 35us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.635293:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8087 00000100:00100000:1.0:1746066807.635298:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8088 00000100:00100000:1.0:1746066807.635301:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+31:1966:x1830882977372288:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.635305:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.635309:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008eecbe00/0xfb36a14ee608dd43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe1a expref: 31 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.635315:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008eecbe00/0xfb36a14ee608dd43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe1a expref: 31 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.635323:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008eecbe00/0xfb36a14ee608dd43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe1a expref: 31 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.635330:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.635331:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.635335:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608dfd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635341:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608dfd5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635362:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.635371:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+30:1966:x1830882977372288:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 69us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.635375:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8088 00000100:00100000:1.0:1746066807.635390:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8089 00000100:00100000:1.0:1746066807.635394:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1966:x1830882977372544:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.635398:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.635404:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e606400/0xfb36a14ee608df8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff71 expref: 9 pid: 4614 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066807.635410:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e606400/0xfb36a14ee608df8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff71 expref: 9 pid: 4614 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066807.635417:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e606400/0xfb36a14ee608df8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff71 expref: 9 pid: 4614 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066807.635423:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.635432:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+8:1966:x1830882977372544:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 38us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.635436:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8089 00000100:00100000:1.0:1746066807.635442:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8090 00000100:00100000:1.0:1746066807.635445:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+29:1966:x1830882977372928:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.635450:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.635454:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093e01c00/0xfb36a14ee608df0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff24 expref: 29 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.635461:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093e01c00/0xfb36a14ee608df0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff24 expref: 29 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.635470:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093e01c00/0xfb36a14ee608df0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5091327) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff24 expref: 29 pid: 10402 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.635488:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.635490:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.635492:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f1fac00/0xfb36a14ee608dff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635497:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1fac00/0xfb36a14ee608dff1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635509:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.635521:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+28:1966:x1830882977372928:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 74us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.635525:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8090 00000100:00100000:1.0:1746066807.635533:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8091 00000100:00100000:1.0:1746066807.635537:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1964:x1830882977373056:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.635542:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.635547:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e607200/0xfb36a14ee608df50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff4e expref: 42 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.635554:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e607200/0xfb36a14ee608df50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff4e expref: 42 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.635562:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e607200/0xfb36a14ee608df50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff4e expref: 42 pid: 8451 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746066807.635568:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.635569:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.635571:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608dfce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635577:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608dfce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635587:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.635596:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1964:x1830882977373056:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 59us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.635600:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8091 00000100:00100000:1.0:1746066807.635606:0:15727:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8092 00000100:00100000:1.0:1746066807.635609:0:15727:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+27:1965:x1830882977373184:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.635614:0:15727:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.635619:0:15727:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608dcb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd9c expref: 27 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066807.635625:0:15727:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608dcb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd9c expref: 27 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066807.635632:0:15727:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608dcb7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fd9c expref: 27 pid: 8451 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066807.635637:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.635638:0:15727:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.635641:0:15727:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f02f400/0xfb36a14ee608dfe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635646:0:15727:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f02f400/0xfb36a14ee608dfe3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635654:0:15727:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.635663:0:15727:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fc98f875-2edf-4505-a13a-65f96879556b+26:1965:x1830882977373184:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 53us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.635666:0:15727:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8092 00010000:00010000:1.0:1746066807.635699:0:21203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f1fac00/0xfb36a14ee608dff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635706:0:21203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f1fac00/0xfb36a14ee608dff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635722:0:21203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f1fac00/0xfb36a14ee608dff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635729:0:21203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1fac00/0xfb36a14ee608dff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635734:0:21203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f1fac00/0xfb36a14ee608dff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635739:0:21203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f1fac00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066807.635742:0:21203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f1fac00/0xfb36a14ee608dff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635747:0:21203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f1fac00/0xfb36a14ee608dff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635754:0:21203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f1fac00/0xfb36a14ee608dff1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.635759:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f1fac00/0xfb36a14ee608dff1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.635788:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1966:x1830882977370752:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 15361us (15948us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.635793:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15596 00010000:00010000:3.0:1746066807.635874:0:20532:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f02f400/0xfb36a14ee608dfe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.635881:0:20532:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f02f400/0xfb36a14ee608dfe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.635892:0:20532:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f02f400/0xfb36a14ee608dfe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.635898:0:20532:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f02f400/0xfb36a14ee608dfe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.635903:0:20532:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f02f400/0xfb36a14ee608dfe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.635907:0:20532:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f02f400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066807.635909:0:20532:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f02f400/0xfb36a14ee608dfe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.635914:0:20532:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f02f400/0xfb36a14ee608dfe3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.635921:0:20532:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f02f400/0xfb36a14ee608dfe3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.635925:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f02f400/0xfb36a14ee608dfe3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066807.635947:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1966:x1830882977370240:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 15871us (16644us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.635952:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15594 00010000:00010000:3.0:1746066807.635966:0:8452:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608dfce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.635971:0:8452:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608dfce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.635980:0:8452:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608dfce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.635985:0:8452:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608dfce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.635990:0:8452:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608dfce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.635994:0:8452:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e606e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066807.635996:0:8452:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608dfce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.636001:0:8452:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608dfce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.636006:0:8452:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608dfce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.636013:0:8452:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e606e00/0xfb36a14ee608dfce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066807.636041:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+7:1966:x1830882977370368:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 16656us (16785us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.636045:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15591 00000100:00100000:3.0:1746066807.636078:0:16018:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16018:1830882977017216:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066807.636091:0:16018:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:0.0:1746066807.636516:0:4614:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608dfd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.636525:0:4614:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608dfd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.636540:0:4614:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608dfd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066807.636541:0:20127:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882977017344:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066807.636546:0:4614:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608dfd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.636551:0:4614:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608dfd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.636554:0:20127:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e806600/0xfb36a14ee608e01b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:0.0:1746066807.636556:0:4614:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135430e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066807.636558:0:4614:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608dfd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.636564:0:4614:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608dfd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.636573:0:4614:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608dfd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.636578:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608dfd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066807.636625:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1966:x1830882977370624:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 17010us (17346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.636631:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15592 00000100:00100000:0.0:1746066807.639109:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.640233:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.640425:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.640444:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977373568 00000100:00100000:2.0:1746066807.640444:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977373440 00000100:00100000:3.0:1746066807.640451:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977373568 00000100:00100000:2.0:1746066807.640451:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977373440 00010000:00010000:3.0:1746066807.640487:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff86 expref: 13 pid: 16018 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.640487:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608dfc0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff8d expref: 13 pid: 16018 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746066807.640510:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8093 00000100:00100000:3.0:1746066807.640516:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1966:x1830882977373568:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066807.640526:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8094 00010000:00010000:3.0:1746066807.640529:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066807.640532:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+13:1965:x1830882977373440:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.640534:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff86 expref: 13 pid: 16018 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.640539:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.640543:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff86 expref: 13 pid: 16018 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.640543:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608dfc0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff8d expref: 13 pid: 16018 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.640551:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608dfc0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff8d expref: 13 pid: 16018 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.640571:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607000/0xfb36a14ee608dfb2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff86 expref: 13 pid: 16018 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.640713:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977373312 00000100:00100000:1.0:1746066807.640716:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977373312 00010000:00010000:1.0:1746066807.640729:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e606200/0xfb36a14ee608df57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff55 expref: 41 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746066807.640746:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8095 00000100:00100000:1.0:1746066807.640750:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1963:x1830882977373312:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.640756:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.640772:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e606200/0xfb36a14ee608df57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff55 expref: 41 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066807.640774:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:1.0:1746066807.640779:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e606200/0xfb36a14ee608df57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff55 expref: 41 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066807.640790:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977373696 00010000:00010000:1.0:1746066807.640791:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e606200/0xfb36a14ee608df57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff55 expref: 41 pid: 8451 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066807.640793:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977373696 00010000:00010000:1.0:1746066807.640801:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.640802:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.640806:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dfea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.640813:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dfea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066807.640818:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15597 00000100:00100000:0.0:1746066807.640824:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+31:32105:x1830882977373696:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066807.640835:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066807.640836:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.640849:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e807000/0xfb36a14ee608e022 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ffa2 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066807.640864:0:4614:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 5090560, mtime: 0x6812dd77, atime: 0x6812dd76, ctime: 0x6812dd77, blocks: 0x1723 00000100:00100000:1.0:1746066807.640865:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977373312:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 114us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.640870:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8095 00010000:00010000:0.0:1746066807.640875:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.640877:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.640881:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e807000/0xfb36a14ee608e022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffa2 expref: 32 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.640892:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e807000/0xfb36a14ee608e022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffa2 expref: 32 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.640899:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e807000, rc 0) 00000100:00100000:0.0:1746066807.640918:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:32105:x1830882977373696:12345-192.168.202.57@tcp:101:cat.0 Request processed in 95us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.640923:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15597 00010000:00010000:2.0:1746066807.641514:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e607600/0xfb36a14ee608dfc0 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff8d expref: 12 pid: 16018 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746066807.641529:0:21351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066807.641532:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e806600/0xfb36a14ee608e01b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066807.641539:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e806600/0xfb36a14ee608e01b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066807.641544:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e806600/0xfb36a14ee608e01b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066807.641555:0:21351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.641559:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.641563:0:21351:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.641573:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066807.641576:0:21973:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dfea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.641577:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066807.641587:0:21973:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dfea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066807.641593:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:1966:x1830882977373568:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 1077us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.641598:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8093 00010000:00010000:2.0:1746066807.641606:0:21973:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dfea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.641612:0:21973:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dfea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.641618:0:21973:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dfea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.641624:0:21973:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129ff6000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066807.641627:0:21973:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dfea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.641633:0:21973:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dfea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.641641:0:21973:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dfea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.641646:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6000/0xfb36a14ee608dfea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066807.642235:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f09a0c46-01bd-4197-bc90-17b6ceef920b+6:1966:x1830882977370496:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 21989us (22434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.642242:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15595 00010000:00010000:2.0:1746066807.642275:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066807.642286:0:20127:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e806600/0xfb36a14ee608e01b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066807.642289:0:16018:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066807.642292:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e806600/0xfb36a14ee608e01b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066807.642295:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:3.0:1746066807.642305:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:2.0:1746066807.642305:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:3.0:1746066807.642381:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642386:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642390:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642394:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129ff7c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066807.642396:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642400:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642406:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066807.642408:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066807.642411:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642416:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e00d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642426:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dfff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642430:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dfff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642434:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dfff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642437:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129ff6e00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066807.642439:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dfff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642443:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dfff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642448:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066807.642449:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066807.642451:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dfff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642455:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6e00/0xfb36a14ee608dfff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642461:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642464:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e006 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642482:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e006 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642486:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129ff6c00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066807.642488:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e006 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642492:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e006 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642497:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135b13b00) 00010000:00010000:3.0:1746066807.642499:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066807.642500:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e006 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642504:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e006 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066807.642534:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6400/0xfb36a14ee608dff8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff94 expref: 265 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.642540:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129ff6400/0xfb36a14ee608dff8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff94 expref: 265 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.642546:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff6400, rc 0) 00000100:00100000:3.0:1746066807.642564:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:32108:x1830882977371136:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 15296us (19354us total) trans 8589944309 rc 301/301 00000100:00100000:3.0:1746066807.642569:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10216 00010000:00010000:2.0:1746066807.644205:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e806400/0xfb36a14ee608e014 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff9b expref: 19 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.644224:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e806600/0xfb36a14ee608e01b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff9b expref: 18 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.644231:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066807.644234:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066807.644236:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e806600, rc 0) 00000100:00100000:2.0:1746066807.644265:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc98f875-2edf-4505-a13a-65f96879556b+18:32110:x1830882977372160:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 15820us (15879us total) trans 8589944310 rc 0/0 00000100:00100000:2.0:1746066807.644272:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10217 00000100:00100000:2.0:1746066807.646768:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:1965:x1830882977373440:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 6226us (7667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.646779:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8094 00000100:00100000:0.0:1746066807.648964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.649050:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977373952 00000100:00100000:1.0:1746066807.649059:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977373952 00002000:00100000:1.0:1746066807.649096:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800921c3b80 x1830882977373952/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.649105:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c3b80 with x1830882977373952 ext(3145728->4194303) 00002000:00010000:1.0:1746066807.649109:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921c3b80 00000100:00100000:1.0:1746066807.649139:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7127 00000100:00100000:1.0:1746066807.649145:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977373952:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066807.649967:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.650229:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977374080 00000100:00100000:2.0:1746066807.650234:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977374080 00010000:00010000:2.0:1746066807.650254:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f6fce00/0xfb36a14ee608df49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff47 expref: 40 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.650298:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8096 00000100:00100000:2.0:1746066807.650305:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977374080:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066807.650314:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066807.650339:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f6fce00/0xfb36a14ee608df49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff47 expref: 40 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746066807.650351:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f6fce00/0xfb36a14ee608df49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff47 expref: 40 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746066807.650371:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f6fce00/0xfb36a14ee608df49 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff47 expref: 40 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746066807.650384:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.650385:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.650389:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dfdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.650396:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dfdc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.650420:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066807.650455:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:1963:x1830882977374080:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 150us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.650460:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8096 00010000:00010000:3.0:1746066807.651090:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dfdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.651103:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dfdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.651120:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dfdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.651125:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dfdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.651131:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dfdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.651136:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135431200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066807.651139:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dfdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.651145:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dfdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.651154:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dfdc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.651159:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135431200/0xfb36a14ee608dfdc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066807.651219:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1966:x1830882977370880:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 31297us (31930us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.651226:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15593 00000100:00100000:0.0:1746066807.657850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.658580:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977374336 00000100:00100000:2.0:1746066807.658589:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977374336 00000100:00100000:2.0:1746066807.658634:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10218 00000100:00100000:2.0:1746066807.658641:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:32106:x1830882977374336:12345-192.168.202.57@tcp:36:lfs.0 00000100:00100000:2.0:1746066807.658767:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:32106:x1830882977374336:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 126us (924us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746066807.658774:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10218 00000100:00100000:2.0:1746066807.662053:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977373952:12345-192.168.202.57@tcp:3:cat.0 Request processed in 12900us (13088us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066807.662062:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7127 00002000:00100000:2.0:1746066807.662073:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff8800921c3b80 x1830882977373952/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.662082:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c3b80 with x1830882977373952 ext(3145728->4194303) 00002000:00010000:2.0:1746066807.662088:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921c3b80 00000100:00100000:1.0:1746066807.663211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.664350:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977374592 00000100:00100000:0.0:1746066807.664359:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977374592 00000100:00100000:0.0:1746066807.664419:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4304 00000100:00100000:0.0:1746066807.664427:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+10:32106:x1830882977374592:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:0.0:1746066807.664629:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:32106:x1830882977374592:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 202us (1418us total) trans 8589944311 rc 0/0 00000100:00100000:0.0:1746066807.664635:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4304 00000100:00100000:0.0:1746066807.668171:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.668234:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977374848 00000100:00100000:3.0:1746066807.668241:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977374848 00000100:00100000:3.0:1746066807.668284:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4305 00000100:00100000:3.0:1746066807.668292:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+11:32106:x1830882977374848:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:3.0:1746066807.668461:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:32106:x1830882977374848:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 169us (296us total) trans 8589944312 rc 0/0 00000100:00100000:3.0:1746066807.668467:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4305 00000100:00100000:0.0:1746066807.671078:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.673739:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.673761:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.673833:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.673851:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977374976 00000100:00100000:0.0:1746066807.673857:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977374976 00000100:00100000:0.0:1746066807.676110:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977375104 00000100:00100000:0.0:1746066807.676118:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977375104 00000100:00100000:1.0:1746066807.676141:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977375232 00000100:00100000:1.0:1746066807.676146:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977375232 00000100:00100000:0.0:1746066807.676147:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977375360 00000100:00100000:0.0:1746066807.676149:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977375360 00000100:00100000:0.0:1746066807.676165:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15598 00000100:00100000:0.0:1746066807.676171:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+26:1966:x1830882977374976:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:1.0:1746066807.676176:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15599 00000100:00100000:1.0:1746066807.676182:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+39:32105:x1830882977375104:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066807.676186:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.676190:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.676202:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f208c00/0xfb36a14ee608e037 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ffb0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.676202:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e807600/0xfb36a14ee608e03e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ffa9 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066807.676220:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38f:0x0] initial LVB size: 4194304, mtime: 0x6812dd77, atime: 0x6812dd76, ctime: 0x6812dd77, blocks: 0x1029 00002000:00010000:0.0:1746066807.676220:0:4614:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd75, atime: 0x6812dd75, ctime: 0x6812dd75, blocks: 0x7ff 00010000:00010000:1.0:1746066807.676235:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.676235:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.676237:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.676237:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.676244:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f208c00/0xfb36a14ee608e037 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb0 expref: 40 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.676244:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e807600/0xfb36a14ee608e03e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffa9 expref: 27 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.676256:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f208c00/0xfb36a14ee608e037 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb0 expref: 40 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.676256:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e807600/0xfb36a14ee608e03e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffa9 expref: 27 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.676264:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f208c00, rc 0) 00010000:00010000:0.0:1746066807.676264:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e807600, rc 0) 00000100:00100000:1.0:1746066807.676912:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:32105:x1830882977375104:12345-192.168.202.57@tcp:101:cat.0 Request processed in 728us (3178us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.676917:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15599 00000100:00100000:1.0:1746066807.676933:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15600 00000100:00100000:1.0:1746066807.676938:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+25:1966:x1830882977375360:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066807.676944:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.676953:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f209200/0xfb36a14ee608e045 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ffbe expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066807.676964:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38d:0x0] initial LVB size: 2097152, mtime: 0x6812dd77, atime: 0x6812dd75, ctime: 0x6812dd77, blocks: 0x821 00010000:00010000:1.0:1746066807.676972:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.676973:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.676977:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f209200/0xfb36a14ee608e045 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffbe expref: 26 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.676985:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f209200/0xfb36a14ee608e045 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffbe expref: 26 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.676991:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f209200, rc 0) 00000100:00100000:2.0:1746066807.677097:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15601 00000100:00100000:2.0:1746066807.677105:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800992afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:32108:x1830882977375232:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066807.677112:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.677119:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ffb7 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.677132:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e807000/0xfb36a14ee608e022 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffa2 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.677138:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.677139:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.677142:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [4116480->4194303] (req 4116480->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.677173:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e807000/0xfb36a14ee608e022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffa2 expref: 33 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066807.677180:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977374976:12345-192.168.202.57@tcp:101:cat.0 Request processed in 1008us (6109us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066807.677183:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e807000/0xfb36a14ee608e022 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffa2 expref: 33 pid: 4614 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066807.677186:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15598 00000100:00100000:2.0:1746066807.677193:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882977017472:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.677240:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.677240:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.677256:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977375488 00000100:00100000:0.0:1746066807.677259:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977375488 00000100:00100000:0.0:1746066807.677377:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15602 00000100:00100000:0.0:1746066807.677383:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977375488:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066807.677390:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.677398:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e807800/0xfb36a14ee608e053 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ffc5 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066807.677410:0:10402:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd77, atime: 0x6812dd73, ctime: 0x6812dd77, blocks: 0x821 00010000:00010000:0.0:1746066807.677417:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.677419:0:10402:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.677423:0:10402:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e807800/0xfb36a14ee608e053 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffc5 expref: 28 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.677432:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e807800/0xfb36a14ee608e053 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffc5 expref: 28 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.677438:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e807800, rc 0) 00000100:00100000:0.0:1746066807.677453:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1966:x1830882977375488:12345-192.168.202.57@tcp:101:cat.0 Request processed in 71us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.677458:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15602 00000100:00100000:0.0:1746066807.677513:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.677524:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977375616 00000100:00100000:0.0:1746066807.677527:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977375616 00000100:00100000:1.0:1746066807.677804:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977375360:12345-192.168.202.57@tcp:101:cat.0 Request processed in 865us (3970us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.677809:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15600 00000100:00100000:1.0:1746066807.677821:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15603 00000100:00100000:1.0:1746066807.677826:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977375616:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066807.677832:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.677841:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f209000/0xfb36a14ee608e05a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ffcc expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066807.677854:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 2097152, mtime: 0x6812dd76, atime: 0x6812dd76, ctime: 0x6812dd76, blocks: 0x81d 00010000:00010000:1.0:1746066807.677874:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.677875:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.677879:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f209000/0xfb36a14ee608e05a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffcc expref: 28 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.677888:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f209000/0xfb36a14ee608e05a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffcc expref: 28 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.677894:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f209000, rc 0) 00000100:00100000:1.0:1746066807.677909:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc98f875-2edf-4505-a13a-65f96879556b+28:1966:x1830882977375616:12345-192.168.202.57@tcp:101:cat.0 Request processed in 84us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.677914:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15603 00000100:00100000:1.0:1746066807.678450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.678466:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977375744 00000100:00100000:3.0:1746066807.678471:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977375744 00000100:00100000:1.0:1746066807.678490:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.678741:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977375872 00000100:00100000:3.0:1746066807.678744:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977375872 00000100:00100000:1.0:1746066807.678759:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15604 00000100:00100000:3.0:1746066807.678764:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15605 00000100:00100000:1.0:1746066807.678766:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+28:1966:x1830882977375744:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:3.0:1746066807.678769:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977375872:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066807.678774:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066807.678775:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.678781:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f209600/0xfb36a14ee608e061 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ffd3 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.678782:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f1fa600/0xfb36a14ee608e068 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ffda expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.678791:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.678791:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.678792:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.678797:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1fa600/0xfb36a14ee608e068 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffda expref: 28 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.678798:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f209600/0xfb36a14ee608e061 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffd3 expref: 29 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066807.678806:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f1fa600/0xfb36a14ee608e068 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffda expref: 28 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.678808:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f209600/0xfb36a14ee608e061 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffd3 expref: 29 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066807.678812:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f1fa600, rc 0) 00010000:00010000:1.0:1746066807.678821:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f209600, rc 0) 00000100:00100000:3.0:1746066807.678830:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+28:1966:x1830882977375872:12345-192.168.202.57@tcp:101:cat.0 Request processed in 61us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.678835:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15605 00000100:00100000:1.0:1746066807.678838:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+28:1966:x1830882977375744:12345-192.168.202.57@tcp:101:cat.0 Request processed in 73us (389us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.678843:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15604 00000100:00100000:0.0:1746066807.685445:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.685597:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882977017472:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.685621:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [4116480->4194303] (req 4116480->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.685636:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff7400, rc 0) 00000100:00100000:2.0:1746066807.685706:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800992afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:32108:x1830882977375232:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 8602us (11942us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.685713:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15601 00000100:00100000:0.0:1746066807.685925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.686087:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977376128 00000100:00100000:3.0:1746066807.686092:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977376128 00002000:00100000:3.0:1746066807.686123:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800921c2d80 x1830882977376128/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.686131:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c2d80 with x1830882977376128 ext(3145728->4194303) 00002000:00010000:3.0:1746066807.686135:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921c2d80 00000100:00100000:3.0:1746066807.686152:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7128 00000100:00100000:3.0:1746066807.686158:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977376128:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066807.686479:0:14546:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977376256 00000100:00100000:1.0:1746066807.686484:0:14546:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977376256 00000100:00100000:1.0:1746066807.686509:0:14546:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 225 00000100:00100000:1.0:1746066807.686515:0:14546:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a530d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69ee3f12-76db-44fe-a8c9-a42ead582d61+15:1964:x1830882977376256:12345-192.168.202.57@tcp:400:kworker.0 00000100:00100000:1.0:1746066807.686543:0:14546:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a530d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69ee3f12-76db-44fe-a8c9-a42ead582d61+15:1964:x1830882977376256:12345-192.168.202.57@tcp:400:kworker.0 Request processed in 28us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.686547:0:14546:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 225 00000100:00100000:0.0:1746066807.687237:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.687425:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977376384 00000100:00100000:3.0:1746066807.687428:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977376384 00010000:00010000:3.0:1746066807.687446:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e807000/0xfb36a14ee608e022 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffa2 expref: 33 pid: 4614 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746066807.687839:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8097 00000100:00100000:3.0:1746066807.687846:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1965:x1830882977376384:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.687855:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.687873:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e807000/0xfb36a14ee608e022 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffa2 expref: 33 pid: 4614 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.687969:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e807000/0xfb36a14ee608e022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffa2 expref: 33 pid: 4614 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.687988:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e807000/0xfb36a14ee608e022 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffa2 expref: 33 pid: 4614 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.688003:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.688005:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.688009:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 32 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.688016:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 32 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.688057:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 32 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066807.688067:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882977017600:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066807.688117:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d7d780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066807.692416:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:21351:1830882977017600:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066807.692535:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.692581:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1965:x1830882977376384:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4734us (5344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.692590:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8097 00000100:00100000:0.0:1746066807.692648:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.692698:0:21550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977376640 00000100:00100000:2.0:1746066807.692704:0:21550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977376640 00002000:00100000:2.0:1746066807.692732:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (4116480->4120575) req@ffff8800921c2a00 x1830882977376640/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.692741:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c2a00 with x1830882977376640 ext(4116480->4120575) 00002000:00010000:2.0:1746066807.692745:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921c2a00 00000100:00100000:2.0:1746066807.692884:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7129 00000100:00100000:2.0:1746066807.692891:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977376640:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:2.0:1746066807.693093:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1964:x1830882977376640:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 203us (446us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066807.693099:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7129 00002000:00100000:2.0:1746066807.693104:0:21550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x391:0x0] (4116480->4120575) req@ffff8800921c2a00 x1830882977376640/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/4536 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.693110:0:21550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c2a00 with x1830882977376640 ext(4116480->4120575) 00002000:00010000:2.0:1746066807.693113:0:21550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921c2a00 00000100:00100000:3.0:1746066807.694903:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977376128:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 8741us (9462us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066807.694910:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7128 00002000:00100000:3.0:1746066807.694916:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff8800921c2d80 x1830882977376128/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.694924:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c2d80 with x1830882977376128 ext(3145728->4194303) 00002000:00010000:3.0:1746066807.694928:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921c2d80 00000100:00100000:0.0:1746066807.698405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.698440:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.698467:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.698503:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.699228:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977376896 00000100:00100000:3.0:1746066807.699236:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977376896 00002000:00100000:3.0:1746066807.699274:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff8800921c0e00 x1830882977376896/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.699283:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c0e00 with x1830882977376896 ext(0->1048575) 00002000:00010000:3.0:1746066807.699288:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921c0e00 00000100:00100000:3.0:1746066807.699305:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977377152 00000100:00100000:3.0:1746066807.699307:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977377152 00002000:00100000:3.0:1746066807.699317:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8800921c3800 x1830882977377152/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.699323:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c3800 with x1830882977377152 ext(1048576->2097151) 00002000:00010000:3.0:1746066807.699325:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921c3800 00000100:00100000:3.0:1746066807.699331:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977377408 00000100:00100000:3.0:1746066807.699332:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977377408 00002000:00100000:3.0:1746066807.699339:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009412b800 x1830882977377408/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.699344:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412b800 with x1830882977377408 ext(1048576->2097151) 00002000:00010000:3.0:1746066807.699346:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009412b800 00000100:00100000:3.0:1746066807.699354:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7130 00000100:00100000:3.0:1746066807.699359:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882977376896:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066807.700500:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977377664 00000100:00100000:3.0:1746066807.700505:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977377664 00002000:00100000:3.0:1746066807.700525:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009412ad80 x1830882977377664/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.700532:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412ad80 with x1830882977377664 ext(1048576->2097151) 00002000:00010000:3.0:1746066807.700536:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009412ad80 00000100:00100000:3.0:1746066807.700549:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7131 00000100:00100000:3.0:1746066807.700554:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+29:1963:x1830882977377152:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066807.701430:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7132 00000100:00100000:3.0:1746066807.701436:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+30:1963:x1830882977377408:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066807.702356:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7133 00000100:00100000:3.0:1746066807.702363:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+30:1963:x1830882977377664:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066807.705593:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.707312:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977377792 00000100:00100000:2.0:1746066807.707322:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977377792 00000100:00100000:2.0:1746066807.707367:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15606 00000100:00100000:2.0:1746066807.707373:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:32108:x1830882977377792:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066807.707390:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.707405:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ffe1 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.707426:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f208c00/0xfb36a14ee608e037 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb0 expref: 41 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.707433:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f1fa600/0xfb36a14ee608e068 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffda expref: 31 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.707440:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.707441:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.707444:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->3256319] (req 3145728->3256319) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 41 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.707483:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f1fa600/0xfb36a14ee608e068 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffda expref: 31 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.707493:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f1fa600/0xfb36a14ee608e068 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffda expref: 31 pid: 20532 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.707503:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882977017728:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.708809:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f208c00/0xfb36a14ee608e037 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb0 expref: 41 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.708819:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f208c00/0xfb36a14ee608e037 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb0 expref: 41 pid: 8452 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746066807.708827:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882977017856:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.709001:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.709121:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.709207:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977377920 00000100:00100000:2.0:1746066807.709211:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977377920 00000100:00100000:2.0:1746066807.709236:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15607 00000100:00100000:2.0:1746066807.709241:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+32:1963:x1830882977377920:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066807.709251:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.709262:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129ff6000/0xfb36a14ee608e076 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ffe8 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.709277:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.709279:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.709285:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff6000/0xfb36a14ee608e076 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe8 expref: 33 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.709297:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129ff6000/0xfb36a14ee608e076 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe8 expref: 33 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.709306:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff6000, rc 0) 00000100:00100000:2.0:1746066807.709329:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1963:x1830882977377920:12345-192.168.202.57@tcp:101:cat.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.709335:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15607 00000100:00100000:0.0:1746066807.713318:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.713349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.713373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.713436:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977378048 00000100:00100000:2.0:1746066807.713443:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977378048 00000100:00100000:2.0:1746066807.713482:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977378176 00000100:00100000:2.0:1746066807.713484:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977378176 00000100:00100000:2.0:1746066807.713493:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977378304 00000100:00100000:2.0:1746066807.713495:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977378304 00000100:00100000:2.0:1746066807.713506:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15608 00000100:00100000:2.0:1746066807.713511:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+43:1963:x1830882977378048:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066807.713526:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.713540:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608e07d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97ffef expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.713558:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.713560:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.713566:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608e07d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffef expref: 44 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.713578:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608e07d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffef expref: 44 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.713587:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff6a00, rc 0) 00000100:00100000:2.0:1746066807.713615:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+44:1963:x1830882977378048:12345-192.168.202.57@tcp:101:cat.0 Request processed in 104us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.713620:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15608 00000100:00100000:2.0:1746066807.713631:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15609 00000100:00100000:2.0:1746066807.713635:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+43:1963:x1830882977378176:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066807.713639:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.713644:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e084 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fff6 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.713652:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.713653:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.713656:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e084 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fff6 expref: 44 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.713664:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e084 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fff6 expref: 44 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.713670:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff7c00, rc 0) 00000100:00100000:2.0:1746066807.713699:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+44:1963:x1830882977378176:12345-192.168.202.57@tcp:101:cat.0 Request processed in 62us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.713704:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15609 00000100:00100000:2.0:1746066807.713712:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15610 00000100:00100000:2.0:1746066807.713716:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+33:1964:x1830882977378304:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066807.713724:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.713731:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608e08b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c97fffd expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.713740:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.713741:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.713744:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608e08b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fffd expref: 34 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.713752:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608e08b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fffd expref: 34 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.713758:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff6800, rc 0) 00000100:00100000:2.0:1746066807.713772:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977378304:12345-192.168.202.57@tcp:101:cat.0 Request processed in 56us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.713776:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15610 00000100:00100000:3.0:1746066807.720313:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+30:1963:x1830882977376896:12345-192.168.202.57@tcp:3:cat.0 Request processed in 20945us (21906us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066807.720324:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7130 00002000:00100000:3.0:1746066807.720334:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x38e:0x0] (0->1048575) req@ffff8800921c0e00 x1830882977376896/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.720342:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c0e00 with x1830882977376896 ext(0->1048575) 00002000:00010000:3.0:1746066807.720347:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921c0e00 00000100:00100000:0.0:1746066807.722835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.724865:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.724890:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882977017728:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.724903:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882977017856:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.724924:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->3256319] (req 3145728->3256319) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 43 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.724938:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff6200, rc 0) 00000100:00100000:2.0:1746066807.724973:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+43:32108:x1830882977377792:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 17600us (19387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.724980:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15606 00000100:00100000:3.0:1746066807.725757:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977378560 00000100:00100000:3.0:1746066807.725763:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977378560 00010000:00010000:3.0:1746066807.725788:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f208c00/0xfb36a14ee608e037 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb0 expref: 43 pid: 8452 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746066807.725809:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8098 00000100:00100000:3.0:1746066807.725814:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+43:1965:x1830882977378560:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.725825:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.725840:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f208c00/0xfb36a14ee608e037 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb0 expref: 43 pid: 8452 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.725849:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f208c00/0xfb36a14ee608e037 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb0 expref: 43 pid: 8452 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.725867:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f208c00/0xfb36a14ee608e037 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb0 expref: 43 pid: 8452 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746066807.725887:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066807.725910:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1965:x1830882977378560:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 96us (3084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066807.725915:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8098 00000100:00100000:3.0:1746066807.726403:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977378432 00000100:00100000:3.0:1746066807.726406:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977378432 00010000:00010000:3.0:1746066807.726419:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f1fa600/0xfb36a14ee608e068 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffda expref: 32 pid: 20532 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746066807.726434:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8099 00000100:00100000:3.0:1746066807.726438:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+32:1965:x1830882977378432:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066807.726445:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066807.726452:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f1fa600/0xfb36a14ee608e068 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffda expref: 32 pid: 20532 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.726459:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f1fa600/0xfb36a14ee608e068 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffda expref: 32 pid: 20532 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.726470:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f1fa600/0xfb36a14ee608e068 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffda expref: 32 pid: 20532 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.726492:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.726493:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066807.726499:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 41 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.726506:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 41 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066807.726531:0:21351:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 41 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066807.726540:0:21351:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882977017984:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066807.726580:0:21351:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d7d780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.731778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.731828:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977378688 00000100:00100000:2.0:1746066807.731836:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977378688 00000100:00100000:2.0:1746066807.731890:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15611 00000100:00100000:2.0:1746066807.731897:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009412b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+32:32110:x1830882977378688:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:2.0:1746066807.731911:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.731924:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e092 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980004 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.731944:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f209200/0xfb36a14ee608e045 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffbe expref: 33 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.731950:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608e07d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffef expref: 41 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.731955:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.731957:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066807.731960:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e092 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [2068480->2097151] (req 2068480->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980004 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.731983:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608e07d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffef expref: 41 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.731992:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608e07d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffef expref: 41 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.732002:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882977018112:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.732065:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f209200/0xfb36a14ee608e045 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffbe expref: 33 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.732076:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f209200/0xfb36a14ee608e045 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffbe expref: 33 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.732083:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882977018240:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.732098:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5049e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066807.732662:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+32:1963:x1830882977377152:12345-192.168.202.57@tcp:3:cat.0 Request processed in 32106us (34220us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066807.732670:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7131 00002000:00100000:3.0:1746066807.732698:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (1048576->2097151) req@ffff8800921c3800 x1830882977377152/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.732706:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c3800 with x1830882977377152 ext(1048576->2097151) 00010000:00010000:3.0:1746066807.732712:0:31366:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f209200/0xfb36a14ee608e045 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffbe expref: 32 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746066807.732721:0:31366:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f209200/0xfb36a14ee608e045 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffbe expref: 32 pid: 8452 timeout: 868 lvb_type: 1 00002000:00010000:3.0:1746066807.732731:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800921c3800 00000100:00100000:3.0:1746066807.732972:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+30:1963:x1830882977377408:12345-192.168.202.57@tcp:3:cat.0 Request processed in 31536us (34504us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066807.732977:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7132 00002000:00100000:3.0:1746066807.732982:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->2097151) req@ffff88009412b800 x1830882977377408/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.732988:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412b800 with x1830882977377408 ext(1048576->2097151) 00002000:00010000:3.0:1746066807.732990:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009412b800 00000100:00100000:0.0:1746066807.735462:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.735639:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977378944 00000100:00100000:3.0:1746066807.735647:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977378944 00002000:00100000:3.0:1746066807.735701:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880094128000 x1830882977378944/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.735710:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094128000 with x1830882977378944 ext(4194304->5091327) 00002000:00010000:3.0:1746066807.735714:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094128000 00000100:00100000:3.0:1746066807.735737:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7134 00000100:00100000:3.0:1746066807.735743:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977378944:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:1.0:1746066807.736497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.736513:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977379200 00000100:00100000:1.0:1746066807.736516:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977379200 00010000:00010000:1.0:1746066807.736534:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608e07d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffef expref: 42 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746066807.736553:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8100 00000100:00100000:1.0:1746066807.736557:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1963:x1830882977379200:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.736568:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.736585:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608e07d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffef expref: 42 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066807.736595:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608e07d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffef expref: 42 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066807.736617:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.736650:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1963:x1830882977379200:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 91us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.736655:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8100 00000100:00100000:1.0:1746066807.736740:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066807.736748:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6a00/0xfb36a14ee608e07d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffef expref: 41 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.736762:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882977018112:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066807.736782:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:21973:1830882977018240:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066807.736802:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e092 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [2068480->2097151] (req 2068480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980004 expref: 29 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.736812:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff6c00, rc 0) 00000100:00100000:2.0:1746066807.736830:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fc98f875-2edf-4505-a13a-65f96879556b+29:32110:x1830882977378688:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4935us (5061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.736837:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15611 00000100:00100000:3.0:1746066807.738706:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977379328 00000100:00100000:3.0:1746066807.738715:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977379328 00002000:00100000:3.0:1746066807.738742:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3252224->3256319) req@ffff88009bb2d880 x1830882977379328/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.738751:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d880 with x1830882977379328 ext(3252224->3256319) 00002000:00010000:3.0:1746066807.738754:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2d880 00000100:00100000:3.0:1746066807.738775:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7135 00000100:00100000:3.0:1746066807.738782:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1964:x1830882977379328:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066807.738884:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1964:x1830882977379328:12345-192.168.202.57@tcp:3:cat.0 Request processed in 102us (2143us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066807.738890:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7135 00002000:00100000:3.0:1746066807.738895:0:31368:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x38f:0x0] (3252224->3256319) req@ffff88009bb2d880 x1830882977379328/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/4536 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.738901:0:31368:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d880 with x1830882977379328 ext(3252224->3256319) 00002000:00010000:3.0:1746066807.738904:0:31368:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2d880 00000100:00100000:1.0:1746066807.739247:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.739267:0:21351:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:21351:1830882977017984:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066807.739271:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977379456 00000100:00100000:1.0:1746066807.739274:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977379456 00010000:00010000:2.0:1746066807.739282:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066807.739288:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f209200/0xfb36a14ee608e045 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffbe expref: 29 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746066807.739303:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8101 00000100:00100000:1.0:1746066807.739308:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977379456:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066807.739315:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066807.739328:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f209200/0xfb36a14ee608e045 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffbe expref: 29 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066807.739336:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f209200/0xfb36a14ee608e045 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffbe expref: 29 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746066807.739358:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f209200/0xfb36a14ee608e045 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffbe expref: 29 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746066807.739368:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882977378432:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 12928us (14504us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066807.739371:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.739372:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066807.739373:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8099 00010000:00010000:1.0:1746066807.739377:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e092 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980004 expref: 28 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.739384:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980004 expref: 27 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.739407:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e092 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980004 expref: 27 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.739417:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882977018368:192.168.202.57@tcp:105: 00000100:00100000:1.0:1746066807.739453:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066807.739892:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009412ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc98f875-2edf-4505-a13a-65f96879556b+28:1963:x1830882977377664:12345-192.168.202.57@tcp:3:cat.0 Request processed in 37529us (41387us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066807.739899:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7133 00002000:00100000:3.0:1746066807.739904:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x390:0x0] (1048576->2097151) req@ffff88009412ad80 x1830882977377664/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.739911:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009412ad80 with x1830882977377664 ext(1048576->2097151) 00002000:00010000:3.0:1746066807.739913:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009412ad80 00000100:00100000:1.0:1746066807.748636:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830882977018368:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066807.748655:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066807.748707:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977379456:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 9397us (9459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.748718:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8101 00000100:00100000:3.0:1746066807.751222:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977378944:12345-192.168.202.57@tcp:3:cat.0 Request processed in 15474us (15761us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066807.751232:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7134 00002000:00100000:3.0:1746066807.751242:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff880094128000 x1830882977378944/t0(0) o3->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.751251:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094128000 with x1830882977378944 ext(4194304->5091327) 00002000:00010000:3.0:1746066807.751256:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094128000 00000100:00100000:0.0:1746066807.753086:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.753112:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.753508:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977379968 00000100:00100000:3.0:1746066807.753518:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977379968 00000100:00100000:3.0:1746066807.753551:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4306 00000100:00100000:3.0:1746066807.753558:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+264:32108:x1830882977379968:12345-192.168.202.57@tcp:35:multiop.0 00000100:00100000:1.0:1746066807.754838:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977379712 00000100:00100000:1.0:1746066807.754844:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977379712 00002000:00100000:1.0:1746066807.754872:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (2068480->2072575) req@ffff880094129880 x1830882977379712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.754885:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094129880 with x1830882977379712 ext(2068480->2072575) 00002000:00010000:1.0:1746066807.754891:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094129880 00000100:00100000:1.0:1746066807.754907:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7136 00000100:00100000:1.0:1746066807.754913:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977379712:12345-192.168.202.57@tcp:3:multiop.0 00000100:00100000:1.0:1746066807.755050:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+27:1963:x1830882977379712:12345-192.168.202.57@tcp:3:multiop.0 Request processed in 135us (1968us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066807.755056:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7136 00002000:00100000:1.0:1746066807.755061:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (2068480->2072575) req@ffff880094129880 x1830882977379712/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/4536 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.755068:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094129880 with x1830882977379712 ext(2068480->2072575) 00002000:00010000:1.0:1746066807.755071:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094129880 00000100:00100000:3.0:1746066807.758270:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:32108:x1830882977379968:12345-192.168.202.57@tcp:35:multiop.0 Request processed in 4706us (5150us total) trans 8589944313 rc 0/0 00000100:00100000:3.0:1746066807.758280:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4306 00000100:00100000:0.0:1746066807.764494:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.764519:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.764530:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.764573:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.765856:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977380096 00000100:00100000:1.0:1746066807.765856:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977380224 00000100:00100000:0.0:1746066807.765859:0:10402:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977380352 00000100:00100000:2.0:1746066807.765864:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977380096 00000100:00100000:1.0:1746066807.765864:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977380224 00000100:00100000:0.0:1746066807.765864:0:10402:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977380352 00000100:00100000:1.0:1746066807.765892:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977380480 00000100:00100000:1.0:1746066807.765894:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977380480 00000100:00100000:0.0:1746066807.765914:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15612 00000100:00100000:2.0:1746066807.765921:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15613 00000100:00100000:0.0:1746066807.765922:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1966:x1830882977380224:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:2.0:1746066807.765927:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882977380352:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:2.0:1746066807.765937:0:20532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.765937:0:10402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066807.765949:0:20532:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ff7600/0xfb36a14ee608e0a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980019 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.765949:0:10402:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e806000/0xfb36a14ee608e099 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980012 expref: -99 pid: 10402 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066807.765988:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882977018496:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066807.765988:0:10402:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882977018624:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066807.766043:0:10402:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.766245:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15614 00000100:00100000:1.0:1746066807.766251:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1963:x1830882977380096:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:1.0:1746066807.766257:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.766263:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ae6e00/0xfb36a14ee608e0a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c98000b expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066807.766284:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882977018752:192.168.202.57@tcp:106: 00000100:00100000:1.0:1746066807.766308:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.766320:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15615 00000100:00100000:1.0:1746066807.766326:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+29:32110:x1830882977380480:12345-192.168.202.57@tcp:101:multiop.0 00010000:00010000:1.0:1746066807.766332:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066807.766338:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e0ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980020 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.766351:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e807800/0xfb36a14ee608e053 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffc5 expref: 30 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.766358:0:9776:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e084 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fff6 expref: 42 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.766363:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.766365:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066807.766367:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e0ae lrc: 5/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->1527807] (req 1048576->1527807) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980020 expref: 30 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.766382:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e084 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fff6 expref: 42 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.766392:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e084 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fff6 expref: 42 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746066807.766400:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882977018880:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066807.766423:0:9776:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e807800/0xfb36a14ee608e053 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffc5 expref: 30 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.766430:0:9776:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e807800/0xfb36a14ee608e053 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffc5 expref: 30 pid: 10402 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746066807.766437:0:9776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882977019008:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066807.766450:0:9776:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fed240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066807.766662:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4ba3480 going to sleep for 11 seconds 00002000:00010000:0.0:1746066807.770691:0:10402:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime: 1746066806 -> 1746066807 00000100:00100000:0.0:1746066807.770713:0:10402:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10402:1830882977018624:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066807.770737:0:10402:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e806000/0xfb36a14ee608e099 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980012 expref: 29 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.770748:0:10402:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e806000/0xfb36a14ee608e099 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980012 expref: 29 pid: 10402 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.770759:0:10402:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e806000, rc 0) 00000100:00100000:0.0:1746066807.770791:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1966:x1830882977380224:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4870us (6271us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066807.770799:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15612 00000100:00100000:1.0:1746066807.770898:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882977018880:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066807.770906:0:9776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:9776:1830882977019008:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066807.770921:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e0ae lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [1048576->1527807] (req 1048576->1527807) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980020 expref: 30 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.770932:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ae6800, rc 0) 00000100:00100000:1.0:1746066807.770950:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+30:32110:x1830882977380480:12345-192.168.202.57@tcp:101:multiop.0 Request processed in 4625us (6377us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.770956:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15615 00002000:00010000:1.0:1746066807.770976:0:21203:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime: 1746066805 -> 1746066807 00000100:00100000:1.0:1746066807.770985:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882977018752:192.168.202.57@tcp:106: 00010000:00010000:1.0:1746066807.770996:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ae6e00/0xfb36a14ee608e0a7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98000b expref: 42 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.771004:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ae6e00/0xfb36a14ee608e0a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98000b expref: 42 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066807.771011:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ae6e00, rc 0) 00000100:00100000:1.0:1746066807.771022:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1963:x1830882977380096:12345-192.168.202.57@tcp:101:cat.0 Request processed in 4772us (6536us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066807.771027:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15614 00002000:00010000:2.0:1746066807.774208:0:20532:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime: 1746066806 -> 1746066807 00000100:00100000:2.0:1746066807.774228:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882977018496:192.168.202.57@tcp:106: 00010000:00010000:2.0:1746066807.774251:0:20532:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129ff7600/0xfb36a14ee608e0a0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980019 expref: 29 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.774262:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ff7600/0xfb36a14ee608e0a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980019 expref: 29 pid: 20532 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066807.774271:0:20532:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129ff7600, rc 0) 00000100:00100000:2.0:1746066807.774312:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fc98f875-2edf-4505-a13a-65f96879556b+28:1965:x1830882977380352:12345-192.168.202.57@tcp:101:cat.0 Request processed in 8386us (9780us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066807.774329:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15613 00000100:00100000:0.0:1746066807.777355:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.777383:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.777935:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.777960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.777979:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977380992 00000100:00100000:0.0:1746066807.777986:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977380992 00000100:00100000:0.0:1746066807.778012:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977380864 00000100:00100000:0.0:1746066807.778013:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977380864 00000100:00100000:0.0:1746066807.778025:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15616 00000100:00100000:0.0:1746066807.778031:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1964:x1830882977380992:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066807.778045:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.778058:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e806200/0xfb36a14ee608e0b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c98002e expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.778074:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.778083:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e806200/0xfb36a14ee608e0b5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98002e expref: 43 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.778108:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e806200/0xfb36a14ee608e0b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98002e expref: 43 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.778613:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e806200, rc 0) 00000100:00100000:0.0:1746066807.778649:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1964:x1830882977380992:12345-192.168.202.57@tcp:101:cat.0 Request processed in 617us (781us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066807.778655:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15616 00000100:00100000:0.0:1746066807.778669:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15617 00000100:00100000:0.0:1746066807.778694:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1964:x1830882977380864:12345-192.168.202.57@tcp:101:cat.0 00000100:00100000:0.0:1746066807.778726:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.778783:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977381120 00000100:00100000:0.0:1746066807.778787:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977381120 00000100:00100000:0.0:1746066807.779205:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15618 00000100:00100000:0.0:1746066807.779210:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+28:32113:x1830882977381120:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066807.779218:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.779228:0:8450:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e806800/0xfb36a14ee608e0bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980035 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.779245:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.779251:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066807.779253:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066807.779255:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e806800/0xfb36a14ee608e0bc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980035 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.779276:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 33 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.779285:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 33 pid: 21973 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066807.779294:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882977019136:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066807.779332:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746066807.779378:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.779386:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ae6600/0xfb36a14ee608e0c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980027 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066807.779407:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882977019264:192.168.202.57@tcp:106: 00000100:00100000:0.0:1746066807.779426:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.779823:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977380736 00000100:00100000:0.0:1746066807.779828:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977380736 00010000:00010000:0.0:1746066807.779844:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e807800/0xfb36a14ee608e053 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffc5 expref: 28 pid: 10402 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066807.781096:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977380608 00000100:00100000:0.0:1746066807.781102:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977380608 00010000:00010000:0.0:1746066807.781117:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e084 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fff6 expref: 43 pid: 8452 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746066807.781174:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8102 00000100:00100000:0.0:1746066807.781181:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+28:1964:x1830882977380736:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066807.781191:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066807.781209:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e807800/0xfb36a14ee608e053 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffc5 expref: 28 pid: 10402 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066807.781218:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e807800/0xfb36a14ee608e053 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffc5 expref: 28 pid: 10402 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066807.781236:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e807800/0xfb36a14ee608e053 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffc5 expref: 28 pid: 10402 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066807.781246:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066807.781272:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fc98f875-2edf-4505-a13a-65f96879556b+27:1964:x1830882977380736:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 91us (3923us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.781276:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8102 00000100:00100000:0.0:1746066807.781307:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8103 00000100:00100000:0.0:1746066807.781312:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+43:1963:x1830882977380608:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066807.781317:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066807.781323:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e084 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fff6 expref: 43 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066807.781329:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e084 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fff6 expref: 43 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066807.781339:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ff7c00/0xfb36a14ee608e084 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fff6 expref: 43 pid: 8452 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746066807.781345:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.781346:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.781352:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e0ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980020 expref: 26 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.781358:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e0ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980020 expref: 26 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.781376:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e0ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980020 expref: 26 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066807.781384:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882977019392:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066807.781410:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.781493:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8450:1830882977019136:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066807.781510:0:8450:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e806800/0xfb36a14ee608e0bc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980035 expref: 29 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066807.781520:0:8450:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e806800, rc 0) 00000100:00100000:1.0:1746066807.781543:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:32113:x1830882977381120:12345-192.168.202.57@tcp:101:cat.0 Request processed in 2333us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066807.781549:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15618 00000100:00100000:0.0:1746066807.785154:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.785198:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977381248 00000100:00100000:0.0:1746066807.785205:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977381248 00002000:00100000:0.0:1746066807.785241:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4116480->4194303) req@ffff8800996da680 x1830882977381248/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.785250:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996da680 with x1830882977381248 ext(4116480->4194303) 00010000:00010000:0.0:1746066807.785258:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 34 pid: 21973 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066807.785271:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 34 pid: 21973 timeout: 868 lvb_type: 0 00002000:00010000:0.0:1746066807.785277:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800996da680 00000100:00100000:0.0:1746066807.785295:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2298 00000100:00100000:0.0:1746066807.785300:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+34:1964:x1830882977381248:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066807.785987:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882977019264:192.168.202.57@tcp:106: 00010000:00010000:0.0:1746066807.786008:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ae6600/0xfb36a14ee608e0c3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980027 expref: 42 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.786018:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ae6600/0xfb36a14ee608e0c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980027 expref: 42 pid: 21203 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066807.786027:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ae6600, rc 0) 00000100:00100000:0.0:1746066807.786198:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1964:x1830882977380864:12345-192.168.202.57@tcp:101:cat.0 Request processed in 7522us (8236us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066807.786205:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15617 00000100:00100000:0.0:1746066807.792157:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882977019392:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066807.792179:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066807.792217:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977380608:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 10903us (14831us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.792226:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8103 00000100:00100000:0.0:1746066807.792270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.792316:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977381504 00000100:00100000:0.0:1746066807.792320:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977381504 00002000:00100000:0.0:1746066807.792866:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38e:0x0] (1523712->1527807) req@ffff8800996d9880 x1830882977381504/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.792875:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d9880 with x1830882977381504 ext(1523712->1527807) 00002000:00010000:0.0:1746066807.792879:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996d9880 00000100:00100000:0.0:1746066807.792900:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7137 00000100:00100000:0.0:1746066807.809902:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1964:x1830882977381248:12345-192.168.202.57@tcp:4:cat.0 Request processed in 24595us (24747us total) trans 17179873797 rc 0/0 00000100:00100000:0.0:1746066807.809913:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2298 00002000:00100000:0.0:1746066807.809923:0:8456:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x391:0x0] (4116480->4194303) req@ffff8800996da680 x1830882977381248/t17179873797(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/448 e 0 to 0 dl 1746066818 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.809932:0:8456:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996da680 with x1830882977381248 ext(4116480->4194303) 00010000:00010000:0.0:1746066807.809940:0:8456:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 36 pid: 21973 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066807.809953:0:8456:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 36 pid: 21973 timeout: 868 lvb_type: 0 00002000:00010000:0.0:1746066807.809960:0:8456:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800996da680 00000100:00100000:0.0:1746066807.809990:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977381504:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066807.810087:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+27:1966:x1830882977381504:12345-192.168.202.57@tcp:3:cat.0 Request processed in 15397us (17816us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066807.810093:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7137 00002000:00100000:0.0:1746066807.810098:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1523712->1527807) req@ffff8800996d9880 x1830882977381504/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/4536 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.810104:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d9880 with x1830882977381504 ext(1523712->1527807) 00002000:00010000:0.0:1746066807.810107:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996d9880 00000100:00100000:0.0:1746066807.815255:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.815280:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977381632 00000100:00100000:0.0:1746066807.815287:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977381632 00010000:00010000:0.0:1746066807.815315:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 36 pid: 21973 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746066807.815338:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8104 00000100:00100000:0.0:1746066807.815345:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+36:1966:x1830882977381632:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066807.815356:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066807.815373:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 36 pid: 21973 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066807.815383:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 36 pid: 21973 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066807.815408:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129ff7400/0xfb36a14ee608e04c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4116480->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffb7 expref: 36 pid: 21973 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746066807.815420:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.815421:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.815427:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e806800/0xfb36a14ee608e0bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980035 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.815434:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e806800/0xfb36a14ee608e0bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980035 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.815459:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e806800/0xfb36a14ee608e0bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980035 expref: 28 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066807.815469:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882977019520:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066807.815531:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066807.822771:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882977019520:192.168.202.57@tcp:105: 00010000:00010000:0.0:1746066807.822786:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066807.823095:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+35:1966:x1830882977381632:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 7750us (7845us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.823104:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8104 00000100:00100000:0.0:1746066807.826157:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.826182:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977381888 00000100:00100000:0.0:1746066807.826188:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977381888 00002000:00100000:0.0:1746066807.826224:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800996d8380 x1830882977381888/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.826238:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8380 with x1830882977381888 ext(2097152->3145727) 00002000:00010000:0.0:1746066807.826242:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800996d8380 00000100:00100000:0.0:1746066807.826258:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7138 00000100:00100000:0.0:1746066807.826265:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977381888:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:0.0:1746066807.844860:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977381888:12345-192.168.202.57@tcp:3:cat.0 Request processed in 18589us (18702us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066807.844876:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7138 00002000:00100000:0.0:1746066807.844887:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x391:0x0] (2097152->3145727) req@ffff8800996d8380 x1830882977381888/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.844895:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8380 with x1830882977381888 ext(2097152->3145727) 00002000:00010000:0.0:1746066807.844900:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800996d8380 00000100:00100000:0.0:1746066807.852380:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.852406:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977382016 00000100:00100000:0.0:1746066807.852412:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977382016 00000100:00100000:0.0:1746066807.852446:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15619 00000100:00100000:0.0:1746066807.852453:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+27:32113:x1830882977382016:12345-192.168.202.57@tcp:101:cat.0 00010000:00010000:0.0:1746066807.852467:0:21203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066807.852494:0:21203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608e0ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c98003c expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.852519:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 39 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.852525:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066807.852527:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066807.852530:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608e0ca lrc: 4/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98003c expref: 28 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.852555:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x50000000020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 39 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.852565:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x70000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 39 pid: 21973 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746066807.852575:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882977019648:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066807.852634:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a4b39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066807.856231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066807.856279:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977382144 00000100:00100000:2.0:1746066807.856286:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977382144 00000100:00100000:0.0:1746066807.856314:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21203:1830882977019648:192.168.202.57@tcp:104: 00002000:00100000:2.0:1746066807.856318:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3256319) req@ffff88009bb2f100 x1830882977382144/t0(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066807.856326:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f100 with x1830882977382144 ext(3145728->3256319) 00010000:00010000:2.0:1746066807.856334:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 40 pid: 21973 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066807.856334:0:21203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608e0ca lrc: 3/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98003c expref: 28 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066807.856345:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 40 pid: 21973 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066807.856347:0:21203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faf5e00, rc 0) 00002000:00010000:2.0:1746066807.856350:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb2f100 00000100:00100000:2.0:1746066807.856367:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 2299 00000100:00100000:2.0:1746066807.856373:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+40:1963:x1830882977382144:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:0.0:1746066807.856376:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+28:32113:x1830882977382016:12345-192.168.202.57@tcp:101:cat.0 Request processed in 3925us (4002us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066807.856382:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15619 00000100:00100000:1.0:1746066807.862861:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1963:x1830882977382144:12345-192.168.202.57@tcp:4:cat.0 Request processed in 6482us (6629us total) trans 21474841100 rc 0/0 00000100:00100000:1.0:1746066807.862872:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 2299 00002000:00100000:1.0:1746066807.862881:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->3256319) req@ffff88009bb2f100 x1830882977382144/t21474841100(0) o4->373f5662-4306-4ad8-af4e-c6b3fb29aadc@192.168.202.57@tcp:213/0 lens 488/448 e 0 to 0 dl 1746066818 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.862889:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f100 with x1830882977382144 ext(3145728->3256319) 00010000:00010000:1.0:1746066807.862897:0:21552:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 42 pid: 21973 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746066807.862909:0:21552:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 42 pid: 21973 timeout: 869 lvb_type: 0 00002000:00010000:1.0:1746066807.862915:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb2f100 00000100:00100000:0.0:1746066807.865931:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066807.865954:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977382272 00000100:00100000:0.0:1746066807.865960:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977382272 00010000:00010000:0.0:1746066807.865986:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 42 pid: 21973 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746066807.866006:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8105 00000100:00100000:0.0:1746066807.866012:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+42:1964:x1830882977382272:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066807.866032:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066807.866052:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x60000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 42 pid: 21973 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066807.866062:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x50000400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 42 pid: 21973 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066807.866080:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e06f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3256319) gid 0 flags: 0x44801400020020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe1 expref: 42 pid: 21973 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746066807.866090:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.866091:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066807.866096:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608e0ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98003c expref: 27 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.866103:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608e0ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98003c expref: 27 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066807.866126:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608e0ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98003c expref: 27 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066807.866135:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882977019776:192.168.202.57@tcp:105: 00000100:00100000:0.0:1746066807.866368:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b21f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066807.871389:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882977019776:192.168.202.57@tcp:105: 00010000:00010000:2.0:1746066807.871406:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066807.871438:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+41:1964:x1830882977382272:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 5425us (5513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066807.871446:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8105 00000100:00100000:1.0:1746066807.884277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.884298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.884320:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066807.884339:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977382656 00000100:00100000:1.0:1746066807.884346:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977382656 00002000:00100000:1.0:1746066807.884383:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009bb2e680 x1830882977382656/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.884392:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2e680 with x1830882977382656 ext(2097152->3145727) 00002000:00010000:1.0:1746066807.884396:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2e680 00000100:00100000:1.0:1746066807.884410:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977382784 00000100:00100000:1.0:1746066807.884412:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977382784 00000100:00100000:2.0:1746066807.884417:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977383040 00002000:00100000:1.0:1746066807.884421:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009bb2c380 x1830882977382784/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746066807.884422:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977383040 00002000:00100000:1.0:1746066807.884427:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c380 with x1830882977382784 ext(3145728->4194303) 00002000:00010000:1.0:1746066807.884429:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2c380 00002000:00100000:2.0:1746066807.884437:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009bb2dc00 x1830882977383040/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066807.884440:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7139 00002000:00100000:2.0:1746066807.884445:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2dc00 with x1830882977383040 ext(3145728->4194303) 00000100:00100000:1.0:1746066807.884445:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977382656:12345-192.168.202.57@tcp:3:cat.0 00002000:00010000:2.0:1746066807.884448:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2dc00 00000100:00100000:2.0:1746066807.884460:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7140 00000100:00100000:2.0:1746066807.884465:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977382784:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066807.884559:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7141 00000100:00100000:3.0:1746066807.884566:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+29:1964:x1830882977383040:12345-192.168.202.57@tcp:3:cat.0 00000001:00080000:1.0:1746066807.890672:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841051 is committed 00000001:00080000:1.0:1746066807.890705:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841089 is committed 00000001:00080000:1.0:1746066807.890713:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841076 is committed 00000001:00080000:1.0:1746066807.890752:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841050 is committed 00000001:00080000:1.0:1746066807.890775:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841098 is committed 00000001:00080000:1.0:1746066807.890782:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841097 is committed 00000001:00080000:1.0:1746066807.890789:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841093 is committed 00000001:00080000:1.0:1746066807.890827:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841099 is committed 00000100:00100000:0.0:1746066807.892420:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc98f875-2edf-4505-a13a-65f96879556b+10:1964:x1830882977382784:12345-192.168.202.57@tcp:3:cat.0 Request processed in 7948us (8114us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066807.892430:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7140 00002000:00100000:0.0:1746066807.892439:0:8455:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x38f:0x0] (3145728->4194303) req@ffff88009bb2c380 x1830882977382784/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066807.892448:0:8455:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c380 with x1830882977382784 ext(3145728->4194303) 00002000:00010000:0.0:1746066807.892453:0:8455:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2c380 00000001:00080000:2.0:1746066807.895502:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873771 is committed 00000001:00080000:2.0:1746066807.895515:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873759 is committed 00000001:00080000:2.0:1746066807.895521:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873747 is committed 00000001:00080000:2.0:1746066807.895543:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873796 is committed 00000001:00080000:2.0:1746066807.895553:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873794 is committed 00000001:00080000:2.0:1746066807.895568:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873769 is committed 00000001:00080000:2.0:1746066807.895596:0:2203:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873792 is committed 00000100:00100000:1.0:1746066807.897467:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+8:1964:x1830882977382656:12345-192.168.202.57@tcp:3:cat.0 Request processed in 13014us (13188us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066807.897491:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7139 00002000:00100000:1.0:1746066807.897501:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38f:0x0] (2097152->3145727) req@ffff88009bb2e680 x1830882977382656/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066807.897515:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2e680 with x1830882977382656 ext(2097152->3145727) 00002000:00010000:1.0:1746066807.897521:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2e680 00000100:00100000:3.0:1746066807.901951:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+9:1964:x1830882977383040:12345-192.168.202.57@tcp:3:cat.0 Request processed in 17377us (17622us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066807.901960:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7141 00002000:00100000:3.0:1746066807.901970:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (3145728->4194303) req@ffff88009bb2dc00 x1830882977383040/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.901978:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2dc00 with x1830882977383040 ext(3145728->4194303) 00002000:00010000:3.0:1746066807.901983:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2dc00 00000100:00100000:0.0:1746066807.913846:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066807.913890:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977383296 00000100:00100000:3.0:1746066807.913897:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977383296 00002000:00100000:3.0:1746066807.913931:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800996d8000 x1830882977383296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/0 e 0 to 0 dl 1746066818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.913937:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8000 with x1830882977383296 ext(4194304->5091327) 00002000:00010000:3.0:1746066807.913941:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800996d8000 00000100:00100000:3.0:1746066807.913963:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7142 00000100:00100000:3.0:1746066807.913968:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+9:1966:x1830882977383296:12345-192.168.202.57@tcp:3:cat.0 00000100:00100000:3.0:1746066807.924967:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+9:1966:x1830882977383296:12345-192.168.202.57@tcp:3:cat.0 Request processed in 10989us (11118us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746066807.924980:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7142 00002000:00100000:3.0:1746066807.924992:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x391:0x0] (4194304->5091327) req@ffff8800996d8000 x1830882977383296/t0(0) o3->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:213/0 lens 488/440 e 0 to 0 dl 1746066818 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066807.925000:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8000 with x1830882977383296 ext(4194304->5091327) 00002000:00010000:3.0:1746066807.925005:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800996d8000 00000100:00100000:0.0:1746066808.173952:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066808.173995:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066808.174172:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977383552 00000100:00100000:1.0:1746066808.174179:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977383552 00002000:00100000:1.0:1746066808.174216:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1527807) req@ffff8800996d8e00 x1830882977383552/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:214/0 lens 488/0 e 0 to 0 dl 1746066819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066808.174226:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8e00 with x1830882977383552 ext(1048576->1527807) 00002000:00010000:1.0:1746066808.174231:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996d8e00 00000100:00100000:3.0:1746066808.174479:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977383424 00000100:00100000:3.0:1746066808.174484:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977383424 00002000:00100000:3.0:1746066808.174500:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (2068480->2097151) req@ffff8800921c3480 x1830882977383424/t0(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:214/0 lens 488/0 e 0 to 0 dl 1746066819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066808.174500:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7143 00002000:00100000:3.0:1746066808.174507:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c3480 with x1830882977383424 ext(2068480->2097151) 00000100:00100000:1.0:1746066808.174507:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+9:1966:x1830882977383552:12345-192.168.202.57@tcp:4:cat.0 00002000:00010000:3.0:1746066808.174509:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921c3480 00000100:00100000:3.0:1746066808.174900:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7144 00000100:00100000:3.0:1746066808.174906:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+10:1966:x1830882977383424:12345-192.168.202.57@tcp:4:cat.0 00000100:00100000:3.0:1746066808.193715:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:fc98f875-2edf-4505-a13a-65f96879556b+12:1966:x1830882977383424:12345-192.168.202.57@tcp:4:cat.0 Request processed in 18801us (19711us total) trans 21474841101 rc 0/0 00000100:00100000:3.0:1746066808.193726:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7144 00002000:00100000:3.0:1746066808.193736:0:31366:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x38d:0x0] (2068480->2097151) req@ffff8800921c3480 x1830882977383424/t21474841101(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:214/0 lens 488/448 e 0 to 0 dl 1746066819 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066808.193744:0:31366:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921c3480 with x1830882977383424 ext(2068480->2097151) 00002000:00010000:3.0:1746066808.193748:0:31366:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921c3480 00000100:00100000:1.0:1746066808.195264:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fc98f875-2edf-4505-a13a-65f96879556b+12:1966:x1830882977383552:12345-192.168.202.57@tcp:4:cat.0 Request processed in 20754us (21314us total) trans 21474841102 rc 0/0 00000100:00100000:1.0:1746066808.195272:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7143 00002000:00100000:1.0:1746066808.195278:0:21552:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x38e:0x0] (1048576->1527807) req@ffff8800996d8e00 x1830882977383552/t21474841102(0) o4->fc98f875-2edf-4505-a13a-65f96879556b@192.168.202.57@tcp:214/0 lens 488/448 e 0 to 0 dl 1746066819 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066808.195285:0:21552:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996d8e00 with x1830882977383552 ext(1048576->1527807) 00002000:00010000:1.0:1746066808.195288:0:21552:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996d8e00 00010000:00010000:1.0:1746066808.263854:0:9851:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066808.910078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066808.910245:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977383680 00000100:00100000:2.0:1746066808.910254:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977383680 00000100:00100000:2.0:1746066808.910301:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15620 00000100:00100000:2.0:1746066808.910307:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+12:1964:x1830882977383680:12345-192.168.202.57@tcp:16:kworker.0 00000100:00100000:1.0:1746066808.910924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066808.911106:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977383936 00000100:00100000:2.0:1746066808.911111:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977383936 00000100:00100000:2.0:1746066808.911130:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15621 00000100:00100000:2.0:1746066808.911135:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977383936:12345-192.168.202.57@tcp:16:kworker.0 00000100:00100000:1.0:1746066808.913821:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066808.914298:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977383808 00000100:00100000:2.0:1746066808.914305:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977383808 00000100:00100000:2.0:1746066808.914334:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15622 00000100:00100000:2.0:1746066808.914340:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977383808:12345-192.168.202.57@tcp:16:kworker.0 00000100:00100000:2.0:1746066809.017802:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fc98f875-2edf-4505-a13a-65f96879556b+14:1964:x1830882977383808:12345-192.168.202.57@tcp:16:kworker.0 Request processed in 103457us (103988us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066809.017813:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15622 00000100:00100000:0.0:1746066809.017911:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+13:1964:x1830882977383936:12345-192.168.202.57@tcp:16:kworker.0 Request processed in 106775us (106987us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.017918:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15621 00000001:00080000:1.0:1746066809.018156:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841102 is committed 00000001:00080000:1.0:1746066809.018169:0:600:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841100 is committed 00000100:00100000:3.0:1746066809.018275:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+8:1964:x1830882977383680:12345-192.168.202.57@tcp:16:kworker.0 Request processed in 107967us (108202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.018281:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15620 00000100:00100000:0.0:1746066809.047815:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.048246:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977384192 00000100:00100000:3.0:1746066809.048254:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977384192 00000100:00080000:0.0:1746066809.048428:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066809.049529:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4307 00000100:00100000:3.0:1746066809.049539:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b086450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+18:32139:x1830882977384192:12345-192.168.202.57@tcp:35:umount.0 00000100:00100000:3.0:1746066809.050218:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b086450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:32139:x1830882977384192:12345-192.168.202.57@tcp:35:umount.0 Request processed in 680us (2408us total) trans 8589944314 rc 0/0 00000100:00100000:3.0:1746066809.050224:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4307 00000100:00100000:0.0:1746066809.055140:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.055229:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977384448 00000100:00100000:3.0:1746066809.055237:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977384448 00000100:00100000:3.0:1746066809.055361:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4308 00000100:00100000:3.0:1746066809.055368:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+19:32139:x1830882977384448:12345-192.168.202.57@tcp:35:umount.0 00000100:00100000:3.0:1746066809.055619:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:32139:x1830882977384448:12345-192.168.202.57@tcp:35:umount.0 Request processed in 250us (487us total) trans 8589944315 rc 0/0 00000100:00100000:3.0:1746066809.055625:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4308 00000100:00100000:0.0:1746066809.058730:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066809.058862:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977384576 00000100:00100000:2.0:1746066809.058869:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977384576 00000100:00100000:2.0:1746066809.058913:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 731 00000100:00100000:2.0:1746066809.058919:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69ee3f12-76db-44fe-a8c9-a42ead582d61+15:1963:x1830882977384576:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066809.058930:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066809.058944:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a4aa8600/0xfb36a14ee60837c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c979c05 expref: 15 pid: 14544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.059183:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.059250:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.059266:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977384832 00000100:00100000:0.0:1746066809.059269:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977384832 00000100:00100000:0.0:1746066809.059287:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977384704 00000100:00100000:0.0:1746066809.059289:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977384704 00000100:00100000:0.0:1746066809.059301:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 732 00000100:00100000:0.0:1746066809.059306:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c396300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69ee3f12-76db-44fe-a8c9-a42ead582d61+16:1966:x1830882977384832:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066809.059312:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066809.059319:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a4aa8000/0xfb36a14ee60837ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c979c36 expref: 16 pid: 14544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.059333:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066809.059362:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c396300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69ee3f12-76db-44fe-a8c9-a42ead582d61+15:1966:x1830882977384832:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 56us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.059368:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 732 00000100:00100000:0.0:1746066809.059394:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 733 00000100:00100000:0.0:1746066809.059399:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69ee3f12-76db-44fe-a8c9-a42ead582d61+14:1963:x1830882977384704:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066809.059405:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066809.059412:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a4aa9000/0xfb36a14ee60837c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c979c2f expref: 14 pid: 14544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.059418:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066809.059429:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094128a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69ee3f12-76db-44fe-a8c9-a42ead582d61+13:1963:x1830882977384704:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 31us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.059434:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 733 00010000:00010000:2.0:1746066809.059538:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066809.059557:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69ee3f12-76db-44fe-a8c9-a42ead582d61+12:1963:x1830882977384576:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 637us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066809.059561:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 731 00000100:00100000:0.0:1746066809.063919:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.064616:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977385472 00000100:00100000:3.0:1746066809.064625:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977385472 00000100:00100000:3.0:1746066809.064709:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15623 00000100:00100000:3.0:1746066809.064716:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+9:1962:x1830882977385472:12345-192.168.202.57@tcp:9:umount.0 00000020:00000080:3.0:1746066809.064742:0:21203:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xfb36a14ee60837e3 00000020:00010000:3.0:1746066809.064748:0:21203:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009fa49800: total 0 00000100:00080000:3.0:1746066809.064751:0:21203:0:(import.c:66:import_set_state_nolock()) ffff88009fa4e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746066809.064777:0:21203:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873797 00000100:00100000:3.0:1746066809.064947:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fc98f875-2edf-4505-a13a-65f96879556b+7:1962:x1830882977385472:12345-192.168.202.57@tcp:9:umount.0 Request processed in 232us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.064953:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15623 00000020:00010000:1.0:1746066809.065018:0:9849:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009fa49800: total 0 00010000:00010000:1.0:1746066809.065046:0:9849:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009fa49800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1746066809.065087:0:9849:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e806800/0xfb36a14ee608e0bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980035 expref: 6 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.065133:0:9849:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a489ea00/0xfb36a14ee608393a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c979d1d expref: 5 pid: 8451 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066809.065145:0:9849:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:1.0:1746066809.065152:0:9849:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f209000/0xfb36a14ee608e05a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffcc expref: 4 pid: 8452 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746066809.065163:0:9849:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2047 -> 2049 00010000:00010000:1.0:1746066809.065169:0:9849:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e807600/0xfb36a14ee608e03e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffa9 expref: 3 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.065177:0:9849:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009fa49800, canceled 4 locks, left on hash table 0. 00010000:00010000:1.0:1746066809.065186:0:9849:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746066809.065187:0:9849:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746066809.065189:0:9849:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1746066809.065452:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066809.074391:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.074486:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977385984 00000100:00100000:1.0:1746066809.074494:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977385984 00000100:00080000:0.0:1746066809.074581:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066809.075736:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15624 00000100:00100000:1.0:1746066809.075745:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+8:1962:x1830882977385984:12345-192.168.202.57@tcp:9:umount.0 00000020:00000080:1.0:1746066809.075770:0:8450:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xfb36a14ee60837dc 00000020:00010000:1.0:1746066809.075776:0:8450:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009fa4c000: total 0 00000100:00080000:1.0:1746066809.075779:0:8450:0:(import.c:66:import_set_state_nolock()) ffff88009fa49000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746066809.076056:0:8450:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841102 00000020:00010000:2.0:1746066809.076846:0:7111:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009fa4c000: total 0 00010000:00010000:2.0:1746066809.076873:0:7111:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009fa4c000, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1746066809.076916:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6c00/0xfb36a14ee608e092 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980004 expref: 6 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.076949:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e0ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->1527807) gid 0 flags: 0x44801000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980020 expref: 5 pid: 9776 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.076974:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009faf5e00/0xfb36a14ee608e0ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98003c expref: 4 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.076985:0:7111:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009fa4c000, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1746066809.076994:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746066809.076995:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746066809.076997:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746066809.077336:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc98f875-2edf-4505-a13a-65f96879556b+2:1962:x1830882977385984:12345-192.168.202.57@tcp:9:umount.0 Request processed in 1587us (2944us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.077347:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15624 00000100:00100000:0.0:1746066809.082184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.082270:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977386368 00000100:00100000:3.0:1746066809.082278:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977386368 00000100:00100000:3.0:1746066809.082329:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10219 00000100:00100000:3.0:1746066809.082336:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+20:1962:x1830882977386368:12345-192.168.202.57@tcp:39:umount.0 00000020:00000080:3.0:1746066809.082363:0:16018:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xfb36a14ee60837d5 00000020:00010000:3.0:1746066809.082369:0:16018:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88013599a800: total 0 00000100:00080000:3.0:1746066809.082372:0:16018:0:(import.c:66:import_set_state_nolock()) ffff880135999800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1746066809.082614:0:9850:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88013599a800: total 0 00000001:00000004:3.0:1746066809.082643:0:16018:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589944315 00010000:00010000:1.0:1746066809.082656:0:9850:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88013599a800, canceled 0 locks, left on hash table 5. 00010000:00010000:1.0:1746066809.082709:0:9850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066809.082712:0:9850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066809.082718:0:9850:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fff1a00/0xfb36a14ee608dd89 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fe36 expref: 19 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.082743:0:9850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066809.082745:0:9850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066809.082748:0:9850:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faf4a00/0xfb36a14ee608cdec lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97f3b6 expref: 18 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.082758:0:9850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066809.082760:0:9850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066809.082763:0:9850:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e9bce00/0xfb36a14ee608dd0b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde2 expref: 17 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.082773:0:9850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:1.0:1746066809.082775:0:9850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746066809.082777:0:9850:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85bd000/0xfb36a14ee608387d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c979cd7 expref: 16 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.082785:0:9850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:1.0:1746066809.082787:0:9850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066809.082789:0:9850:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e806600/0xfb36a14ee608e01b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ff9b expref: 15 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.082801:0:9850:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88013599a800, canceled 5 locks, left on hash table 0. 00010000:00010000:1.0:1746066809.082810:0:9850:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746066809.082811:0:9850:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746066809.082813:0:9850:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746066809.083018:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc98f875-2edf-4505-a13a-65f96879556b+13:1962:x1830882977386368:12345-192.168.202.57@tcp:39:umount.0 Request processed in 681us (838us total) trans 8589944316 rc 0/0 00000100:00100000:3.0:1746066809.083025:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10219 00010000:00010000:0.0:1746066809.266395:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066809.587961:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.588057:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977386496 00000100:00100000:1.0:1746066809.588068:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977386496 00000100:00100000:1.0:1746066809.588137:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 734 00000100:00100000:1.0:1746066809.588144:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:69ee3f12-76db-44fe-a8c9-a42ead582d61+12:1966:x1830882977386496:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.588157:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.588172:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800926be400/0xfb36a14ee60837ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c979c60 expref: 12 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.588202:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.588260:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:69ee3f12-76db-44fe-a8c9-a42ead582d61+11:1966:x1830882977386496:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 116us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.588266:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 734 00000100:00100000:0.0:1746066809.589271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.589360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.589398:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977386624 00000100:00100000:0.0:1746066809.589399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.589402:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977386624 00000100:00100000:2.0:1746066809.589747:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977386880 00000100:00100000:2.0:1746066809.589751:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977386880 00000100:00100000:3.0:1746066809.589824:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977386752 00000100:00100000:3.0:1746066809.589828:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977386752 00000100:00100000:1.0:1746066809.589828:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 735 00000100:00100000:1.0:1746066809.589833:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:69ee3f12-76db-44fe-a8c9-a42ead582d61+12:1965:x1830882977386624:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.589841:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066809.589845:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 736 00000100:00100000:3.0:1746066809.589850:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69ee3f12-76db-44fe-a8c9-a42ead582d61+12:1965:x1830882977386752:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.589850:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800926be800/0xfb36a14ee60837f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c979c8a expref: 12 pid: 14544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.589856:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.589859:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066809.589862:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800926be200/0xfb36a14ee60837f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c979c91 expref: 11 pid: 14546 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.589870:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.589879:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:69ee3f12-76db-44fe-a8c9-a42ead582d61+10:1965:x1830882977386624:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 46us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.589881:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69ee3f12-76db-44fe-a8c9-a42ead582d61+10:1965:x1830882977386752:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 32us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.589885:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 735 00000100:00100000:3.0:1746066809.589887:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 736 00000100:00100000:3.0:1746066809.589907:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15625 00000100:00100000:3.0:1746066809.589912:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1962:x1830882977386880:12345-192.168.202.57@tcp:9:umount.0 00000020:00000080:3.0:1746066809.589931:0:21203:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xfb36a14ee608380d 00000100:00080000:1.0:1746066809.589952:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746066809.589978:0:21203:0:(import.c:66:import_set_state_nolock()) ffff88009fa48800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1746066809.590043:0:9851:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1746066809.591576:0:21203:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873797 00000100:00100000:3.0:1746066809.591738:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+2:1962:x1830882977386880:12345-192.168.202.57@tcp:9:umount.0 Request processed in 1823us (2336us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.591746:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15625 00000100:00100000:0.0:1746066809.595849:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.596744:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977387008 00000100:00100000:3.0:1746066809.596753:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977387008 00000100:00100000:3.0:1746066809.596810:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15626 00000100:00100000:3.0:1746066809.596818:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+5:1962:x1830882977387008:12345-192.168.202.57@tcp:9:umount.0 00000020:00000080:3.0:1746066809.596841:0:21203:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xfb36a14ee6083806 00000100:00080000:3.0:1746066809.596848:0:21203:0:(import.c:66:import_set_state_nolock()) ffff88013599e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746066809.596874:0:21203:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841102 00000100:00100000:3.0:1746066809.597013:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f09a0c46-01bd-4197-bc90-17b6ceef920b+2:1962:x1830882977387008:12345-192.168.202.57@tcp:9:umount.0 Request processed in 195us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.597019:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15626 00000100:00080000:1.0:1746066809.597074:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746066809.597268:0:9849:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066809.603330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.603643:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977387264 00000100:00100000:3.0:1746066809.603651:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977387264 00000100:00080000:1.0:1746066809.603783:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066809.603834:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10220 00000100:00100000:3.0:1746066809.603842:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+12:1962:x1830882977387264:12345-192.168.202.57@tcp:39:umount.0 00000020:00000080:3.0:1746066809.603867:0:16018:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xfb36a14ee60837ff 00000020:00010000:3.0:1746066809.603872:0:16018:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88013599c800: total 0 00000100:00080000:3.0:1746066809.603875:0:16018:0:(import.c:66:import_set_state_nolock()) ffff88013599d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746066809.603982:0:16018:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589944316 00000020:00010000:0.0:1746066809.604173:0:7111:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88013599c800: total 0 00010000:00010000:0.0:1746066809.604179:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746066809.604209:0:7111:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88013599c800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1746066809.604233:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:0.0:1746066809.604235:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746066809.604241:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a85bc800/0xfb36a14ee608381b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c979cbb expref: 11 pid: 14548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.604257:0:7111:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88013599c800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1746066809.604263:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746066809.604265:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746066809.604266:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746066809.605439:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f09a0c46-01bd-4197-bc90-17b6ceef920b+9:1962:x1830882977387264:12345-192.168.202.57@tcp:39:umount.0 Request processed in 1594us (2112us total) trans 8589944317 rc 0/0 00000100:00100000:3.0:1746066809.605447:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10220 00000100:00100000:0.0:1746066809.634507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.634590:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977387392 00000100:00100000:3.0:1746066809.634598:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977387392 00000100:00080000:1.0:1746066809.634762:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066809.634867:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10221 00000100:00100000:3.0:1746066809.634875:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+265:32161:x1830882977387392:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066809.634894:0:16018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066809.634908:0:16018:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608e0d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980043 expref: -99 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.634955:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608e0d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.634965:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608e0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.634974:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608e0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.634983:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fa400/0xfb36a14ee608e0df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.634988:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fa400/0xfb36a14ee608e0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.634992:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fa400/0xfb36a14ee608e0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635286:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608e0e6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635294:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608e0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635300:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608e0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00200000:3.0:1746066809.635324:0:16018:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:3.0:1746066809.635328:0:16018:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746066809.635340:0:16018:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608e0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635347:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608e0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635353:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608e0d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635359:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608e0d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635364:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608e0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635370:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f1fbe00 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066809.635374:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608e0d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635379:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608e0d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635387:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009ebec800) 00010000:00010000:3.0:1746066809.635390:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066809.635393:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608e0d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635398:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fbe00/0xfb36a14ee608e0d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635424:0:16018:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fa400/0xfb36a14ee608e0df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635429:0:16018:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fa400/0xfb36a14ee608e0df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635438:0:16018:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fa400/0xfb36a14ee608e0df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635442:0:16018:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f1fa400 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066809.635444:0:16018:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fa400/0xfb36a14ee608e0df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635449:0:16018:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fa400/0xfb36a14ee608e0df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635465:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ed99400) 00010000:00010000:3.0:1746066809.635467:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066809.635469:0:16018:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fa400/0xfb36a14ee608e0df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635473:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fa400/0xfb36a14ee608e0df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.635493:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f1fb200/0xfb36a14ee608e0d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980043 expref: 267 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.635503:0:16018:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608e0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980043 expref: 266 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.635508:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066809.635509:0:16018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066809.635511:0:16018:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1e200, rc 0) 00000100:00100000:3.0:1746066809.635547:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:32161:x1830882977387392:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 673us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.635552:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10221 00000100:00100000:1.0:1746066809.641784:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.641811:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.641829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.641847:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.641873:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977387520 00000100:00100000:1.0:1746066809.641879:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977387520 00000100:00100000:1.0:1746066809.641918:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977387648 00000100:00100000:1.0:1746066809.641920:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977387648 00000100:00100000:1.0:1746066809.641926:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977387776 00000100:00100000:1.0:1746066809.641928:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977387776 00000100:00100000:1.0:1746066809.641936:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977387904 00000100:00100000:1.0:1746066809.641937:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977387904 00000100:00100000:1.0:1746066809.641947:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15627 00000100:00100000:1.0:1746066809.641952:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+13:1964:x1830882977387520:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066809.641967:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.641982:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d0d3400/0xfb36a14ee608e0ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c98004a expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066809.642001:0:9776:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38d:0x0] initial LVB size: 2097152, mtime: 0x6812dd77, atime: 0x6812dd75, ctime: 0x6812dd77, blocks: 0x821 00010000:00010000:1.0:1746066809.642016:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.642017:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.642024:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0d3400/0xfb36a14ee608e0ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98004a expref: 14 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.642042:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d0d3400/0xfb36a14ee608e0ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98004a expref: 14 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.642051:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0d3400, rc 0) 00000100:00100000:1.0:1746066809.642087:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1964:x1830882977387520:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 134us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.642092:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15627 00000100:00100000:1.0:1746066809.642105:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15628 00000100:00100000:1.0:1746066809.642109:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+13:1964:x1830882977387648:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066809.642115:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.642121:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d0d2600/0xfb36a14ee608e0f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980051 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066809.642131:0:9776:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd77, atime: 0x6812dd73, ctime: 0x6812dd77, blocks: 0x81f 00010000:00010000:1.0:1746066809.642138:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.642139:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.642143:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0d2600/0xfb36a14ee608e0f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980051 expref: 14 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.642150:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d0d2600/0xfb36a14ee608e0f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980051 expref: 14 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.642156:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0d2600, rc 0) 00000100:00100000:1.0:1746066809.642169:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1964:x1830882977387648:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 60us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.642176:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15628 00000100:00100000:1.0:1746066809.642186:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15629 00000100:00100000:1.0:1746066809.642190:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977387776:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066809.642195:0:9776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.642203:0:9776:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d0d3800/0xfb36a14ee608e0fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980058 expref: -99 pid: 9776 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066809.642466:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15630 00000100:00100000:2.0:1746066809.642473:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+13:1964:x1830882977387904:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066809.642480:0:21973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066809.642488:0:21973:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135430600/0xfb36a14ee608e102 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c98005f expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066809.642500:0:21973:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38f:0x0] initial LVB size: 4194304, mtime: 0x6812dd77, atime: 0x6812dd76, ctime: 0x6812dd77, blocks: 0x1029 00010000:00010000:2.0:1746066809.642508:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.642509:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.642513:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135430600/0xfb36a14ee608e102 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98005f expref: 14 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066809.642527:0:21973:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135430600/0xfb36a14ee608e102 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98005f expref: 14 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066809.642534:0:21973:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135430600, rc 0) 00000100:00100000:2.0:1746066809.642549:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1964:x1830882977387904:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 78us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066809.642554:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15630 00000100:00080000:0.0:1746066809.642663:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746066809.642667:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1746066809.643742:0:9776:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 5090560, mtime: 0x6812dd77, atime: 0x6812dd77, ctime: 0x6812dd77, blocks: 0x171f 00010000:00010000:1.0:1746066809.643756:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.643758:0:9776:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.643763:0:9776:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0d3800/0xfb36a14ee608e0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980058 expref: 22 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.643772:0:9776:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d0d3800/0xfb36a14ee608e0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980058 expref: 22 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.643779:0:9776:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d0d3800, rc 0) 00000100:00100000:1.0:1746066809.643818:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977387776:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 1627us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.643824:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15629 00000100:00100000:0.0:1746066809.661642:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066809.661739:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977388160 00000100:00100000:2.0:1746066809.661746:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977388160 00000100:00100000:2.0:1746066809.662306:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10222 00000100:00100000:2.0:1746066809.662314:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+266:32161:x1830882977388160:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066809.662330:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066809.663719:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135431200/0xfb36a14ee608e109 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980066 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.663798:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135430e00/0xfb36a14ee608e110 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066809.663810:0:20127:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608e0e6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980043 expref: 267 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.663820:0:20127:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135430e00/0xfb36a14ee608e110 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066809.663845:0:20127:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608e0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980043 expref: 267 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.663855:0:20127:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608e0e6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980043 expref: 267 pid: 16018 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746066809.663866:0:20127:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882977019904:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066809.665375:0:20127:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.667323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066809.667507:0:20127:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20127:1830882977019904:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066809.667524:0:20127:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135430e00/0xfb36a14ee608e110 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000100:00100000:3.0:1746066809.667566:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977388288 00000100:00100000:3.0:1746066809.667572:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977388288 00010000:00010000:3.0:1746066809.667602:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608e0e6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980043 expref: 268 pid: 16018 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746066809.667633:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8106 00000100:00100000:3.0:1746066809.667638:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:1964:x1830882977388288:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066809.667649:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066809.667653:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608e0e6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980043 expref: 268 pid: 16018 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746066809.667662:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608e0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980043 expref: 268 pid: 16018 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746066809.667699:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e200/0xfb36a14ee608e0e6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980043 expref: 268 pid: 16018 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746066809.667712:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066809.667716:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135430e00/0xfb36a14ee608e110 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066809.667723:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135430e00/0xfb36a14ee608e110 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066809.667732:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135430e00/0xfb36a14ee608e110 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066809.667750:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066809.668007:0:20127:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135430e00/0xfb36a14ee608e110 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066809.668014:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135430e00/0xfb36a14ee608e110 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:2.0:1746066809.668039:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066809.668146:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135431200/0xfb36a14ee608e109 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980066 expref: 269 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.668160:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135430e00/0xfb36a14ee608e110 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980066 expref: 268 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.668165:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066809.668168:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066809.668170:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135430e00, rc 0) 00000100:00100000:2.0:1746066809.668192:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:32161:x1830882977388160:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 5879us (6561us total) trans 8589944318 rc 0/0 00000100:00100000:2.0:1746066809.668198:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10222 00000100:00100000:3.0:1746066809.668407:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:1964:x1830882977388288:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 767us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.668417:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8106 00000100:00100000:0.0:1746066809.671306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.671448:0:16789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977388544 00000100:00100000:3.0:1746066809.671464:0:16789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977388544 00000100:00100000:3.0:1746066809.671509:0:16789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4309 00000100:00100000:3.0:1746066809.671517:0:16789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+267:32161:x1830882977388544:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:3.0:1746066809.671706:0:16789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:32161:x1830882977388544:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 189us (405us total) trans 8589944319 rc 0/0 00000100:00100000:3.0:1746066809.671712:0:16789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4309 00000100:00100000:0.0:1746066809.675083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066809.675247:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977388800 00000100:00100000:2.0:1746066809.675254:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977388800 00000100:00100000:2.0:1746066809.675298:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10223 00000100:00100000:2.0:1746066809.675305:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:32161:x1830882977388800:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066809.675321:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066809.675323:0:20127:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746066809.675344:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135430e00/0xfb36a14ee608e110 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x318:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980066 expref: 268 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.675373:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5e00/0xfb36a14ee608de46 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fead expref: 267 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.675383:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066809.675386:0:20127:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066809.675395:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135430200/0xfb36a14ee608e11e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c98006d expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.675474:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135430c00/0xfb36a14ee608e125 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066809.675484:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135430c00/0xfb36a14ee608e125 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066809.675491:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135430c00/0xfb36a14ee608e125 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:2.0:1746066809.675500:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00010000:00010000:2.0:1746066809.675580:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135430200/0xfb36a14ee608e11e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98006d expref: 269 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.675631:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135430c00/0xfb36a14ee608e125 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98006d expref: 268 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.675637:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066809.675639:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066809.675641:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135430c00, rc 0) 00000100:00100000:2.0:1746066809.675709:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:32161:x1830882977388800:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 404us (631us total) trans 8589944320 rc 0/0 00000100:00100000:2.0:1746066809.675716:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10223 00000100:00100000:0.0:1746066809.677842:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.677874:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.677984:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.678096:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977388928 00000100:00100000:3.0:1746066809.678102:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977388928 00000100:00100000:0.0:1746066809.678314:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977389056 00000100:00100000:0.0:1746066809.678318:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977389056 00000100:00100000:0.0:1746066809.678347:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977389184 00000100:00100000:0.0:1746066809.678349:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977389184 00000100:00100000:0.0:1746066809.678361:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15631 00000100:00100000:0.0:1746066809.678367:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1963:x1830882977389056:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:0.0:1746066809.678399:0:20532:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e133 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.678412:0:20532:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d0d3400/0xfb36a14ee608e0ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98004a expref: 15 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.678419:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.678421:0:20532:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.678423:0:20532:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e133 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.678446:0:20532:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d0d3400/0xfb36a14ee608e0ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98004a expref: 15 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.678467:0:20532:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d0d3400/0xfb36a14ee608e0ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98004a expref: 15 pid: 9776 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746066809.678478:0:20532:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882977020032:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066809.678541:0:20532:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a72789c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.678558:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15632 00000100:00100000:0.0:1746066809.678563:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1963:x1830882977389184:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:0.0:1746066809.678578:0:4614:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e13a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.678587:0:4614:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d0d2600/0xfb36a14ee608e0f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980051 expref: 15 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.678596:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.678598:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.678599:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e13a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.678614:0:4614:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d0d2600/0xfb36a14ee608e0f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980051 expref: 15 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066809.678621:0:4614:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d0d2600/0xfb36a14ee608e0f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980051 expref: 15 pid: 9776 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746066809.678629:0:4614:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a0d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882977020160:192.168.202.57@tcp:104: 00000100:00100000:0.0:1746066809.678648:0:4614:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7278b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.678671:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.678724:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.678966:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977389312 00000100:00100000:3.0:1746066809.678970:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977389312 00000100:00100000:3.0:1746066809.678983:0:21973:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977389440 00000100:00100000:3.0:1746066809.678984:0:21973:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977389440 00000100:00100000:3.0:1746066809.678995:0:21973:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15633 00000100:00100000:3.0:1746066809.678999:0:21973:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977388928:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066809.679014:0:21973:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e800/0xfb36a14ee608e141 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.679023:0:21973:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ff6000/0xfb36a14ee608e076 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe8 expref: 24 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.679028:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.679029:0:21973:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.679030:0:21973:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e800/0xfb36a14ee608e141 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.679047:0:21973:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129ff6000/0xfb36a14ee608e076 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe8 expref: 24 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.679054:0:21973:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129ff6000/0xfb36a14ee608e076 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe8 expref: 24 pid: 4614 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746066809.679061:0:21973:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882977020288:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066809.679087:0:21973:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d7d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066809.679098:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15634 00000100:00100000:3.0:1746066809.679102:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977389312:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066809.679114:0:8112:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e600/0xfb36a14ee608e148 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.679122:0:8112:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608e08b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fffd expref: 24 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.679126:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.679127:0:8112:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.679129:0:8112:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e600/0xfb36a14ee608e148 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.679139:0:8112:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608e08b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fffd expref: 24 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.679145:0:8112:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608e08b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fffd expref: 24 pid: 8452 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746066809.679152:0:8112:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882977020416:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066809.679164:0:8112:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d7d840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066809.679172:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15635 00000100:00100000:3.0:1746066809.679175:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977389440:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:3.0:1746066809.679184:0:21203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f1fa400/0xfb36a14ee608e14f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.679192:0:21203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d0d3800/0xfb36a14ee608e0fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980058 expref: 24 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.679196:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.679197:0:21203:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.679198:0:21203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1fa400/0xfb36a14ee608e14f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.679208:0:21203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d0d3800/0xfb36a14ee608e0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980058 expref: 24 pid: 9776 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.679214:0:21203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d0d3800/0xfb36a14ee608e0fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980058 expref: 24 pid: 9776 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746066809.679219:0:21203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882977020544:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066809.679230:0:21203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066809.681563:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.682022:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.682074:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977389696 00000100:00100000:3.0:1746066809.682079:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977389696 00010000:00010000:3.0:1746066809.682102:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0d2600/0xfb36a14ee608e0f4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980051 expref: 16 pid: 9776 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746066809.682122:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8107 00000100:00100000:3.0:1746066809.682127:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1963:x1830882977389696:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066809.682138:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066809.682154:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d0d2600/0xfb36a14ee608e0f4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980051 expref: 16 pid: 9776 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746066809.682162:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d0d2600/0xfb36a14ee608e0f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980051 expref: 16 pid: 9776 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746066809.682180:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.682181:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.682185:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e13a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.682192:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e13a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.682204:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066809.682229:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1963:x1830882977389696:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 102us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.682234:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8107 00000100:00100000:2.0:1746066809.682593:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977389568 00000100:00100000:2.0:1746066809.682597:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977389568 00000100:00100000:2.0:1746066809.682618:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15636 00000100:00100000:2.0:1746066809.682622:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1963:x1830882977389568:12345-192.168.202.57@tcp:1:lfs.0 00010000:00010000:2.0:1746066809.682647:0:8450:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135430000/0xfb36a14ee608e156 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.682658:0:8450:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135430600/0xfb36a14ee608e102 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98005f expref: 16 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066809.682663:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.682664:0:8450:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.682667:0:8450:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135430000/0xfb36a14ee608e156 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.682706:0:8450:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135430600/0xfb36a14ee608e102 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98005f expref: 16 pid: 21973 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066809.682715:0:8450:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135430600/0xfb36a14ee608e102 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98005f expref: 16 pid: 21973 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746066809.682725:0:8450:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882977020672:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066809.682771:0:8450:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4191300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066809.682881:0:20532:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20532:1830882977020032:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066809.682897:0:20532:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e133 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.683194:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d0d2600/0xfb36a14ee608e0f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980051 expref: 16 pid: 9776 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746066809.683210:0:4614:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a0d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4614:1830882977020160:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066809.683219:0:4614:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e13a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.683227:0:4614:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e13a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.683236:0:4614:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e13a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.683253:0:4614:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e13a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.683260:0:4614:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e13a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.683266:0:4614:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e13a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.683271:0:4614:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093ae6800 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066809.683274:0:4614:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e13a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.683281:0:4614:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e13a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.683290:0:4614:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e13a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.683296:0:4614:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ae6800/0xfb36a14ee608e13a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.683332:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1963:x1830882977389184:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 4769us (5352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.683338:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15632 00000100:00100000:0.0:1746066809.683392:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.683424:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977389824 00000100:00100000:3.0:1746066809.683428:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977389824 00010000:00010000:3.0:1746066809.683440:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d0d3400/0xfb36a14ee608e0ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98004a expref: 15 pid: 9776 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746066809.683465:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8108 00000100:00100000:3.0:1746066809.683474:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1965:x1830882977389824:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066809.683480:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066809.683490:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d0d3400/0xfb36a14ee608e0ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98004a expref: 15 pid: 9776 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746066809.683498:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d0d3400/0xfb36a14ee608e0ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98004a expref: 15 pid: 9776 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746066809.683509:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d0d3400/0xfb36a14ee608e0ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98004a expref: 15 pid: 9776 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746066809.683520:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.683521:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.683524:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e133 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.683530:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e133 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.683552:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066809.683569:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1965:x1830882977389824:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 95us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.683574:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8108 00010000:00010000:0.0:1746066809.684047:0:20532:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e133 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.684088:0:20532:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e133 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.684134:0:20532:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e133 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.684140:0:20532:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e133 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.684146:0:20532:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e133 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.684150:0:20532:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129ff6200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066809.684153:0:20532:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e133 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.684159:0:20532:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e133 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.684167:0:20532:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e133 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.684178:0:20532:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129ff6200/0xfb36a14ee608e133 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20532 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.684218:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+13:1963:x1830882977389056:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 5851us (6347us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.684224:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15631 00000100:00100000:3.0:1746066809.685087:0:21973:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:21973:1830882977020288:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066809.685116:0:21973:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e800/0xfb36a14ee608e141 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066809.685716:0:8112:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:8112:1830882977020416:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066809.685727:0:8112:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e600/0xfb36a14ee608e148 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066809.685905:0:21203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21203:1830882977020544:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066809.685916:0:21203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f1fa400/0xfb36a14ee608e14f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.686408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.686439:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.686487:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.686559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066809.686579:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977390080 00000100:00100000:2.0:1746066809.686594:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977390080 00010000:00010000:2.0:1746066809.686616:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608e08b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fffd expref: 25 pid: 8452 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746066809.686617:0:21351:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977389952 00000100:00100000:1.0:1746066809.686620:0:21351:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977389952 00010000:00010000:1.0:1746066809.686632:0:21351:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129ff6000/0xfb36a14ee608e076 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe8 expref: 26 pid: 4614 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746066809.686695:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977390336 00000100:00100000:2.0:1746066809.686698:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977390336 00000100:00100000:0.0:1746066809.686744:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977390208 00000100:00100000:0.0:1746066809.686748:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977390208 00000100:00100000:1.0:1746066809.686759:0:21351:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8109 00010000:00010000:0.0:1746066809.686763:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d0d3800/0xfb36a14ee608e0fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980058 expref: 27 pid: 9776 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746066809.686766:0:21351:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1963:x1830882977390080:12345-192.168.202.57@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066809.686775:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8110 00010000:00010000:1.0:1746066809.686777:0:21351:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066809.686780:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+27:1966:x1830882977389952:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066809.686785:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066809.686795:0:21351:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608e08b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fffd expref: 27 pid: 8452 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746066809.686796:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129ff6000/0xfb36a14ee608e076 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe8 expref: 27 pid: 4614 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746066809.686803:0:21351:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608e08b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fffd expref: 27 pid: 8452 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746066809.686804:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129ff6000/0xfb36a14ee608e076 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe8 expref: 27 pid: 4614 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746066809.686820:0:21351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129ff6800/0xfb36a14ee608e08b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fffd expref: 27 pid: 8452 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746066809.686820:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129ff6000/0xfb36a14ee608e076 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c97ffe8 expref: 27 pid: 4614 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746066809.686832:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.686834:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.686834:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066809.686835:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8111 00010000:00010000:1.0:1746066809.686836:0:21351:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.686837:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e800/0xfb36a14ee608e141 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.686838:0:21351:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e600/0xfb36a14ee608e148 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.686845:0:21351:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e600/0xfb36a14ee608e148 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066809.686855:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1966:x1830882977390208:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066809.686860:0:21351:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066809.686862:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066809.686871:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d0d3800/0xfb36a14ee608e0fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980058 expref: 25 pid: 9776 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746066809.686878:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d0d3800/0xfb36a14ee608e0fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980058 expref: 25 pid: 9776 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746066809.686885:0:21351:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977390080:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 120us (478us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066809.686888:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d0d3800/0xfb36a14ee608e0fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980058 expref: 25 pid: 9776 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746066809.686890:0:21351:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8109 00010000:00010000:3.0:1746066809.686897:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.686898:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.686900:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f1fa400/0xfb36a14ee608e14f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.686905:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1fa400/0xfb36a14ee608e14f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.686920:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066809.686936:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1966:x1830882977390208:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 95us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.686942:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8111 00010000:00010000:3.0:1746066809.686960:0:8112:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e600/0xfb36a14ee608e148 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.686966:0:8112:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e600/0xfb36a14ee608e148 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.686982:0:8112:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e600/0xfb36a14ee608e148 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.686988:0:8112:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e600/0xfb36a14ee608e148 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.686994:0:8112:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e600/0xfb36a14ee608e148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.686999:0:8112:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1e600 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066809.687002:0:8112:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e600/0xfb36a14ee608e148 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.687008:0:8112:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e600/0xfb36a14ee608e148 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.687020:0:8112:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e600/0xfb36a14ee608e148 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.687025:0:8112:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e600/0xfb36a14ee608e148 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.687079:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135430600/0xfb36a14ee608e102 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98005f expref: 13 pid: 21973 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746066809.687083:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e800/0xfb36a14ee608e141 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066809.687094:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8112 00000100:00100000:2.0:1746066809.687099:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+13:1965:x1830882977390336:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066809.687099:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066809.687105:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066809.687114:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1966:x1830882977389952:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 333us (675us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066809.687116:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135430600/0xfb36a14ee608e102 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98005f expref: 13 pid: 21973 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746066809.687120:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8110 00010000:00010000:2.0:1746066809.687123:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135430600/0xfb36a14ee608e102 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98005f expref: 13 pid: 21973 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746066809.687134:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.687135:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.687137:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135430000/0xfb36a14ee608e156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.687143:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135430000/0xfb36a14ee608e156 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.687153:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066809.687156:0:21973:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e800/0xfb36a14ee608e141 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.687163:0:21973:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e800/0xfb36a14ee608e141 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066809.687168:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+13:1965:x1830882977390336:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 69us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066809.687174:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8112 00010000:00010000:0.0:1746066809.687174:0:21973:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e800/0xfb36a14ee608e141 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.687180:0:21973:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e800/0xfb36a14ee608e141 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.687186:0:21973:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e800/0xfb36a14ee608e141 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.687195:0:21973:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1e800 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:0.0:1746066809.687198:0:21973:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e800/0xfb36a14ee608e141 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.687199:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135430600/0xfb36a14ee608e102 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98005f expref: 12 pid: 21973 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746066809.687203:0:21973:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e800/0xfb36a14ee608e141 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066809.687210:0:8450:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8450:1830882977020672:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066809.687211:0:21973:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e800/0xfb36a14ee608e141 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.687216:0:21973:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1e800/0xfb36a14ee608e141 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21973 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.687220:0:8450:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135430000/0xfb36a14ee608e156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.687225:0:8450:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135430000/0xfb36a14ee608e156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.687234:0:8450:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135430000/0xfb36a14ee608e156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.687245:0:8450:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135430000/0xfb36a14ee608e156 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.687245:0:21973:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882977388928:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 8246us (9409us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066809.687251:0:8450:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135430000/0xfb36a14ee608e156 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.687251:0:21973:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15633 00010000:00010000:2.0:1746066809.687257:0:8450:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135430000/0xfb36a14ee608e156 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.687262:0:8450:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135430000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066809.687264:0:8450:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135430000/0xfb36a14ee608e156 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.687270:0:8450:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135430000/0xfb36a14ee608e156 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.687278:0:8450:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135430000/0xfb36a14ee608e156 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.687283:0:8450:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135430000/0xfb36a14ee608e156 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066809.687354:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977389312:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 8250us (8680us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.687360:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15634 00010000:00010000:3.0:1746066809.687401:0:21203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f1fa400/0xfb36a14ee608e14f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.687408:0:21203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f1fa400/0xfb36a14ee608e14f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.687419:0:21203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f1fa400/0xfb36a14ee608e14f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.687425:0:21203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f1fa400/0xfb36a14ee608e14f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.687431:0:21203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f1fa400/0xfb36a14ee608e14f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.687436:0:21203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f1fa400 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066809.687438:0:21203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f1fa400/0xfb36a14ee608e14f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.687450:0:21203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f1fa400/0xfb36a14ee608e14f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.687466:0:21203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f1fa400/0xfb36a14ee608e14f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.687471:0:21203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f1fa400/0xfb36a14ee608e14f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21203 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066809.687492:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+11:1963:x1830882977389568:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 4868us (5934us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.687493:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1963:x1830882977389440:12345-192.168.202.57@tcp:1:lfs.0 Request processed in 8318us (8769us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066809.687497:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15636 00000100:00100000:3.0:1746066809.687506:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15635 00000100:00100000:3.0:1746066809.692231:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.692444:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977390592 00000100:00100000:0.0:1746066809.692451:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977390592 00000100:00100000:2.0:1746066809.693008:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10224 00000100:00100000:2.0:1746066809.693017:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+268:32161:x1830882977390592:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:2.0:1746066809.693056:0:20127:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746066809.693076:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e4e00/0xfb36a14ee608debd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fede expref: 268 pid: 14550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.693091:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135430800/0xfb36a14ee608dd04 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fddb expref: 267 pid: 809 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.693101:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130f35800/0xfb36a14ee608dd12 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c97fde9 expref: 266 pid: 14549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.693109:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066809.693113:0:20127:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066809.693134:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135431200/0xfb36a14ee608e15d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066809.693143:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135431200/0xfb36a14ee608e15d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066809.693150:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135431200/0xfb36a14ee608e15d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000040:00080000:2.0:1746066809.693784:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3234, 88 off273856 00000004:00080000:2.0:1746066809.693791:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770871114604ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.693838:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3235, 88 off273856 00000004:00080000:2.0:1746066809.693843:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770871166701ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066809.693866:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3236, 88 off273944 00000004:00080000:2.0:1746066809.693870:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770871193558ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066809.693877:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3235, 88 off273944 00000004:00080000:2.0:1746066809.693879:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770871203244ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.693885:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3236, 88 off274032 00000004:00080000:2.0:1746066809.693887:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770871211305ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.693894:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3237, 88 off274032 00000004:00080000:2.0:1746066809.693896:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770871219989ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066809.693902:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3238, 88 off274120 00000004:00080000:2.0:1746066809.693904:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770871227818ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066809.693909:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3239, 88 off274208 00000004:00080000:2.0:1746066809.693911:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770871235420ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066809.693917:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3237, 88 off274120 00000004:00080000:2.0:1746066809.693920:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770871244195ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.693927:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3240, 88 off274296 00000004:00080000:2.0:1746066809.693929:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770871252993ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066809.693935:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3238, 88 off274208 00000004:00080000:2.0:1746066809.693937:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770871261255ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.693943:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3241, 88 off274384 00000004:00080000:2.0:1746066809.693945:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770871269135ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066809.693951:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3239, 88 off274296 00000004:00080000:2.0:1746066809.693953:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770871276848ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.693959:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3240, 88 off274384 00000004:00080000:2.0:1746066809.693961:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770871285321ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.693967:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3241, 88 off274472 00000004:00080000:2.0:1746066809.693969:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770871293241ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.693975:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3242, 88 off274560 00000004:00080000:2.0:1746066809.693978:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770871301654ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.693983:0:20127:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3242, 88 off274472 00000004:00080000:2.0:1746066809.693985:0:20127:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770871309440ns, next at 749511475809ns, rc = 0 00000001:00080000:1.0:1746066809.724958:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944311 is committed 00000001:00080000:1.0:1746066809.724972:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944304 is committed 00000001:00080000:1.0:1746066809.724980:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944290 is committed 00000001:00080000:1.0:1746066809.724984:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944299 is committed 00000001:00080000:1.0:1746066809.724993:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944321 is committed 00000004:00080000:1.0:1746066809.724997:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2515 committed 00000004:00080000:1.0:1746066809.725003:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2514 committed 00000004:00080000:1.0:1746066809.725008:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2513 committed 00000004:00080000:1.0:1746066809.725009:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2512 committed 00000004:00080000:1.0:1746066809.725010:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2511 committed 00000004:00080000:1.0:1746066809.725011:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2514 committed 00000004:00080000:1.0:1746066809.725013:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2510 committed 00000004:00080000:1.0:1746066809.725014:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2513 committed 00000004:00080000:1.0:1746066809.725015:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2509 committed 00000004:00080000:1.0:1746066809.725017:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2512 committed 00000004:00080000:1.0:1746066809.725019:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2511 committed 00000004:00080000:1.0:1746066809.725020:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2510 committed 00000004:00080000:1.0:1746066809.725021:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2508 committed 00000004:00080000:1.0:1746066809.725022:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2507 committed 00000004:00080000:1.0:1746066809.725024:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2509 committed 00000004:00080000:1.0:1746066809.725025:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2508 committed 00000004:00080000:1.0:1746066809.725026:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2506 committed 00000001:00080000:1.0:1746066809.725033:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944310 is committed 00000001:00100000:1.0:1746066809.725050:0:14626:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f09a0c46-01bd-4197-bc90-17b6ceef920b 00000001:00080000:1.0:1746066809.725053:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944317 is committed 00000001:00100000:1.0:1746066809.725055:0:14626:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fc98f875-2edf-4505-a13a-65f96879556b 00000001:00080000:1.0:1746066809.725058:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944316 is committed 00000020:00000080:1.0:1746066809.725074:0:14626:0:(genops.c:904:class_export_put()) final put ffff88013599c800/f09a0c46-01bd-4197-bc90-17b6ceef920b 00000020:00000080:1.0:1746066809.725083:0:14626:0:(genops.c:904:class_export_put()) final put ffff88013599a800/fc98f875-2edf-4505-a13a-65f96879556b 00000020:00000080:1.0:1746066809.725156:0:292:0:(genops.c:863:class_export_destroy()) destroying export ffff88013599c800/f09a0c46-01bd-4197-bc90-17b6ceef920b for lustre-MDT0000 00000020:00000080:1.0:1746066809.725190:0:292:0:(genops.c:863:class_export_destroy()) destroying export ffff88013599a800/fc98f875-2edf-4505-a13a-65f96879556b for lustre-MDT0000 00000020:00000080:1.0:1746066809.725208:0:292:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88013599d800 for lustre-MDT0000 00000020:00000080:1.0:1746066809.725212:0:292:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880135999800 for lustre-MDT0000 00000100:00100000:1.0:1746066809.725224:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977020800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.725268:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066809.725301:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977021312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.725311:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066809.725324:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746066809.725327:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977021184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.725336:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066809.725343:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977021696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.725352:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066809.725364:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977020928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.725374:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066809.725381:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977021440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.725390:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066809.725397:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746066809.725400:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977021056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.725410:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066809.725417:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ec2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977021568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.725425:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066809.725441:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977020800 00000100:00100000:1.0:1746066809.725445:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977020800 00000100:00100000:1.0:1746066809.725489:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977021312 00000100:00100000:1.0:1746066809.725491:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977021312 00000100:00100000:1.0:1746066809.725499:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977021184 00000100:00100000:1.0:1746066809.725501:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977021184 00000100:00100000:1.0:1746066809.725506:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977021696 00000100:00100000:1.0:1746066809.725507:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977021696 00000100:00100000:1.0:1746066809.725512:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977020928 00000100:00100000:1.0:1746066809.725514:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977020928 00000100:00100000:1.0:1746066809.725519:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977021440 00000100:00100000:1.0:1746066809.725520:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977021440 00000100:00100000:1.0:1746066809.725525:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977021056 00000100:00100000:1.0:1746066809.725527:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977021056 00000100:00100000:1.0:1746066809.725533:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977021568 00000100:00100000:1.0:1746066809.725535:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977021568 00000100:00100000:1.0:1746066809.725543:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15637 00000100:00100000:1.0:1746066809.725548:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3296:x1830882977020800:12345-0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746066809.725554:0:20127:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009e8c7100 reply state ffff88012cac0000 transno 8589944321 ns: mdt-lustre-MDT0000_UUID lock: ffff880135431200/0xfb36a14ee608e15d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000100:00100000:3.0:1746066809.725561:0:20127:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746066809.725622:0:20127:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746066809.725633:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:32161:x1830882977390592:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 32616us (33408us total) trans 8589944321 rc 0/0 00000100:00100000:3.0:1746066809.725639:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10224 00000100:00100000:3.0:1746066809.725731:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977022080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066809.725742:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3296:x1830882977020800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (474us total) trans 21474841103 rc 0/0 00000100:00100000:3.0:1746066809.725747:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066809.725747:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15637 00000100:00100000:1.0:1746066809.725755:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977022080 00000100:00100000:1.0:1746066809.725757:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977022080 00000100:00100000:3.0:1746066809.725766:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977022592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066809.725770:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15638 00000100:00100000:1.0:1746066809.725773:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3296:x1830882977021312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066809.725779:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066809.725786:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746066809.725790:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977021952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066809.725802:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066809.725808:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977022464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066809.725818:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066809.725830:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977022592 00000100:00100000:3.0:1746066809.725832:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977022592 00000100:00100000:3.0:1746066809.725842:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977021952 00000100:00100000:3.0:1746066809.725844:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977021952 00000100:00100000:1.0:1746066809.725847:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3296:x1830882977021312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (534us total) trans 21474841104 rc 0/0 00000100:00100000:3.0:1746066809.725849:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977022464 00000100:00100000:3.0:1746066809.725850:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977022464 00000100:00100000:1.0:1746066809.725851:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15638 00000100:00100000:3.0:1746066809.725857:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15639 00000100:00100000:1.0:1746066809.725859:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15640 00000100:00100000:3.0:1746066809.725861:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3296:x1830882977021184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.725863:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3296:x1830882977021696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.725948:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3296:x1830882977021696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (595us total) trans 21474841105 rc 0/0 00000100:00100000:1.0:1746066809.725953:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15640 00000100:00100000:1.0:1746066809.725961:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15641 00000100:00100000:1.0:1746066809.725965:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3293:x1830882977020928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.726048:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3293:x1830882977020928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (672us total) trans 21474841106 rc 0/0 00000100:00100000:1.0:1746066809.726052:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15641 00000100:00100000:1.0:1746066809.726061:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15642 00000100:00100000:1.0:1746066809.726065:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3293:x1830882977021440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.726134:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3293:x1830882977021440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (742us total) trans 21474841107 rc 0/0 00000100:00100000:1.0:1746066809.726139:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15642 00000100:00100000:1.0:1746066809.726147:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15643 00000100:00100000:1.0:1746066809.726151:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800992af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3293:x1830882977021056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066809.726206:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15644 00000100:00100000:3.0:1746066809.726211:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3293:x1830882977021568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066809.726226:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800992af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3293:x1830882977021056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (814us total) trans 21474841108 rc 0/0 00000100:00100000:1.0:1746066809.726230:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15643 00000100:00100000:1.0:1746066809.726238:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15645 00000100:00100000:1.0:1746066809.726242:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3294:x1830882977022080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066809.726286:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3293:x1830882977021568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (859us total) trans 21474841109 rc 0/0 00000100:00100000:3.0:1746066809.726291:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15644 00000100:00100000:3.0:1746066809.726299:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15646 00000100:00100000:3.0:1746066809.726302:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3294:x1830882977022592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066809.726312:0:10402:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15647 00000100:00100000:3.0:1746066809.726316:0:10402:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3294:x1830882977021952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066809.726353:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3294:x1830882977022080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (604us total) trans 17179873798 rc 0/0 00000100:00100000:1.0:1746066809.726358:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15645 00000100:00100000:1.0:1746066809.726366:0:8450:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15648 00000100:00100000:1.0:1746066809.726369:0:8450:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ef5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3294:x1830882977022464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066809.726410:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746066809.726413:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746066809.726415:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066809.726416:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746066809.726418:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746066809.726436:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3294:x1830882977022592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 133us (656us total) trans 17179873799 rc 0/0 00000100:00100000:1.0:1746066809.726436:0:8450:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3294:x1830882977022464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (617us total) trans 17179873800 rc 0/0 00000100:00100000:1.0:1746066809.726441:0:8450:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15648 00000100:00100000:2.0:1746066809.726449:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15646 00000100:00080000:1.0:1746066809.726475:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746066809.726478:0:7119:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066809.726566:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977022208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066809.726583:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066809.726609:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977022720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.726619:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977022208 00000100:00100000:1.0:1746066809.726623:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.726623:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977022208 00000100:00100000:1.0:1746066809.726634:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066809.726636:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977022720 00000100:00100000:0.0:1746066809.726637:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977022720 00000100:00100000:1.0:1746066809.726638:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977021824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.726646:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15649 00000100:00100000:1.0:1746066809.726650:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.726650:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3295:x1830882977022208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066809.726658:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e8c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977022336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066809.726669:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066809.726701:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977021824 00000100:00100000:1.0:1746066809.726704:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977021824 00000100:00100000:1.0:1746066809.726714:0:9776:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977022336 00000100:00100000:1.0:1746066809.726716:0:9776:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977022336 00000100:00100000:1.0:1746066809.726723:0:9776:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15650 00000100:00100000:1.0:1746066809.726726:0:9776:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3295:x1830882977022720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.726750:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3295:x1830882977022208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (166us total) trans 17179873802 rc 0/0 00000100:00100000:0.0:1746066809.726758:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15649 00000100:00100000:0.0:1746066809.726767:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15651 00000100:00100000:0.0:1746066809.726771:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1830882977021824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.726780:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15652 00000100:00100000:0.0:1746066809.726783:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3295:x1830882977022336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066809.726802:0:9776:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3295:x1830882977022720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (178us total) trans 17179873803 rc 0/0 00000100:00100000:1.0:1746066809.726807:0:9776:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15650 00000100:00100000:3.0:1746066809.726969:0:10402:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ef5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3294:x1830882977021952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 280us (793us total) trans 17179873801 rc 0/0 00000100:00100000:3.0:1746066809.726975:0:10402:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15647 00010000:00010000:3.0:1746066809.726993:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135431200/0xfb36a14ee608e15d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066809.727004:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135431200/0xfb36a14ee608e15d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066809.727009:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135431200/0xfb36a14ee608e15d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066809.727013:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135431200 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066809.727016:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135431200/0xfb36a14ee608e15d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066809.727021:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135431200/0xfb36a14ee608e15d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20127 initiator: MDT0 00010000:00010000:3.0:1746066809.727032:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066809.727035:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066809.727038:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135431200/0xfb36a14ee608e15d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00000100:00100000:0.0:1746066809.727041:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830882977022336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 257us (370us total) trans 17179873804 rc 0/0 00010000:00010000:3.0:1746066809.727042:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135431200/0xfb36a14ee608e15d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20127 initiator: MDT0 00000100:00100000:0.0:1746066809.727047:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15652 00000100:00100000:0.0:1746066809.727071:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873792 gen 2 00000004:00080000:0.0:1746066809.727074:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5bb2680, transno 17179873752 00000004:00080000:0.0:1746066809.727094:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5bb1f80, transno 17179873753 00000004:00080000:0.0:1746066809.727096:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5bb1c00, transno 17179873754 00000004:00080000:0.0:1746066809.727098:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5bb0700, transno 17179873755 00000004:00080000:0.0:1746066809.727100:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e868a80, transno 17179873756 00000004:00080000:0.0:1746066809.727102:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e86a680, transno 17179873757 00000004:00080000:0.0:1746066809.727103:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e86aa00, transno 17179873758 00000004:00080000:0.0:1746066809.727105:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e86b800, transno 17179873759 00000004:00080000:0.0:1746066809.727108:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e869f80, transno 17179873760 00000004:00080000:0.0:1746066809.727109:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e86a300, transno 17179873761 00000004:00080000:0.0:1746066809.727111:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e868000, transno 17179873762 00000004:00080000:0.0:1746066809.727113:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e86b480, transno 17179873763 00000004:00080000:0.0:1746066809.727115:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e86b100, transno 17179873764 00000004:00080000:0.0:1746066809.727117:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e869880, transno 17179873765 00000004:00080000:0.0:1746066809.727119:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e86bb80, transno 17179873766 00000004:00080000:0.0:1746066809.727121:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e868e00, transno 17179873767 00000004:00080000:0.0:1746066809.727123:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e868700, transno 17179873768 00000004:00080000:0.0:1746066809.727125:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092046d80, transno 17179873769 00000004:00080000:0.0:1746066809.727128:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093211f80, transno 17179873775 00000004:00080000:0.0:1746066809.727129:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093213480, transno 17179873776 00000004:00080000:0.0:1746066809.727131:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093210e00, transno 17179873777 00000004:00080000:0.0:1746066809.727133:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093211880, transno 17179873778 00000004:00080000:0.0:1746066809.727134:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093212300, transno 17179873779 00000004:00080000:0.0:1746066809.727137:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093211500, transno 17179873780 00000004:00080000:0.0:1746066809.727139:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093212a00, transno 17179873781 00000004:00080000:0.0:1746066809.727140:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093210700, transno 17179873782 00000004:00080000:0.0:1746066809.727142:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efb7480, transno 17179873783 00000004:00080000:0.0:1746066809.727144:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efb4700, transno 17179873784 00000004:00080000:0.0:1746066809.727146:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efb4a80, transno 17179873785 00000004:00080000:0.0:1746066809.727148:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efb6300, transno 17179873786 00000004:00080000:0.0:1746066809.727150:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efb4e00, transno 17179873787 00000004:00080000:0.0:1746066809.727152:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efb5f80, transno 17179873788 00000004:00080000:0.0:1746066809.727154:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efb4000, transno 17179873789 00000004:00080000:0.0:1746066809.727156:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efb5500, transno 17179873790 00000004:00080000:0.0:1746066809.727157:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efb5180, transno 17179873791 00000004:00080000:0.0:1746066809.727159:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e634e00, transno 17179873792 00000100:00100000:0.0:1746066809.727165:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009e8c7b80 x1830882977022336/t17179873804(17179873804) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066825 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746066809.727173:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c7b80/2, rc 0, transno 17179873804 00000100:00100000:0.0:1746066809.727177:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977022336:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066809.727186:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c6300/2, rc 0, transno 17179873802 00000100:00100000:0.0:1746066809.727189:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977022208:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066809.727194:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c5f80/2, rc 0, transno 17179873803 00000100:00100000:0.0:1746066809.727196:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977022720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.727305:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3295:x1830882977021824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 533us (653us total) trans 17179873805 rc 0/0 00000100:00100000:0.0:1746066809.727311:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15651 00000004:00080000:0.0:1746066809.727328:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c4e00/2, rc 0, transno 17179873805 00000100:00100000:0.0:1746066809.727332:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977021824:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066809.727738:0:14590:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 36 done 00000100:00100000:0.0:1746066809.728126:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746066809.728135:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977022848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.728161:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066809.728271:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841093 gen 2 00000004:00080000:3.0:1746066809.728275:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a45e4a80, transno 21474841057 00000004:00080000:3.0:1746066809.728281:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a45e7100, transno 21474841058 00000004:00080000:3.0:1746066809.728283:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ec2c700, transno 21474841059 00000004:00080000:3.0:1746066809.728285:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a45e5500, transno 21474841060 00000004:00080000:3.0:1746066809.728286:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a45e5c00, transno 21474841061 00000004:00080000:3.0:1746066809.728288:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a45e4380, transno 21474841062 00000004:00080000:3.0:1746066809.728290:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a45e6a00, transno 21474841063 00000004:00080000:3.0:1746066809.728292:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a45e4700, transno 21474841064 00000004:00080000:3.0:1746066809.728294:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921c1180, transno 21474841065 00000004:00080000:3.0:1746066809.728296:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2ea00, transno 21474841066 00000004:00080000:3.0:1746066809.728298:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800921c1c00, transno 21474841067 00000004:00080000:3.0:1746066809.728300:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094128e00, transno 21474841068 00000004:00080000:3.0:1746066809.728302:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092708000, transno 21474841069 00000004:00080000:3.0:1746066809.728304:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009412b480, transno 21474841070 00000004:00080000:3.0:1746066809.728306:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092709180, transno 21474841071 00000004:00080000:3.0:1746066809.728308:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009412a300, transno 21474841072 00000004:00080000:3.0:1746066809.728310:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e637b80, transno 21474841078 00000004:00080000:3.0:1746066809.728311:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093213800, transno 21474841079 00000004:00080000:3.0:1746066809.728313:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e635180, transno 21474841080 00000004:00080000:3.0:1746066809.728315:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093210380, transno 21474841081 00000004:00080000:3.0:1746066809.728317:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e635500, transno 21474841082 00000004:00080000:3.0:1746066809.728318:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093213b80, transno 21474841083 00000004:00080000:3.0:1746066809.728320:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e636300, transno 21474841084 00000004:00080000:3.0:1746066809.728321:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093210000, transno 21474841085 00000004:00080000:3.0:1746066809.728323:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929cc700, transno 21474841086 00000004:00080000:3.0:1746066809.728324:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929cf800, transno 21474841087 00000004:00080000:3.0:1746066809.728326:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929cca80, transno 21474841088 00000004:00080000:3.0:1746066809.728328:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929cfb80, transno 21474841089 00000004:00080000:3.0:1746066809.728329:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929cd500, transno 21474841090 00000004:00080000:3.0:1746066809.728331:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929ced80, transno 21474841091 00000004:00080000:3.0:1746066809.728332:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929ce300, transno 21474841092 00000004:00080000:3.0:1746066809.728334:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800929ce680, transno 21474841093 00000100:00100000:3.0:1746066809.728338:0:3293:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88008c394380 x1830882977021056/t21474841108(21474841108) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066825 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746066809.728345:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c394380/2, rc 0, transno 21474841108 00000100:00100000:3.0:1746066809.728348:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977021056:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066809.728355:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ec2ce00/2, rc 0, transno 21474841109 00000100:00100000:3.0:1746066809.728357:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977021568:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066809.728364:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c396300/2, rc 0, transno 21474841106 00000100:00100000:3.0:1746066809.728366:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977020928:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066809.728371:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ec2dc00/2, rc 0, transno 21474841107 00000100:00100000:3.0:1746066809.728373:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977021440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066809.728438:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ec2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3296:x1830882977021184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2576us (3100us total) trans 21474841110 rc 0/0 00000100:00100000:3.0:1746066809.728443:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15639 00000100:00100000:3.0:1746066809.728545:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977022848 00000100:00100000:3.0:1746066809.728549:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977022848 00000100:00100000:3.0:1746066809.728569:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15653 00000100:00100000:3.0:1746066809.728573:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830882977022848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066809.728666:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3295:x1830882977022848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (504us total) trans 17179873806 rc 0/0 00000100:00100000:3.0:1746066809.728672:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15653 00000004:00080000:3.0:1746066809.728710:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c4700/2, rc 0, transno 17179873801 00000100:00100000:3.0:1746066809.728713:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977021952:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066809.728719:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c7480/2, rc 0, transno 17179873800 00000100:00100000:3.0:1746066809.728722:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977022464:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066809.728727:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c4a80/2, rc 0, transno 17179873798 00000100:00100000:3.0:1746066809.728729:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977022080:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066809.728735:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e8c4380/2, rc 0, transno 17179873799 00000100:00100000:3.0:1746066809.728737:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e8c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1830882977022592:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066809.728753:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e7800/2, rc 0, transno 21474841110 00000100:00100000:3.0:1746066809.728756:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977021184:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066809.728763:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ec2f800/2, rc 0, transno 21474841105 00000100:00100000:3.0:1746066809.728765:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ec2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977021696:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066809.728772:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094128a80/2, rc 0, transno 21474841103 00000100:00100000:3.0:1746066809.728774:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977020800:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066809.728780:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e6680/2, rc 0, transno 21474841104 00000100:00100000:3.0:1746066809.728782:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1830882977021312:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066809.729225:0:14588:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 32 done 00000004:00080000:0.0:1746066809.729320:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8696300/2, rc 0, transno 17179873806 00000100:00100000:0.0:1746066809.729324:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977022848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066809.729549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.729844:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977390720 00000100:00100000:3.0:1746066809.729847:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977390720 00000100:00100000:3.0:1746066809.729870:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10225 00000100:00100000:3.0:1746066809.729875:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:32161:x1830882977390720:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066809.729888:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066809.729901:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e600/0xfb36a14ee608e164 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980074 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.729938:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e600/0xfb36a14ee608e164 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980074 expref: 252 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.729949:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e600/0xfb36a14ee608e164 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980074 expref: 252 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.729963:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066809.729965:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066809.729968:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1e600, rc 0) 00000100:00100000:3.0:1746066809.729992:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:32161:x1830882977390720:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 117us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.729997:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10225 00000100:00100000:0.0:1746066809.733363:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066809.733571:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977390848 00000100:00100000:2.0:1746066809.733578:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977390848 00000100:00100000:2.0:1746066809.733609:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10226 00000100:00100000:2.0:1746066809.733615:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:32161:x1830882977390848:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066809.733628:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066809.733642:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135431e00/0xfb36a14ee608e16b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c98007b expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.733714:0:20127:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135431400/0xfb36a14ee608e172 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066809.733724:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135431400/0xfb36a14ee608e172 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066809.733733:0:20127:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135431400/0xfb36a14ee608e172 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00000004:00200000:2.0:1746066809.733751:0:20127:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x318:0x0]: returning size 9284864 00000004:00200000:2.0:1746066809.733755:0:20127:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746066809.733765:0:20127:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135431400/0xfb36a14ee608e172 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20127 initiator: MDT0 00010000:00010000:2.0:1746066809.733782:0:20127:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135431e00/0xfb36a14ee608e16b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98007b expref: 254 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.733794:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135431400/0xfb36a14ee608e172 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98007b expref: 253 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.733800:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066809.733802:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066809.733805:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135431400, rc 0) 00000100:00100000:2.0:1746066809.733835:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32161:x1830882977390848:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 221us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066809.733841:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10226 00000100:00100000:0.0:1746066809.736396:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066809.737729:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977390976 00000100:00100000:2.0:1746066809.737738:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977390976 00000100:00100000:2.0:1746066809.738243:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15654 00000100:00100000:2.0:1746066809.738251:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+19:1964:x1830882977390976:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066809.738265:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066809.738281:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135430a00/0xfb36a14ee608e179 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980082 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.738295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00002000:00010000:2.0:1746066809.738299:0:4614:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x38e:0x0] initial LVB size: 1048576, mtime: 0x6812dd75, atime: 0x6812dd75, ctime: 0x6812dd75, blocks: 0x801 00010000:00010000:2.0:1746066809.738313:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.738315:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.738322:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135430a00/0xfb36a14ee608e179 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980082 expref: 20 pid: 4614 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066809.738330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00010000:00010000:2.0:1746066809.738339:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135430a00/0xfb36a14ee608e179 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980082 expref: 20 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066809.738348:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135430a00, rc 0) 00000100:00100000:3.0:1746066809.738534:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977391232 00000100:00100000:3.0:1746066809.738537:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977391232 00000100:00100000:3.0:1746066809.738555:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977391104 00000100:00100000:3.0:1746066809.738557:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977391104 00000100:00100000:3.0:1746066809.738815:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15655 00000100:00100000:3.0:1746066809.738821:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+12:1964:x1830882977391232:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066809.738828:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066809.738837:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130edcc00/0xfb36a14ee608e180 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980090 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066809.738851:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38e:0x0] initial LVB size: 2097152, mtime: 0x6812dd77, atime: 0x6812dd73, ctime: 0x6812dd77, blocks: 0x81f 00010000:00010000:3.0:1746066809.738859:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.738861:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.738865:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130edcc00/0xfb36a14ee608e180 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980090 expref: 13 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.738874:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130edcc00/0xfb36a14ee608e180 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980090 expref: 13 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.738880:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130edcc00, rc 0) 00000100:00100000:3.0:1746066809.738911:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+13:1964:x1830882977391232:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 91us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.738917:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15655 00000100:00100000:3.0:1746066809.738928:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15656 00000100:00100000:3.0:1746066809.738932:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+12:1963:x1830882977391104:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066809.738936:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066809.738942:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130edd000/0xfb36a14ee608e187 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980089 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066809.738950:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38d:0x0] initial LVB size: 2097152, mtime: 0x6812dd77, atime: 0x6812dd75, ctime: 0x6812dd77, blocks: 0x821 00010000:00010000:3.0:1746066809.738957:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.738958:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.738961:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130edd000/0xfb36a14ee608e187 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980089 expref: 13 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.738968:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130edd000/0xfb36a14ee608e187 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980089 expref: 13 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.738973:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130edd000, rc 0) 00000100:00100000:3.0:1746066809.738983:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+13:1963:x1830882977391104:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 51us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.738987:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15656 00000100:00100000:2.0:1746066809.739132:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977390976:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 882us (2743us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066809.739137:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15654 00000100:00100000:0.0:1746066809.739632:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.739668:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066809.739775:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977391488 00000100:00100000:2.0:1746066809.739778:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977391488 00000100:00100000:2.0:1746066809.739794:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977391360 00000100:00100000:2.0:1746066809.739796:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977391360 00000100:00100000:2.0:1746066809.739805:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15657 00000100:00100000:2.0:1746066809.739809:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1964:x1830882977391488:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066809.739816:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066809.739824:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608e18e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c98009e expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066809.739835:0:4614:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x391:0x0] initial LVB size: 5090560, mtime: 0x6812dd77, atime: 0x6812dd77, ctime: 0x6812dd77, blocks: 0x171f 00010000:00010000:2.0:1746066809.739842:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.739844:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.739848:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608e18e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98009e expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066809.739856:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608e18e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98009e expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066809.739866:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135430e00, rc 0) 00000100:00100000:2.0:1746066809.739882:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1964:x1830882977391488:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 72us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066809.739885:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15657 00000100:00100000:2.0:1746066809.739894:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15658 00000100:00100000:2.0:1746066809.739899:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+21:1963:x1830882977391360:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066809.739904:0:4614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066809.739909:0:4614:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135431000/0xfb36a14ee608e195 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c980097 expref: -99 pid: 4614 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066809.739919:0:4614:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x390:0x0] initial LVB size: 2097152, mtime: 0x6812dd76, atime: 0x6812dd76, ctime: 0x6812dd76, blocks: 0x821 00010000:00010000:2.0:1746066809.739925:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.739926:0:4614:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.739930:0:4614:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135431000/0xfb36a14ee608e195 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980097 expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066809.739937:0:4614:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135431000/0xfb36a14ee608e195 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980097 expref: 22 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066809.739944:0:4614:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135431000, rc 0) 00000100:00100000:2.0:1746066809.739957:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977391360:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 59us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066809.739961:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15658 00000100:00100000:2.0:1746066809.741052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.741187:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977391616 00000100:00100000:3.0:1746066809.741191:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977391616 00000100:00100000:3.0:1746066809.741211:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15659 00000100:00100000:3.0:1746066809.741216:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+13:1963:x1830882977391616:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066809.741224:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066809.741232:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608e19c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c9800a5 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066809.741245:0:8452:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x38f:0x0] initial LVB size: 4194304, mtime: 0x6812dd77, atime: 0x6812dd76, ctime: 0x6812dd77, blocks: 0x1029 00010000:00010000:3.0:1746066809.741253:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.741254:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.741259:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608e19c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800a5 expref: 14 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.741272:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608e19c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800a5 expref: 14 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.741279:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130edd600, rc 0) 00000100:00100000:3.0:1746066809.741499:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1963:x1830882977391616:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 281us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.741504:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15659 00000100:00100000:0.0:1746066809.748002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.748084:0:21552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977391872 00000100:00100000:1.0:1746066809.748092:0:21552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977391872 00000100:00100000:1.0:1746066809.749080:0:21552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7145 00000100:00100000:1.0:1746066809.749088:0:21552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977391872:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:1.0:1746066809.749120:0:21552:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1a3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.749132:0:21552:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.749133:0:21552:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.749138:0:21552:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.749149:0:21552:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.753056:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.753568:0:31366:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977392128 00000100:00100000:3.0:1746066809.753576:0:31366:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977392128 00000100:00100000:3.0:1746066809.753627:0:31366:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7146 00000100:00100000:3.0:1746066809.753633:0:31366:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1963:x1830882977392128:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:3.0:1746066809.753660:0:31366:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130edce00/0xfb36a14ee608e1aa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.753672:0:31366:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.753694:0:31366:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.753699:0:31366:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130edce00/0xfb36a14ee608e1aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.753710:0:31366:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130edce00/0xfb36a14ee608e1aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.755764:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.755792:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.755913:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977392384 00000100:00100000:1.0:1746066809.755919:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977392384 00000100:00100000:1.0:1746066809.755953:0:8455:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977392640 00000100:00100000:1.0:1746066809.755955:0:8455:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977392640 00000100:00100000:1.0:1746066809.755970:0:8455:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7147 00000100:00100000:1.0:1746066809.755976:0:8455:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1964:x1830882977392384:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:1.0:1746066809.756000:0:8455:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093ae7800/0xfb36a14ee608e1b1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.756011:0:8455:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.756012:0:8455:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.756016:0:8455:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ae7800/0xfb36a14ee608e1b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.756027:0:8455:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ae7800/0xfb36a14ee608e1b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066809.760117:0:31368:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7148 00000100:00100000:3.0:1746066809.760127:0:31368:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977392640:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:3.0:1746066809.760156:0:31368:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608e1b8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.760168:0:31368:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.760170:0:31368:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.760174:0:31368:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608e1b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.760183:0:31368:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608e1b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.760716:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.761257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066809.761595:0:11692:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977392896 00000100:00100000:2.0:1746066809.761603:0:11692:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977392896 00000100:00100000:2.0:1746066809.761615:0:21551:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977393152 00000100:00100000:2.0:1746066809.761617:0:21551:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977393152 00000100:00100000:2.0:1746066809.761654:0:21551:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7149 00000100:00100000:2.0:1746066809.761660:0:21551:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1963:x1830882977393152:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:2.0:1746066809.761693:0:21551:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135431e00/0xfb36a14ee608e1bf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.761704:0:21551:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.761705:0:21551:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.761708:0:21551:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135431e00/0xfb36a14ee608e1bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.761718:0:21551:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135431e00/0xfb36a14ee608e1bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.762352:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.762366:0:8456:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977393536 00000100:00100000:0.0:1746066809.762369:0:8456:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977393536 00000100:00100000:0.0:1746066809.762386:0:8456:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7150 00000100:00100000:0.0:1746066809.762390:0:8456:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977393536:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:0.0:1746066809.762406:0:8456:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f208e00/0xfb36a14ee608e1c6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.762412:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.762413:0:8456:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.762416:0:8456:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f208e00/0xfb36a14ee608e1c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.762423:0:8456:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f208e00/0xfb36a14ee608e1c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066809.762921:0:21550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7151 00000100:00100000:2.0:1746066809.762925:0:21550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1963:x1830882977392896:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:2.0:1746066809.762935:0:21550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135431200/0xfb36a14ee608e1cd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.762941:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.762942:0:21550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.762945:0:21550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135431200/0xfb36a14ee608e1cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.762951:0:21550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135431200/0xfb36a14ee608e1cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.763540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.764599:0:31367:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977393664 00000100:00100000:0.0:1746066809.764606:0:31367:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977393664 00000100:00100000:0.0:1746066809.764650:0:31367:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 7152 00000100:00100000:0.0:1746066809.764656:0:31367:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1963:x1830882977393664:12345-192.168.202.57@tcp:3:lfs.0 00010000:00010000:0.0:1746066809.764689:0:31367:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8801363f2e00/0xfb36a14ee608e1d4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.764698:0:31367:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.764699:0:31367:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066809.764703:0:31367:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363f2e00/0xfb36a14ee608e1d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.765867:0:31367:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801363f2e00/0xfb36a14ee608e1d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.772248:0:21552:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.772263:0:21552:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.772272:0:21552:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.772278:0:21552:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093ae7c00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066809.772281:0:21552:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.772287:0:21552:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.772303:0:21552:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.772309:0:21552:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21552 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.772399:0:21552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:373f5662-4306-4ad8-af4e-c6b3fb29aadc+28:1963:x1830882977391872:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 23308us (24401us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066809.772409:0:21552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7145 00010000:00010000:1.0:1746066809.776202:0:8455:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093ae7800/0xfb36a14ee608e1b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.776215:0:8455:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093ae7800/0xfb36a14ee608e1b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.776222:0:8455:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093ae7800/0xfb36a14ee608e1b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.776231:0:8455:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093ae7800 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:1.0:1746066809.776234:0:8455:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093ae7800/0xfb36a14ee608e1b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.776240:0:8455:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093ae7800/0xfb36a14ee608e1b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.776254:0:8455:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093ae7800/0xfb36a14ee608e1b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.776259:0:8455:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ae7800/0xfb36a14ee608e1b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.776316:0:8455:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:373f5662-4306-4ad8-af4e-c6b3fb29aadc+20:1964:x1830882977392384:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 20336us (20553us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066809.776323:0:8455:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7147 00010000:00010000:3.0:1746066809.781907:0:31366:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130edce00/0xfb36a14ee608e1aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.781920:0:31366:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130edce00/0xfb36a14ee608e1aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.781927:0:31366:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130edce00/0xfb36a14ee608e1aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.781933:0:31366:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130edce00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066809.781937:0:31366:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130edce00/0xfb36a14ee608e1aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.781944:0:31366:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130edce00/0xfb36a14ee608e1aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.781960:0:31366:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130edce00/0xfb36a14ee608e1aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.781965:0:31366:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130edce00/0xfb36a14ee608e1aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31366 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066809.782060:0:31366:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+18:1963:x1830882977392128:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 28421us (29004us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066809.782071:0:31366:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7146 00010000:00010000:3.0:1746066809.789099:0:21551:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135431e00/0xfb36a14ee608e1bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.789113:0:21551:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135431e00/0xfb36a14ee608e1bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.789120:0:21551:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135431e00/0xfb36a14ee608e1bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.789126:0:21551:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135431e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066809.789129:0:21551:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135431e00/0xfb36a14ee608e1bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.789135:0:21551:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135431e00/0xfb36a14ee608e1bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.789150:0:21551:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135431e00/0xfb36a14ee608e1bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.789155:0:21551:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135431e00/0xfb36a14ee608e1bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21551 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066809.789224:0:21551:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1963:x1830882977393152:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 27560us (27963us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066809.789234:0:21551:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7149 00010000:00010000:2.0:1746066809.793715:0:8456:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f208e00/0xfb36a14ee608e1c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.793729:0:8456:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f208e00/0xfb36a14ee608e1c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.793736:0:8456:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f208e00/0xfb36a14ee608e1c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.793742:0:8456:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f208e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066809.793745:0:8456:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f208e00/0xfb36a14ee608e1c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.793753:0:8456:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f208e00/0xfb36a14ee608e1c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.793769:0:8456:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f208e00/0xfb36a14ee608e1c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.793775:0:8456:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f208e00/0xfb36a14ee608e1c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066809.794285:0:8456:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+26:1964:x1830882977393536:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 31889us (31929us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066809.794294:0:8456:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7150 00010000:00010000:2.0:1746066809.797882:0:21550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135431200/0xfb36a14ee608e1cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.797897:0:21550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135431200/0xfb36a14ee608e1cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.797904:0:21550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135431200/0xfb36a14ee608e1cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.797909:0:21550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135431200 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066809.797913:0:21550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135431200/0xfb36a14ee608e1cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.797926:0:21550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135431200/0xfb36a14ee608e1cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.797943:0:21550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135431200/0xfb36a14ee608e1cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.797949:0:21550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135431200/0xfb36a14ee608e1cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066809.798027:0:21550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977392896:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 35096us (37306us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066809.798036:0:21550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7151 00010000:00010000:2.0:1746066809.802926:0:31367:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8801363f2e00/0xfb36a14ee608e1d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.802939:0:31367:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801363f2e00/0xfb36a14ee608e1d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.802951:0:31367:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801363f2e00/0xfb36a14ee608e1d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.802958:0:31367:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801363f2e00 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:2.0:1746066809.802961:0:31367:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801363f2e00/0xfb36a14ee608e1d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.802967:0:31367:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801363f2e00/0xfb36a14ee608e1d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.802981:0:31367:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801363f2e00/0xfb36a14ee608e1d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.802985:0:31367:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801363f2e00/0xfb36a14ee608e1d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31367 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066809.803040:0:31367:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1963:x1830882977393664:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 38380us (39497us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066809.803048:0:31367:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7152 00010000:00010000:3.0:1746066809.807386:0:31368:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608e1b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.807399:0:31368:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608e1b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.807405:0:31368:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608e1b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.807410:0:31368:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ee1f000 already unused, calling callback (ffffffffa0866d70) 00010000:00010000:3.0:1746066809.807413:0:31368:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608e1b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.807419:0:31368:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608e1b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.807434:0:31368:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608e1b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.807438:0:31368:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1f000/0xfb36a14ee608e1b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31368 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066809.807879:0:31368:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977392640:12345-192.168.202.57@tcp:3:lfs.0 Request processed in 47749us (52080us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066809.807888:0:31368:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 7148 00000100:00100000:0.0:1746066809.814986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066809.815081:0:16018:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977393920 00000100:00100000:2.0:1746066809.815088:0:16018:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977393920 00000100:00100000:2.0:1746066809.815163:0:16018:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10227 00000100:00100000:2.0:1746066809.815170:0:16018:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32161:x1830882977393920:12345-192.168.202.57@tcp:36:lfs.0 00010000:00010000:2.0:1746066809.815210:0:16018:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066809.815230:0:16018:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135431400/0xfb36a14ee608e172 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x318:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98007b expref: 253 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.815262:0:16018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:2.0:1746066809.815265:0:16018:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066809.815295:0:16018:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1db lrc: 3/0,1 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066809.815305:0:16018:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1db lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:2.0:1746066809.815312:0:16018:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1db lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000004:00010000:2.0:1746066809.815449:0:16018:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009e869f80 reply state ffff88009f19a000 transno 8589944322 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1db lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16018 initiator: MDT0 00000100:00100000:2.0:1746066809.815465:0:16018:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746066809.815518:0:16018:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:32161:x1830882977393920:12345-192.168.202.57@tcp:36:lfs.0 Request processed in 348us (644us total) trans 8589944322 rc 0/0 00000100:00100000:2.0:1746066809.815523:0:16018:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10227 00010000:00010000:3.0:1746066809.816763:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1db lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.816773:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1db lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.816779:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1db lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.816788:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ff41600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066809.816791:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1db lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.816796:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1db lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.816806:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066809.816809:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066809.816812:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1db lrc: 2/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00010000:00010000:3.0:1746066809.816817:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1db lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16018 initiator: MDT0 00000100:00100000:0.0:1746066809.817488:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.818170:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977394048 00000100:00100000:3.0:1746066809.818178:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977394048 00000100:00100000:3.0:1746066809.818543:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15660 00000100:00100000:3.0:1746066809.818551:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:32161:x1830882977394048:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066809.818564:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066809.818577:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ea00/0xfb36a14ee608e1e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c9800ac expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.818762:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135430a00/0xfb36a14ee608e179 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980082 expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.818774:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.818775:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.818779:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ea00/0xfb36a14ee608e1e2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800ac expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.818805:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135430a00/0xfb36a14ee608e179 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980082 expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.818815:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135430a00/0xfb36a14ee608e179 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980082 expref: 23 pid: 4614 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746066809.818825:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882977022976:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066809.819046:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.820831:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.820938:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882977022976:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066809.820958:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ea00/0xfb36a14ee608e1e2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800ac expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.820971:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ee1ea00, rc 0) 00000100:00100000:3.0:1746066809.820999:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:32161:x1830882977394048:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2448us (3512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.821006:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15660 00000100:00100000:2.0:1746066809.821067:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977394176 00000100:00100000:2.0:1746066809.821075:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977394176 00010000:00010000:2.0:1746066809.821095:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135430a00/0xfb36a14ee608e179 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980082 expref: 23 pid: 4614 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746066809.821112:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8113 00000100:00100000:2.0:1746066809.821118:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882977394176:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066809.821131:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066809.821148:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135430a00/0xfb36a14ee608e179 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980082 expref: 23 pid: 4614 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746066809.821161:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135430a00/0xfb36a14ee608e179 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980082 expref: 23 pid: 4614 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746066809.821178:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135430a00/0xfb36a14ee608e179 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980082 expref: 23 pid: 4614 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746066809.821551:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.821553:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.821560:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ea00/0xfb36a14ee608e1e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800ac expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.821567:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ea00/0xfb36a14ee608e1e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800ac expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.821590:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee1ea00/0xfb36a14ee608e1e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800ac expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066809.821598:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882977023104:192.168.202.57@tcp:105: 00000100:00100000:2.0:1746066809.821635:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d1de40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066809.823823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.823933:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882977023104:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066809.823948:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066809.823976:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977394176:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2858us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.823988:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8113 00000100:00100000:3.0:1746066809.824016:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977394304 00000100:00100000:3.0:1746066809.824020:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977394304 00000100:00100000:3.0:1746066809.824044:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15661 00000100:00100000:3.0:1746066809.824049:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:32161:x1830882977394304:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:3.0:1746066809.824061:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066809.824073:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135430400/0xfb36a14ee608e1e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c9800b3 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.824310:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130edd000/0xfb36a14ee608e187 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980089 expref: 15 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.824318:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.824319:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.824323:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135430400/0xfb36a14ee608e1e9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800b3 expref: 15 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.824345:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130edd000/0xfb36a14ee608e187 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980089 expref: 15 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066809.824355:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130edd000/0xfb36a14ee608e187 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980089 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746066809.824364:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882977023232:192.168.202.57@tcp:104: 00000100:00100000:3.0:1746066809.824809:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066809.827160:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882977023232:192.168.202.57@tcp:104: 00010000:00010000:3.0:1746066809.827184:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135430400/0xfb36a14ee608e1e9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800b3 expref: 15 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.827197:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135430400, rc 0) 00000100:00100000:3.0:1746066809.827242:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:32161:x1830882977394304:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 3191us (3424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.827249:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15661 00000100:00100000:2.0:1746066809.828069:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.828135:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977394432 00000100:00100000:3.0:1746066809.828141:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977394432 00010000:00010000:3.0:1746066809.828164:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130edd000/0xfb36a14ee608e187 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980089 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746066809.828329:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8114 00000100:00100000:3.0:1746066809.828336:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1964:x1830882977394432:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066809.828346:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066809.828363:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130edd000/0xfb36a14ee608e187 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980089 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746066809.828372:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130edd000/0xfb36a14ee608e187 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980089 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746066809.828391:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130edd000/0xfb36a14ee608e187 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980089 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746066809.828415:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.828416:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.828424:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135430400/0xfb36a14ee608e1e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800b3 expref: 14 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.828432:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135430400/0xfb36a14ee608e1e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800b3 expref: 14 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.828472:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135430400/0xfb36a14ee608e1e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800b3 expref: 14 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066809.828482:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882977023360:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066809.828536:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.830394:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.830487:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882977023360:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066809.830502:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066809.830533:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1964:x1830882977394432:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2196us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.830540:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8114 00000100:00100000:2.0:1746066809.830610:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977394560 00000100:00100000:2.0:1746066809.830614:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977394560 00000100:00100000:2.0:1746066809.830651:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15662 00000100:00100000:2.0:1746066809.830657:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:32161:x1830882977394560:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:2.0:1746066809.830668:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066809.830698:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c9800ba expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.830719:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130edcc00/0xfb36a14ee608e180 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980090 expref: 15 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066809.830726:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.830727:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066809.830730:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1f0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800ba expref: 15 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.830750:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130edcc00/0xfb36a14ee608e180 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980090 expref: 15 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066809.830760:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130edcc00/0xfb36a14ee608e180 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980090 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746066809.830768:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882977023488:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066809.830802:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d1db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.833782:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882977023488:192.168.202.57@tcp:104: 00010000:00010000:0.0:1746066809.833805:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800ba expref: 15 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.833819:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff41600, rc 0) 00000100:00100000:0.0:1746066809.833858:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:32161:x1830882977394560:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 3201us (3469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.833866:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15662 00000100:00100000:0.0:1746066809.834170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.834321:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977394688 00000100:00100000:3.0:1746066809.834327:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977394688 00010000:00010000:3.0:1746066809.834348:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130edcc00/0xfb36a14ee608e180 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980090 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746066809.834379:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8115 00000100:00100000:3.0:1746066809.834385:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1963:x1830882977394688:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066809.834394:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066809.834411:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130edcc00/0xfb36a14ee608e180 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980090 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746066809.834425:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130edcc00/0xfb36a14ee608e180 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980090 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746066809.834443:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130edcc00/0xfb36a14ee608e180 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980090 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746066809.834858:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.834860:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.834867:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800ba expref: 14 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.834874:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800ba expref: 14 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.834899:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff41600/0xfb36a14ee608e1f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800ba expref: 14 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066809.834908:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882977023616:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066809.834964:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066809.836721:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882977023616:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066809.836735:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066809.836760:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1963:x1830882977394688:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2375us (2590us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.836767:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8115 00000100:00100000:0.0:1746066809.836889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.837032:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977394816 00000100:00100000:1.0:1746066809.837036:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977394816 00000100:00100000:1.0:1746066809.837060:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15663 00000100:00100000:1.0:1746066809.837066:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:32161:x1830882977394816:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066809.837079:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.837091:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c9800c1 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.837109:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135431000/0xfb36a14ee608e195 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980097 expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.837119:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.837120:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.837123:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1f7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800c1 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.837142:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135431000/0xfb36a14ee608e195 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980097 expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.837152:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135431000/0xfb36a14ee608e195 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980097 expref: 23 pid: 4614 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746066809.837161:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8694a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882977023744:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066809.837489:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066809.838658:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8694a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882977023744:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066809.838691:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1f7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800c1 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066809.838713:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.838768:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977394944 00000100:00100000:3.0:1746066809.838772:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977394944 00010000:00010000:3.0:1746066809.838788:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135431000/0xfb36a14ee608e195 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980097 expref: 24 pid: 4614 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746066809.838805:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8116 00000100:00100000:3.0:1746066809.838810:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977394944:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066809.838819:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066809.838836:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135431000/0xfb36a14ee608e195 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980097 expref: 24 pid: 4614 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746066809.838845:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135431000/0xfb36a14ee608e195 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980097 expref: 24 pid: 4614 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746066809.838932:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.838933:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135431000/0xfb36a14ee608e195 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980097 expref: 24 pid: 4614 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746066809.838934:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.838938:0:8452:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800c1 expref: 24 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.838945:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800c1 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.838963:0:8452:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093ae7c00/0xfb36a14ee608e1f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800c1 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066809.838972:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8694a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882977023872:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066809.838989:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.839036:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066809.839038:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882977394944:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 227us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.839044:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8116 00000100:00100000:1.0:1746066809.840202:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8694a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882977023872:192.168.202.57@tcp:105: 00010000:00010000:1.0:1746066809.840213:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ae7c00, rc 0) 00000100:00100000:1.0:1746066809.840799:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:32161:x1830882977394816:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 3732us (3909us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.840806:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15663 00000100:00100000:0.0:1746066809.842580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.842728:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977395072 00000100:00100000:1.0:1746066809.842735:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977395072 00000100:00100000:1.0:1746066809.842776:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15664 00000100:00100000:1.0:1746066809.842782:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:32161:x1830882977395072:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066809.842796:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.842809:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ae7600/0xfb36a14ee608e1fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c9800c8 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.842829:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608e18e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98009e expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.842835:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.842836:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.842839:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ae7600/0xfb36a14ee608e1fe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800c8 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.842860:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608e18e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98009e expref: 23 pid: 4614 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.842874:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608e18e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98009e expref: 23 pid: 4614 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746066809.842883:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8694a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882977024000:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066809.842941:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.845039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.845119:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8694a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8452:1830882977024000:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066809.845141:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ae7600/0xfb36a14ee608e1fe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800c8 expref: 23 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.845153:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ae7600, rc 0) 00000100:00100000:1.0:1746066809.845184:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:32161:x1830882977395072:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2403us (2608us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.845191:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15664 00000100:00100000:3.0:1746066809.845528:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977395200 00000100:00100000:3.0:1746066809.845534:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977395200 00010000:00010000:3.0:1746066809.845557:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608e18e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98009e expref: 23 pid: 4614 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746066809.845576:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8117 00000100:00100000:3.0:1746066809.845581:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1963:x1830882977395200:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066809.845595:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066809.845612:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608e18e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98009e expref: 23 pid: 4614 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746066809.845621:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608e18e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98009e expref: 23 pid: 4614 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746066809.845639:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135430e00/0xfb36a14ee608e18e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x391:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c98009e expref: 23 pid: 4614 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746066809.845664:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.845665:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.845671:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ae7600/0xfb36a14ee608e1fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800c8 expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.845706:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ae7600/0xfb36a14ee608e1fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800c8 expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.845729:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093ae7600/0xfb36a14ee608e1fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800c8 expref: 22 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066809.845739:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882977024128:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066809.845797:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.847696:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.847716:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9852:1830882977024128:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066809.847730:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066809.847760:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977395328 00000100:00100000:1.0:1746066809.847764:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977395328 00000100:00100000:3.0:1746066809.847765:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+22:1963:x1830882977395200:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 2184us (2731us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.847773:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8117 00000100:00100000:1.0:1746066809.847908:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15665 00000100:00100000:1.0:1746066809.847915:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:32161:x1830882977395328:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:1.0:1746066809.847928:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066809.847940:0:8452:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ae7e00/0xfb36a14ee608e205 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c9800cf expref: -99 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.847958:0:8452:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608e19c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800a5 expref: 15 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.847969:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.847970:0:8452:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066809.847973:0:8452:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ae7e00/0xfb36a14ee608e205 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800cf expref: 15 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.847993:0:8452:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608e19c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800a5 expref: 15 pid: 8452 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066809.848003:0:8452:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608e19c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800a5 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746066809.848011:0:8452:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8694a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882977024256:192.168.202.57@tcp:104: 00000100:00100000:1.0:1746066809.848053:0:8452:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0ab9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066809.850295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.850369:0:8452:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8694a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8452:1830882977024256:192.168.202.57@tcp:104: 00010000:00010000:1.0:1746066809.850390:0:8452:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ae7e00/0xfb36a14ee608e205 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800cf expref: 15 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066809.850402:0:8452:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ae7e00, rc 0) 00000100:00100000:1.0:1746066809.850432:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:32161:x1830882977395328:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2517us (2759us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066809.850438:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15665 00000100:00100000:3.0:1746066809.850511:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977395456 00000100:00100000:3.0:1746066809.850516:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977395456 00010000:00010000:3.0:1746066809.850536:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608e19c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800a5 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746066809.850565:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8118 00000100:00100000:3.0:1746066809.850570:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1964:x1830882977395456:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066809.850579:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066809.850594:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608e19c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800a5 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746066809.850602:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608e19c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800a5 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746066809.850619:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130edd600/0xfb36a14ee608e19c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x38f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800a5 expref: 15 pid: 8452 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746066809.850829:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.850831:0:9852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066809.850837:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ae7e00/0xfb36a14ee608e205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800cf expref: 14 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.850844:0:9852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ae7e00/0xfb36a14ee608e205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800cf expref: 14 pid: 8452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066809.850865:0:9852:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093ae7e00/0xfb36a14ee608e205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800cf expref: 14 pid: 8452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066809.850874:0:9852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882977024384:192.168.202.57@tcp:105: 00000100:00100000:3.0:1746066809.852111:0:9852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009961b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066809.854634:0:9852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ef5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9852:1830882977024384:192.168.202.57@tcp:105: 00010000:00010000:3.0:1746066809.854651:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066809.854703:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+14:1964:x1830882977395456:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 4131us (4412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.854712:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8118 00000100:00100000:0.0:1746066809.856397:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.856584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.856611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.856629:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977395712 00000100:00100000:0.0:1746066809.856636:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977395712 00000100:00100000:0.0:1746066809.856860:0:8450:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977395584 00000100:00100000:0.0:1746066809.856864:0:8450:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977395584 00000100:00100000:1.0:1746066809.856942:0:8452:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977395840 00000100:00100000:1.0:1746066809.856946:0:8452:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977395840 00000100:00100000:1.0:1746066809.856968:0:8452:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15666 00000100:00100000:1.0:1746066809.856974:0:8452:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1963:x1830882977395712:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:1.0:1746066809.857152:0:8452:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066809.857154:0:8452:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066807 -> 1746066807 00002000:00010000:1.0:1746066809.857156:0:8452:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066805 -> 1746066807 00002000:00010000:1.0:1746066809.857158:0:8452:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066807 -> 1746066809 00002000:00010000:1.0:1746066809.857159:0:8452:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746066809.857193:0:8452:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1963:x1830882977395712:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 218us (908us total) trans 21474841111 rc 0/0 00000100:00100000:1.0:1746066809.857199:0:8452:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15666 00000100:00100000:1.0:1746066809.857225:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.857239:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977396096 00000100:00100000:1.0:1746066809.857242:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977396096 00000100:00100000:1.0:1746066809.857256:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15667 00000100:00100000:1.0:1746066809.857261:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882977395584:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:1.0:1746066809.857345:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066809.857347:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066805 -> 1746066807 00002000:00010000:1.0:1746066809.857349:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066805 -> 1746066807 00002000:00010000:1.0:1746066809.857350:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066805 -> 1746066809 00002000:00010000:1.0:1746066809.857351:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:1.0:1746066809.857367:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977395584:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 105us (783us total) trans 17179873807 rc 0/0 00000100:00100000:1.0:1746066809.857371:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15667 00000100:00100000:1.0:1746066809.857381:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15668 00000100:00100000:1.0:1746066809.857385:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+15:1964:x1830882977395840:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:1.0:1746066809.857441:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066809.857443:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066807 -> 1746066807 00002000:00010000:1.0:1746066809.857445:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066803 -> 1746066807 00002000:00010000:1.0:1746066809.857446:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066807 -> 1746066809 00002000:00010000:1.0:1746066809.857448:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746066809.857474:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1964:x1830882977395840:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 88us (862us total) trans 21474841112 rc 0/0 00000100:00100000:1.0:1746066809.857479:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15668 00000100:00100000:1.0:1746066809.857489:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15669 00000100:00100000:1.0:1746066809.857493:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+23:1964:x1830882977396096:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:1.0:1746066809.857545:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:1.0:1746066809.857547:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066807 -> 1746066807 00002000:00010000:1.0:1746066809.857548:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066807 -> 1746066807 00002000:00010000:1.0:1746066809.857550:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066807 -> 1746066809 00002000:00010000:1.0:1746066809.857552:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5919 -> 5919 00000100:00100000:1.0:1746066809.857566:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1964:x1830882977396096:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 73us (340us total) trans 17179873808 rc 0/0 00000100:00100000:1.0:1746066809.857571:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15669 00000100:00100000:1.0:1746066809.857617:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.857629:0:20532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977395968 00000100:00100000:1.0:1746066809.857632:0:20532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977395968 00000100:00100000:1.0:1746066809.857644:0:20532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15670 00000100:00100000:1.0:1746066809.857648:0:20532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+24:1963:x1830882977395968:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:1.0:1746066809.857720:0:20532:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066809.857722:0:20532:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066806 -> 1746066807 00002000:00010000:1.0:1746066809.857724:0:20532:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066806 -> 1746066807 00002000:00010000:1.0:1746066809.857726:0:20532:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066806 -> 1746066809 00002000:00010000:1.0:1746066809.857727:0:20532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746066809.857740:0:20532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:373f5662-4306-4ad8-af4e-c6b3fb29aadc+25:1963:x1830882977395968:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 91us (123us total) trans 17179873809 rc 0/0 00000100:00100000:1.0:1746066809.857744:0:20532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15670 00000100:00100000:1.0:1746066809.857778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:1.0:1746066809.857836:0:8451:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977396224 00000100:00100000:1.0:1746066809.857838:0:8451:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977396224 00000100:00100000:1.0:1746066809.857850:0:8451:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 15671 00000100:00100000:1.0:1746066809.857853:0:8451:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+16:1963:x1830882977396224:12345-192.168.202.57@tcp:2:lfs.0 00002000:00010000:1.0:1746066809.857904:0:8451:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746066809.857906:0:8451:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066807 -> 1746066807 00002000:00010000:1.0:1746066809.857907:0:8451:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066806 -> 1746066807 00002000:00010000:1.0:1746066809.857909:0:8451:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066807 -> 1746066809 00002000:00010000:1.0:1746066809.857910:0:8451:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746066809.857926:0:8451:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:373f5662-4306-4ad8-af4e-c6b3fb29aadc+17:1963:x1830882977396224:12345-192.168.202.57@tcp:2:lfs.0 Request processed in 71us (147us total) trans 21474841113 rc 0/0 00000100:00100000:1.0:1746066809.857929:0:8451:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 15671 00000100:00100000:0.0:1746066809.860782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:2.0:1746066809.861449:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977396480 00000100:00100000:2.0:1746066809.861465:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977396480 00000100:00100000:2.0:1746066809.862761:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4310 00000100:00100000:2.0:1746066809.862771:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32161:x1830882977396480:12345-192.168.202.57@tcp:35:lfs.0 00000004:00010000:2.0:1746066809.862816:0:16596:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x318:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135430c00/0xfb36a14ee608e125 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98006d expref: 253 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.862852:0:16596:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066809.862864:0:16596:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e600/0xfb36a14ee608e164 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c980074 expref: 253 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.862870:0:16596:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066809.862891:0:16596:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e600/0xfb36a14ee608e164 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980074 expref: 253 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066809.862901:0:16596:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e600/0xfb36a14ee608e164 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980074 expref: 253 pid: 20127 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746066809.862911:0:16596:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e93c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16596:1830882977024512:192.168.202.57@tcp:104: 00000100:00100000:2.0:1746066809.862986:0:16596:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d1db40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066809.865249:0:16596:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e93c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16596:1830882977024512:192.168.202.57@tcp:104: 00010000:00010000:2.0:1746066809.865267:0:16596:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00000100:00100000:0.0:1746066809.865505:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.866043:0:9852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977396608 00000100:00100000:3.0:1746066809.866049:0:9852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977396608 00010000:00010000:3.0:1746066809.866075:0:9852:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e600/0xfb36a14ee608e164 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980074 expref: 254 pid: 20127 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746066809.866105:0:9852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 8119 00000100:00100000:3.0:1746066809.866112:0:9852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+254:1964:x1830882977396608:12345-192.168.202.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066809.866121:0:9852:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066809.866126:0:9852:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e600/0xfb36a14ee608e164 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980074 expref: 254 pid: 20127 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746066809.866134:0:9852:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e600/0xfb36a14ee608e164 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980074 expref: 254 pid: 20127 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746066809.866149:0:9852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ee1e600/0xfb36a14ee608e164 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.57@tcp remote: 0xdd8900966c980074 expref: 254 pid: 20127 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746066809.866171:0:9852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066809.866176:0:9852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066809.866183:0:9852:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066809.866188:0:9852:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066809.866203:0:9852:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066809.866243:0:9852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:1964:x1830882977396608:12345-192.168.202.57@tcp:103:ldlm_bl.0 Request processed in 131us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066809.866250:0:9852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 8119 00010000:00010000:2.0:1746066809.866388:0:16596:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00010000:00010000:2.0:1746066809.866394:0:16596:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00000040:00080000:2.0:1746066809.866959:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3243, 88 off274648 00000004:00080000:2.0:1746066809.866964:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771044287467ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.867000:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3243, 88 off274560 00000004:00080000:2.0:1746066809.867003:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771044327182ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066809.867014:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3244, 88 off274648 00000004:00080000:2.0:1746066809.867017:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771044340935ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066809.867023:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3244, 88 off274736 00000004:00080000:2.0:1746066809.867026:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771044349596ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.867032:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3245, 88 off274824 00000004:00080000:2.0:1746066809.867034:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771044358015ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.867040:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3245, 88 off274736 00000004:00080000:2.0:1746066809.867042:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771044366233ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066809.867048:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3246, 88 off274824 00000004:00080000:2.0:1746066809.867050:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771044373967ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066809.867056:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3247, 88 off274912 00000004:00080000:2.0:1746066809.867058:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771044382007ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066809.867064:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3246, 88 off274912 00000004:00080000:2.0:1746066809.867066:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771044390131ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.867072:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3248, 88 off275000 00000004:00080000:2.0:1746066809.867074:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771044397900ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066809.867079:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3247, 88 off275000 00000004:00080000:2.0:1746066809.867081:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771044405472ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.867087:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3249, 88 off275088 00000004:00080000:2.0:1746066809.867089:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771044413292ns, next at 749511475809ns, rc = 0 00000040:00080000:2.0:1746066809.867095:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3248, 88 off275088 00000004:00080000:2.0:1746066809.867097:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771044421403ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.867103:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3249, 88 off275176 00000004:00080000:2.0:1746066809.867105:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771044429206ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.867111:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3250, 88 off275264 00000004:00080000:2.0:1746066809.867113:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771044436806ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.867118:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3251, 88 off275352 00000004:00080000:2.0:1746066809.867120:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771044444531ns, next at 749511128030ns, rc = 0 00000040:00080000:2.0:1746066809.867127:0:16596:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3250, 88 off275176 00000004:00080000:2.0:1746066809.867129:0:16596:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771044453586ns, next at 749511475809ns, rc = 0 00000004:00010000:3.0:1746066809.891338:0:16596:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009e86bb80 reply state ffff88012d529000 transno 8589944323 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16596 initiator: MDT0 00000100:00100000:3.0:1746066809.891350:0:16596:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746066809.891359:0:16596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066809.891361:0:16596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066809.891369:0:16596:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135430c00/0xfb36a14ee608e125 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x318:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c98006d expref: 253 pid: 20127 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066809.891451:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+253:32161:x1830882977396480:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 28682us (30675us total) trans 8589944323 rc 0/0 00000100:00100000:3.0:1746066809.891466:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4310 00000001:00080000:1.0:1746066809.891543:0:14626:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944323 is committed 00000004:00080000:1.0:1746066809.891547:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2523 committed 00000004:00080000:1.0:1746066809.891554:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2523 committed 00000004:00080000:1.0:1746066809.891558:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2522 committed 00000004:00080000:1.0:1746066809.891559:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2521 committed 00000004:00080000:1.0:1746066809.891560:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2520 committed 00000004:00080000:1.0:1746066809.891562:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2522 committed 00000004:00080000:1.0:1746066809.891563:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2519 committed 00000004:00080000:1.0:1746066809.891564:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2521 committed 00000004:00080000:1.0:1746066809.891566:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2518 committed 00000004:00080000:1.0:1746066809.891567:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2520 committed 00000004:00080000:1.0:1746066809.891568:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2519 committed 00000004:00080000:1.0:1746066809.891569:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2518 committed 00000004:00080000:1.0:1746066809.891571:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2517 committed 00000004:00080000:1.0:1746066809.891572:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2516 committed 00000004:00080000:1.0:1746066809.891573:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2517 committed 00000004:00080000:1.0:1746066809.891574:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2516 committed 00000004:00080000:1.0:1746066809.891575:0:14626:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2515 committed 00000100:00100000:0.0:1746066809.891786:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977024896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.891824:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.891845:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977025408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.891857:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.891865:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977025920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.891877:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.891884:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977026432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.891892:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.891903:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746066809.891906:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977025024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.891916:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.891923:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977025536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.891931:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.891938:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977026048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.891946:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.891953:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977026560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.891961:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.891975:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977024896 00000100:00100000:0.0:1746066809.891981:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977024896 00000100:00100000:0.0:1746066809.892000:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977025408 00000100:00100000:0.0:1746066809.892002:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977025408 00000100:00100000:0.0:1746066809.892009:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977025920 00000100:00100000:0.0:1746066809.892010:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977025920 00000100:00100000:0.0:1746066809.892015:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977026432 00000100:00100000:0.0:1746066809.892017:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977026432 00000100:00100000:0.0:1746066809.892021:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977025024 00000100:00100000:0.0:1746066809.892022:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977025024 00000100:00100000:0.0:1746066809.892026:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977025536 00000100:00100000:0.0:1746066809.892027:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977025536 00000100:00100000:0.0:1746066809.892032:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977026048 00000100:00100000:0.0:1746066809.892033:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977026048 00000100:00100000:0.0:1746066809.892037:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977026560 00000100:00100000:0.0:1746066809.892038:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977026560 00000100:00100000:0.0:1746066809.892044:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15672 00000100:00100000:0.0:1746066809.892048:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3295:x1830882977024896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066809.892183:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066809.892186:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb mtime from disk: 1746066807 -> 1746066807 00002000:00010000:0.0:1746066809.892188:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb atime from disk: 1746066807 -> 1746066807 00002000:00010000:0.0:1746066809.892189:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb ctime from disk: 1746066809 -> 1746066809 00002000:00010000:0.0:1746066809.892191:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38f:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746066809.892213:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830882977024896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (388us total) trans 21474841114 rc 0/0 00000100:00100000:0.0:1746066809.892218:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15672 00000100:00100000:0.0:1746066809.892230:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15673 00000100:00100000:0.0:1746066809.892234:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3295:x1830882977025408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.892310:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830882977025408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (451us total) trans 21474841115 rc 0/0 00000100:00100000:0.0:1746066809.892315:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15673 00000100:00100000:0.0:1746066809.892324:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15674 00000100:00100000:0.0:1746066809.892327:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830882977025920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066809.892404:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb size from disk: 5090560 -> 5090560 00002000:00010000:0.0:1746066809.892407:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb mtime from disk: 1746066807 -> 1746066807 00002000:00010000:0.0:1746066809.892408:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb atime from disk: 1746066807 -> 1746066807 00002000:00010000:0.0:1746066809.892410:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb ctime from disk: 1746066809 -> 1746066809 00002000:00010000:0.0:1746066809.892412:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x391:0x0] updating lvb blocks from disk: 5919 -> 5919 00000100:00100000:0.0:1746066809.892430:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3295:x1830882977025920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (552us total) trans 17179873810 rc 0/0 00000100:00100000:0.0:1746066809.892434:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15674 00000100:00100000:0.0:1746066809.892443:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15675 00000100:00100000:0.0:1746066809.892447:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830882977026432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066809.892518:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746066809.892520:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746066809.892521:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066809.892523:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746066809.892524:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746066809.892541:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3295:x1830882977026432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (648us total) trans 17179873811 rc 0/0 00000100:00100000:0.0:1746066809.892546:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15675 00000100:00100000:0.0:1746066809.892554:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15676 00000100:00100000:0.0:1746066809.892558:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3295:x1830882977025024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.892628:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830882977025024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (710us total) trans 21474841116 rc 0/0 00000100:00100000:0.0:1746066809.892633:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15676 00000100:00100000:0.0:1746066809.892642:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15677 00000100:00100000:0.0:1746066809.892646:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3295:x1830882977025536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.892731:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830882977025536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (798us total) trans 21474841117 rc 0/0 00000100:00100000:0.0:1746066809.892736:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15677 00000100:00100000:0.0:1746066809.892744:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15678 00000100:00100000:0.0:1746066809.892748:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830882977026048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.892818:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3295:x1830882977026048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (869us total) trans 17179873812 rc 0/0 00000100:00100000:0.0:1746066809.892823:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15678 00000100:00100000:0.0:1746066809.892837:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15679 00000100:00100000:0.0:1746066809.892841:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3295:x1830882977026560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066809.892853:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977024640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066809.892875:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066809.892886:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977025152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066809.892899:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066809.892905:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977025664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.892911:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3295:x1830882977026560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (949us total) trans 17179873813 rc 0/0 00000100:00100000:0.0:1746066809.892916:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15679 00000100:00100000:2.0:1746066809.892917:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066809.892923:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977026176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.892923:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977024640 00000100:00100000:0.0:1746066809.892925:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977024640 00000100:00100000:0.0:1746066809.892933:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977025152 00000100:00100000:2.0:1746066809.892934:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.892935:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977025152 00000100:00100000:0.0:1746066809.892940:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977025664 00000100:00100000:0.0:1746066809.892941:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977025664 00000100:00100000:2.0:1746066809.892942:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1746066809.892946:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977024768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.892946:0:21203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977026176 00000100:00100000:0.0:1746066809.892948:0:21203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977026176 00000100:00100000:0.0:1746066809.892954:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15680 00000100:00100000:2.0:1746066809.892957:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066809.892957:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3293:x1830882977024640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066809.892962:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977025280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066809.892973:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066809.892979:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a45e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977025792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066809.892989:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066809.892995:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977026304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066809.893005:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746066809.893017:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746066809.893019:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977024768 00002000:00010000:0.0:1746066809.893019:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb mtime from disk: 1746066807 -> 1746066807 00002000:00010000:0.0:1746066809.893021:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb atime from disk: 1746066807 -> 1746066807 00000100:00100000:2.0:1746066809.893022:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977024768 00002000:00010000:0.0:1746066809.893023:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb ctime from disk: 1746066809 -> 1746066809 00002000:00010000:0.0:1746066809.893024:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38d:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746066809.893033:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977025280 00000100:00100000:2.0:1746066809.893034:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977025280 00000100:00100000:2.0:1746066809.893040:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977025792 00000100:00100000:2.0:1746066809.893042:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977025792 00000100:00100000:0.0:1746066809.893043:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882977024640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (167us total) trans 21474841118 rc 0/0 00000100:00100000:2.0:1746066809.893046:0:8112:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977026304 00000100:00100000:0.0:1746066809.893047:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15680 00000100:00100000:2.0:1746066809.893049:0:8112:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977026304 00000100:00100000:0.0:1746066809.893054:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15681 00000100:00100000:0.0:1746066809.893058:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800992af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3293:x1830882977025152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066809.893063:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15682 00000100:00100000:2.0:1746066809.893067:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882977025664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.893124:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800992af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882977025152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (223us total) trans 21474841119 rc 0/0 00002000:00010000:2.0:1746066809.893127:0:8112:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746066809.893129:0:8112:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb mtime from disk: 1746066807 -> 1746066807 00000100:00100000:0.0:1746066809.893129:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15681 00002000:00010000:2.0:1746066809.893131:0:8112:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb atime from disk: 1746066807 -> 1746066807 00002000:00010000:2.0:1746066809.893132:0:8112:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb ctime from disk: 1746066809 -> 1746066809 00002000:00010000:2.0:1746066809.893134:0:8112:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x38e:0x0] updating lvb blocks from disk: 2049 -> 2049 00000100:00100000:2.0:1746066809.893148:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3293:x1830882977025664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (230us total) trans 17179873814 rc 0/0 00000100:00100000:2.0:1746066809.893152:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15682 00000100:00100000:2.0:1746066809.893159:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15683 00000100:00100000:2.0:1746066809.893163:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882977026176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.893209:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15684 00000100:00100000:0.0:1746066809.893213:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3293:x1830882977024768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066809.893232:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3293:x1830882977026176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (296us total) trans 17179873815 rc 0/0 00000100:00100000:2.0:1746066809.893236:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15683 00000100:00100000:2.0:1746066809.893245:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15685 00000100:00100000:2.0:1746066809.893249:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3293:x1830882977025280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066809.893272:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066809.893274:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb mtime from disk: 1746066807 -> 1746066807 00002000:00010000:0.0:1746066809.893276:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb atime from disk: 1746066807 -> 1746066807 00002000:00010000:0.0:1746066809.893277:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb ctime from disk: 1746066809 -> 1746066809 00002000:00010000:0.0:1746066809.893279:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x38e:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746066809.893295:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3293:x1830882977024768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (337us total) trans 21474841120 rc 0/0 00000100:00100000:0.0:1746066809.893299:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15684 00000100:00100000:2.0:1746066809.893307:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882977025280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (333us total) trans 21474841121 rc 0/0 00000100:00100000:0.0:1746066809.893308:0:21203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15686 00000100:00100000:2.0:1746066809.893311:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15685 00000100:00100000:0.0:1746066809.893312:0:21203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882977025792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066809.893318:0:8112:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15687 00000100:00100000:2.0:1746066809.893321:0:8112:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830882977026304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066809.893369:0:21203:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066809.893371:0:21203:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb mtime from disk: 1746066807 -> 1746066807 00002000:00010000:0.0:1746066809.893373:0:21203:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb atime from disk: 1746066807 -> 1746066807 00002000:00010000:0.0:1746066809.893375:0:21203:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb ctime from disk: 1746066809 -> 1746066809 00000100:00100000:2.0:1746066809.893376:0:8112:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3293:x1830882977026304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (369us total) trans 17179873816 rc 0/0 00002000:00010000:0.0:1746066809.893376:0:21203:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x390:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746066809.893383:0:8112:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15687 00000100:00100000:0.0:1746066809.893389:0:21203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3293:x1830882977025792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (398us total) trans 17179873817 rc 0/0 00000100:00100000:0.0:1746066809.893393:0:21203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15686 00000004:00080000:2.0:1746066809.893407:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8697800/2, rc 0, transno 21474841120 00000100:00100000:2.0:1746066809.893411:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977024768:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066809.893411:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8695180/2, rc 0, transno 21474841116 00000100:00100000:0.0:1746066809.893414:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977025024:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066809.893417:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8695500/2, rc 0, transno 21474841121 00000100:00100000:2.0:1746066809.893420:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977025280:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066809.893420:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e7100/2, rc 0, transno 21474841117 00000100:00100000:0.0:1746066809.893423:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977025536:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066809.893425:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e5c00/2, rc 0, transno 17179873817 00000004:00080000:0.0:1746066809.893428:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e6a00/2, rc 0, transno 17179873812 00000100:00100000:2.0:1746066809.893431:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977025792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.893431:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977026048:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066809.893436:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093213800/2, rc 0, transno 17179873816 00000004:00080000:0.0:1746066809.893436:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093213b80/2, rc 0, transno 17179873813 00000100:00100000:2.0:1746066809.893439:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977026304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.893439:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977026560:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066809.893444:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8694380/2, rc 0, transno 21474841118 00000004:00080000:0.0:1746066809.893445:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8696680/2, rc 0, transno 21474841114 00000100:00100000:2.0:1746066809.893446:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977024640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066809.893447:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977024896:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066809.893451:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8695f80/2, rc 0, transno 21474841119 00000100:00100000:2.0:1746066809.893470:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977025152:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066809.893476:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e5500/2, rc 0, transno 17179873814 00000100:00100000:2.0:1746066809.893478:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977025664:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066809.893483:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e4700/2, rc 0, transno 17179873815 00000004:00080000:0.0:1746066809.893483:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e4a80/2, rc 0, transno 21474841115 00000100:00100000:2.0:1746066809.893485:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977026176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066809.893485:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977025408:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066809.893491:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a45e4380/2, rc 0, transno 17179873810 00000100:00100000:0.0:1746066809.893493:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a45e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977025920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066809.893498:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093210380/2, rc 0, transno 17179873811 00000100:00100000:0.0:1746066809.893500:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1830882977026432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066809.893512:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977026688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066809.893528:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066809.893545:0:4614:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977026688 00000100:00100000:2.0:1746066809.893547:0:4614:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977026688 00000100:00100000:2.0:1746066809.893561:0:4614:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15688 00000100:00100000:2.0:1746066809.893565:0:4614:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3293:x1830882977026688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066809.893640:0:4614:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3293:x1830882977026688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (110us total) trans 17179873818 rc 0/0 00000100:00100000:2.0:1746066809.893644:0:4614:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15688 00000004:00080000:2.0:1746066809.893662:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efb5f80/2, rc 0, transno 17179873818 00000100:00100000:2.0:1746066809.893665:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1830882977026688:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066809.893813:0:3280:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066809.893821:0:3280:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066809.893827:0:3280:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066809.893833:0:3280:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ff40600 already unused, calling callback (ffffffffa137d690) 00010000:00010000:3.0:1746066809.893836:0:3280:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066809.893841:0:3280:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066809.893852:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff88012d3b8400) 00010000:00010000:3.0:1746066809.893858:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066809.893861:0:3280:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16596 initiator: MDT0 00010000:00010000:3.0:1746066809.893865:0:3280:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff40600/0xfb36a14ee608e20c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16596 initiator: MDT0 00000100:00100000:2.0:1746066809.896204:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:0.0:1746066809.896256:0:20127:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977396736 00000100:00100000:0.0:1746066809.896261:0:20127:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977396736 00000100:00100000:0.0:1746066809.896288:0:20127:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 10228 00000100:00100000:0.0:1746066809.896294:0:20127:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+250:32161:x1830882977396736:12345-192.168.202.57@tcp:101:lfs.0 00010000:00010000:0.0:1746066809.896310:0:20127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066809.896323:0:20127:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5200/0xfb36a14ee608e213 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x318:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd8900966c9800d6 expref: -99 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.896363:0:20127:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5200/0xfb36a14ee608e213 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800d6 expref: 251 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.896374:0:20127:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d4e5200/0xfb36a14ee608e213 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x318:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.57@tcp remote: 0xdd8900966c9800d6 expref: 251 pid: 20127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066809.896387:0:20127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x318:0x0].0x0 (ffff880135b13900) 00010000:00010000:0.0:1746066809.896390:0:20127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066809.896392:0:20127:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d4e5200, rc 0) 00000100:00100000:0.0:1746066809.898351:0:20127:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:32161:x1830882977396736:12345-192.168.202.57@tcp:101:lfs.0 Request processed in 2050us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066809.898359:0:20127:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 10228 00000100:00100000:0.0:1746066809.902422:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.57@tcp (source: 12345-192.168.202.57@tcp) 00000100:00100000:3.0:1746066809.902526:0:16596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882977396992 00000100:00100000:3.0:1746066809.902534:0:16596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882977396992 00000100:00100000:3.0:1746066809.902585:0:16596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.57@tcp, seq: 4311 00000100:00100000:3.0:1746066809.902592:0:16596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+251:32161:x1830882977396992:12345-192.168.202.57@tcp:35:lfs.0 00000100:00100000:3.0:1746066809.903075:0:16596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:373f5662-4306-4ad8-af4e-c6b3fb29aadc+252:32161:x1830882977396992:12345-192.168.202.57@tcp:35:lfs.0 Request processed in 482us (658us total) trans 8589944324 rc 0/0 00000100:00100000:3.0:1746066809.903082:0:16596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.57@tcp, seq: 4311 00010000:00010000:1.0:1746066810.268215:0:9850:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1746066810.686989:0:5056:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed 00010000:00010000:0.0:1746066811.271048:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 69170 lines, 69170 kept, 0 dropped, 0 bad.